DEPARTMENT OF COMPUTER SCIENCE · Web viewEvaluations from on-site supervisors of the Computer Science Master’s degree students who register for academic credit for Computer Science

Assessment Plan for Four Year Review

College of Liberal Arts and SciencesDepartment of Computer Science

M.S. in Computer ScienceOctober 2013

Dr. Nicholas T. Karonis, submitter

September 21, 20231

Student Learning Outcomes

Graduates of the NIU Master of Science in Computer Science will be able to demonstrate the following at an expected/average or higher level:

1. The ability to evaluate and analyze a business problem and decide whether or not it is amenable to a computer solution.

2. The ability to design a practical software solution to a business problem.

3. The ability to design and implement individual computer programs that are correct, substantial, easy-to-use, efficient, and easily understood by other programmers.

4. The ability to test and prove that a computer program is correct.

5. The ability to learn throughout their careers.

6. Interpersonal and team building skills at a level appropriate for career advancement.

September 21, 20232

I. Program Goals Relating to University Mission

II. Program Objectives/Learning Outcomes III. Methods to Evaluate Effectiveness (See further description in Part IV)

The mission of the NIU Department of Computer Science is to prepare individuals for rewarding, successful, and interesting careers in industry, government, and nonprofit organizations. The Department is dedicated to providing students with the technical background and the analytical skills required to carry out analysis, design, coding, and testing of computer software.

80% of the graduates of the NIU Master of Science in Computer Science will be able to demonstrate the following at an expected/average or higher level:1. The ability to evaluate and analyze a business

problem and decide whether or not it is amenable to a computer solution.




5. The ability to learn throughout their careers.6. Interpersonal and team building skills at a level

appropriate for career advancement.1

A. Internship Assessment Survey, sent to employers by Computer Science.

B. Internship Assessment Survey, sent to employers by Career Services

C. University Alumni Survey.D. Graduating M.S. Candidate Survey.E. Capstone Project in CSCI 567.F. Comprehensive Examination.

September 21, 2023 3

IV. Description of Methods to Collect and Analyze Data

Method Description Type of Method Target Performance Level

Timeline Person Responsible

A. Internship Assessment Survey, sent to employers by Computer Science.

Evaluations from on-site supervisors of the Computer Science Master’s degree students who register for academic credit for Computer Science internships. Some, but not all, of these students are included in Method B, below.

Direct, summative. 80% of the graduates with the M.S. in Computer Science will be able to demonstrate outcomes 1, 2, 3, 4, 5, and 6 at an expected/average or higher level.

Surveys are sent out every semester. Results are compiled in May for the prior Spring, Summer, and Fall semesters.

Near the end of every semester, the Graduate Secretary sends the survey to all internship supervisors. The internship advisor compiles statistical results and comments. Collective results are used by faculty to evaluate and revise courses and content.

B. Internship Assessment Survey, sent to employers by Career Services.

Evaluations from on-site supervisors of Computer Science Master’s degree students who accept Computer Science internships obtained through the Career Services. Some, but not all, of these students are included in Method F, above.

Direct, summative. 80% of the graduates with the M.S. in Computer Science will be able to demonstrate outcomes 1, 2, 3, 4, 5, and 6 at an expected/average or higher level.

Surveys are sent out every semester. Results are compiled in May for the prior Spring, Summer, and Fall semesters.

Career Services manages the survey and sends the Department the results. The internship advisor compiles statistical results and comments. Collective results are used by faculty to evaluate and revise courses and content.

C. University Alumni Survey

University Master’s degree graduates are asked about their perceptions of how well the department prepared them for their careers.

Indirect, summative. 80% of the graduates with the M.S. in Computer Science will be able to demonstrate outcomes 1, 2, 3, 4, 5, and 6 at an expected/average or higher level.

One and five years after graduation.

Results are compiled by the university and delivered to the Department as available. Collective results are used by faculty to evaluate and revise courses and content.


D. Graduating M.S. Candidate Student Survey

Graduating computer science M.S. candidates are asked about their experiences in the Department of Computer Science and how well they think the program prepared them for their careers.

Indirect, summative. 80% of the graduates with the M.S. in Computer Science will be able to demonstrate outcomes 1, 2, 3, 4, 5, and 6 at an expected/average or higher level.

At the end of every semester.

Near the end of every semester, the Graduate Secretary sends the survey to all graduating M.S. candidates. The results are compiled by the Assistant to the Chair. Collective results are used by faculty to evaluate and revise courses and content.

E. Capstone Project in CSCI 567

Projects in CSCI 567, the Analysis and Design/Software Engineering course, pull together many skills and serve as a capstone evaluation.

Direct, summative. 80% of the graduates with the M.S. in Computer Science will be able to demonstrate outcomes 1, 2, 3, and 6 at an expected/average or higher level.

Each semester. CSCI 567 professors collect the data. Collective results are used by faculty to evaluate and revise courses and content.

F. Comprehensive Examination

Comprehensive examination over graduate curriculum, addressing breadth and depths of mastery.

Direct, summative. 80% of the graduates with the M.S. in Computer Science will be able to demonstrate outcomes 1, 2, 3, and 4at an expected/average or higher level.

Examination given each Fall, Spring, and Summer.

Department Master’s Comprehensive Committee; faculty in each area of concentration write questions, grade exams, and evaluate overall results. Collective results are used by faculty to evaluate and revise courses and content.


Outcomes by Methods

Outcomes

Methods

1. Analyzing problem

2. Designing solution

3.Designing and implementing

programs

4.Testing

5.Future

learning

6.Interpersona

l and Teamwork

A. Internship Assessment Survey, sent to employers by Computer Science

X X X X X X

B. Internship Assessment Survey, sent to employers by Career Services

X X X X X X

C. University Alumni Survey X X X X X X

D. Graduating M.S. Candidate Survey

X X X X X X

E. Capstone Project in CSCI 567 X X X X

F. Comprehensive Examination X X X X


V. Department’s Response to Assessment ResultsFaculty and the Graduate Studies Committee of the Department of Computer Science review the results of the various assessment instruments and discuss ways in which to change the curriculum to better achieve the stated goals. Based on this review, proposals are presented to appropriate faculty (often the entire faculty), to the Chair, and to the Advisory Committee (when appropriate) for implementation.

In the past, such assessment measures have occasioned frequent changes in specific courses, in course requirements, in course offering patterns, and in the requirements for each of the three emphases. 1For example, the information gathered from the assessment program (particularly from Methods A, B, D and F) prompted the Department to consolidate the subject matter of existing courses (CSCI 562 and 563) to provide graduate students the opportunity for additional electives in object-oriented programming and design. This curriculum update was a direct result of assessment feedback. Another example is that the Department has initiated courses in .net programming, web services, security, and, most recently, mobile device programming, including a graduate certificate.

In all such deliberations, however, conflicting information and the costs associated with implementing recommended changes are thoroughly investigated. For example, a recommendation that the Department should include course work about an industry specific software package often has cost implications that make implementing such a recommendation impossible. Other recommendations must also be rejected because they address training issues not appropriate to an educational program.

The department also assesses student opinions of factors that are not directly attributable to learning outcomes. Obtaining students’ perceptions about advising matters, course availability, the Department’s teaching strengths, and related matters has helped the Department to be more responsive to student needs and concerns, even though these perceptions are not actually directly related to learning outcomes. This feedback is regularly used to revise the relevant processes, thus closing the feedback loop. For example, survey information gathered from graduating students has resulted in changes in the advising information that the Department makes available to all of its students.

AttachmentsAttachment A: Graduate Internship Assessment Survey (sent out by Computer Science)Attachment B: Graduate Internship Assessment Survey (sent out by Career Services)Attachment C: University Alumni Survey Attachment D: Graduating M.S. Candidate Survey Attachment E: Capstone Project in CSCI 567 Attachment F: Comprehensive Exam


Attachment AGraduate Internship Assessment Survey

(sent out by Computer Science)We would greatly appreciate it if you would complete the following form assessing the performance of the intern you recently supervised. Try to keep in mind the educational background of the intern when evaluating each characteristic. All information will be kept confidential and will be included only in summary reports for the assessment of our educational program. Please return the completed form in the envelope provided. Thank you for your cooperation.

1. Please choose the single word that you think best describes the intern’s performance:_____________________________

2. How do you rate the intern on the following characteristics?Analytical ability: outstanding good expected marginal poorTechnical ability: outstanding good expected marginal poorPlanning ability: outstanding good expected marginal poorQuality of work: outstanding good expected marginal poorQuantity of work: outstanding good expected marginal poorDependability: outstanding good expected marginal poorOrganizational skills: outstanding good expected marginal poorTeamwork andcommunication skills: outstanding good expected marginal poorInitiative: outstanding good expected marginal poorAttitude: outstanding good expected marginal poorLearning ability: outstanding good expected marginal poorOverall Performance: outstanding good expected marginal poor

3. How would you say that this intern compares to: other NIU computer science interns you have supervised?

superior above average average below average inferior not applicable

computer science interns from other universities?superior above average average below average inferior not applicable

4. Intern was employed this last:_____summer _____fall____winter

5. Today’s date: ___________________________

6. Please feel free to make any other comments on the back of this page.

d:\docs\internship\assess


Attachment B Graduate Internship Assessment Survey

(sent out by Career Services)



Attachment CUniversity Alumni Survey


University Alumni SurveyDepartment of Computer Science

Do you feel you are able to: Evaluate and analyze a problem and decide whether or not it is amenable to a computer

solution. strongly agree agree no opinion disagree strongly disagree

Design a practical software solution to a business problem. strongly agree agree no opinion disagree strongly disagree

Design and implement individual computer programs that are correct, substantial, easy-to-use, efficient, and easily understood by other programmers.

strongly agree agree no opinion disagree strongly disagree

Test and prove that a computer program is correct.strongly agree agree no opinion disagree strongly disagree

Learn throughout your career.strongly agree agree no opinion disagree strongly disagree

Demonstrate interpersonal and team building skills to perform at a level appropriate for career advancement.



Attachment DGraduating M.S. Candidate Survey


April 12, 2013

Dear Graduating Graduate Student:

The Department of Computer Science has tried hard and will continue to strive to provide the best possible education for our students. Accordingly, we would like to know your opinion of the education you have received with us. Could you please take a few minutes to answer this questionnaire? The responses will be completely anonymous.

These questions relate to only the Department of Computer Science, not to the university as a whole. For example, the question on advisement would relate to advisement only within our department, not to any advisement you might have received elsewhere on campus. For each question, circle the answer that best reflects your opinion. If you don’t understand a question, just skip it.

We would appreciate it if you would return the questionnaire in the enclosed envelope as soon as possible. Thanks in advance for your cooperation.

Sincerely,

Nicholas T. Karonis, ChairDepartment of Computer Science


Assessment Questionnaire for Graduating Computer Science M.S. Candidates

Do you feel that: The advisement from the Department of Computer Science was effective and helpful?


The faculty (not including teaching assistants) were:o knowledgeable and experienced in their fields?


o organized and effective as teachers?strongly agree agree no opinion disagree strongly disagree

o helpful?strongly agree agree no opinion disagree strongly disagree

o available for consultation during scheduled office hours?strongly agree agree no opinion disagree strongly disagree

The teaching assistants (when provided) were:o knowledgeable?


o helpful?strongly agree agree no opinion disagree strongly disagree

o available for consultation during scheduled office hours?strongly agree agree no opinion disagree strongly disagree

Do you feel you are able to: Evaluate and analyze a business problem and decide whether or not it is amenable to a computer

solution. strongly agree agree no opinion disagree strongly disagree

Design a practical software solution to a business problem. strongly agree agree no opinion disagree strongly disagree

Design and implement individual computer programs that are correct, substantial, easy-to-use, efficient, and easily understood by other programmers.


Test and prove that a computer program is correct. strongly agree agree no opinion disagree strongly disagree

Learn throughout your career. strongly agree agree no opinion disagree strongly disagree

Perform interpersonal and team building activities at a level appropriate for career advancement. strongly agree agree no opinion disagree strongly disagree


Attachment ECapstone Project in CSCI 567


Computer Science Student Capstone ExperienceEvaluation of Group Projects for CSCI 467 & 567

CSCI 467/567 for semester _____________________

Evaluator: ___________________________________________

Date of Evaluation: ____________________________________

Graduate Student(s) Undergraduate Student(s)

Scoring Scale:

1 = Group did not achieve outcome in any significant respect.

2 = Group did not achieve outcome as well as expected.

3 = Group satisfied outcome at a minimal level.

4 = Group satisfied expectations at an expected level for the outcome.

5 = Group exceeded expectations for the outcome.

N/A = Not applicable for this capstone.

Number of Groups Per Score Category

Student Learning Outcome 1 2 3 4 5 N/A

1. Evaluate and analyze a problem and decide whether or not it is amenable to a computer solution.




5. The ability to learn throughout their careers.

6. Interpersonal and team building skills at a level appropriate for


career advancement.


Attachment FComprehensive Examination

Students pursuing the MS in Computer Science who do not choose the thesis option are required to take courses preparing them for a comprehensive examination near the end of their program of study. To this end, students must take courses in two areas of emphasis prior to taking the exam.

Professors teaching comprehensive area exam courses write the questions each semester. The same professors grade their exam questions using the following scale:

HP: high pass P: pass LP: low pass F: fail

After all questions have been graded by their respective professors, the Graduate Studies Committee meets to review the question grades. The Committee determines whether a student passes or fails each area exam, based upon the grades for the relevant questions.

If a student fails one or both area exams, a second attempt for one or both area exams will be allowed in the succeeding semester. Retaking an area exam requires a retake of the entire exam, not just a portion of it. Failure to pass an exam area in the second attempt will result in no degree awarded, regardless of course grades or other factors.

Academic Year: Pass Fail Total

SummerFallSpring 2013 Total


Documents

DEPARTMENT OF COMPUTER SCIENCE · Web viewEvaluations from on-site supervisors of the Computer Science Master’s degree students who register for academic credit for Computer Science