Dept. of Computing and Technology (CaT) School of Science and Technology

Dept. of Computing and Technology (CaT)School of Science and Technology

B.S. in Computer Science (CS)

CIP Code: 110101Program Code: 415

1Program Quality Improvement Report 2009-2010

Program actions since last assessment presentation

(actions from previous 3 priority outcomes*)

1. Discussed implementing an entry level assessment under the new curriculum.

2. Discussed the position of the midlevel assessment under the new curriculum.

3. Continued including team-work projects in lower division courses CS1313, CS1513, and CS2413.

2

Program actions since last assessment presentation

(actions from previous 3 priority outcomes*)

4. Planed to offer the new CS curriculum starting with fall 2010.

5. Began discussions of revising the current assessment tools to be inline with the new curriculum.

3

Student Learning or Service Outcomes

General Student Learning Outcomes

A-1. Students will possess the necessary knowledge and skills to solve problems using a computer (Bloom’s Knowledge).

A-2. Students will understand and classify algorithms, structures, and

computational systems. (Bloom’s Understanding).

A-3. Students will be able to apply what they have learned to perform successfully at entry-level positions in industry, or gain admission to graduate/professional schools (Bloom’s Application).


Student Learning or Service Outcomes

Specific Student Learning Outcomes

B-1. Be able to design and create computer programs (Bloom’s Synthesis).

B-2. Demonstrate the ability to evaluate data structures, discrete structures, and algorithms (Bloom’s Evaluation).

B-3. Be able to analyze computer architectures, operating systems, and networking (Bloom’s Analysis).

B-4. Demonstrate sufficient professional communication skills.


Alignment of Outcomes

The B.S. in CS program, as well as all programs in the CaT Dept., support the University Mission in the Cameron University Plan 2013 as stated below…

“Cameron University provides a diverse and dynamic student body access to quality educational opportunities; foster a student-centered academic environment that combines innovative classroom teaching with experiential learning; prepare students for professional success, responsible citizenship, life-long learning, and meaningful contributions to a rapidly changing world; and is a driven force in the cultural life and economic development of the region.”


Alignment of Outcomes

• Outcomes A-1, B-1 experiential learning• Outcomes A-2, A-3, B-1, B-2, B-3, B-4 professional success • Outcome B-1, B-2, B-3, B-4 meaningful contributions to a

rapidly changing world


Student Learning Outcome Measurements

List of Direct Measures of Student Learning Outcomes

B-1 Programming Project

B-2 CS Skills Examination

B-3 National Major Field Assessment Test (MFAT)

8


List of Indirect Measures of Student Learning Outcomes

• Exit Surveys

9


PROGRAM GOAL: A-1 Students will possess the necessary knowledge and skill to solve problems using a computer.

PROGRAM OBJECTIVE 1

CURRICULUM AREA OR TARGET AUDIENCE

MEASUREMENT OF PROGRAM OBJECTIVE

Measurements

Methods used to determine validity of measurement instruments

Methods used to determine reliability of measurements

Schedule for measurements

B-1 Programming Fundamentals . Demonstrate the ability to design and create a well-organized computer program.

CS 4203 Software Engineering

Locally developed programming project (direct)

Norm-referenced scores

Inter-rater reliability

Annually , at the beginning of the Spring Semester

10


PROGRAM GOAL: A-2 Students will understand and classify algorithms, structures, and computational systems.

PROGRAM OBJECTIVE 2



Measurements




B-2 Be able to evaluate data structures and algorithms.


Locally developed test (direct)



Annually , at the beginning of the Spring Semester

11


PROGRAM GOAL: A-2 Students will understand and classify algorithms, structures, and computational systems.

PROGRAM OBJECTIVE 3



Measurements




B-3 Be able to evaluate different architectures, operating systems, and networking protocols.


National MFAT Exam (Major Field Assessment Test)



Annually , Spring Semester

12

Display and Analysis of Assessment Data


TABLE 1 Results of the Problem Solving Skills (Programming Project)

Outcomes A-1, B-1 Spring 2000

Spring 2001

Spring 2002

Spring 2003

Spring 2004

Spring 2005

Spring 2006

Spring 2007

Spring 2008

Spring 2009

F S F S F S F S F S F S F S F S F S F S 10 100 3 95 1 100 6 100 4 100 3 100 5 100 2 100 3 100 4 100 1 96 2 90 2 90 2 95 4 92 2 95 1 90 1 95 1 85 2 95 2 94 1 85 2 85 1 90 1 80 1 80 1 88 1 90 1 75 1 85 1 92 1 80 3 80 2 80 3 70 1 85 1 80 1 72 1 80 1 90 1 75 1 75 1 70 1 65 1 0 3 70 1 43 2 0 1 80 1 70 1 70 1 50 2 60 1 65 1 0 1 40 1 0 1 40 1 0

Mean 96.6

Mean 73.3

Mean 75.9

Mean 85.7

Mean 94.2

Mean 74.2

Mean 84.8

Mean 84.4

Mean 82.1

Mean 75.5

Std dev. 5.4

Std dev. 29

Std dev. 26.4

Std dev. 19.8

Std dev. 6.6

Std dev. 27.3

Std dev. 32.4

Std. dev. 13.5

Std dev. 21

Std dev. 40.4

N 16

N 12

N 11

N 14

N 9

N 13

N 9

N 8

N 7

N 10


Program Quality Improvement Report 2009-2010 14

F Score2 1002 951 901 804 50

Mean 76.0Std Dev 23.1N 10

Spring 2010

020406080

100120

00 01 02 03 04 05 06 07 08 09 10

Programming ProjectMean Score Trends

TABLE 1 - Problem Solving Skills (Programming Project) …


15

TABLE 2

Results of the CS Skills Assessment Outcomes A-2, B-2, B-3

Spring 2000

Spring 2001

Spring 2002

Spring 2003

Spring 2004

Spring 2005

Spring 2006

Spring 2007

Spring 2008

Spring 2009

F S F S F S F S F S F S F S F S F S F S 1 96 1 95 1 93 1 95 1 95 2 96 1 96 1 94 1 97 1 95 1 95 1 90 1 89 1 91 2 87 1 92 1 93 1 93 1 84 1 94 1 88 1 85 1 84 2 88 1 84 1 90 1 90 1 88 2 78 2 91 2 85 1 80 1 82 1 87 2 81 1 88 2 87 1 83 1 77 1 90 1 80 1 79 1 80 2 82 1 80 1 86 1 79 2 70 1 69 1 85 1 78 1 75 1 78 1 78 2 77 1 76 1 76 1 66 1 43 1 82 2 77 2 73 3 70 1 77 1 64 1 74 1 73 1 64 1 72 2 75 1 68 1 61 1 75 1 67 1 41 1 67 1 74 1 67 1 53 1 68 1 64 1 66 1 70 1 58 1 43 1 57 1 67 1 0 1 40 1 38 1 62 1 24 1 35 1 55 Mean 77.4

Mean 70.3

Mean 75.5

Mean 72.7

Mean 81.3

Mean 73.7

Mean 80.2

Mean 78.5

Mean 75.1

Mean 83.3

Std dev 11.0

Std dev 24.4

Std dev 11.9

Std dev 21.6

Std dev 8.1

Std dev 20.7

Std dev 16.6

Std dev 12.4

Std dev 16.6

Std dev 11.1

N 16

N 12

N 11

N 14

N 10

N 13

N 9

N 8

N 7

N 10



F Score1 981 961 921 811 771 681 501 441 29

Mean 70.1Std Dev 24.7N 9

Spring 2010

60

65

70

75

80

85

00 01 02 03 04 05 06 07 08 09 10

CS Skills Mean Score Trends

TABLE 2 – CS Skills Exam Assessment …


17

TABLE 3

Results of the Major Field Achievement Test (MFAT) Outcomes A2, B2, B3

Spring 2007

76 Institutions Spring 2008

Spring 2009

Spring 2010

National Statistics

2006-2009 193 Institutions

National Mean

Dept. Mean

Dept. Mean

Dept. Mean

Dept. Mean

Mean Std. Dev.

Programming Fundamentals

57.3 51 71 52 52 55.8 12.6

Discrete Structures, Algorithms

35.0 30 35 28 35 35.2 8.4

Systems (Architecture, Operating Systems, Networking, Database)

44.2 38 40 36 42 42.8 9.3

Overall Scores

142 153 142 146 148.6 9.7

*Score range for overall means 120-200



01020304050607080

2007 2008 2009 2010

Programming Fundamentals

0

10

20

30

40

2007 2008 2009 2010

Discrete Structures, Algorithms

32

34

36

38

40

42

44

2007 2008 2009 2010

Systems (Arch, Net, OS, DB)

135

140

145

150

155

2007 2008 2009 2010

Overall Scores



TABLE 4

Results of the Exit Survey – Spring 2008 Number Surveyed: 10

Question Strongly Agree Agree Neutral Disagree Strongly

Disagree 1. The computer science curriculum has given me a firm grounding in mathematics and the sciences.

67% 33%

2. As a result of my education I feel confident of my abilities to utilize computer science principles to identify, formulate, and solve computer science problems.

33% 67%

3. I am proficient in the application of these principles in the design of computer software.

17% 83%

4. I feel I have gained the ability to communicate effectively, both orally and in writing, with technical and non-technical audiences.

50% 50%

5. The CS program has helped me to work effectively, independently, and on teams within the discipline and across disciplines.

67% 33%


20

TABLE 4

Results of the Exit Survey – Spring 2009 Number Surveyed: 3



67% 33%


67% 33%


33% 67%


67% 33%

5. The CS program has helped me to work effectively, independently, And on teams within the discipline and across disciplines.

67% 33%



TABLE 4 Continued Results of the Exit Survey – Spring 2010

Number Surveyed: 7



71% 29%


86% 14%


14% 86%


14% 72% 14%

5. The CS program has helped me to work effectively, independently, and on teams within the discipline and across disciplines.

43% 57%

Action plan for Student-Learning or Service Outcomes

• Update the student learning outcome measurements to be inline with the new CS curriculum

• Update the requirements for the CS minor to be inline with the new CS curriculum


Documents

Dept. of Computing and Technology (CaT) School of Science and Technology