Using CLA-in-the-Classroom Using CLA-in-the-Classroom Performance Tasks for Assessment Performance Tasks for Assessment

in a in a Quantitative Reasoning CourseQuantitative Reasoning Course

Gerald Kruse, PhD.Gerald Kruse, PhD.Associate Professor of Mathematics and Computer ScienceAssociate Professor of Mathematics and Computer Science

Juniata CollegeJuniata CollegeHuntingdon, PAHuntingdon, PA

kruse@juniata.eduhttp://faculty.juniata.edu/krusehttp://faculty.juniata.edu/kruse

MA 103, Quantitative Methods, at Juniata CollegeMA 103, Quantitative Methods, at Juniata College“Mathematics 103 prepares students to be quantitatively literate citizens in today's world. “Mathematics 103 prepares students to be quantitatively literate citizens in today's world.

By learning to By learning to think critically about quantitative issuesthink critically about quantitative issues, students , students will be able to make responsible decisions in their daily lives. Problems are analyzed and will be able to make responsible decisions in their daily lives. Problems are analyzed and solved using numerical, graphical, statistical, and algebraic reasoning. Technology is solved using numerical, graphical, statistical, and algebraic reasoning. Technology is

used to help visualize data and facilitate calculations, as well as to used to help visualize data and facilitate calculations, as well as to present present quantitative output and verbal argumentsquantitative output and verbal arguments. ”. ”

Collegiate Learning Assessment, (CLA), Collegiate Learning Assessment, (CLA), Performance Task GoalsPerformance Task Goals““Critical Thinking, Analytic Reasoning, and Problem SolvingCritical Thinking, Analytic Reasoning, and Problem Solving

“Written Communication”“Written Communication”

*I am aware we could make this linkage for most classes…*I am aware we could make this linkage for most classes…

Leveraging “Existing Frameworks”Leveraging “Existing Frameworks”

MA 103 re-designed during a sabbatical:MA 103 re-designed during a sabbatical:

Quantitative Skills AssessmentQuantitative Skills AssessmentPre and Post (first and last day of semester, Pre and Post (first and last day of semester, does not count toward final grade)does not count toward final grade)

Quantitative Attitudes SurveyQuantitative Attitudes SurveyPre and Post (first and last day of semester)Pre and Post (first and last day of semester)

Daily Activities and Daily Activities and 3 Open-ended Projects3 Open-ended Projects

Modifying MA 103 to Assess Improvements Modifying MA 103 to Assess Improvements in Quantitative Reasoning/Critical Thinkingin Quantitative Reasoning/Critical Thinking

Use a “CLA-like” performance task as a Use a “CLA-like” performance task as a pre and post assessmentpre and post assessment

Construct Projects 01, 02, and 03 using Construct Projects 01, 02, and 03 using CLA guidelinesCLA guidelines

Is performance better on the post-Is performance better on the post-assessment?assessment?

Why CLA Performance Tasks Why CLA Performance Tasks in MA 103?in MA 103?

The goals of CLA Performance tasks align nicely with the goals The goals of CLA Performance tasks align nicely with the goals of MA 103. of MA 103.

In particular, the In particular, the critical thinking critical thinking goal is mentioned in both, and goal is mentioned in both, and it involves evaluating or making good arguments.it involves evaluating or making good arguments.

We extend this to We extend this to quantitative reasoningquantitative reasoning,, as critical thinking as critical thinking focusing on numbers and data.focusing on numbers and data.

So, how do we use Performance Tasks to measure quantitative So, how do we use Performance Tasks to measure quantitative reasoning skills?reasoning skills?

Collegiate Learning Assessment (CLA)Collegiate Learning Assessment (CLA)Performance TasksPerformance Tasks

What are Performance Tasks?What are Performance Tasks?

““..realistic problems that require students to ..realistic problems that require students to analyze complex materials and determine analyze complex materials and determine the relevance to the task and credibility. the relevance to the task and credibility.  Students' written responses to the tasks  Students' written responses to the tasks are evaluated to assess their abilities to are evaluated to assess their abilities to think critically,think critically, reason analytically, solve reason analytically, solve problems and communicate clearly and problems and communicate clearly and cogently. ”cogently. ”

Performance Task Scenario for Pre Performance Task Scenario for Pre and Post-Assessmentand Post-Assessment

Sen. Nathan Sen. Nathan DulceDulce is running for re-election vs. Pat is running for re-election vs. Pat SauerSauer

Proposed bill to ban aspartame, an artificial sweetener, from Proposed bill to ban aspartame, an artificial sweetener, from being added to any soft drink or food product, being added to any soft drink or food product, DulceDulce opposes, opposes, SauerSauer approves. approves.

Pat Sauer made two arguments during a recent TV interview:Pat Sauer made two arguments during a recent TV interview:

(1) Strong correlation between the number of people who (1) Strong correlation between the number of people who consume aspartame and headaches, so, “banning consume aspartame and headaches, so, “banning aspartame would improve the health of the state’s citizens.” aspartame would improve the health of the state’s citizens.” (2)“aspartame should be banned and replaced with (2)“aspartame should be banned and replaced with sucralose.” Pat Sauer supported this argument by referring sucralose.” Pat Sauer supported this argument by referring to a news release.to a news release.

Standard “Self-contained” Standard “Self-contained” DisclaimerDisclaimer

The given scenario is hypothetical, but realistic, and the task The given scenario is hypothetical, but realistic, and the task contains several documents from different information contains several documents from different information sources. sources. While your personal experiences and values While your personal experiences and values are important, this task is self-contained, so you should are important, this task is self-contained, so you should base your response(s) on the information in the base your response(s) on the information in the provided documents.provided documents.

The open-ended performance task allows us to assess your The open-ended performance task allows us to assess your critical thinking and quantitative reasoning skills. In addition, critical thinking and quantitative reasoning skills. In addition, your presentation and writing will be considered when your your presentation and writing will be considered when your submittal is scored.submittal is scored.

So, the task has several attached documents, either containing So, the task has several attached documents, either containing relevant information, or “red-herrings.”relevant information, or “red-herrings.”

Performance Task Scenario Performance Task Scenario for In-semester Projectsfor In-semester Projects

• Protagonist is a student at Juniata College, Protagonist is a student at Juniata College, major in Environmental Science major in Environmental Science (foreshadowing for future task)(foreshadowing for future task)

• Protagonist is also Student Government Protagonist is also Student Government TreasurerTreasurer

• Works closely with “Bruce Stacy,” Director Works closely with “Bruce Stacy,” Director of Student Activitiesof Student Activities

• Self-contained, recommendations based Self-contained, recommendations based solely on provided documentssolely on provided documents

Assessment Section 01 Section 02 Section 03

Pre-Assessment

First day of class

QR Assessment QR Assessment Traditional Math Skills

Project 01 Performance Task, based on CLA

Traditional Traditional

Project 02 Performance Task, based on CLA

Traditional Traditional

Project 03 Performance Task, based on CLA

Traditional Traditional

Post-Assessment

Last day of class

QR Assessment QR Assessment QR Assessment

Quantitative Reasoning Assessment Schedule, Fall 2009

Assumptions/QuestionsAssumptions/QuestionsWill students in both Section 01 and 02 will have better results on the Post-Will students in both Section 01 and 02 will have better results on the Post-

Assessment than the Pre-Assessment?Assessment than the Pre-Assessment?

Will the students in Section 01, show more improvement on the Post-Will the students in Section 01, show more improvement on the Post-Assessment than students in Section 02? Assessment than students in Section 02?

The students in Section 01 had projects based on CLA-like Performance The students in Section 01 had projects based on CLA-like Performance Tasks, while the students in Sections 02 and 03 had traditional projects.Tasks, while the students in Sections 02 and 03 had traditional projects.

How will the students in Section 03 score on the Quantitative Reasoning How will the students in Section 03 score on the Quantitative Reasoning Post-Assessment?Post-Assessment?

Traditional Math Skills Assessments were given prior to Fall 2009 Traditional Math Skills Assessments were given prior to Fall 2009 semester. The QR Assessment is given here to compare if not having semester. The QR Assessment is given here to compare if not having seen it previously makes a difference.seen it previously makes a difference.

Does MA103 help Improve student’s Quantitative Reasoning skills?Does MA103 help Improve student’s Quantitative Reasoning skills?

Any Questions or Comments?Any Questions or Comments?

MA 103, Project 01MA 103, Project 01In response to the funding controversy, Bruce Stacy has asked you to write a In response to the funding controversy, Bruce Stacy has asked you to write a

etter, and etter, and upload it in Moodleupload it in Moodle, by , by Monday, February 16 (due at theMonday, February 16 (due at the

beginning of your MA 103 class)beginning of your MA 103 class), answering the allegations., answering the allegations.

His two main concerns are answering whether the funding allocations are fairHis two main concerns are answering whether the funding allocations are fair

and equitable, and answering why the funding was cut given that the studentand equitable, and answering why the funding was cut given that the student

enrollment was rising. So at the very least, you will be sure to addressenrollment was rising. So at the very least, you will be sure to address

his two concerns in your letter, although you realize there may be additionalhis two concerns in your letter, although you realize there may be additional

points to be made.points to be made.

From working with Bruce Stacy over the last year and a half, you know that heFrom working with Bruce Stacy over the last year and a half, you know that he

really values visual aids like graphs and charts, so you consider ways toreally values visual aids like graphs and charts, so you consider ways to

incorporate these in your letter, where appropriate. incorporate these in your letter, where appropriate.

Materials Available to the Materials Available to the StudentStudent

Email complaining that allotments are unfairEmail complaining that allotments are unfair

Letter from College President explaining budget Letter from College President explaining budget decrease for student organizations, even though decrease for student organizations, even though enrollment is increasingenrollment is increasing

Table showing club funding history and projected fundingTable showing club funding history and projected funding

Bar chart of last three years of club membershipBar chart of last three years of club membership

Line graph of last three years of FTELine graph of last three years of FTE

Juniatian article describing student protests over club Juniatian article describing student protests over club fundingfunding

MA 103, Project 02MA 103, Project 02

Keep our characterKeep our character

Analyze loans, loan table, interest, etc…Analyze loans, loan table, interest, etc…(a component in previous Projects)(a component in previous Projects)

Write a letter to parents describing desire Write a letter to parents describing desire to switch from ESS to finance or to switch from ESS to finance or accounting, hope to test web-site accounting, hope to test web-site evaluation skillsevaluation skills

Critical thinking involves Critical thinking involves evaluating/making good argumentsevaluating/making good arguments

Making good arguments involves. . .Making good arguments involves. . .

Clearly stating a conclusionClearly stating a conclusion

Evaluating and selecting evidenceEvaluating and selecting evidence

Creating links between evidence and conclusionCreating links between evidence and conclusion

We can then consider quantitative reasoning as We can then consider quantitative reasoning as critical thinking involving numbers/data…critical thinking involving numbers/data…