Presentation Font

Innovations 2012 Closing the Loop

1

AgendaCulture of AssessmentUnlocking The DataTracking ImprovementNext StepsQuestions / Conversation Culture of AssessmentGuiding Principles

Systemic; not episodicPurposefulEmbedded in existing curriculumStudent centeredTransparentUsed to improve C&I

7Improvement vs. AccountabilityEwell, P. (2009, November). Assessment, accountability, and improvement: Revisiting the tension. (NILOA Occasional Paper No.1). Urbana, IL: University of Illinois and Indiana University, National Institute of Learning Outcomes Assessment. ImprovementAccountabilityIntentFormative (Improve)Summative (Judge)StanceInternalExternalEthosEngagementCompliance

Peter Ewell, Ph.D.8

Situation on Your Campushttps://docs.google.com/spreadsheet/viewform?pli=1&formkey=dDk3YTVaRXBscjhQQmVtbmhWNl9TeWc6MA#gid=0

http://pollev.com/brianeppIs Assessment Important? What is the % of accreditor sanctions that are related to a campus compliance with student learning outcome requirements?

70%11Assessment Cycle12Moving from the Open Loop to Closing the LoopDevelop Awareness: Left BrainRight Brain.. Data Visualization

Implement Action: Dig Deeper: Horizontally or Vertically Scope: Involve your TeamChange: Enhance Curriculum and Instruction

Refine Roadmap

Unlocking The DataUnlocking SLO Data

?

Information Is Beautifulhttp://www.informationisbeautiful.net/visualizations/What do you want/need to knowQuestionQuestion AgainQuestion Once More

?Correlation Brings ActionHow are my Institutions outcomes performing?What ratio of students mastered their BIO outcomes last year?How many students are mastering their program outcomes?Judge of a man by his questions rather than by his answers.VoltaireGather what you needFind Your NounsFind Your VerbsFind Your Math

Denver Waterhttp://www.denverwater.org/Conservation/UseOnlyWhatYouNeed/What ratio of students mastered their BIO outcomes last year?studentsGather what you need

Grammar what you needBIO outcomeslast yearmasteredratio

Impactful Data

Dont Hate Me Because Im BeautifulThere Is No Single, Magical Silver BulletNo Man/Woman Is An Island

Information is Beautifulhttp://www.informationisbeautiful.net/store/Make It Worth Seeing Make It Instantly Meaningful Make It Prompt More Questions To Your Audience! Immediately Actionable

20Unlocking Student Learning Outcome Data?

Information Is Beautifulhttp://www.informationisbeautiful.net/visualizations/

What ratio of students mastered their BIO outcomes last year?What ratio of students mastered their BIO outcomes last year?

NounsVerbsMath

No BulletNo IslandBeautifulMeaningfulQuestioning

What questions are you asking?Does student outcome performance vary across course sections?Does student outcome performance vary across terms?Does % of students mastering an outcome increase through the program?Which outcomes (in a program, in a course) do most students not master?

Tracking Improvements to C&I

Jump In

with a PlanAsk Tracking Questions

Is this about the student or the SLO?

How frequently will we collect/track?

How much data can we show?

How will stakeholder improvement discussions be tracked?Next Steps

Start Small but Start

28Blaich, C.F. & Wise, K.S. (2011, January). From Gathering to Using Assessment Results: Lessons from the Wabash National Study (NILOA Occasional Paper No.8). Urbana, IL: University for Illinois and Indiana University, National Institute of Learning Outcomes Assessment.

Assessment data has legs only if the evidence collected rises out of extended conversations across constituencies about:(a) what people hunger to know about their teaching and learning environments and (b) how the assessment evidence speaks to those questions. (pg. 12)

29Taking Your Next Steps

Determine your team/audienceArticulate your data questionsEstablish which data to track and how oftenStart!!!Perfect is the Enemy of Good

31

Assessment & Analytics GroupContact email: brian.epp@pearson.com