PEER ASSISTED TEACHING SCHEME (PATS)

Embed Size (px)

DESCRIPTION

PEER ASSISTED TEACHING SCHEME (PATS). TEACHERS HELPING TEACHERS BUILDING QUALITY IN HIGHER EDUCATION UNITS. Associate Professor Angela Carbone Monash University. RMIT Seminar Friday 17th June Building 10 level 8 Room 4 RMIT, City Campus. Presentation Overview. Background - PowerPoint PPT Presentation

Text of PEER ASSISTED TEACHING SCHEME (PATS)

ALTC Teaching Fellowship

PEER ASSISTED TEACHING SCHEME (PATS)

RMIT SeminarFriday 17th JuneBuilding 10 level 8 Room 4RMIT, City Campus

TEACHERS HELPING TEACHERSBUILDING QUALITY IN HIGHER EDUCATION UNITSAssociate Professor Angela CarboneMonash University

1BackgroundEducation Quality in the Higher Education contextQuality Measures used within MonashConcerns with current methods of improving qualityPeer Assisted Teaching Scheme (PATS)AimThe process and activitiesThe implementationData collection and findingsProposed OutcomesFuture works

2ALTC Teaching Fellowship Presentation RMIT Seminar 17 June 2011 Presentation OverviewThe Australian government has recently introduced the Advancing Quality in HE initiative. Elements of the package include:-TEQSAMission-based compactsMy University websitePromoting Excellence in Learning and Teaching Collegiate Learning AssessmentAustralian Graduate Survey (plus others)

http://www.deewr.gov.au/HigherEducation/Policy/Pages/AdvancingQuality.aspx

3BackgroundAdvancing Quality in Higher EducationALTC Teaching Fellowship Presentation RMIT Seminar 17 June 2011 BackgroundLearning and Teaching Quality MeasuresAustralian Graduate Survey (AGS) comprises of two components:Graduate Destination Survey (GDS)Course Experience Questionnaire (CEQ)Analysis main themes/domains of Assessment, Course Design, Outcomes, Staff, SupportEg : Further improvement for IT is needed in Structure in Course Design and Teaching Skills in staff, http://opq.monash.edu.au/mqu/evaluations/ags/ceq.html

Student Evaluations (at Monash University)Monash Experience Questionnaire (MEQ)Student Evaluation of Teaching and Unit (SETU) instrument4ALTC Teaching Fellowship Presentation RMIT Seminar 17 June 2011 BackgroundStudent Evaluations of Teaching and Units-- Unit Evaluation questionsItem 1: The unit enabled me to achieve its learning objectivesItem 2: I found the unit to be intellectually stimulatingItem 3: The learning resources in this unit supported my studiesItem 4: The feedback I received in this unit was helpfulItem 5: Overall I was satisfied with the quality of this unit

Two open-ended questions:What were the best aspects of the unit?What aspects of this unit are most in need of improvement?

5ALTC Teaching Fellowship Presentation RMIT Seminar 17 June 2011 BackgroundMonash Unit Evaluation IndicatorsColour CodeInterpretationUnit MeasureCharacteristics of unit response distributionTargetsOutstandingoverall item median 4.7A considerable majority of responses are strongly agree5% of units have medians 4.7Meeting aspirationsoverall item median between 3.6 - 4.69Responses are generally above neutral, the great majority are agree or strongly agree80% of units fall in this bandNeeding improvementoverall item median between 3.01 3.59Responses are generally neutral or bimodal with no clear trend10% of units fall in this bandNeeding critical attentionoverall item median 3.0Responses generally below neutral, majority disagree or strongly disagree5% of units have medians 3.06ALTC Teaching Fellowship Presentation RMIT Seminar 17 June 2011 BackgroundUnit Evaluation Ranking of Faculties at MonashFaculty of Information TechnologySemester 1 Rankings 2008 ranked 9/10 (mean 3.61, Uni 3.79)* 2009 ranked 6/10 (median 3.91, Uni 3.94) 2010 ranked 7/10 (median 3.93, Uni 3.96)

Faculty of Information TechnologySemester 2 Rankings 2008 ranked 8/10 (mean 3.68, Uni 3.78)* 2009 ranked 8/10 (median 3.90 Uni 3.94) 2010 ranked 6/10 (median 3.95, Uni 3.99)FacultyResponse RateMedianArts38.84%4.11Law49.00%4.04Art & Design48.89%3.99Business & Economics47.69%3.99University46.04%3.99Science53.03%3.98Information Technology43.73%3.95Education45.75%3.95Pharmacy30.73%3.93Engineering46.60%3.92Medicine, Nursing & Health Sciences49.37%3.92Faculty Rankings in Semester 2, 2010* In 2008 only mean values were reported. From 2009 median values were reported as the mean was deemed not an appropriate measure of central tendency.7ALTC Teaching Fellowship Presentation RMIT Seminar 17 June 2011 BackgroundMethods of improving qualityHigher education teacher preparationPredominant model is via centrally delivered programsConcernsPrograms usually do not include discipline specific contentPrograms often neglect the needs of non-early career teaching staff whose units need helpNot enough support and detailed attention provided8ALTC Teaching Fellowship Presentation RMIT Seminar 17 June 2011 Peer Assisted Teaching SchemeAimA program where two or more colleagues collaborate in helping to improve the quality of teaching and student satisfaction within identified units

Aims:To improve student satisfaction with the quality of unitsTo build leadership capacity using currently recognisedoutstanding teachers as critical friends and mentors

MENTOR + MENTEE9ALTC Teaching Fellowship Presentation RMIT Seminar 17 June 2011 Peer Assisted Teaching SchemeThe original process

Workshops:1. Interactive Lecturing 2. Planning Your Teaching3. Peer Observation of TeachingDeliverables:Strategy PlanBackchatPeer Observation of TeachingCritical Reflection10ALTC Teaching Fellowship Presentation RMIT Seminar 17 June 2011

Peer Assisted Teaching Scheme-- The revised process11Refining pre semester activitiesRefining post semester activitiesALTC Teaching Fellowship Presentation RMIT Seminar 17 June 2011 11Peer Assisted Teaching Scheme ImplementationPilot study implemented in the Faculty of Information Technology (2008-2009)Phase 1 extended the scheme to the Physical Science cluster of Monash University (FIT, Eng, Sci) (2009-2010)Phase 2 extended the scheme to all remaining clusters of Monash University (2010-2011)12ALTC Teaching Fellowship Presentation RMIT Seminar 17 June 2011 Peer Assisted Teaching Scheme Data CollectionData was collected via three different methods:Unit Evaluation resultsSurveyed participantsFocus Group sessions with mentees and mentors13ALTC Teaching Fellowship Presentation RMIT Seminar 17 June 2011 Peer Assisted Teaching Scheme Unit Evaluation Results The pilot studyUnitSemesterMedian#Enr#RespFIT1S2, 20082.865925S1, 20094.332016FIT2S2, 20082.113820S1, 20093.53012FIT3S2, 20082.955723S1, 20093.564925FIT4S2, 20082.5247S1, 20093.67305FIT5*S1, 20094.362516* FIT5 was a new unit taught in 2009; while the lecturer had not taught the unit before he wanted to be involved in PATS because his previous unit was flagged as needing critical attention (Median: 2.95, Mean: 2.83 (112 students enrolled, 29 responses).14Pilot Faculty of Information Technology 2008-2009Moved into needs improvementsMoved into meeting aspirationsALTC Teaching Fellowship Presentation RMIT Seminar 17 June 2011 Peer Assisted Teaching Scheme Unit Evaluation Results Phase 1UnitSemesterMedian#Enr#RespFIT6S1, 200935925S1, 20102.922016FIT7S1, 200933820S1, 20103.283012FIT8S1, 20092.55723S1, 20104.34925ENG1S2, 20091.7510429S2, 20102.5612348ENG2S2, 20092299S2, 20104.1276SCI1S2, 2009375S2, 20103.522SCI2S2, 20093.147951S2, 20102.93721215Phase 1 Physical Science Cluster (IT, ENG, SCI) 2009-2010Moved into meeting aspirationsMoved into needs improvementRemained in critical attention zoneALTC Teaching Fellowship Presentation RMIT Seminar 17 June 2011 Peer Assisted Teaching SchemeSurveys Areas for improvement16Students commented on the following areas:Lectures relevance, structure, Lecturers teaching skills, accessibility, expertise/knowledgeFeedback amount, relevance, timingResources relevance, amount, LMSAssessment specifications/requirements, types of tasks, alignment with lecture contentTutorials relevance, structure/use of time, alignment with lecture contentTutors teaching skills, accessibility, expertise/knowledgeEthics approval has been recently obtained to analyse unit evaluation qualitative comments for units needing critical attentionALTC Teaching Fellowship Presentation RMIT Seminar 17 June 2011 Peer Assisted Teaching Scheme Focus group sessions - PATS in a word17Learning and Teaching Effectivenessreflectionencouragingsupportiveconstructivecommunicationfostering discussionsreview & planSharing ideasRelationship-buildingInterpretative guidanceaccountabilitycollaborativeALTC Teaching Fellowship Presentation RMIT Seminar 17 June 2011 Focus group sessions Opportunities and Challenges

Building leadership/mentoring capacity Coffee vouchers to build supportive, collegial relationship with colleagues within faculty Places more priority on teaching can lead to improved teaching practice Improving quality of higher education, better student experience Partnering processTime consuming Feeling stigmatisedRequires total dedication from both partners to be successful More workload18OpportunitiesChallengesALTC Teaching Fellowship Presentation RMIT Seminar 17 June 2011 Unit Evaluation Results Phase 2UnitSemesterMedian#Enr#RespART1S1, 20102.333519ART2S1, 20104.5188BUS1S1, 20102.889147EDU1S1, 20103.116539EDU2S1, 20103.116539EDU3S1, 20103.932412ENG1S1, 20103.656419FIT1S1, 20103.289326FIT2S1, 20103.567019FIT3S1, 2010NEW UNITPHM1S1, 20103.9824677PHM2S1, 20104.17246PHM3S1, 2010NEW UNITPHM4S1, 20103.911907219Phase 2 University Wide 2010-2011Phase 2 of the scheme is currently in progress with the following faculties participating:

Arts (4 participants)Business and Economics (2 participants)Education (6 participants)Engineering (2 participants)Information Technology (6 participants)Pharmacy and Pharmaceutical Sciences (4 participants)

In 2011, the scheme has been opened up to all faculties at Monash University. ALTC Teaching Fellowship Presentation RMIT Seminar 17 June 2011 Peer Assisted Teaching Scheme- Proposed OutcomesA consistent and university-wide strategy/policy to assist academics to improve units that need critical attentionIdentification of perceived challenges and opportunities for the development of PATS as a mechanism to improve quality of teaching in Highe