Update on the Implementation of Update on the Implementation of p pp pSchoolSchool--based Assessment (SBA)based Assessment (SBA)

Dr George PookDr George PookDeputy Secretary General, HKEAADeputy Secretary General, HKEAAeputy Sec eta y Ge e a ,eputy Sec eta y Ge e a ,

November 4November 4 –– 5 20105 2010November 4 November 4 –– 5, 20105, 2010

Some SBA QueriesSome SBA Queries

1 Implementation as a means to an end1. Implementation as a means to an end

NSS curricular objectives must be matchedjby assessment

SBA can assess skills / outcomes notSBA can assess skills / outcomes notcovered in public examinations (e.g.investigation practical work design projectinvestigation, practical work, design project,fieldwork, presentation)

Familiarity with SBA breeds respect

Longitudinal study on CE English Language SBA (2005 2007)SBA (2005 – 2007)

Faculty of Education (HKU) study monitored the setting,conduct marking and moderation of SBA componentconduct, marking and moderation of SBA componentIntroduction of SBA was met with initial concernProfessional development opportunities and supportProfessional development opportunities and supportmaterials providedTeachers’ views more positive as system bedded inp yStudents initially neutral, with some concern about teachers’workloadOver time students became more positive, and valued thesupported autonomyIf SBA i t b ff ti i l t t b d tIf SBA is to be effective in long term, more must be done toinform school principals

2. Development of improved systemsIncremental change and growth of SBABetter support measures for SBA teachersBetter support measures for SBA teachersStandardized practice across subjectsConstructive balance of moderation methodology

(i) Statistical moderation with an element of expert j d tjudgement

(ii) Expert judgement with an element of statistical adjustmentadjustment

Submission of sample student SBA work required for all moderationfor all moderation

Fairness through moderation

Teachers well placed to judge relative performanceof studentsof studentsInternal standardization within each schoolSt d t ’ k d ithi h h l ill t bStudents’ rank order within each school will not bechangedM d ti h l b i t t d diModeration on a school basis to standardizeacross schoolsS l f t d t SBA k i dSamples of student SBA work reviewedFurther investigation of unusual cases

Statistical moderation

Applicable to most HKDSE subjectsApplicable to most schools in each of these subjectsApplicable to most schools in each of these subjectsModeration adjustment should fairly reflect standardof SBA performance in a schoolpIn some schools (outliers), statistical moderation maynot fairly reflect performancey pOutliers identified by review of sample student workModifications to statistical moderation adjustmentModifications to statistical moderation adjustmentthen based on sample review

Expert judgement moderation

Applied to subjects with small entry, or with SBAhaving very different outcomes from thoseassessed in examinations

Experienced professional makes recommendationsfor adjustment based on sample review

Statistical checks made based on backgroundtrendstrends

Samples of student SBA work How?

Samples previously collected for CE and AL

Uniform sampling methodology for HKDSE

Samples chosen by HKEAA after final SBA markssubmitted in S6

Six pieces of work, chosen randomly from each of sixp , ymark bands spread across whole ability range forschool

Samples are normally written work

English language has different procedureEnglish language has different procedure

3. Fitting SBA in

SBA fits in naturally with internal assessment

SBA i t f l t hi d l i tSBA is a part of normal teaching and learning, not anadd-on

C d t d d ll S5 d S6Conducted gradually over S5 and S6

SBA for each subject has significant part done underdi t t h i i i ldirect teacher supervision in classroom

Curriculum time set aside for key SBA activitiesithi th l h l dwithin the regular school day

SBA should not represent an additional workload

4. Roles and shared responsibilities

EDB HKEAAEDB

SCHOOL COORDINATORS

SBA SUPERVISORS / DISTRICT COORDINATORS

SCHOOLSCHOOL PRINCIPALS SCHOOL

TEACHERSNote: 1) Each party has a specific

role to play and should betrusted in that role in orderto achieve assessment

STUDENTS

to achieve assessmentintegrity.

2) Continuous communicationand feedback requiredand feedback required

Some example responsibilities

Students will: Understand SBA requirements, schedule,school regulations, assessment criteriaComplete the tasks honestly, responsiblyand on timeKeep a proper record of their SBA work

Teachers will: Explain the above to studentsTeachers will: Explain the above to studentsAdminister SBA according to HKEAAregulations and proceduresregulations and proceduresAssess and authenticate students’ workSubmit SBA marks and records onSubmit SBA marks and records onschedule

Some example responsibilities

P i i l ( th i d i t ) illPrincipals (or their designates) will:Establish school regulations and procedures for

d i i t i SBAadministering SBASend representatives to attend SBA conferencesand coordinator teacher meetingsand coordinator-teacher meetingsNominate a school coordinator for each subjectEndorse SBA marks for submissionMaintain a quality assurance system for SBAy yProvide feedback to HKEAA

SSome example responsibilities

School coordinators will:

Liaise with HKEAA and the district coordinatorsPlan the school assessment scheduleCoordinate the reporting of marks to HKEAAReport to the district coordinators any irregularitiesirregularities

SBA supervisors / Monitor SBA and report irregularities to HKEAAdistrict coordinators will:

Write reports on progress of SBAMeet with school coordinators / teachers to

id id d i tprovide guidance and receive commentsReview samples of students’ work

Some example responsibilitiesSome example responsibilitiesHKEAA will: Develop assessment framework and criteria

Cond ct researchConduct researchOrganize and lead teacher professionaldevelopment course (with EDB)p ( )Appoint and train SBA supervisors / districtcoordinatorsProcess assessment records, moderate SBAmarks and provide feedback to schools

EDB ill S d i t h f i lEDB will: Sponsor and organize teacher professionaldevelopment courses (with HKEAA)Provide learning and teaching resources to helpProvide learning and teaching resources to helpimplementationSupport the WebSAMS system for processingSBA d tSBA dataEvaluate school quality assurance systems

5. Support provided for SBA

Handbooks for school leaders and teachers (2009)Handbooks for school leaders and teachers (2009)Sample assessment tasks and exemplars (2009 and ongoing)Professional development programmes for teachers (ongoing)Professional development programmes for teachers (ongoing)Professional advice and support to schools by districtcoordinators (ongoing)Financial support to schools (e.g. LS curriculum supportgrant)EDB parents’ seminars (ongoing)EDB parents seminars (ongoing)“HKDSE Information on School-based Assessment” booklet(2009)“Useful tips for parents, vol 8” by EDB (Nov, 2010)“Moderation of School-based Assessment scores” booklet(Dec 2010)(Dec, 2010)

6. Some possible questions that might ariseHow much guidance and feedback can teachers give tostudents?H h ld t d t ’ l t b i i f k b d lt ith?How should students’ late submission of work be dealt with?What can students do if they have queries about the SBAscores given by their teacher?scores given by their teacher?Will students be penalized if they plagiarise work?Will SBA results be reported separately in the Diploma?p p y p

F th d th i th “H db k fFor these and many others queries, see the “Handbook forschool leaders on SBA” and the new “FAQs on theimplementation of SBA in HKDSE” just uploaded on the NASp j pWeb Bulletin.

7. The way forward for SBAySeptember –November 2010

Annual SBA teachers’ seminars for 12 subjects

November 2010 Meeting of Advisory Group on SBA implementation inthe HKDSE

November 2010 Standards Committee of HKEAA decides onNovember 2010 Standards Committee of HKEAA decides onmoderation method for each HKDSE subject

December 2010 Publication of booklet on SBA moderationmethodology

May – July 2011 Submission by schools of Secondary 5 SBA marks

September –October 2011

Provision of feedback to schools on Secondary 5 SBAmarks

January – April Submission by schools of Secondary 6 SBA marksJanuary – April 2012

Submission by schools of Secondary 6 SBA marksand student work samples

September – Provision of SBA feedback to schoolsOctober 2012 Review of SBA procedures based on first

administration

We can achieve successful implementation of SBA in the HKDSE for the benefit of

student learning

What now?

Your immediate questions and comments on SBA willYour immediate questions and comments on SBA willbe welcomed this afternoon

A f th ti d t SBA bAny further questions and comments on SBA can bedirected to the SBA team at sba@hkeaa.edu.hk, or bytelephone to HKEAA assessment development generaltelephone to HKEAA assessment development generalenquiries: 3628 8070

Thank you for your time and consideration