28
^j\n 'J . ^ o^ \ dL" ^ ^ ^ OCT- J V3-' l~ J UMASS/AMHERST 315QbbDlbin4S3 Department of Education government wuivicriiITS COLLECTION MAY 1 2 1S95 Mwx%\\^ of Massachusetts Depositary Copy The Massachusetts English Language Assessment - Oral Handbook September 1 994

The Massachusetts English language assessment - oral handbook

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: The Massachusetts English language assessment - oral handbook

^j\n 'J . ^ o^ \ • dL" ^ ^ ^ OCT- J V3-'

l~J

UMASS/AMHERST

315QbbDlbin4S3

Department of

Education government wuivicriiITS

COLLECTION

MAY 1 2 1S95

Mwx%\\^ of MassachusettsDepositary Copy

The Massachusetts

English Language

Assessment - Oral

Handbook

September 1 994

Page 2: The Massachusetts English language assessment - oral handbook
Page 3: The Massachusetts English language assessment - oral handbook

Massachusetts Board of Education

Mr. Martin S. Kaplan, Esq., Chairperson, NewtonDr. Madelaine S. Marquez, Vice Chair, Amherst

Mr. Thomas Chin, NewtonMs. Patricia A. Crutchfield, Springfield

Ms. Marjorie Dolan, Boston

Dr. Jerome H. Grossman, Chestnut Hill

Mr. Frank Haydu, III, Dover

Mr. William K. Irwin, Jr., Wilmington

Ms. Elizabeth Kittredge, LongmeadowMr. S. Paul Reville, Worcester

Dr. Richard R. Rowe, Belmont

Dr. Stacy L. Scott, Lowell

Rev. Michael W. Walker, Brockton

Ex Officiis

(Voting Privileges)

Ms. Erin Megin, Westboro

Chairperson, Student Advisory Council

Dr. Piedad F. Robertson, Charlestown

Secretary, Executive Office of Education

(Non-Voting Privileges)

Dr. Stanley Z. Koplik, Boston, Chancellor

Higher Education Coordinating Council

Dr. Robert V. Antonucci, Commissioner of Education andChief Executive Officer of the Board of Education

September 1994

Publication #

Tlie Massachusetts Departnnent of Education insures equal employment/educational opportunities/

affirmation action regardless of race, color, creed, national origin or sex, in con\pliance with Title VI

and Title LX, or handicap, in compliai^ce with section 504.

Page 4: The Massachusetts English language assessment - oral handbook

d^^%i^...

Page 5: The Massachusetts English language assessment - oral handbook

2rt V. Antonucciommissioner

The Commonwealth of Massachusetts

Department of Education

350 Main Street, Maiden, Massachusetts 02148-5023

September 1994

(617)388-3300(617)388-3392 Fax

Dear Friends:

The Education Reform Act of 1993, as well as numerous national initiatives,

calls for the development of enhanced means of assessment. Authentic

assessments which support effective classroom practice are an important piece

of our initiatives for school reform. The need for an appropriate assessment

process for students with limited English proficiency is particularly acute.

To address these needs, the Massachusetts Department of Education has taken

a leadership role in developing the innovative assessment process described in

this booklet. This process is called the Massachusetts English Language

Assessment-Oral (MELA-O). The MELA-O is an alternative means of

assessing the oral language skills of English language learners from a holistic

perspective. It records student progress in ways which assist the teacher in

planning instruction and activities which move learners toward a greater

mastery of English.

The development and field testing of the MELA-O is the work of a group of

Massachusetts educators, the Massachusetts Assessment Advisory Group.

This working group has received extensive guidance and support from the

Evaluation Assistance Center at The George Washington University. (See

individual names. Acknowledgement page) Each of these people has

committed extensive hours of labor and creative input to the project. Onbehalf of the students of Massachusetts, I tharvk them and commend their fine

efforts.

I am pleased that educators from a number of other states have expressed an

interest in the MELA-O. This innovative assessment process is an important

addition to the tools which are available for teachers who are working with

bilingual students.

Robert V. Antonucci

Commissioner of Education

Page 6: The Massachusetts English language assessment - oral handbook
Page 7: The Massachusetts English language assessment - oral handbook

Acknowledgments

In 1992, a group of bilingual, ESL and assessment professionals was convened by the Bureau

of Equity and Language Services at the Department of Education to examine the oral testing

instruments currently authorized by the state for use v^ith students in TBE programs. This group,

subsequently named MAAG (Massachusetts Assessment Advisory Group), identified

a need for more meaningful assessment. MELA-O is a response to this need and was developed as a

collaborative effort between the Evaluation Assistance Center (EAC) East at the George Washington

University andMAAG. It is based on the American Council for the Teaching of Foreign Languages

(ACTFL) guidelines and modeled on the Student Oral Language Observation Scale (SOLOM)developed by the San Jose CA Unified School District, 1985 and the Student Oral Proficiency Rating

(SOPR), an adaption of the SOLOM by Development Associates, 1987.

The commitment and dedicated effort of the following individuals have made the development of this

alternative assessment possible. Many hours of conunitted effort have been contributed by each

individual.

Massachusetts Assessment Advisory GroupGeorgette Gonsalves, New England Multifunctional Resource Center

Beverly Miyares, Accountability and Evaluation Services, Department of Education

Domenic Mauro, Bilingual Director, Waltham Public Schools

James O'Connor, Coordinator for Testing and Evaluation, Boston Public Schools

Connie O'Hare, Interim Director of BiHngual Programs, Holyoke Public Schools

Sal Petralia, Testing and Assessment Supervisor, Lawrence Public Schools

Kathryn Riley, State Advisory Council on Bilingual Education

Mario Teixeira, Bilingual Director, New Bedford Public Schools

Elizabeth Thomas, Learning Support Services, Department of Education

Facilitator: Margaret Davis, Instruction and Curriculum Services, Department of Education

Evaluation Assistance Center, George Washington University

Charlene Rivera, Director

BCristen Carl

Edwina Carreon

Margaret E. Malone

Written By:

Members of the Massachusetts Assessment Advisory Group

Edited by:

Christopher Berry

Page 8: The Massachusetts English language assessment - oral handbook
Page 9: The Massachusetts English language assessment - oral handbook

Table of Contents

Introduction

What Is MELA-O?

Using MELA-O 5

Examples 11

Suggested Practices for Oral Language Development 13

Page 10: The Massachusetts English language assessment - oral handbook
Page 11: The Massachusetts English language assessment - oral handbook

Introduction

This booklet is written to serve two audiences:

1. Educators who are interested in obtaiiung basic information

about the MELA-O assessment. Proper use of the MELA-Orequires training and practice. For more information, call the

Evaluation Assistance Center East, 1-800-925-3223, or the

Massachusetts Department of Education, 617-388-3300, x234.

2. Teachers who have been trained and who are using

MELA-O. The content and format have been designed to

provide an easy to read desk reference.

Page 12: The Massachusetts English language assessment - oral handbook
Page 13: The Massachusetts English language assessment - oral handbook

I. What Is MELA-O? (The Massachusetts

English Language Assessment - Oral)

The ''MELA-O" is a process for measuring oral English language

proficiency. It is based on the concept of communicative

competence, which consists of a learner's ability to understand, to

speak and to be understood by others in English. MELA-O was

developed in response to concerns that assessments were often

disruptive and intimidating, especially when carried out by an

unfamiliar individual. It brings meaningful assessment in line

with good classroom practice, and provides useful information to

the teacher in planning for the needs of individual students.

MELA-O measures a student's oral English language proficiency

through a series of informal observations in natural classroom

situations. This approach emphasizes that learners should be

placed in situations where they can use language naturally in real

communication with others. In this way, learners do not just

memorize words and rules, but develop the ability to understand

and to be understood.

The MELA-O assessment system is based on two principles:

1) the classroom teacher is best qualified to assess a student's

proficiency; and 2) cumulative observation results in better

assessment. MELA-O permits classroom teachers to accumulate

observations of authentic language use to evaluate and describe a

student's oral language proficiency. Because this evaluation is

done by a teacher, not an outside evaluator, it eliminates the

high-pressure, formal testing situation which can often produce

an inaccurate evaluation. Because observations occur over a

period of tim.e, the results are a more accurate reflection of

students' oral proficiency.

"MELA-O measures a

studenfs oral English

language proficiency

through a series of

informal observations

in natural classroom

situations.

"

The Massachusetts English Language Assessment - Oral Handbook

Page 14: The Massachusetts English language assessment - oral handbook

"In doing observations

and then using the

MELA-O assessment

with each child, a

teacher must reflect on

opportunitiesfor

language use in his or

her classroom."

MELA-O can also help a teacher improve learning within his or

her own classroora. In doing observations and then using the

MELA-O assessment with each child, a teacher must reflect on

opportunities for language use in his or her classroom. This

reflection may suggest useful changes or innovations to the

teacher. It might also provide information that can be used as the

basis for future language planning and in the development of

Individual Learning Plans (ILPs). A discussion of effective teacher

practices that can be used in conjunction with MELA-Oassessment in language classrooms is included in section IV.

MELA-O is consistent with the American Council for the

Teaching of Foreign Languages (ACTFL) Proficiency Guidelines

(1986). The ACTFL scale allows raters to evaluate oral proficiency

in English on a range from low to high: Novice, Intermediate,

Advanced and Superior. In contrast, MELA-O provides a

descriptive rating from 0-5 for each of four different aspects of

oral production: fluency, vocabulary, pronunciation and

granunar. It also provides a rating for aural comprehension. In

producing five specific ratings, the MELA-O attempts to reflect

the complexity and individual patterns of language learning.

This expands a teacher's ability to describe each student's

performance and development. Like the ACTFL Guidelines,

MELA-O describes the characteristics of speakers who fall under

each level.

An initial pilot study using classroom teachers in 1993 and an

expanded pilot study in 1993-94 both yielded overwhelmingly

positive results. Teachers involved in both studies agreed that

MELA-O results were accurate and descriptive. They also agreed

that in using MELA-O they had learned things about their ownclassrooms, their own teaching, and the performance of

individual students which proved useful in planning future

instruction.

2 The Massachusetts English Language Assessment - Oral Handbook

Page 15: The Massachusetts English language assessment - oral handbook

Frequent Questions:

• Why use MELA-O?

The MELA-O is an authentic assessment which produces a

rich description of a student's progress toward full English

proficiency. The information provided can be used in

planning specific learning activities which build on the

student's strengths and provide the student with

opportunities to develop the skills not yet mastered.

• Does MELA-O provide comprehensive testing for LEP

students?

No. MELA-O evaluates oral production and aural

comprehension. It does not evaluate reading and writing.

Assessments in the reading and writing of the second

language may, however, be coordinated with the results

of this oral language assessment.

• How does MELA-O fit into the decision about appropriate

program placement for an individual student?

MELA-O provides meaningful information about the

student's English speaking and listening development.

However, a great deal more information is necessary for

program placement.

• Can MELA-O be used to evaluate new students entering

the district?

No. Only trained professionals who know the student well

can produce reliable results with this assessment system.

The familiarity between the evaluator and the student is

one of the features that makes MELA-O a more -

meaningful tool for assessment. For entering students,

one of the standard tests of English oral skills still must

be used.

"Only trained

professionals who

know the student well

can produce reliable

results with this

assessment system."

The Massachusetts English Language Assessment - Oralllandbook 3

Page 16: The Massachusetts English language assessment - oral handbook

CO ^UJ ^

^•^

w 5 vu

OCJ

OCO Ujo ^C/3 <

<D

a;

-JUJ>UJ

UJ>

CO

-JUJ>UJ

eg

_iUJ>UJ

UJ>UJ

UJ>UJ

<nco

WOT

03 OT (0 5=;

-3.E o o

>. .2

OJTJ W<D (Z Z3

S oEWoo

3.Eo

'«) >\oj <o

y Eo:o w ->,

r- C ^

3-2 to

oto <i>

(O %1 c

<n

c— «

ffl «J <J

— o

<a

<D

<D

OJm-£: o

V-1 <D -J<-

52

Eooo

<T)<D > wHi wn Oo

<a

CO o

_ <0(0 OJ <DE Q-CD

CL.£ Ecxro (0to C (0

•acCO

22

'tis.

_o'(Oto

o

to

^ to oo to

l^oEJ2 c 0) o<D O CL^

c to^ (03 2.C-0

ctl)

3 c:cr (D<D.>•i= o)C <D

$ to

.2*=+r CO

«-2&_ *<

*2 to

to ©

S8.S

<DD)to

to •-> EE|5i5

tDJ3

toco

0)

2 to

£Ew8c o— o— o to _.E to Q.ti

-C <0 <0 •=

^^^^

<U 0) c-

«8«<D <D P

X® o ®

> to "> <D i_to

<D O«loIs

(0

"" <D »—

OT g (0

(0 2 to o)O Q-o <0

^ *°'^ E**- en to *=

^E^«S.2«o312 o£

<D

CO

.-CD

o tD ii'.E

to<D

E

— CO

tJ _Q© <D to-"

O CX O (D

E<«-ow^

« c

oE>.^'5° tD to o'^

•= <D B-tO 13

© Q <_. (0 <Dm c.E"oJ=

o0)o

u. to

oo(0©

<D g-tD

k. t4 ,

o OL.

fT ©C> cto

ffl

to E

to o to-^^

o 3 to " a> 9-

u:.E.E.«:2 ©

© 5to to

E <D

"* ir © C3>

O '-'-- ^~ to CO ®to c c: E"O O (0 J5

rj to o ©O 0(0*-Q-.E-£^

.*- <D

© o^co-«^00 «^:3

to ©CO ©o :fifo.^ to © g)

to E ^cnEx^wE25?to CL-^ t-•r Q.fO ©O to c w

<DtO'F O"=5 C to . .-—

O r^ E^D-^o-> O O ®

li°8E3 © c »- s§-^-2 {g 8

© 3 "(0W Q.O— —

to '"

iTJ to =J-Si o~ E «-J— --*

©

.t:'w © ©

^ P «r

ill ill©_ CL© c m^coc^ro^

500 oxE=—= O -t; ir: i--^<. O.b W Q-W

© c © ©©^ 2>

- Ec«to c 5 ®- tl

© (0 E c^A ®*S to to O >»- O)

©TDO— ©

CL^s-JO© iJ

XI

E to j3-rr x> © X .::

c ^ ® 5<2 to Jo-a.

N tO-O E ©"E E £ o o

8 ©I© 2^ © E ^ ©CC o-o t :3

©©

©^© w|£2.-2Q.TDQ.3to CO

©O D)

©^COwto©

3 £

©to

TN to ©I« *- toto 3 I-

©to wo © ^E c'^.-i-ooto c*"i_ COTJOf-©W O 3® Ew E c3 E ©to o*::Q.O o

ccCO©E

x>©00 oc©o

©c.o

o §2ZXJ Q.

CO

E-o

o >

i|1= Oto ©'

8«-®o,9-xCO ©

©©©to

JZ

c^. ©TJt,

O)t0 C £1

©=»«!

O,/»®

**- S«iOT.2o2-5 too~~51-2o « o73 O 5co^oE o ©Etz.2o o Oo P-cE o

lisX OJ3

co'lo^

x: ©^ ® *-•— Q.3© h03=

't_ O'Dn • »

^CL^ toQ.C ECOc .0 ©

= o ©© w-^

.E ^ >.

«i-^©^ oCX-t: c« 5 ©

"cO 01.E^ 2—© 0:=3:E-S5

©.>

"to

cc

. - o to© c c^w©T © t;

to >.c:

E o-Qc: © ;Q^.E

o©"O.2 >.o)ro ®.E

E -to

25e^s©

E ©.o>^o°to ^ o© c

X ©©JZ

to ^ -— © ©c: E©-"•OJQ

•2>^©©.S 3 to Oc:;= 3 E~ c D)2to— c ©-0

E'^—'S o^ © ^-^ "?«

to

EEto

t: © *-©o »- o

_ w o

o 3 w

5:^0>©<rt © 2,0© »- O) _w k c©3 8i5ffl

© ® © ©E^ES-go)^ Q.2

©© cJO O2 E ©EEc08S

©o-^

.E 2'« ©o 3

uoisuaqajdojoQ

x>©to

©co

oc©o

o ©2

T^ O-r.,

E3i28-S.®

© i»*^

p-o o

©^ pCO o 5

•^ ©.2

.2 2'-6

•^ E ©CO o o

CO ©

x> ©1*-7d11-^

©CO o

« o^ ^

^1 s^

l_ —© Cl

EEEwo>»- Eo>^*°« oSS ® w.^ t Jo

to o f= ,„

-Elo^

i^ "5 © ®

Aouanij

XI©© >^

C®00

ZXI Q.

AjBinqeooA

^ D)gci)® oE c: c cr ; •*"

©« ^^V. ®© o o 9-5.E5 2

XJ©CO o©o

o §2ZXI Q.

. to

loE

c t ^o 2 ©© D)'0

yxioXI ®XJ2-^oQ.O 5

© ©^O E©

x>©2©cO

^ EO ©Zx>

uojiBiounuoJd JBUJUJBJ9

uoipnpojcj

p ® w®^®e3«Sg»8© 00 <2w_j to«_<< © «-

© *- t:to E CX

o 3 ®

w ©Q

«--o c

E ®'to©XJ ©

2-a?>©o-^ wWc E '^

2:©-B0)T3 ©.E'Bir

>LL ©

CD ©To

CO

Page 17: The Massachusetts English language assessment - oral handbook

II. Using MELA-0

A) The Matrix

At the heart of the MELA-O assessment is a "matrix" (see page 4)

by which each student is rated in two areas: the ability to

comprehend and the ability to produce English. The

comprehension category is inclusive, wlule production is hirther

broken down into the categories of fluency, vocabulary,

pronunciation and grammar. Within each of the five areas,

students are rated on a scale of six levels of proficiency. The

scores range from 0, indicating no demonstrated ability in that

proficiency category, to 5, indicating a level of ability that is

equivalent to that of a native English speaker of the same age.

The criteria for each level are described in the matrix and were

defined to represent the wide range of possible achievement

levels. Each student will receive two composite scores, one for

English oral language comprehension and one for oral language

production, as well as individual scores for each aspect of

production. The composite score for production is derived from

the individual scores for each aspect of production.

"Each student will

receive two composite

scores, onefor English

oral language

comprehension and one

for oral language

production. . .

"

Training is required before assessing students using the MELA-Oscale. It is strongly recommended that the teacher/evaluator

observe the student for a minimum of two months prior to

beginning assessment. Level distinctions will become more

easily discernible with practice in a variety of classroom settings.

Categories and Levels are described in more detail on the

following page.

The Massachusetts English Language Assessment - Oral Handbook 5

Page 18: The Massachusetts English language assessment - oral handbook

".. .younger learners of

a second language will

generally acquire the

language without a

perceptible accent.

"

I. CATEGORY - COMPREHENSION:

Tlie overall objective in assessing the learner's comprehension of

oral language is to determine his or her level of understanding by-

observing oral and behavioral responses in the classroom setting.

The contiiiuum of "Level 0" through "Level 5" provides a logical

and measurable sequence for the teacher/evaluator observing the

learner in interpersonal and classroom interactive situations. The

descriptor "interpersonal" refers to oral exchanges on a personal

level, while the classroom descriptor refers to discussion on

educational content. The teacher-rater should assess either area

equally. "Level 1" describes a student who can comprehend only

basic English sentences and phrases. "Level 5" approximates the

comprehension level of a native English speaker of the same age.

IL CATEGORY - PRODUCTION:

1) FLUENCY: The five levels within this category focus on the

speaking fluency of the learner. "Level 1" describes the beginner

who uses single word utterances or short memorized chunks of

language. "Level 5" approxin\ates the language of a native

English speaker of the same age.

2) VOCABULARY: Command of the lexicon is sequenced over

five levels here. "Level 1" describes the beginner who may use

nouns and basic verb vocabulary, for example, but with little or

no coherence or comprehensibility. "Level 5" approximates the

vocabulary of the native English speaker of the same age.

3) PRONUNCIATION: The sound system of a student's first

language affects his or her pronunciation in the second language.

Within tliis category, "Level 1" through "Level 4" highlight the

progression of access and practice in using the second language.

"Level 5" approximates the pronunciation of the native English

speaker. The teacher-evaluator should remember that younger

learners of a second language will generally acquire the language

without a perceptible accent.

6 The Massachusetts English Language Assessment - Oral Handbook

Page 19: The Massachusetts English language assessment - oral handbook

4) GRAMMAR: As in pronunciation, the syntax and other

grammatical aspects of the first language may hinder production

in the second language. ''Level 1" through "Level 4" describe a

sequence of language acquisition behaviors with a focus on

frequency of errors. "Level 5" approximates the grammar of the

native English speaker of the same age.

B) Preparation and Observation

It is important that the teacher-evaluator become thoroughly

familiar with the matrix and its categories before making

observations. Once familiar with the matrix, the teacher should

make a series of observations over a period of time. MELA-Odepends on a natural approach to observing a student's oral

English language proficiency. In contrast to controlled or staged

observations, naturalistic observations of typical behavior are

done in the most unobtrusive manner possible.

".. .naturalistic

observations oftypical

behavior are done in

the most unobtrusive

manner possible."

Teachers do not need to create special activities for the purpose of

assessment. In contrast to an oral examination with set questions

and time frame, MELA-O requires the observer to look at the

students' typical oral English as it is used ia daily communication

in the classroom or other school settings. Although it may be

advisable to create situations in which students have ample

opportunity to speak and listen, no situations should be contrived

solely for the purpose of assessment. The observations aye based

on the everyday use of language by the students as they interact

with their peers and with their teachers. These observations

should be made during class time or other normal activities

which form part of the school day. ESL classes in themselves

should provide sufficient interactive oral English activities for

such observations.

The Massachusetts English Language Assessment - Oral Handbook 7

Page 20: The Massachusetts English language assessment - oral handbook

C) Interpreting MELA-O Results

"MELA-O provides

teachers with a rich

contextual description

of a student's

performance. . .

"

The purpose of MELA-O is to obtain a meaningful indication of a

student's oral English proficiency. The traditional labels such as

No English Proficiency, Limited English Proficiency, and Full

English Proficiency have little meaning to teachers or parents and

have little impact on the activities that take place in the classroom.

MELA-O provides teachers with a rich contextual description of a

student's performance and allows the teacher to identify areas in

which individuals and groups of students need improvement.

These descriptions will help teachers to plan activities that will

address student needs within their classrooms. The MELA-Oassessment, kept as a part of the student's record, will provide

future teachers with a valuable view of oral proficiency.

Frequent Questions

• In what types of settings are students observed? Can

MELA-O rate oral proficiency in interpersonal situations as

well as in academic discussions?

Students are observed at any time and in a variety of

settings, instructional as well as conversational, during

regular interaction with peers, teachers and other adults.

• Are situations and activities contrived by the teacher for the

sake of the MELA-O observation?

No. The teacher should observe the student's interaction

with English-speaking adults and peers. The process

assures ample opportunity for students to interact in the

normal classroom routine.

8 The Massachusetts English Language Assessment - Oral Handbook

Page 21: The Massachusetts English language assessment - oral handbook

• How many times does a teacher have to observe each child

to get a good sense of the student's oral proficiency before

assigning a score?

Holistic observation requires multiple evaluations of a

student's oral proficiency in both formal and informal

settings. For new students, we recommend a two-month

observation period before assignment of assessment ratings.

• What score does a teacher assign a student who falls

between two categories in the matrix?

A category rating indicates full mastery of all aspects of

that category. If they have not yet achieved full mastery,

the lower rating should be assigned.

• What score does a teacher assign to a student who gives an

appropriate, but non-verbal response?

Non-verbal responses are scored within the

comprehension category.

• What about a studentwho responds to a statement in a

language other than English?

English production has not been demonstrated. It may be

that English comprehension is demonstrated.

• How can reliability be assured when two people assess the

same student?

"A category rating

indicatesfull mastery

of all aspects ofthat

category."

Consistent, well-planned and well-structured training is

the key to ensuring reliability among various evaluators.

Training should be ongoing and teachers working with

the same students should be given an opportunity to

compare and critique their ratings of each student. As

with any instrument, reliability is obtained with training

and practice.

The Massachusetts English Language-Assessment - Oral Handbook 9

Page 22: The Massachusetts English language assessment - oral handbook

Who rates the students?

"MELA-O should he

administered by a

person with sufficient

proficiency in English

to make reliable

judgments."

Only people who have received training in the

administration of MELA-O and have had an opportunity

to observe the students for a sufficient period of time

during the year.

What training is necessary?

The training should focus ore

• purpose of the instrument

• understanding each category in the matrix

• rating of oral language production in a natural and

classroom setting

• understanding of second language acquisition and oral

language development states

• interpretation of results and v^ays to improve

instructional plans to enhance students' progress

MELA-O should be administered by a person with

sufficient proficiency in English to make reliable

judgments. Teacher-evaluators should also have a

fundamental knowledge of the theories of second

language acquisition.

Below are real examples of assessments conducted during the

MELA-O pilot study.

10 The Massachusetts English Language Assessment - Oral Handbook

Page 23: The Massachusetts English language assessment - oral handbook

III. EXAMPLES

Student One - Second Grader

Rating:

Con\prehension - 5

Production - Fluency: 5

Vocabulary: 4

Pronunciation: 5

Grammar: 5

Teacher Description: ''This student's comprehension most

resembles a native speaker and she comprehends everything,

including content. There are no lapses in her fluency and the

student speaks to n\e in English, knowing that I am a native

English speaker. She may search for a word or expression;

however, she is not often interrupted by searching for language.

There is a slight hesitation on idioms and vocabulary. Her

pronunciation and grammar are perfect."

Composite production

score would he "4"

because the student

has one area

(vocabulary) which is

not yet at

the level ofa native

English speaker ofthe

same age.

The Massachusetts English Language Assessment - Oral Handbook 11

Page 24: The Massachusetts English language assessment - oral handbook

Composite production

score would be "1

"

since the student is

beyond no proficiency

and the teacher has

"reason to believe she

can speak more.

Student Two - Fifth Grader

Rating:

Comprehension - 2

Production Fluency: 1

Vocabulary: 1

Pronunciation: 1

Grammar:

Composite production

score would be "4"

in this case, making

a holisticjudgement

from the individual

scores is easy.

Teacher Description: "I give this student a 2 (in comprehension),

not because of her language but because she doesn't speak at all

(if the student did, the teacher might be able to know more). The

student uses single word utterances because she is shy, but she

still hasn't shown her potential. I have reason to believe she can

speak more, but she hasn't shown it. If I make her speak, she says

one word but comprehensibility is seldom good. She doesn't

speak sentences so her pronunciation has to be 1. I can't grade

grammar because she uses no word order."

Student Three: Fifth grader

Rating:

Comprehension - 4

Production - Fluency: 4

Vocabulary: 4

Pronunciation: 4

Grammar: 4

Teacher Description: "The student understands all the sodal

directions but not all academic content. The student produces

very well but there is still a lot of depth in the academic content

which the student cannot reach (in discussion). He does not use

many liigh-level vocabulary words but he has a good vocabulary.

There is slight influence from the primary language of this child

in speech, but it is very easy to understand him and he is close to

a 5. In the student's grammar, sophistication is missing but

mistakes do not obscure meaning and he is not often inaccurate."

12 The Massachusetts English Language Assessment - Oral Handbook

Page 25: The Massachusetts English language assessment - oral handbook

IV. Suggested Practices for Oral LanguageDevelopment

As discussed above, MELA-O invites teachers to evaluate and

strengthen their own classroom strategies and approaches in

developing their students' oral language proficiency. Classrooms

that are student-centered, where students do most of the talking,

are more effective in encouraging oral language development.

This list of activities is therefore intended to serve as a starting

point for teachers who find they must include more speaking

activities in their classrooms.

The following suggested activities for oral language development

should be considered in the context of whole language

approaches to the teaching and learning of a second language.

Most of these activities can be easily and productively combined

with reading and writing activities. They can be adapted for use

across level and across grade.

1. Storytelling - fictional or true

2. Role-playing

3. Games

4. Interviews

5. Debates

6. Drama

7. Show and tell

8. Peer-tutoring

9. Reading followed by discussion

10. Writing followed by discussion

The Massachusetts English Language Assesstnent - Oral Handbook 13

Page 26: The Massachusetts English language assessment - oral handbook

11. Jigsaw: For example: determine the most economical

supermarket in the neighborhood. To do this, prices for selected

items must be obtained by different students. Each member of

the group is given the chief responsibility for a specific portion of

the learning task. Thus, the task cannot be successfully completed

without the participation of each member of the group.

12. Cooperative projects: The members of the group work

together to complete a group project, such as an oral presentation.

Each member of the group receives a grade based on the

evaluation of the group project.

13. Problem-posing: Discussion leading to the identification of a

problem, usually social, which is important to the students

involved, and a subsequent discussion of possible solutions to the

problem. The three major components are listening, dialogue,

and action.

Guidelines for small-group work

a. Keep group membership the same for a while - don't change

group membership every time you do group work.

b. Give the group a specific task - don't just say "Discuss..." or

"Talk about."

c. Discuss or model roles of group members before breaking

into groups; this helps ensure more equitable group participation.

d. Group work should be concluded by a follow-up activity,

during which the group reports, in either oral or written form,

on its work.

14 The Massachusetts English Language Assessrnent - Oral Handbook

Page 27: The Massachusetts English language assessment - oral handbook

Suggested Reading

Teachers are encouraged to consult the following references for

more ideas and information about strategies for developing oral

language:

Cant Stop Talking

George Rooks. Rowley, MA: Newbury House, 1983.

ESLfor Action: Problem-Posing at Work

Elsa Auerbach and Nina Walter. Reading, MA: Addison-Wesley

Pub., 1987.

Fact to Face: Communication, Culture, and Collaboration

Virginia V. Zanger. Boston, Heinle & Heinle, 1993.

Making it Happen: Interacting in the Second Language Classroom

Patricia Richard-Amato. New York: Lorgman Inc., 1988.

The Natural Approach - Language Acquisition in the Classroom

Stephen D. Krashen and Tracy D. Terrell. New York: Pergamon

Press, 1983.

The Massachusetts English Language Assessment - Oral Handbook 15

Page 28: The Massachusetts English language assessment - oral handbook