20
The Japan Language Testing Association NII-Electronic Library Service The Japan Language Testing Assooiation Predicting SpeakingAbility From Vocabulary Know edge 知識 によ能力 能性 Rie KOIZUMI 利恵Doctoral Course University () f Tsukuba 筑波 学院 課程 本研 究 本人 英語 初級 者 中学 3 1 年生 を対象と a 知識 話す際 運用 関係 b 能力 発表知識 c 能力 語彙 知識 を使 能力 が可 かに 調 た。 結果、発表語 知識 は 能力 影響 与え グ能 力 は 話 す 際 運用 える れた 能力 半分 発表 知識 予測 可能 あ り、 また グ能力 5 1 は語知識 を使 う能 力 によ 1 1 t oduction Vbcabularyhas long been regarded as a vital component of communica ve languageability e g Bachman Palmer 1996 p 68 Caol1 1968 pp 54 55 Since communicative l guage ability includes speaking ability vocabulary owledge plays an integral role in spe dng a language e g Higgs Cli brd 1982 Levelt 1993 However there havebeenfew studies that examine the degree to which vocabulary knowledge affects speakdng ability Noro Shimamoto 2003 p 41 and 血e degreeto which vocabulary knowledge contributes to predicting speaking ability Therefbre this paper mainly aims to investigate the relationship between speaking abi ity amd vocabulary and to examine how rnuch productive vocabulary knowledge can predict speaking abMty The participants of this study are JapanesebeginnerleveI leanlers of English Naturally itis unreasonable to assume that vocabulary knowledge can predict all speakdng ability since many other components apart from vocabUlary knowledge are likely toexist so vocabUlary knowledge tests are not enough to assess speaking ability and speaking tests always seem to be indispensable However the reason this research is administered is that infbmlation on the strength of impact and on the degree Qf predictabihty can helpunderstand the importance of vocabulary in speaking ability as wen as provide the basisfbran empirical model of speaking ability and for rationales of language teaching and assessment 2 Literature Review 2 1Re ationship BetweenSpeakingAbility and Vocabulary at a Begjnner Level There is a theoretical and empirical background to the relationship between 1 N 工工 Eleotronio Library

Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The  Japan  Language  Testing  Assooiation

Predicting Speaking Ability From Vocabulary Know 且edge

  「語彙知識によるス ピー キ ン グ能力の 予測可能性」

           Rie KOIZUMI (小 泉利恵)

Doctoral・Course, University()f Tsukuba(筑波大 学 大学院博士 課程)

                      要 旨

 本研 究は 日本 人の 英語 初級者 (中学 3 年 ・高校 1 年生)を対 象 と し、(a)ス ピ

ーキ ン グ能力 と語 彙 (発表 語 彙知識 ・話す際 の 語彙運用)の 関係 と 、 (b)ス ピー

キ ン グ能力は 「発表語彙知識」 に よ っ て どの 程度予測が可能か 、 (c)ス ピー キ

ン グ能力は 「語彙知識 を使 う能力」 に よ っ て どの 程 度予測が 可 能か に つ い て調

べ た。 そ の 結果 、発表語 彙知識 はス ピーキ ン グ能力 に強い 影響 を与え 、ス ピ

キン グ能力 は話す 際の 語 彙運用に 強い 影響を 与え る こ とが示 され た 。ス ピ

ーキ

ン グ能力の 半分以上 は発表語 彙知識 に よっ て 予測 が 可能 で あ り、ま た ス ピー キ

ン グ能力 の 約 5分の 1 は語彙知識 を使 う能力 に よ っ て 予測が可能で あ っ た 。

                   1。1皿t「oduction

   Vbcabulary has  long been regarded  as  a vital component  of communica 口ve

language ability (e.g., Bachman & Palmer,1996, p,68; Ca∬ ol1,1968, pp.54

−55).

Since  communicative   l跏 guage  ability   includes  speaking   ability ,  vocabulary

  owledge  plays an  integral role in spe 田dng  a language (e .g。, Higgs & Cli丘brd,1982 ;

Levelt,1993). However, there have been few studies  that examine  the degree to which

vocabulary  knowledge affects speakdng  ability (Noro & Shimamoto,2003,p」 41)and

血e degree to which  vocabulary  knowledge contributes  to predicting speaking  ability.

Therefbre, this paper mainly  aims  to investigate the relationship between speaking

abi 正ity− amd  vocabulary  and  to examine  how  rnuch  productive vocabulary  knowledge

can  predict speaking  abMty . The participants of this study  are  Japanese beginner leveI

leanlers of English.

   Naturally,.it is unreasonable  to assume  that vocabulary  knowledge can  predict all

speakdng  ability since many  other components  apart  from vocabUlary  knowledge are

likely to exist, so vocabUlary  knowledge tests are  not  enough  to assess speaking  ability,

and  speaking  tests always  seem  to be indispensable. However, the reason  this research

is administered  is that infbmlation on  the strength of  impact  and  on  the degree Qf

predictabihty can  help understand  the importance of  vocabulary  in speaking  ability , as

wen  as provide the basis fbr an empirical  model  of  speaking  ability  and  for rationales

of  language teaching  and  assessment .

                  2.Literature Review

2.1Re 且ationship  Between Speaking Ability and  Vocabulary at a Begjnner Level

   There  is  a theoretical  and  empirical   background   to .the relationship   between

一 1 一

N 工工一Eleotronio  Library  

Page 2: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The JapanLanguageTesting Association

speaking and vocabulary. In the theoretical model'of Ll and L2 speaking (de Bot,1992; Leyelt, 1989, 1993), vocabulary has a central position in fbrming an utterance

with appropriate meanings and with syntactic, merphological, and phonological

structures. Levelt's model of the speaking process is one of ,the most influential from a

psycholinguistic perspective. Although Levelt's model was developed in order to

explain monolingual Ll speaking mechanisms without plaiming time, it has also been

used for L2 learners (e.g., de Bot, 1992; DOrnyei & Kormos, 1998) with some

modification when necessary, In this model, there are three stages of speech

production: (a) conceptualization (i.e., forming messages), (b) formulation (i.e., putting

the messages in a form of language), and (c) articulation (pTonouncing the form and

expressing the messages). in the formulation stage, the lexicon, which contains all the

inforrnation related to vocabulary, plays a crucial part. After rnessages are forrned,

words are searched for from a part of the lexicon and grarnmatical structures are

derived accordingly. Then morphological and phonological information is added by

using another part of the lexicon, Levelt's model suggests that yocabulary is always

required in the formulation stage and that no speech can be produced without

vo ¢ abulary. Additionally, the role of vocabulary seems rnuch greater among begiming

level learners because they tend to lack the minimum vocabulary needed.

ln addition to the theoretical importance, 'several

empirical studies have

consistently suggested that there is a substantial relationship between speaking ability

and vocabulary, especially at the beginner level (Adams, 1980; Higgs & Clifford,

1982; Ishizuka, 2000; Koizumi & Kurizaki, 2002; Takiguchi, 2003). Adams (1980)examined speaking factors that separate neighboring level groups using discriminant

analysis among workers in foreign affairs and their famiIies. It was fbund that

vocabulary is the only factor of level change from O+ to 1 on the Foreign Servicg

institute (FSI) rating scale (i.e., frorn Novice High to lntermediate Low and

intermediate Atfid on the ACTFL [American Coun¢il on the 'Ibaching

of Foreign

Languages] rating scale, Fulcher, 2003, p. 15). Although Adam's study has often been

cited (e.g., Fulcher, 2003, p. 183), the number of participants was small at the lower

levels (n = 7 fbr Novice Low to Novice High, p. 2), so precautions should be taken

when one interprets his results.

Based on Adams (1980), Higgs and CliffOrd (1982) made a rnodel of the relative

iMportance of various elements (i.e., yocabulary, grammar, pronunciation, fluency, and

sociolinguistics) to overall ability. in order to validate the model, they asked 50

teachers for their opinions on how each element affects speaking proficiency at each

proficiency level. Higgs and Cliffbrd showed that their model is similar to the teachers'

perceptions and that vocabulary contributes the most to speaking proficiency at a

beginner level. One problem conceming their study is that they only examined the

teaehers' perceptions instead of having teachers rate learners' utterances from

interviews (Magnan, 1988, p. 274).

-2-

Page 3: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The JapanLanguageTesting Association

Koizumi and Kurizaki (2002) found strong associations between speaking test

scores arid the pumber of words uttered on the speaking test (ry = .69- .80, n = 76, p.

24). ln their studM there is a question of whether their speaking test scores refiected

overal1 speaking ability

Talciguchi (2oo3) conducted principal component analysis using holistic speaking

scores based on ACTFL Proficieney Guidelines (Fulcher, 2003, pp. 233-238) and

speaking perfbrmanee measures. As a result, the holistic scores and the number of

words uttered for one minute loaded on the same factor (p. 50), which suggests a

strong association between speaking ability and vocabulary. Since Takiguchi's

participants were srnal1 in number (n = 17) as was the case with Adams (1980), the

result needs to be interpreted with caution.

ln Ishizuka (2000), there was a moderate correlation (r = .43, n = 26, pp. 15-18)

between (a) vocabulary depth tests based on Read (1993) and (b) interview tests of the

Society for 'I;esting

English Proficiency kst in Practical English Proficiency (STEP[fest; Eiken, 2003). It seems that Ishizuka failed to report enough infbrrnation on the

validity of the test used (see also Read, 2000, pp. 183-184, for the validity issue

conceming the depth test). As such, the relationship between vocabulary depth and

speaking ability seems to be less conclusive in his research.

in summary, vocabulary seems to relate to speaking ability substantially and to be

probably the strongest of many speaking ability components (e.g., pronunciation and

fluency) at the begirmer level, although each study has its own weakness. It is also

interesting to review the studies above with special fOcus on the aspects of vocabulary

they targeted. The four studies (Adams, 1980; Higgs & Clifford, 1982; Koizumi &

Kurizaki, 2002; Takiguchi, 2003) dealt with a relationship between (a) speaking ability

and (b) vocabulary used in speaking perfbTmance (vocabulary performance), and the

degree of associations were rather strong. On the other hand, Ishizuka (2000) examined

an association between (a) speaking ability and (c) vocabulary stored as knowledge

(vocabular y knowlecige), showing a moderate relationship. Therefore, the results above

can lead to the following hypothesis: The relationship between speaking ability and

vocabulary perfOrmance is stronger than the one between speaking ability and

vocabulary knowledge.

Moreover, vocabulary knowledge is often separated into receptive and productive

knowledge (e.g., Read, 2000, p. 154). Receptive knowledge is the knowledge to

understand a word, which is often used in listening and reading, whereas productiveknowledge is the knowledge to produce a word when one speaks and writes (Schmitt,2000, p. 4). Ishizuka's (2ooO) vocabulary depth can be categorized into receptiye

vocabulary knowledge since words were provided and test takers selected the right

words in the test. ln relation to speaking, productive vocabulary knowledge seerns to

affect speaking ability more than receptive vocabulary knowledge does.

-3-

Page 4: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The JapanLanguageTesting Association

22 Purposes of the Current Study

The present research has three purposes: (a) to examine the extent of the-

relationship between speaking ability and two types of vocabulary (i.e., productiveyocabulary knowledge and vocabulary perfbrmance), (b) to inyestigate to what extent

productive vocabulary knowledge can predict speaking ability, and (c) to explore how

much the ability to use vocabulary knoWiedge is involved in speaking ability. The

participants of this study are Japanese beginner level learners of English. One

hypothesis and two research questions were addressed as follows:

Hypothesis: The relationship between speaking ability and vocabulary perforrnance is

stronger than the one between speaking abiiity and productive vocabulary

knowledge (VK).Research question 1: How much can speaking ability be predicted by vocabulary

knowledge? .

Research question 2: How much can speaking ability be predicted by the ability to use

vocabulary knowledge?

The hypothesis and research questions correspond to the three purposes of the present

paper, It was rnade based on the previous studies and tested in a confirmatory way. To

the author's knowledge, the degree to which speaking abMty can be predicted has yetto be examined, so research questions, not hypotheses, were posed.

2.3 Definitions of Key Tlerrns

Speaking ability is defined as the ability to preduce rule-based expressions as

well as formplaic phrases gSkehan. 1998). The range of ability covers only

school-based proficiency (Shohamy, 1992), which refers to the proficiency in which

vocabulary, structures, functions, and contexts are limited to what has been learned at

school, Proficiency is viewed as communicative language ability in Bachman and

Palmer (1996), which is composed of (a) language knowledge, including vocabularyknowledge, apd (b) ability to use the language knowledge (McNamara, 1996).

While vocabulary knowledge consists of various aspects (Nation, 2001, p. 27),

this study focuses only on the knowledge of written foTm and meaning at one-word

level, which is often called vocabulary size (see Koizumi, 2003b, p. 27, for detailedconstruct definitien). It is worth noting that productive vocabulary knowledge defined

here deal with written aspects, not spoken ones, because vocabulary knowledge needed

to be conceptualized as more independent from speaking ability since speaking ability

includes vocabulary knowledge theoretically.

In order to reflect vocabutary used in speaking perzformance (vocabutary

peifbrmance), the nurnber of words uttered during speaking tasks was used based on

Koizumi and Kurizaki (2002) and Takiguchi (2003).

-4-

Page 5: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The JapanLanguageTesting Association

3. Method

3.1 Participants

The participants in this research were 172 Japanese beginner level leamers from

the ages of 14 to 16, who had studied English as a foreign language fbr approximately

two or three years at school. They included third-year students at two public juniorhigh schools (n = 149) and first-year students at a prefectural senior high schoel (SHS;n = 18) and at an SHS aff/iliated .with a national university (n = 5). The participants'

speaking levels were from "less than Smattering" to

"Waystage

Plus or above" levelsi

(Koizumi, 2004a).

3.2 Materials

The two tests (a speaking test and a productive vocabulary knowledge test) were

used.2

3.2.1 Speaking 'Ilest

The speaking test was designed to assess the school-based speaking proficiency

(ShohamM 1992) of Japanese junior high school students, especially accuracy and

fluency in language competence and apprepriacy in pragmatic knowledge in Pulcher's

(2003) frarnework (p. 48). It was a face-to-face oral interview, and the speaking tasks

were created based on the contexts and functions listed in the Course of Study

(Ministry of Education, 1989, 1999) as well as North (2000). The test was composed

of three monologic tasks ([fasks 1, 4, and 5) and two interactive tasks (scripted role

plays; lhsks 2 and 3; see [fable 1). Of the five tasks, only 'Ihsk

4 provided planningtime, and this lasted one minute. The participants were not inforrned about the content

or structure of the test befbrehand. ln order to exclude the effbct of listening ability on

utterances, Japanese meanings were presented to a test taker when he or she had

dithculty in comprehendmg the interviewer.

Four analytic rating scales were developed with fbur levels (O to 3): (a) Tliskfulfillment (for Thsks 2 and 3), (b) Vbcabulary

"Ylolume,

(c) Accuracy (includingAppropriateness), and (d) Huency ((b), (c), & (d) fbr Tasks 1, 4, and 5). Koizumi

(2004a) showed some aspects of positiye validity evidence for the speaking test and

there were no misfitting or overfitting tasks in Rasch analysis.

3.2.2 Productive Vbcabulary Knowledge [Ibst

The productive vocabulary knowledge -test (VKT) was designed to assess

productive vocabulary knowledge (aspects of vocabulary size) fbr Japanese beginner

level learners of English (see Tabte 2). It was adapted from'the 1,OOO to 3,OOO word

frequency sections in the second -version of a Vbcabulary Size 'P:st

fbr Japanese

Learners of English (Mochizuki, 1998). In scoring the productive VKT, one point was

-5-

Page 6: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The JapanLanguageTesting Association

Table 1 Examples ofthe speaking 7lest 7lrsks (All written in Japanese)7bsk 1 Please introduce yourself for 90 seconds, Please talk about many things.

When you have finished reading, please raise your head (i.e., no planning time, the

same as in 'fasks

3 and 5). 11rrlbpic Exarnples: name, grade, school, fayorites, family, and friends7lask 2 Ybu are talking with your friend, Express what you're talking about as shown

in the picture (see Koizumi, 2003a, fbr a picture). Elicited sentences: I want to go to

Maru a to bu a bookJGoodb e.fHetlo,IVP'hat time is it now.2/I am sor ,

7Zisk 3 Ybu are a reporter for your school newspaper. YOu are going to interview a boy

who transferred from another school last week, and then write a report. Look at your notes and ask him questions about himself. The teacher in front of you will play the role of the new student.

'slrNotes:

Things to ask the boy (l)Do you like this school.7

@W7;ere do you live now,7 @Where did you live befbre?7bsk 4 -T}311 me about your favorite singer, TV programs, or animal for 90 seconds.

YOu have one minute to prepare. IfrExarnple: reasons, how popular they are7Lisk 5 Ybur brother is mischievous. While you were at school, he scattered your things about your room. When you scolded him about it, he said,

"nothing has

changed at al1." Tbll him how the room has changed by comparing how it was befbre

with how it is now. Ybu have 90 seconds tos eak. (see Koizumi, 2003a, for ictures)

given when a meaning and a written fOrm matched exactly.

After Rasch analysis, some misfitting and overfiuing iterns were excluded (see[fable 2 for the number of rernaining items). Koizumi (2003b) examined sorne aspects

of yalidity of inferences and uses of the two tests and obtained favorable results.

Table 2 Examples ofthe Productive ltbcabulary Knowledge 7lest

(a) Productive ltbcabuiary Knowledge 7lest (originally 40 items; 30 items remained) Write the English word that best corresponds to the Japanese meaning on your answer

sheet. The first letter of the English word is already given. Write as much of the word

as possible even if you are unsure about the exact answer.

1. Sft (1 )[Answer:lunch] 34. =L!7FV (c- [chicken]

3.3 Procedures and Analyses

The students took the two tests in July of 2002. The speaking test was conducted

after schoel, whereas the two vocabulary knowledge tests were administered in Englishclasses except at the prefectural high school, where it was conducted after school. in

administering the 15-minute speaking test, 11 Japanese interviewers with sufficient

English speaking ability participated after attending a practice session to learn the

interview procedures. The interviewers rnoved to the next section when there was a

silence for at least 15 seconds, in order to avoid pressuring the students. During the

speaking test, al1 the utterances were tape-recorded. As for the productive VKT, a

maximum of 45 minutes was provided by which time al1 students said that they had

-6-

Page 7: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The JapanLanguageTesting Association

finished the tests.

Tlasks 2 and 3 on the speaking test were scored by three trained raters by listening

to the tapes while looking at the transcription. For Thsks, 1, 4, and 5 on the speaking

test, utterances were scored by a rater based on transcribed and quantified results,

which were checked by three trained raters. The answers on the productive VKT were

scored by two trained raters. Both for the speaking test and productive VK[I; the

interrater reliability was very high (Both 1.00 in Rasch analysis). The data of the two

tests were analyzed separately using EACETS for Windows 3.45.2 (Linacre, 1991),

which implements the multi-faceted Rasch measurement model. Each of the logit

ability scores derived was considered to reflect a student's speaking ability and

productive vocabulary knowledge.

The number of words uttered during speaking tasks, which is a reflection of

vocabulary perforrTiance, was counted only on the three tasks that elicited extendedspeech (i.e., Tasks 1, 4, and 5) and the values were averaged to remove the effects of

tasks. Although the three measures (i.e., the nurnber of unpruned token, pruned token,

and word types) were originally considered,. only the number of word types (Type, r

hereafter) was selected fbr subsequent analysis. This was because three measures were

highly correlated (r = .91- .99) and because the relationship arnong them was strong

enough to raise the question of multicollinearity (Tabachnick & Fidell, 2001, p. 84),with which two of the three variables needed to be removed. Types were counted based

on lemma as in Daller, van Hout, and Treffers-Daller (2003). That is, base fOnn and

inflected forms were considered to be the same type. For example, the following were

considered to one type: p4ay, plays, playing; be, is, am, are, was, wene, been; 7bro.

7laro's.

in order to investigate Research question 2, five speaking pei[fbrmance measures

of lexical complexity were utilized (see fable 3). These measures were deemed to

indicate the existence of the ability to produce utterances with lexical complexity and,

by extension, the ability to use vocabulary knowledge to produce such utterances. The

measures were computed using utterances from three tasks combined (i.e., an average

of the results of 'fasks

1, 4, and 5).

The definitions of Iexical words and gramrnatical words were based on

O'Loughlin (2001) with minor modifications (see Koizumi, 2004b for details). Lexical

words were content words and gramrnatical words were function words (e.g., all forms

of be, db, have and auxiliaries). The judgment of Iexical and grammatical words from

all the three tasks was conducted by the author and another rater who were majoring in

applied linguistics. The interrater reliability was very high (r = .99, p < .Ol). When

there were disagreements, they discussed and carne to an agreement, which was

utilized as the final coding.

Hypothesis and Resegrch question 1 were answered using path analysis by

utilizing SPSS 10.0 E and Amos 4.02. Research question 2 was solyed using multiple

-7-

Page 8: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The JapanLanguageTesting Association

regression analysis. An alpha level of .05 was used for al1 statistical tests.

Table 3 Five Speaking Peiformance Measures ofLexical Comptexit),

(LC 1) No. of different word types divided by No. of words; i.e., type token ratio)

[Code: Typelroken]

(LC2) No. of different word types divided by the square root of No. of words

[TypelV-[Ibken](LC3) No. of lexical words per word [Lexical wordsllbken]

(LC4) No. of sophisticated lexical words and No. of basic (i.e., non-sophisticated)

lexical words given half the weight divided by No. of words (Weighted lexical

density) [{Sophistcated words + O.5 ' Basic words}IIbken]

(LC5)No.ofso histicatedwordt es erword[So histicatedwordt esllbken]

Alote. See Daller, van Hout, & Treffers-Daller (2003) fbr LCI, LC2, and LC5 and

O'Loughlin (2001) for LC3 and LC4. Sophisticated words = words not in the list of

1250 words in the JACET List of 8000 Basic Wbrds [JACET Basic Word Revision

Committee, 2003] with proper nouns and Japanese words excluded. JACET 8000

LeveE Marker (Shimizu, 2004) was used fbr coding.

4. Results and Discussion

4.1 Before Constructing Models

Missing data, which can be considered missing completely at random ('Ibyoda,

2003, p. 107), were excluded (n = 28), and as a result, 144 students rernained.

As seen in Table 4, the internal consistency estimates were high on the two tests.

in the initial analysis, two assumptions about using structural equation modeling were

examined: univariate norrnality and multivariate norrnality (Kunnan, 1998, p. 313). As

for univariate normality, a value of kurtosis was rather 1arge <more than 1 ± 21; Kunnan,

p. 313) on Type, However, the histogram fOr Type was near to normal distributions.

Tbble4 DescriptiveStatisticsfortheThreeMeasures

Measure MSD Min Max Skew Kurt a

Speaking Testa (Speaking Ability)PToductive VKTa (Productive VK)

T e(Vbcabular PerfOrmance)

O.02 O.98 -2.30 3.78 O.45 1.21 .86

-1.71 2.22 -7.97 5.76 O.06 1.49 .91

.11.27 8.52 O.OO 42.67 1.38 2.04

Note. n = 144. Min = Minimum; Max = Maximum; Skew = Skewness; Kurt = Kurtosis."the

results of logit scores except for the Cronbach's alpha (ct), which was calculated

using raw scores (The averaged scores of the raters were used). O = interpretation of

the measures; VKT = Vbcabulary Knowledge 'Ibst.

Next, Mahalanobis Distance was utilized in order to detect multivariate outliers,

which are related to multivariate normality. Five cases (students with x 2 of more than

18.47, cij' = 4, p < .OOI, Tabachnick & Fidell, 2001, p. 93) were deleted until no others

showed the extrerne values.3 Befbre removal, rnultivariate normality values in the

-8-

NII-Electronic Mbrary

Page 9: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The JapanLanguageTesting Association

Amos output were 21.22, but after deletion, the value decreased to 2.78. Although both

figures were high enough to be significant, showing multivariate non-normality, the

value after exclusion became much closer to norrriality, which led to the decision that

this data of 139 students (i.e., 144 - 5) would be used for subsequent analysis (seeAppendix A, for means, SDs, and correlations, n = 139).

4.2 Model of Speaking Abi]ity and Vbcabulary

ln order to make a model explaining the relationships between speaking abilitY,

vocabulary knowledge, and vocabulary perfOrmance, one path model (Model 1) was

drawn. It should be noted that, as in Figure 1, there are theoretical directions where

productive vocabulary knowledge affects speaking ability, which infiuences

vecabulary performance, but not the other way around.

FigureI. Model1(StandardizedSolution;n=139)

in the path model (see Figure 1), rectangles show measured (observed) variables,

which can be assessed directly. Circles represent measurement errors. One-way arrows

represent a direct impact, and the numbers beside them are path coefficients, indicating

the degree.of impact. The coefficients range from -1.00

to 1.00 in the standardized

solution. For model estimation, a maximum likelihood method was us ¢ d. As shown in

Table 5, Model 1 fit the data well. All the coefficients of the regression weights and

correlations were significant.

In order to investigate whether there are significant differences in strengths

between the effect of productive vocabulary knowledge on speaking ability and the

effect of speaking ability on vocabulary performance in eaeh task, the following two

procedures were followed. First, a model was made with two path coefficients in focus

fixed to the same value (see Figure 2). Then, four types of fit indices that can be used

for inodel comparison when the degrees of freedom are different CIbyoda, 2003, p. 127,

225) were utilized for a comparison between the constrained (AB fixed) model and

Model 1. FirstlM Parsimony adjustment Comparative Fit lndex (PCFD showed that the

fixed model was a little better than Model 1 (see Table 5). Secondly, Root Mean

-9-

Page 10: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The JapanLanguageTesting Association

Square Error of Approximation (RMSEA) dernonstrated that Model 1 was better than

the AB fixed modei. Thirdly, Browne-Cudeck Criterion (BCC)4 indicated that Model 1

was betteT than the AB fixed model. Fourthly, the x 2 difference test (Tletbachnick &

Fidell, 2001, p. 703) suggested that Model 1 was significantly better than the AB fixed

model.

Figure2, CodingofPathCoefficients

Table5・ FitStatisticsforModels 2 X(d

,x21dy'

CFIPCFIRMSEA(909t6CI)BCC

x2difference

(dCriteria >,05 <2.0 >.90 Hi her< O.05Lower

Model1 O.72 O,72

(1), .40

1.00 .33 .oo(.OO-.21)17.20

ABFixed 136.89 68.44

(2), .OO

.50 .34 .70 151.31

(.60- .80)

136.17** (1)

Note. n = 139. PCFI = Parsimony adjustment Comparative Fit lndex; RMSEA = Root

Mean Square Error of Approximation; CI = Confidence interval; BCC =

Browne-Cudeck Criterion; See Arbuckle & Wothke (1995) for the criteria; Higher =

The higher, the better. **p

< .Ol .

When a model is better thaii another model, it indicates that the condition (i.e.,fixed or non-fixed) in the better model is preferable and that the path coefficients at

issue are either different or the same across the models. The results in the four indices

did not always agree (i.e., PCFI: A= B; RMSEA, BCC, and x2difference test: A ;

B). However, eonsistent results arrived at by three indices were as follows: A iE B.

Therefore, Hypothesis (i.e., "lhe

relationship between speaking ability and vocabulary

performance is stronger than the one between speaking ability and productive

vocabulary knowledge.") was supported.

A point to be noted is that although the comparison between Model 1 and the

fixed model was conducted for hypothesis testing, the model accepted in this study was

Model 1 because the fixed model was not based on the previous literature. Moreover,

-10-

Page 11: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The JapanLanguageTesting Association

one thing to be kept in mind in interpreting these results is that results of one-way

arrows showing a direct impact do not guarantee that there are causal relationships, and

that other types of evidence are needed to clairn causality (e.g., Maeda, 2004). ln this

research, causal relationships were stated for the fo11owing two reasons in addition to

the results of path analysis. First, theoretically, productive vocabulary knowledge can

be deemed to affect speaking abilitM which influences yocabulary perfb'rmance.

Second, in terms of test administration, the opposite causal direction of speaking

ability affecting productive vocabuiary knowledge is unlikely because about three

quarters of the students took the productive VKT before the speaking test whereas the

rest took the speaking test before the productive VKT.

Model 1 shows that productive vocabulary knowledge influenced speaking ability

strongly (.78) and that speaking ability afiiected vocabulary perforrnance strongly (.81).The impact of speaking ability on vocabulary perfbrrnance was stronger than the

impact of productiye vocabulary knowledge on speaking ability. Moreover, productive

vocabulary knowledge had a substantial influence on vocabulary perfOrrTiance (.63[= .78* .81]).

Conceming the impact of productive vocabulary knowledge on speaking ability,

it was found that if students have such knowledge, it is likely that they have high

speaking ability to a large extent. Ishizuka (20oo) found a moderate effect of receptive

vocabulary depth on speaking abili.ty (r = .43), whereas the current study dealt with

productive yocabulary size and fbund a stronger effect. It seems that productive

vocabulary size affects speaking ability more than receptive vocabulary depth does

among beginning leamers.

With respect to the effect of speaking abMty on yocabulary performance, the

results indicate that if students have high speaking abilitM it is likely that they will

produce better vocabulary perfbpmance, specifically a 1arger number of word types.

This result is consistent with previous studies (Adarns, 1980; Higgs & Cliffbrd, 1982;

Koizumi & Kurizaki, 2002; Takiguchi, 2003). Additionally, the influence of productive

vocabulary knowledge on vocabulary perfOrmance is also substantial.

Research question 2 of the degree to which speaking ability can be predicted by

vocabulary knowledge was answered using the value at the upper right of the rectangle,

which signifies the proponion of speaking ability accounted for (R2) by productiyevocabulary knowledge in Model 1 (.61). Therefore, more than half of speaking ability

(6 1 %) can be explained by productive vocabulary knowledge. Since the current study

assessed only one-word level vocabulary knowledge, it is rather surprising to obtain

such a high percentage of speaking abdity explained only by productive vocabulary

knowledge. One may wonder if the reason such a high percentage was gained was that

the students' utterances evaluated and interpreted as speaking ability were very shert,

so the impact of vocabulary was strong. However, this explanation may be difficult to

adyance because speaking tasks elicited utterances varying from short to long. While

-11-

Page 12: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The JapanLanguageTesting Association

two dialogic tasks (i.e., [fasks 2 and 3) mostiy extracted one-sentence level utterances,

three monoiogic tasks produced a short to rnedium length of speech (in case of the

number of pruned token, 1letsk 1: M = 18.01, SD = 14.15; 'fask

4: MF 11.40, SD =

12.69; 1fask 5: M = 16,58, SD = 18.22), Further analysis needs to be perfbrmed

regarding the relationship between the number of fbrmulaic expressions and speaking

ability. The proportions of vocabulary perfOrmance accounted fbr (R2) by speakingability (65%) suggest that about half of vocabulary perfbrmance can be predicted by

speaking ability.

43 What Explains the Remaining 39% in Speaking Ability?

The results in Section 4.2 show that 61% of spealdng ability is pTedicted by

productive vocabulary knowledge. The next question to address is what covers the

remaining 39%. Research question 2 was examined in an exploratory way by using

five perfbrmance measures of lexical complexity (see [fable 3) and productivevocabulary knowledge logit scores as independent vaiiables, and speaking ability logit

scores as a dependent variable. The reason confirmatory analysis was not used here

was that theoretically, speaking ability afliects speaking performance, and the attempt

to explain speaking ability frorn speaking perfbrrnance is in the opposite direction.

[[:wo types of multiple regression analysis were utilized: sequential and stepwise

regression analysis. ln sequential regression analysis, two steps were taken. First,

productive vocabulary knowledge was first entered into the regression equation.

Second, fiye perfbrmance measures were then entered and some measures were

selected and included into the regression equation based on statistical criteria. Stepwise

multiple regression analysis was employed for "eliminating variables that are clearly

superfluous in order to tighten up future research" (Thbachnick & Fidell, 2001, p. 138).

The multiple regression equation was found to be significantly meaningfu1, F(3, 134) =

164.65, p < .OOI, The three variables were able to predict speaking ability to a 1arge

degree (79%; see 'Ihble

6).S

Since speaking perfbrmance measures (e.g., LCI and LC2) can be considered to

imply the existence of the ability to produce such performance, speaking ability was

accounted for by productive vocabulary knowledge (60%)6 and the ability to produce

utterances with lexical complexity and, by extension, the ability to use vecabulary

knowledge to produce such utterances (19%; 15 + 4). Arnong the two perfbmiance

measures other than productive vocabulary knowledge, the percentage of LC2 (Typelffoken) was the highest. Ms result suggests that other lexical aspects than the size

of productive vocabulary knowledge may be worth further exploration in investigating

predictors of speaking ability.

-12-

Page 13: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The JapanLanguageTesting Association

[[bbte 6 Regression Analysis Summaryfor Six I,keriables Pnedicting SPeaking AbilityMeasure B SEBff R zR2

ConstantStep 1: Productive Vbcabulary Knowledge

Step 2: LC2 Type!V-[fbken

LCIT etlbken

O.50 O.38O.19** O.02 .43

O.22** O.04 .36-1.55** 033 -.25

.60**.75**.79**.15.04

?Vote. n = 138. T = Thsk. R2 signifies the percentage explained cumulatively (e.g., 74%

was explained by productive vocabulary knowledge and LC2 Type/J'Ibken.

**p

< ,Ol.

Compared with the more percentage explained. by productive vocabulary

knowledge, 19% of speaking ability was explained by the ability to use vocabulary

knowledge, the proponion of which was smaller but seems substantial. Such ability

may include the ski11 to select words from the vocabulary knowledge appropriate to

context, to construct discourse, and to pronounce formed utterances in a limited time. It

seems that this 19% has a crucial role because it makes vocabulary knowledge function

as an element of speaking ability. The role of the 19% can be illustrated by examining

two students' examples in ・this study. A male student at junier high school had high

productive vocabulary knowledge but low speaking ability. His teacher mentioned that

he could not speak at length and logically even in his first language (Japanese). He

seems to have had some vocabulary knowledge but lacked the ability to use it properly.On the other hand, a female student at junior high school had low productivevocabulary knowledge but high speaking ability. Her teacher stated that she spoke a

great deal in Japanese when she was cheerfu1 although her basic knowledge was not

'high. She appears to have had a smal1 amount of vocabulary knowledge but to have

been able to put it to use very effectively. Her characteristics were reminiscent of

"VVes"

(Schmidt, 1983), who had low linguistic knewledge but high speaking ability

and who was able to communicate effectively. These examples illustrate the

importance of the ability to use vocabulary knowledge in speaking.

ln the present research the remaining 21% (i.e., 1OO - 79) of speaking ability was

not predicted, but based on Bachman and Palmer (1996), it is likely that some

proponions are accounted for by students' indiyidual factors, such as communication

strategies (DeKeyser, 1988), motivation (Koizumi, 2002), risk-taking,extroversion-introyersion (Skehan, 1989), as well as prior experiences of language

leaming and assessment (e.g., how English was leamed and whether and how often

speaking tests were taken), whereas others are explained by measurement errors.

4.4 Further Analysis: Relationship Between Ilest Performance in the Productive

Vocabulary Knowledge Ilest and in the Speaking [fest

-13-

Page 14: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The JapanLanguageTesting Association

While all the hypothesis and research questions were examined in Sections 4.2

and 4.3, a more detailed analysis was made conceming the relationship between test

perfbrrnance in the productiye vocabulary knowledge test (VKT) and in the speaking

test.

There were two words shared between the productive VKT and the speaking test:

box and popular. Responses from test takers in the two tests in relation to the two

words were cornpared in this section. ln the speaking test, Thsk S contained a picture of

a box, whereas in the prompt of Tleisk 4, popularity was one of the discussion subjects

(see Z[letble 1). Howeyer, it was not obligatory to use the two words, and obligatory

contexts will be required in future studies.

[fable 7 demonstrates that most students fo11owed the expected pattems but that

there were some students (n = 2 and 6 fOr each word) who responded in an unexpected

way (i.e., they did not use a spelling simi1ar to the pronunciation but uttered the word

successfu11y) fbr three probable reasons. First, they had learned the sound but had not

yet acquired the spelling. The fact that both box and popuiar are loanwords from

English te Japanese may be related to this phenomenon. Second, they were not able to

recall a word from a prompt in Japanese (as in the productive VKT) but were able to

do it from a picture (as in Thsk 5 in the speaking test). The second reason can be

justhied with the claim that word knowledge inc!udes various aspects (e.g., Nation,

2001), Third, the amount of pressure in the two tests was different. Some students may

have given up writing a word or written a different word sharing the same starting

letter (e.g., book) when they were not very sure, even wheh an instruction said, "Write

as much of the word as possible even if you are unsure about the exact answer." ln

contrast, they faced interlocutors in the speaking test, so they may have felt more

pressured and tried harder to utter the word.

Among these three reasons, the first reveals a future direction for research. When

a relationship between speaking and productive vocabulary knowledge is analyzed in

detai1, the knowledge to pronounce words, rather than knowledge of spellings, needs to

be assessed in a spoken version of a productive vocabulary knowledge test. lf a written

version using the same fbrrnat as the current study was employed (maybe because ofpracticality). the scoring methods may require modification in order to take knowledge

of pronunciation into account. Such modification would involve giving credit fbr

incorrect spelling with seeming knowledge of correct pronunciation. ln fact, the qualityof this method was investigated in Koizumi (2003b), but the conclusion was that the

method was less valid than exact word scoring .in terms of correlational analysis.

However, in the analysis of a relationship with speaking ability, the consideration of

pronunciation seems crucial, and scoring methods may need to be flexible according to

the test purpose.

-14-

Page 15: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The JapanLanguageTesting Association

[fable 7 lixpected and Actual Response Patterns inRelation to the 7Svo Yilords Shared

Between the Productive 1,bcabulary Knowledge 7lest and the Speaking 71est

Expectedpatterns bex(n -

165)popular(n - 152)

Corrects Mn Ex ectable Ex ectable*7082 30 15

lncorrect spelling with an

indication of knowledge ofcorrect ronunciation

Expectable Expectable'1 2 24 23

incorrect spellifig with liuleindication of knowledge of

pronunciation OR no

answer

Little Expectableexpectable

2a 8 6 54

Note, Used [Not used] = The word was [not] used. * = This pattern can occur due to a

lack of time to use the word, lack of ability to use the knowledge, lack of confidence to

use the word, or due to not noticing the prompt in the picture. aResponses

in the

productive VKT: no answer (n = 1), book (n = 2); bResponses: no answer (n = 4),po (n= 1), pluer (n = 1).

5. Conclusion

S.1 Main Findings in the Current Stitdy

The current study investigated the relationship between speaking ability,

vocabulary knowledge, and vocabulary perft)miance of Japanese beginner level

learners of English. The results indicate the existence of (a) a substantial effect of

productive vocabulary knowledge on speaking abilitM and (b) a substantial effect of

speaking ability on vocabulary perfbrrnance, and that the impact of (b) is significantlystronger than that of (a) (i.e., a support for Hypothesis). It is also demonstrated that

more than half (60-61%) of speaking ability is explained by productive vocabulary

knowledge (i.e., a response to Research question 1) whereas oneLfifth (19%) is

pr¢ dicted by the ability to use vocabulary knowledge (i.e., a response to Research

question 2).

5.2 Practica] Implications

The findings in the current study suggest three implications for practical purposes.

First, for instruction, the importance of productive vocabulary knowledge carmot be

overstated. Thus, increasing such knowledge is essential to enhancing high speaking

ability.7 However, the ability to put the vocabulary knowledge into use may also be

important although the proponion of speaking ability covered by it is smalier (19%). Second, fbr assessment, speaking tests that elicit speech from students are

necessary because speaking ability involves not only knowledge but also the ability to

use it, which was empirically tested in this study. In addition, rating categories of

-15-

Page 16: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The JapanLanguageTesting Association

speaking tests should include lexical aspects (e.g,, vocabulary volume and lexical

complexity), which can also be weighted in scoring, because of the essential role of

vocabulary in speaking ability.

Third, since a substantial amount of speaking ability can be predicted by

productive vocabulary knowledge, this finding can make the administration of

speaking tests more practical by predicting speaking ability with approximate precisionfrom vocabulary knowledge, and by selecting tasks in $peaking tests that are more

appropriate to students' speaking ability.8 It should be noted, however, that only a smal1

portion of tasks in a speaking test should be selected using this method since this

procedure involves errors of estimates, and that content aspect of validity needs to be

considered in task selection.

5.3 Further Research

The current study only examined the relationship between speaking ability and

vocabulary of Japanese beginner leyel learners of English. Further investigation should

focus on interrnediate and advanced learners. An anticipated result based on Adams

(1980) and Higgs & Cliffbrd (1982) is that there is a decrease in the degree to which

speaking ability can be explained by vocabulary knowledge, which may lead to the

modification of models.

Moreover, the results of the present study may be related to the following

experirnental aspects: the elicitation method, the speaking tasks, the rating scales, and

the vocabulary tests used. Therefore, replication studies are needed for generalization.ln relation to the speaking test, the speaking ability assessed in the current research

may be rather limited in that the ability covered was not proficiency overal1 but

school-based proficiency and that it did not include a component of pronunciation.Therefore, a wider range of speaking ability needs to be assessed fbr the purpose of

generalization. Regarding the vocabulary tests used, one-word level vocabulary size

was the target, but multi-word level vocabulary knowledge size as well as vocabulary

depth may also be crucial in speaking (e.g., Read, 2000). A funher rnodel may also be

necessary that includes other faetors explaining speaking ability, while test method

effects (i.e., paper-and-pencil tests vs. perfbrmance tests) should be controlled and

latent yar iables introduced utilizing structural equation modeling.

Acknowledgements

I gratefully acknowledge the financial support of the Japan Language Tbsting

Association (JIJITA), An earlier version of this paper was presented at the 7th JL[[:AArmual Conference on October 25, 2003, at Kumarnoto University and at the 24th

Tsukuba So6iety of English Language Tleaching on June 27, 2004. I arn deeply

indebted to Professor Akihiko Mochizuki for his usefu1 suggestions and

encouragement in conducting the experirnent and analysis. I would also wish to thank

-16-

Page 17: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The JapanLanguageTesting Association

Professor Tamaki Hattori, Mr. Hitoshi Takiguchi, Mr. Yb In'narni, Mr. Koya Suzuki,

Ms. Maki Shimizu, and many others who gave me invaluable comments.

Notes

1. An example of proficiency descriptors at the Smattering level is.℃̀ an use some

basic greetings; gan say thank you, sorr y" and an example at the Waystage Plus level

is "Can

interact with reasonable ease in structured situations and short

conversations, provided the other person helps if necessary" (Nomh, 2000, pp. 274-275), North's proficiency scale was used as the basis of the Common Reference

Levels of Common European Framework (Council of Europe, 2001). ln the

Common Reference Levels, most of the participants in this study belonged to the

level of basic users or below.

2. AIthough two other paper-and-pencil tests, a receptive vocabulary knowledge test

and a grammar test, were also conducted (Koizumi, 2003b), the two tests were not

used in the current study because the correlation between productive vocabulary

knowledge and receptive vocabulary knowledge was high (r = ,84, n = 139), and

because a grammar test had rather low reliability ( a = .67, n = 144).

3. Ari analysis of the relationship between variables reyealed that the five outliers had

exceptionally weak (n = 2) or strong (n = 3) relationships between speaking ability,

vocabulary knowledge and yocabulary perfbrniance.4. The reason why BCC was used instead ofAIC in this study was because

"BCC

. imposes a slightly greater penalty fbr model complexity than does AIC" (Arbuckle & Wbthke, 1995, p. 404), which seemed more appropriate for the model

comparlson.

5. R2 was the stime when productive vocabulary knowledge and five lexical complexity

measures were entered on at a time.

6. The values are very slightly different between Figure 1 and Thble 6, probably

because of the smal1 decline in nurnbers in [[hble 6 (n = 136).

7. See Aizawa, Ochiai, & Osaki (2003), Nation (2001), Schmitt (2000) for teaching

principles of vocabulary.

8. This method seems to be able to reduce not only the time it takes to administer an

adaptive speaking test and to iearn how to administer it, but also an interviewer's

on-line burden of selecting tasks during the test (see Koizumi, 2003a, for detailed

analysis based on Bachman & Palmer, 1996). Moreover, efficient task selection can

"enhance

measurernent precision" (Lord, 1971, p. 228), leading to a decrease in the

number of tasks (Heming, 1987, p, 140). This method is based on the principle of

two-stage testing, a type of adaptive or tailored test (e,g., Weiss, 1983, p. 6). The use

of vocabulary and other knowledge for selecting later tasks can be found in two

existing tests: the DIALANG assessment system (Council of Europe, 2001, pp.

226-243) and 'fest

Ybur English (Chapelle, Jamieson, & Hegelheimer, 2003), which

-17-

Page 18: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The JapanLanguageTesting Association

do not include speaking sections. Although this approach is less ethcient than a

computer-adaptive speaking test (Kenyon, Stauffer, Louguit, & van Duzer, 2002),

the format presented in the current study seems to have an advantage in that it is

useful when there is limited access to computer programs that enable

computer-adaptive task selection, and in that approximate speaking ability can be

obtained before administration of the speaking test.

ReferencesAdarns, M. L, (1980). Five co-occuning factors in speaking proficiency. in J. R. Firth (Ed;), Measuring spoken language proficiency (pp. 1-6). Washington, DC: Georgetown University

Press.Aizawa, K., Ochiai, N., & Osaki, S. (2003). The effects ef teaching on vocabulary knowledge:

Receptive vs. productive, AnnualReview ofEnglish Language Education in lapan, 14, 151.160.Arbuckle, J. L,. & W6thke, W. (1995). Amos 4,O user's guide, Chicago: SmallWaters

Corporation,

Bachman, L. E, & Palmer, A. S. (1996), Language testing in practice. Oxford University Press,Carroll, J. B, (1968). The psychology of language testing. In A. Davies (Ed.), Language testing

symposium: A psycholinguistic approach (pp. 46-69). OxfQrd University Press.Chapelle, C, A,, Jamieson, J,, & Hegelheimer, VL (2003). Vhlidation of a web-based ESL test.

Language 71esting, 20, 409-439.Council of Europe. (200 1). Common European Framework ofRojlinencefor Languages:

Learning, teaching, assessment, Cambridge University Press,

Daller, H,, van Hout, R., & [li:efifers-Daller, J. (2003). Lexical richness in the spontaneous

speech of bilinguals. ttipplied Linguistics. 24, 197-222.de Bot, K. (1992). A bilingual production model: Levelt's `speaking'

model adapted. Applied

Linguistics, 13, 1-24,DeKeyser, R, M, (1988). Cornrnunicative processes and strategies. Annual Review ofApptied Linguistics, 9, 108-121.D6rnyei, Z., & Kormos, J. (1998). Problem-solving rnechanisms in L2 communication: A

psycholinguistic perspective. Studies in Second Language Acquisition, 20, 349-385.

Eiken. (2004). The Societ),for 7lesting English Pwfciency, inc. Retrieved October 17, 2004,

fromhttp:llwww.eiken.or.jp/Fulcher, G (2003). festing second ianguage speaking, Essex, U.K.: Pearson Education

Limited.Henning, G (1987). A guide to language testing: Development, evaluation, research. Boston, MA: Heinle & Heinle,Higgs, T. Vl, & Cliffbrd, R. (1982). The push toward cornmunication. in T. VL Higgs (Ed.), Curriculum, competence, and theforeign language teacher (pp. 57-79). Lincolnwood, IL: National

'Ilextbook.

Ishizuka, H (Jlivawaot), (2ooO), rge.#vataa)ue S t speaking eeh a])ia ma--native-like fluency itge.ecpmua}CJ b rag 6rbts--- [Correlations between depth ofyocabulary

knowledge and speaking ability: Can native-like fluency be enhanced by vocabulary

knowledge?]1 , S71EPBulletin, 12, 13-25.Japan Association of College English Tleachers (JACET) Basic Wbrd Revision Committee

(Ed.). (2oo3). .LtlCETList of8000 Basic Vilorzis. Tbkyo: JACET.

Kenyon, D. M., StauffeT, S., Louguit, M., & yan Duzer, C. (2002, December). Building a

computer-adaptivefoce-to:face oral intervierv: 71he BESTPtus, Paper presented at the 24th

-18-

Page 19: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The  Japan  Language  Testing  Assooiation

  LanguagerTesting Research Colloquium, Hong Kong.Koizumi, R .(2002). The eff巳cts of motivation , language anxiety , and  test anxiety  on  English

  pToficiency of  Japanese junior high school  students .JLTA  Journat,5,91−110.Koizumi

, R.(2003a). Devetopment ofa  speaking  testfor Japanese/unior  high school  students .

  Unpublished master’

s thesis, University of  Tsukuba, Japan.Koizumi, R.(2003b). A  prOductive vocabulary  knowledge.test for novice  Japanese learners of

  English:Validity and  its scoring  methods . JABAETJournai,7,23−52.Koizumi, R.(2004a). Attainment levels ofspeaking  ability  ofJapanese /unior  high school

  stud θnts . Manuscript submitted  for publication.Koizumi

, R (2004b). Specrking pelformance measures  off 『uency , accuracy , and  complexity  as

  developmental indices. Manuscript submitted  for publication.Koizumi

, R.,& Kurizaki,1(小泉利恵 & 栗嵜逸美).(2002).「日本人 中学生の モ ノ ロ

ーグ

  にお け るス ピーキ ン グ の 特徴 [Speaking characteristics  of  monoiogues  given by

  Japanese junior high school  stUdents ]J.Bulletin Ofthe Kanto−Koshin−Etsu English Language  Education Society,16,17−28.Kunnan, A . J.(1998). An intrOduction to structural  equation  m 〔》delling for language

  assessment  research . Language Testin8,15,295−332.Levelt, W . J. M .(1989). Speakin8: From  intention’ to articulation . MA :Mrr  Press.Levelt, W . J. M .(1993). The architecture  of  normal  spoken  language use. in G  B且anken ,

 J,Dittmann, H .(運  

,1. C. Marshall

,& C .  W . Wal 且esch (Eds.),

 Linguistic disorders and

  pathotogies.・An international handbook (pp.1−15). Berlin:Walter de Gruyter.

Linacre, J. M .(1991). A  user

’s guide to FACETS ’ Rasch −Model  computer  pro8rams. Chicago:

  MESA  Press.Lord, R M .(1971). A theoretical stUdy  of two ・stage  testing. Psychometrika.36,227−242.Maeda, H (前 田啓朗).(2004). 「因果分析 の 妥当性 の 検証一

日本の 英語 教育学研 究にお

  ける傾向 と展 望一[investigating the validity  of  causa1  analyses :Tendencies and

  perspeCtives in English language learning education studies in Japan]」 . JLTA Journat,6,  140−147.

Magnan , S. S.(1988). Gra  ar and  the A   rし Ora1贓 ciency hteMew ;Discussion and

  data. Modern  Langua8e Journat,72,266−276.McNamara, T.(1996).Measurin8 second  lan8uage peiformance. Essex, U .K :Addison

  Wesley Longman Lirnited.Ministry of  Education, Science and  Culture(文部省).(1989). 『中学校指導書 外 国語編

  [instruction guidelines for junior high school ]』.東京 : 開隆堂.

Ministry of  Education, Science& Culture(文部省).(1999)。『中学校学習指導要領 (平成 10

  年 12月)解説一外国語編一【Explanation of the Course of StUdy for junioT high school

  concerning  foreign languages]』.東京 : 東京書籍.Mochizuki

, M .(1998). A  Vocabulary Size Test for Japanese Learneils of  English. IRLT

  Bulletin, 12,27−53.Nation

, 1. S. P.(2001). Learnin8 vocabular  y in another  tangua8e. Cambridge University Press.

Noro , T.,& Shimamoto, T (野 呂忠司 & 島本 た い 子 ).(2003). 「英語の 語彙知識 と言語運

  用 [English vocabulary  knowledge and  linguistic performance]」.in 門田修平 (Ed.), 『英

  語 の メン タル レ キ シ コ ン :語彙の 獲得 ・処理 ・学習 [The’English〃mental  texicon]』 (pp.

  141−147).東京 : 松柏社.North, B (2000). The deveiopment ofa  common  framework scale  of lan8uage proficiency.

  New  Ybrk:Peter Lang.O ’Loughiin

, K .(2001). Studies in lan8uage testin813 : The equivaience  ofdirect and

  semi−direct speaking  tests. Cambridge  University Press.

Read, J.(1993). The development of  a new  measure  of L2 vocabulary  knowledge. Langua8e  Testing,10,355−371.Read. J,(2000). Assessing vocabuiar  y. Cambridge University Press.

一 19 一

N 工工一Eleotronio  Library  

Page 20: Predicting Speaking Ability From Vocabulary 語 知識 能力 測 能性

The Japan Language Testing Association 

NII-Electronic Library Service 

The JapanLanguageTesting Association

Schmidt, R. (1983), interaction, acculturation, and the acquisition of communicative

cornpetence. in N. Wolfson & E, Judd (Eds.), Sociolinguistics and tanguage acquisition (pp. 137-174). Rowley, MA: Newbury House.

Schmitt, N. (2000). Vbcabutar), in language teaching. Cambridge University Press.

Shimizu, S. (2004). JACET 8000 Level Marken Renieved October 17, 2004, from

htrp:llwwwOl.tcp-ip.or.jp/-・shinlJ8LevelMarkerli81rn,cgiShohamy, E. (1992), Beyond proficiency testing: A diagnostic feedback testing model fbr

assessing foreign language learning. Modern Lansuage Journal, 76, 513-521.

Skehan, R (1989). Individuat dij7larences in second-language learning, London: Edward

Arnold.Skehan, P, (1998). A cognitive approach to language learning. Oxford University Press.

Tltbachnick, B. G, & Fidell, L. S. (2001). Using multivariate statistics (4th international

student ed.). Needham Heights, MA: Allyn & Bacon.[hkiguchi, H. (2003). A study qf the development of speaking skilts within theframework of fluency, accuracy and complexity among Japanese EFTLjunior high school students,

Unpublished master's thesis, Joetsu University of Education, Japan,Tbyoda,H(eNasM,Ed.).(2003). T#;f)twneB5)EFf [fieewt]i [Questionsabout Covariance StructureAnalysis], Mm- : njfi#JIE.Weiss, D. J. (1983), introduction. in D. J. Weiss (Ed.), Nex, horizons in testing: Latent trait test

theory and computeriied adcrptive testing (pp. 1-8). New York: Academic PTess.

AppendixA IntercorrelationsandDescriptiveStatisricsforThreeMeasuresMeasure 1 2 M SDMinMax Skew Kurt

1. Speaking Ability2. Productive Vbcabulary

Knowledge3.T e

.78

.81.66

-O.05 O.91, -2.30 2.68 O.11 O.43-1.80 .2.09 -7.97 3.96 -O.16 1.44

10.81 7.77O.OO 37.33 1.131.08

Note. n = 139. All Pearson product-moment correlation coefficients were significant at

P<.Ol.

Appendix B Intercorrelations and Descriptive Statisticsfor Seven Measures

Measure 1 2 3 4 5 6 7 M sw

1 . Speaking Ability

2. Productive Nlocabulary ,77*'

Knowiedge

3. LCI [Typelroken] -.69'" -.50'"

4.LC2[TypelV-Ibken] .78'* .62"" -,64'*

--

5.LC3 -.4S**-.46** .49** -.38** --

[Lexical wordslroken]

6. LC4 [{Sophisticated -.37** -.42'* .38** -.29"'

.91*'

words + O.5 * Basic

words}IToken]

7.LC5[Sophisticated -.02

-.10

-.02 .00 .16

word typeslroken]

cf.Te ,80'*

.54*

-O.03 O.90-1.76 2.03

O.80 O.14

4.69 1.45

O.57 O.11

O.33 O.06

O.08 O.05

.65** -.74** ,94** -.46**-,39** -.07 10.89 7.75

Note. n = 138. *p < ,05.*'ip < .Ol.

-20-

NII-Electronic Mbrary