15
DOCUMENT RESUME ED 048 370 TM 000 462 AUTHCR TTTLE INSTITUTICN PUB CATE NOTE FIDES PRICE DESCRIPTORS IDENTIFIERS retersen, twain Anderson, Douclas Closing the Communications Gap with Item Sampling. Mankato State Coll., Minn. Teb 71 14p.; Paper presented at the Annual Meeting of the American Educational Research Association, New York, New York, February 1971 ERRS Price AF-$0.65 HC-$3.29 Attitude Tests, *College Environment, College :students, rata Collection, *Factor Analysis, Factor Structure, *Item Sampling, Measurement Techniques, *Research Methodology, *Student Attitudes *Campus Environment Scale ABSTRACT The equivalency of item sampling and student sampling of attitudes of college students was investigated. A factor analysis of student-sampled data collected daring Spring 1969, was compared with a factor analysis of item-sampled data collected each quarter from Fall 1968, through Winter 1970, at Mankato State College, using the Campus Environment Study (CES) developed by the Central States Cclleges and Universities Cooperative Research Program. In an earlier study item sampling was demonstrated tc be equivalent to student -:ampling in terms of correlations of item means and standard deviations. It was also found that standard deviations of item-sampled responses were systematically smaller than for student sampling. When the results of that earlier study and the present one were compared, factor structures of student attitudes were found to be similar if not equivalent. Factors from item sampling had several common items on similar factors gained from student sampling. Item-sampled factors contained many items from the same a priori environments of the original item pool. The congruence of the item.; in the item-sampled factors was judged to be high, with some notable exceptions which could be attributed to the less than perfect intercorrplation matrix. An example of a typical item smple, consisting of six questions taKen from the full 150-item CES is attached. (AutLor/TA)

DOCUMENT RESUME - ERICDOCUMENT RESUME ED 048 370 TM 000 462 AUTHCR TTTLE INSTITUTICN PUB CATE NOTE. FIDES PRICE. DESCRIPTORS. IDENTIFIERS. retersen, twain Anderson, Douclas Closing

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: DOCUMENT RESUME - ERICDOCUMENT RESUME ED 048 370 TM 000 462 AUTHCR TTTLE INSTITUTICN PUB CATE NOTE. FIDES PRICE. DESCRIPTORS. IDENTIFIERS. retersen, twain Anderson, Douclas Closing

DOCUMENT RESUME

ED 048 370 TM 000 462

AUTHCRTTTLEINSTITUTICNPUB CATENOTE

FIDES PRICEDESCRIPTORS

IDENTIFIERS

retersen, twain Anderson, DouclasClosing the Communications Gap with Item Sampling.Mankato State Coll., Minn.Teb 7114p.; Paper presented at the Annual Meeting of theAmerican Educational Research Association, New York,New York, February 1971

ERRS Price AF-$0.65 HC-$3.29Attitude Tests, *College Environment, College:students, rata Collection, *Factor Analysis, FactorStructure, *Item Sampling, Measurement Techniques,*Research Methodology, *Student Attitudes*Campus Environment Scale

ABSTRACTThe equivalency of item sampling and student

sampling of attitudes of college students was investigated. A factoranalysis of student-sampled data collected daring Spring 1969, wascompared with a factor analysis of item-sampled data collected eachquarter from Fall 1968, through Winter 1970, at Mankato StateCollege, using the Campus Environment Study (CES) developed by theCentral States Cclleges and Universities Cooperative ResearchProgram. In an earlier study item sampling was demonstrated tc beequivalent to student -:ampling in terms of correlations of item meansand standard deviations. It was also found that standard deviationsof item-sampled responses were systematically smaller than forstudent sampling. When the results of that earlier study and thepresent one were compared, factor structures of student attitudeswere found to be similar if not equivalent. Factors from itemsampling had several common items on similar factors gained fromstudent sampling. Item-sampled factors contained many items from thesame a priori environments of the original item pool. The congruenceof the item.; in the item-sampled factors was judged to be high, withsome notable exceptions which could be attributed to the less thanperfect intercorrplation matrix. An example of a typical item smple,consisting of six questions taKen from the full 150-item CES isattached. (AutLor/TA)

Page 2: DOCUMENT RESUME - ERICDOCUMENT RESUME ED 048 370 TM 000 462 AUTHCR TTTLE INSTITUTICN PUB CATE NOTE. FIDES PRICE. DESCRIPTORS. IDENTIFIERS. retersen, twain Anderson, Douclas Closing

MANKATO STATE C I._ LEGE : .

OF-WE CR INS rUi IONAL RN E nc_H

MANKATO, MINNESCT t. 54C0 I

December 30, 1970

Closing the Cormunications Gap iith Item Sanoling

DWATN F. PETERSEN

Mankato State College

DOUGS H. ANDERSON

University of Minnesota

INTRODUICTIO',7

U S DEPAR ;MINT OF HEALTH. EDUCATIONWELFARE

OFFICE CF EDUCATIONTHIS DOCUMENT HAS BEEN REPRODUCEDEXACTLY AS RECEIVED FROMTHE PERSOII CRORGANiZATON ORIGINATING n POINTS OF512W OR OPINIONS STATED DO NOT NESESSARILy REPRESENT OFFICIAL OFFICE CF EDUCATION POSITION OR POL.CY

Serious qustions have been raised out the strengthand flexibility of our educational system. John Gardner hasspoken of uniovi:Ig critics, uncritical lever: and lovincritics. Too icany opportunities have bean provid.f the un-loving critics end uncritical lovers within and without ourinstitu:Aons of higher education. Few, if any, provisionshave b:en node for the development of loving critics. Yet,if our institutions are to retain or gain strength, theymost have the flexibility to respond to iesponsible ini,utfrom the majority of patrons. Historically when studentswero &lowed to el-,gage in criticism, a sample of .6,_:dentswas as3;cd a population of questions. After receivin poorreturn with limited opportunity fo.c collecting resconsesregularly over a period of yea , it 11:as be'an.d7..cided. themu:it he a better way.

Item sampling involves randomly selecting itcu ratherthan individuals and then administring the iunt! sar:Ples toa population instead ot with a sample of individu:ls. Itemsampling has the potentialitl of providing a voice for thesilent majority. Lord (lf?.55, 1960, 196Z) laid he groundworkand demonstrated the practicability of item sal:)]ing forachiwement testing aoelications. Lord (1962) , Plumlee (19(4),and Cool: a Stufflebeam (1967) extended recarch on ite.1 sam-pling by using various siuc item samples an., e:ncmineThis study, as well a en enirieal cooparison of the validityof it-mi and examinee samplinu (Owen Stufflebra'.1, 1967),indicated that a large numbe.,7 of cramnees takig only a fe;;itern each provided it bottc m. c:Itiitue of the pol,ulation norm

n of e-'- r'- itemsax & Cromacit (1966) and Prcnch & Greer (1964) have addressed

Page 3: DOCUMENT RESUME - ERICDOCUMENT RESUME ED 048 370 TM 000 462 AUTHCR TTTLE INSTITUTICN PUB CATE NOTE. FIDES PRICE. DESCRIPTORS. IDENTIFIERS. retersen, twain Anderson, Douclas Closing

-2-

the context question and demonstrated that if the time limitis generous and the sample is short, context or the order ofthe items fades as a determinant of responses to the items.As Lord suggested in 1962, item sampling is being used totrade items for people in a wide variety of situations. Itis being used in National Assessment (Mervin & Warner, 1969) ,achievement monitoring (Allen & ackin, 1S70) and in the U. S.census.

It is the purpose of this paper to investigate the equiva-lency of item sampling and student skampling of the structureof attitudes of college students. If we are to provide oppor-tunities for the masses to respond to the concerns of highereducation, we must provide a simple straight forward means ofevaluating attitudes of our patrons. At a general session c,fthe 1970 A.E.R.A. convention on problems and developments inreseE:.:ch design and methodology in studying the college stu-dent, Howard Becker pointed out that the day of getting returnson 150-item inventories from college students is past. AlexanderW. Astin suggested that C. Robert Pace and others wore so con-cerned with reliability in the development of :college environmentscales when they utilized the agree/disagree response pattern(Pace E Stern, 1958) that they di a not allow for measuromenL ofchange. It is unlikely that, in a short period of time,student's response will shift abruutly from agree to disagree,but very possible that he night rove from strongly agree toagree or uncertain on a five point scale.

To achieve this purpose illustrative data from a "CampusEnvironment Study" will be presented. Factors from a factoranalysis of item samples will be analyzed from the standpointof the following questions: (1) Are the factors from item-sampled data similar to factors of student sampled data?(2) Are the item-sampled factors representative of items ina priori environments? (3) Are they items in the item-sampledfactors congruent?

METHOD

Items from the Campus Erironment Study (CBS)* were itemsampled and administered to students at pre-registration eachquarter sta:ting in Fall, 1968. Each item-sample containedsix statements whic.h were randomly selected from 150 items.During the academic year 1968-69 a sratified 13ndom samplewas drawn, one item from each of six a priori college environ-ments: Academic, Physical, Cultural, Communications, Community

*The writers wish to express appreciation to Dr. Herb Silveyof Central States College end University Cooperative ResearchProgram for permis:;lon utilize the pool of items from theCampus Environment study.

2

Page 4: DOCUMENT RESUME - ERICDOCUMENT RESUME ED 048 370 TM 000 462 AUTHCR TTTLE INSTITUTICN PUB CATE NOTE. FIDES PRICE. DESCRIPTORS. IDENTIFIERS. retersen, twain Anderson, Douclas Closing

-3-

Relationships and Moral-Ethical environments. During Fall,1969, and Winter, 1970, the six items were drawn completelyat random from the pool of items. (See Appendix A) AtMankato State College there were 5,958 item samples collectedduring Fall, 1.968; 5,421 during Winter, 1969; 4,1.74 duringSpring, 1969; 7,454 during Fall, 1969; and 7,690 during Winter,1970 for a total of 25,276 representing over a 93 percentreturn from those pre-registering. A missing data correlationmatrix program was developed by the co-author at the University

. of Minnesota. This "psuedo" matrix 'vas then applied to a prin-cipal factor analysis and the factors rotated to meaningfulstructure with a varimax rotation program. Due to the "psuedo"matrix, a .40 rather than a .35 factor loading was used as acutoff point. The factors thus obtained were ccmpared withfactors sildlarly obtained from a student sampled factor analy-sis based on data collected on all 150 items from 791 studentsat ;4ankato State College during Spring, 1968. (Petersen, 1969)The factors were also compared with the a twiari scales of thaCIS and the con;ruance of iLmms on each factor was interpreted.

RESULTS

I-Lum sampling was demonstzated to be equivalent La studentsampling in -.erms of correlations of item moans and standarddeviations in a previous study. (Petersen, 1969) It was alsofound that standard deviations of item-sampled responses woresystematically smaller than for student sampling.

In the nresent study the "psuedo" correlation matrix,which was a result of interoorrclations of 25,276 si.,c itemsamples, produced some factor loadings greater than unity.However, a previous factor analysis based on 15,144 item sam-ples produced some factor loadings as great as 1.38, 1.17, 1.34,1.25, 1.29 w.d 1.18. The high factor loadings in the presentstudy such as 1.03, 1.08, 1.07, 1.10, 1.04, 1.07 and 1.1P aremore tolerable but indicate a need for still more data. Ifthe data collected in 1966-69 had not been based on stratifiedrandom sampling it is likcly that fever f;Acter loadings wouldhave exceeded unity.

In the tables which follow, the factors will be presentedand the three questions relating to the purpose of the paceraddressed for each factor. On the right of each table thefactor number derived from the student sample factor analysisis listed. While this does not allow for a divert comparisonof factor structures derived from student sampling and itemsampling, it is all that can be accomplished at this time.The factors from the student sampled data are number I-X andthe factors from the present study are number XI-XXI.

Fac:7or XI in Table 1 is similar to Factors I and IV of thestudent sampled data. Factor. I was a dimension involving warm

3

Page 5: DOCUMENT RESUME - ERICDOCUMENT RESUME ED 048 370 TM 000 462 AUTHCR TTTLE INSTITUTICN PUB CATE NOTE. FIDES PRICE. DESCRIPTORS. IDENTIFIERS. retersen, twain Anderson, Douclas Closing

-4-

personal copuintnications between and among students and faculty.Factor IV involved official, administrative type communication.The item sampled factor XI is a combination of the studentsampled factors and four of the five items are from the a prioricommunications environment (items 76-100). The congruence ofthis factor is very high with all of the items dealing withconcern and communication.

TABLE 1. Factor XI from Varimax Rotation Loadings of PrincipalFactor Analysis of the 150 Items of the Campus EnvironmentStudy at Mankato State College,, Fall, 1968, through Winter, 1970

Item No. Item Factor StudentLoading Sampling

Factors

93 The administration attempts to keep stu- 1.03 IVdents informed on matters of policy.

99 The administration informs faculty and .$t0 IVstudents promptly of clenge.s.

94 There is a friendly relationship tetween .72faculty and students.

79 Generally, student7 feel quite comfortablein approaching ins:.ruetors regarding aproblem.

107 The faculty on this campus is considerateand concerned with student Problems.

_ _ _ _ _ _ _ _ _ . . _ _ _ _ . _ _ _ _ _ _ _ _ _ _ . _

Factor XII is not similar to any of the student sampledfactors except that it is made up of items from three differentfactors. Two of the three items arc from the comnunicationsenvironment of the a !_.riori scale and are 7ongruent. All threeiteiits do not appear to have congruence with one another unlessdrinking habits can be related to communication.

TABLE 2. Factor XII from Varimax Rotation Loadings of PrincipalFactor Analysis of the 150 items of the Campns EnvironmentStudy at Mankato State College, Vail, 1968, through Winter, 1970

Item No. Item Factor StudentLoading Sampling

Factors

el The administration and teaching faculty 1.08 IVappear to cooperate well.

127 Excessive drinIzing by students does not .61 II

create a real problem on this campus.

76 it is easy for students to communicate .44

with the administration.

4

Page 6: DOCUMENT RESUME - ERICDOCUMENT RESUME ED 048 370 TM 000 462 AUTHCR TTTLE INSTITUTICN PUB CATE NOTE. FIDES PRICE. DESCRIPTORS. IDENTIFIERS. retersen, twain Anderson, Douclas Closing

-5-

Factor XIII has one item in common with factor VIIIwhich was an organizational communications factor. The othertwo items arc from the a priori physical environment. Twoof the three items are congruent but the third is not.

TABLE 3. Factor XIII from Varimax Rotation Loadings of PrincipalFactor Analysis of the 150 Items of the Campus EnvironmentStudy at Mankato State College, Fall, 1968, through Winter, 1970

Item No. Item Factor StudentLoading Sampling

Factors

34 The library is a good place to study.

31. The campus has a very attractiveappearance.

88 The student governmnt is functioningsatisfactorily.

3.07

.71

woy

l'actor XIV in Table 4 did not load on the student samaledfactor analysis. All items are from the a priori, academicenvironment. The items are exceptionally congruent, have highloadings and relate to good teaching.

TABLE 4. Factor XIV from Varimax Rotation Loadings of PrincipalFactor Analysis of the 150 items of the Campus EnvironmentStudy at Mankato State College, Fall, 1960, through ; ;inter, 1970

Item No. Item FactorLoading

21 Good teaching is a characteristic of most 1.10instructors at this institution.

18 Most instructors recognize a superior student .66tnd are willing to take extra time to challengehim.

19 There is a good balance between idealism and .65other points of view in the classroom.

4 Stimulating classroom discussions are frequent. .64

Factor XV in Table 5 did not load on the.student samoledfactor analyses. All items are from the a priori academicenvironment. The items are congruent and indicate thAt thismay be a scholarship dimension ors the academic environment.

Page 7: DOCUMENT RESUME - ERICDOCUMENT RESUME ED 048 370 TM 000 462 AUTHCR TTTLE INSTITUTICN PUB CATE NOTE. FIDES PRICE. DESCRIPTORS. IDENTIFIERS. retersen, twain Anderson, Douclas Closing

-6-

TABLE 5. Factor XV from Varimax Rotation Loadings of PrincipalFactor Analysis of the 150 Items of the Campus EnvironmentStudy at Mankato State College, Fall, 1968, through Winter, 1970

Item No. Item FactorLoading

6 High scholarship is a common goal of moststudents.

1.09

11 Examinations satisfactorily measure course .56assignments and presentations.

8 Many students on this campus are striving for .55high grades.

13 The academic aLmosphore on ths capus encourages .52students to go on to graduate work.

Factor XVI is yet another academic factor. Which did notload on the student samnle analysis. All five items aro fromthe a priori academic environment. Most items are congruentand relate to dedicated Ceaching.

TABLE 6. Factor XVI from Varimax Rotation Loadings of PrincipalFactor Analysis of the 150 Items Of the Campus EnvironmentStudy a": Mankato State College, Fall, 1968, through Winter, 1970

Item No. Item FactorLoading

12 Most instructors here are dedicated teachers. 1.07

13 The academic atmosphere on this campus encourages .56students to go on to graduate work.

2 Most instructors are very thorough in the teaching .50of their subject matter.

19 There is a good balance between idealism and other .45points of view in the classroom.

24 The institution provides a great many academic .42

resources for student use.

Factor XVII in Table 7 SOONS to he a community reiatedphysical environment dimension. The four items which loadedon tha student sampled factor analysis each came fromdifferent factor. Three items come from the a Rriori commun-ity relations environment (items 101-125), t1.7o from thephysical environment, one each from the a priori cultural and

anvron7nt. Desnitt- t!;c diversity, the itemsseem -7ongruent in the community related physical area.

Page 8: DOCUMENT RESUME - ERICDOCUMENT RESUME ED 048 370 TM 000 462 AUTHCR TTTLE INSTITUTICN PUB CATE NOTE. FIDES PRICE. DESCRIPTORS. IDENTIFIERS. retersen, twain Anderson, Douclas Closing

-7-

TABLE 7. Factor XVII from Varimax Rotation Loadings of PrincinalFactor Analysis of the 150 Items of the Campus EnvironmentStudy at Mankato State College, Fall, 1968, through icinter, 1970

Item No. Item FactorLoading

StudentSamplingFactors

36 Off-campus housing facilities aresatisfactory.

.92

95 Rumors are quickly dissoelled on thiscampus by ready access to facts.

.66 IV

109 The merchants in thin community treat stu-dents like first class citizens.

.62

54 Classical music is popular with the majorityof students.

.54 VII

e7 Housing costs are reasonable for the facil-ities and services provi&cl.

.51

117 UPper classmen provide helpful leadershipto new students.

.42

11.5 The general atmosphere on campus is friendly. -.67

Factor XVIII relates favorably with factor II of the studentsampled analysis. That factor was a large moral-ethical factor.The items are very representative of the a priori moral-ethicalenvironment (items 126-150) . Ti o items on this factor are partic-ularly

TABLE

Item

congruent in the moral ethical dimension.

8. Factor. XVIII from Varimax Potation Loadings of PrincipalFactor Analysis of the 150 Items of the Campus EnvironmentStudy at Mankato State College, Fall, 1968, through Winter, 197C

StudentSamplingFactors

No. Item FactorLoading

138 Uncontrolled student behavior is not acharacteristic of this institution.

.98

126 Students respect institutional rules andregulations.

.74 II

111 There are ample opportunities to meetpeople through social functions and stu::tentorganizations.

.61

136 Institutional regulations do not placeventrints on necial yer,Ovot.

.40 V

74 In general the speech and habits of studentsreflect refinement and good taste.

.40

127 Excasni-,,a drin1:;nc dee:: citea real prc,!-.cm on this caus.

.40 TT

7

Page 9: DOCUMENT RESUME - ERICDOCUMENT RESUME ED 048 370 TM 000 462 AUTHCR TTTLE INSTITUTICN PUB CATE NOTE. FIDES PRICE. DESCRIPTORS. IDENTIFIERS. retersen, twain Anderson, Douclas Closing

-8-

Factor XIX in table 9 does not relate to the studentsampled analysis, although one item appeared on each offactors I and X. It does not relate well to any of thea priori environments except perhaps the moral-ethical domain.The congruence of the items relates to freedom of expressionand openness for the most part but items on the use of drugs,library assistance and preparation for classes contradictsthis interpretation.

TABLE 9. Factor XIX from Varimax Rotation Loadings of PrincipalFactor Analysis of the 150 Items of the Campus EnvironmentStudy at Man%ato State College, Fall, 1968 through Winter, 1970

Item No. Item Factor StudentLoading Sampling

Factors

7 Open mindedness and objecivity are .1.00characteristic of most classes.

77 The expression of student opinions is .49encouraged.

147 The use of hallucinatory drugs students .49has not become widespread on this campus.

42 The library staff provides sufficient .45personal assistance in locating materialsin the library.

130 Freedom of speech is an accepted practice .40on this eampu.

9 Considerable out or class preparation by .40 Xstudents is 'necessary for most courses.

Factor XX related well with factors I and III of thestudent sampled analysis. Factor was the warm personalcommunications factor and III a friendliness dimension.Three of the four items are from the community relationshipenvironment of the a priori scale (!..tems 101-125). Thecongruence of this factor relates to mutual respect andconcern between and among students and facul ty.

8

Page 10: DOCUMENT RESUME - ERICDOCUMENT RESUME ED 048 370 TM 000 462 AUTHCR TTTLE INSTITUTICN PUB CATE NOTE. FIDES PRICE. DESCRIPTORS. IDENTIFIERS. retersen, twain Anderson, Douclas Closing

-9-

TABLE 10. Factor XX from Varimax Rotation Loadings of PrincipalFactor Analysis of the 150 Items of the Campus EnvironmentStudy at Mankato State College, Fall, 1968, through Winter, 3.970

Item No. Item . Factor StudentLoading Smpling

Factors

122 The faculty, as a general rulewelcomestudent appeal for advice and counsel.

110 There is a feeling of mutual respectbetween students and faculty.

112 Students show :1 concern for each otherat this institution.

78 Instructors are easy to approach withquestions concerning classwork.

1.18

.54

.49

I

I

TTT

I

Factor X;:l. doe E not relate to any of the student sampledfactors except factor VII which while they have only one it=in common seem both to be measuring student cultural opportunities.Seven of the eight items are from the a priori cultural environ-ment (items :,1-75). The congruence of this factor is exceptionallyhigh and all of the items are related to cultural oPportunities.including recreation.

TABLE 11. Factor XXI from Varimax Rotation Loadings of PrincipalFactor. Analysis of the 150 Items of the Carpus EnvironmentStudy at. Mankato State Collecre, Fall, 3968, through Winter, 197C

Item Ile. Item Pactn'r StudentLoadiraj Slmpling

Factors

59 Dramatic presentations are given frequently .89on campus.

29 Recreational facilities arc adequate to meetthe needs of most students.

75 Artists and performing.groups appear .45frequently on campus.

70 The library of tapes and records, i.e., music, ./-poetry, etc., is used exensivelv by students.

64 There is opportunity to study cultures other. .42than our own.

51 Opportunities are provided for students to .40evaluate works of art.

65 There are a variety of performing musical -.57groups on this campus.

5C. hive 1)crfol.7:1F:.nc,:-.n of symi)honion, ballet, rin.-1 -.45 Viicperas ara pi:Ironizarl by ;lir, studorlts,

--

9

Page 11: DOCUMENT RESUME - ERICDOCUMENT RESUME ED 048 370 TM 000 462 AUTHCR TTTLE INSTITUTICN PUB CATE NOTE. FIDES PRICE. DESCRIPTORS. IDENTIFIERS. retersen, twain Anderson, Douclas Closing

-10-

All six of the a priori environments were representedin both factor analytical studies. As can he seen in Table12, there wera two more academically oriented factors amongthe student sampled factors. The academic factors were allsmall being comprised of five or fewer items. The communi-cations environment split four ways in the student sampledanalysis with a student newspaper and organizational commun-ications failing to appear on the item sampled analysis. Theother difference in number of factors was in the communityrelationships, environment where two 'factors were identifiedwith relatively few items which although in a majority onthe factors, were from this environment.

TABLE 12. Number of Factors Gained in A Priori Environmentsfrom Varimax Rotations of Principal Factor Analyses ofa Student Sample of Spring, 196e and Item Sample7 ofthe 150 Items of the Campus Environment Study at MankatoState College, Fall, 1968 through Winter, 1970

Environment Item Sample Student Sample

kcademix 3

Physical 1 . 1 .

Cultural 2 2

Communica Lions 2 4

Community Relationships 2 1

Moral Ethical 1

TOTAL 11 10

DISCUSSION

The present results indicate that the structure of studentattituds arc similar if not equivalent when measured with itemsampling and student sampling. The student sample factor analysiswas completes using Spring, 1968 data and the item sample analysisutilized data collected each quarter from Fall, 1968 through Winter,1970. It is impossible to collect sufficient item sampled dataon one mediuff sized campus rluring one.quartei; unless the populationof items is reduced or the item sample size is .rIcreasecl.

Even with these limitations in the present study, severalitems load or similar factors. The item sampled factors loadmore consistently on items from the name a pric environmentsdespite th 1: c:-. that ccntivity nom- a: items is atrandom. The congruence of items loading on the same item sampled

10

Page 12: DOCUMENT RESUME - ERICDOCUMENT RESUME ED 048 370 TM 000 462 AUTHCR TTTLE INSTITUTICN PUB CATE NOTE. FIDES PRICE. DESCRIPTORS. IDENTIFIERS. retersen, twain Anderson, Douclas Closing

factor is similar to student sampled factors with somenotable exceptions. The exceptions may be related to the"psuedo" inercorrelation matrix but then the similarityalso may be associated with th less than perfect matrix.By utilizing a .40 factor loading cutoff for inclusion ina factor this limitation was compensated for in part.

All of the a priori environments were represented inboth factor analytical studies. There were two more acad-emically oriented and two fewer communications orientedfactors in the item sampled analysis than in the studentsampled analysis. This difference may be accounted for bythe temporal difference in when the data was collected. Itmay also be attributed to the factor analytical process itself.

The present study should be considered a pilot study orat most a developmental attempt to equate student samplingwith item sampling. More research is needed. A proposednext step in the develcp.7ent of item sampling may also proveto be more conclusive. That would be to administer one com-plete 150 item inventory to a student sample for every 25 sixitem samples of the pool of items at the same time on seve):alcollege campuses or at one large university. This ` could besuperior to debreasing the population of items because oneassumption of item samnling is that the items' must representall items which could 7De asked. It would also be superiorto increasing the item sample size because six items is mostoptimum for fitting on one page and Producing a very highrate of return.

In summary, factor structures of student attitudes werefound to be similar if not equivalent. Factors from itemsampling had several common items of similar factors gainedfrom student sampling. Item sampled factors contained manyitems from the same a priori environments of the originalitem pool. The conciruence of the items in the item sampledfactors was judged to he high with some notable exceptions.

11

Page 13: DOCUMENT RESUME - ERICDOCUMENT RESUME ED 048 370 TM 000 462 AUTHCR TTTLE INSTITUTICN PUB CATE NOTE. FIDES PRICE. DESCRIPTORS. IDENTIFIERS. retersen, twain Anderson, Douclas Closing

-12-

REFERENCES

ALLEN, P. W. & R. A. MACKIN, Toward a redefinition of teachereducation, Educational Technology, 1970, 10, 65-70.

COOK, D. L. & D. L. STUFFLE1 Estimating test norms fromvariable size item and examinee samples. Educationaland Psychological Measurement, 1967, 27, 601-610.

FRENCH, J. L. & D. GREER, Effect cif test-item arrangement onphysiological and psychological behAvior in primary-school children. Journal of Eductiticnal Measurement,1964, 1, 151-153.

LORD, F. M. Sampling fluctuations resulting from the samplingof test items. Psychometrika, 19F,5, 20, 1-22.

LORD, F. M. Use of true-score theory'to predict moments ofunivariate and bivariatc observed-score distributions.Psychometrika, 1960, 25, 325- -342.

LORD, F. M. Estimating norms by item :_;ampling. Educationaland Psychological "easurewent, 1962, 22, 259-267.

LOLD, F. M. & M. R. NOVICR, Statistil iheOries ofmc.:ntaltest scores. Reading, Massachuse'tts: Addison-Wesley,1968.

MERWIN, J. C. & F. B. NOMER, Evaluation in assessing theprogress of education .c.o provide bases of public under-standing and publi policy. Educational evaluation:new roles, new meand. Chicago: Nations) Society forthe Study of Education Pert II, University of ChicagoPress, 1969.

OWNS, T. R. & D. L. STUiFLEHEAMr An exnerimental comparisonof item sampling and examinee saa.r,ling for estina4li.ng testnorms. Columbus, Ohio: Evaluation Center, Ohio StateUniversity, rugust 1, 1967.

PACE, C. R. & G. q. STERN, approach to the measurermeasurer.e-c ofpsychological characterics of college environments,Journal of Educational Psychology, 1958, 5, 269-277.

PETERSEN, D. F. .Item sampling of institutional environments.The challenge and response of institutional researel.Athens, Georgia: The Association for Infftitutional Research,1969.

PLUILCE, LYNNDTTE B. Estimcting means and sLandard deviationsfrom partial data--empirical check on Lord's item samplingtechnique. Fdaustional and P.ycholegeal Mcasuremcnt,1964, 24, 623-630.

=, G. T. R. CRO=7, The offect!7 of wIriovs forms of itemarrz:n:Jemcnts en tent performance. E(1:,;(Laiona.1_

Masuremr-Int. lf:(6, 3, 309-311.

12

Page 14: DOCUMENT RESUME - ERICDOCUMENT RESUME ED 048 370 TM 000 462 AUTHCR TTTLE INSTITUTICN PUB CATE NOTE. FIDES PRICE. DESCRIPTORS. IDENTIFIERS. retersen, twain Anderson, Douclas Closing

AUTHORS

PETERSEN, DWAIN FRANKLIN Address: Office of InstitutionalResearch P.O. Box 75 1nkaf.1,5State College, Mankato,Minnesota 56001 Title: Director of InstitutionalResearch, Professor of Educational Psychology Age: 3GDegrees: B.M.E., Wayne State College; M.S.E., DrLkeUniversity; Ed. D., University of Nebraska Specialization:Educational Psychology; institutional research, evaluation

ANDDPS0:::, DOUCLAS HARRY Address: 205 Experimcntal EngineoringUniversity of Minnesota, Minneapolis, Minnesota 55400 .

. Title:_ Associate Professor of. Educational PsychologyAge: 47 Degrees: B.E.E., B.S., M.S., Ph.D.:Universityof-. Minnesota Specialization Educational Psychology;measurement, computer applications

13

Page 15: DOCUMENT RESUME - ERICDOCUMENT RESUME ED 048 370 TM 000 462 AUTHCR TTTLE INSTITUTICN PUB CATE NOTE. FIDES PRICE. DESCRIPTORS. IDENTIFIERS. retersen, twain Anderson, Douclas Closing

14 -13-

Appendix A

DO YOU :-.1,1`,.F FC1IJEE MiN1.111'1, f.1"1 L STA1E., CI. 11E.F1"

1115, i,", 1,1q, ( 'LIE

YES! Si20`4GLY

sTurrs :HC:b A COICLR',1 FL A EACH OTWIR AT THIS1^,STITTIC!N.

LY AIN

THE INSTITUTU,N HAS tXTi.. ViIVF MUSEUY COLLECTIONS.

THE IS ST:,r:iNG STOOEra LJYALTY TI) THISINJSTIFUTION.

STUL,E\FTS [-1:; THIS CVIPUS HAVE AN EXCrr.LLL,)T(713P1RJUITY TO AIPPIICC.IATION IN THE FINE

k..4v,POS FOOD ScRVICES IRE SATISFACTrtkY.

r.-Els pi- ALL ItACES 0A-',TICIPATF IN ALL CAMPUSACTIVITIFS W.,; AA EQUAL YASIS.

SEX I mx t..A1E 2

Cl1-5.5111CA111:5N 1 -1.E

C1,511EC-E II " . "1i 511,..1.5t!E3El Gt,,;Y 0!/- 1 cow- E E:EE,,TE II.1 r-,E'

FFE,511.5,EE.E E' ,.';CEt: / ,!.!: 1,51N 7,11-5

CL1511.1:41151 ^01NE 1 EE'r,c,EC C 1

4 fi 5 /1. E

71.'511-,Y SOUR, CF F,-JCP1101,:IFEEE5E:E

MAIO? REEA 1

&POW' ,OPT,051,11,E

.

CP 1

P. SE1,1[1,;(_F5 2 ,r,.51CG.Tr.:0.:

F!ir; CAI EC,51(751,,,:,1.1 5 NyLy.;r-, rEE.E0.

T111,5

5 1rA .51E-,1,1:15E

MAKI: No tii,t11:ii:S P41:1..e.'.! Ti liS LINE

litESE rcx,N,,;ifru li: rrrEY lra r 1;1 EE1Ej,E,1)5'CI

mom

f_0.,,Er,E:r; 7,-11 ',,,.71;:EET

MANLY@ Si '.7f: ILLFGEmm

OFHCE (..!E SE.E./0-:(f1

(MO

IMP

2

3 ob.

1 Wars 4

NO '.