17
FIRST-YEAR WRITING PROGRAM ASSESSMENT REPORT 2015-16 By Ginny Crisco “Writing may be by far the single academic skill most closely associated with college success [. . .]” (5) --David T. Conley Redefining College Readiness INTRODUCTION In April 2015, Dr. Frank Lamas, Bernard Vinovrski, Maxine McDonald, Tina Beddall, and Dr. Andres Hernandez released a report entitled “Bold New Vision for Developmental Education and Student Success at Fresno State.” This report included several implications for the First-Year writing program in the English Department including: RECOMMENDATION #1 : reevaluate the cut off scores for the SAT and the ACT to better evaluate the competence of students. RECOMMENDATION #2 : Use only the SAT or ACT as appropriate benchmarks for evaluating student’s competence in English and math and make the EPT and ELM optional. RECOMMENDATION #5 : Change the purpose and intent of Early Start courses from an experience to a preparation requirement for challenge exams that must be taken at the end of the course. RECOMMENDATION #6 : For English, offer SI to students who are already taking the GE English through various methodologies. In response to the “Bold New Vision for Developmental Education and Student Success at Fresno State,” the First-Year Writing Program provides the following program assessment report. This report on our First-Year Writing Program, informed by the current scholarship on Composition Studies and Writing Program Administration proposes the following: Directed Self Placement (DSP, our current placement mechanism) with an exit assessment is the most reliable, appropriate, student-centered placement mechanism that, as a practice and an approach toward placement, has CSU-wide and scholarly support. Research in our discipline and assessment research in our program shows that test scores are not the best placement mechanism for students and should only be used – if used at all – to advise students -- within the more important context of student self-efficacy (defined below). In comparison to our new program, our previous program, which used mainstreaming (one course for all students with supplemental instruction) had higher failure rates and lower retention rates, as our research data shows.

David T. Conley Redefining College Readiness · 3 critical reading and writing), Summary / Conversation (how to incorporate outside sources into writing, cite them, and avoid plagiarism),

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: David T. Conley Redefining College Readiness · 3 critical reading and writing), Summary / Conversation (how to incorporate outside sources into writing, cite them, and avoid plagiarism),

FIRST-YEARWRITINGPROGRAMASSESSMENTREPORT2015-16

ByGinnyCrisco

“Writingmaybebyfarthesingleacademicskillmostcloselyassociatedwithcollegesuccess[...]”(5) --David T. Conley Redefining College Readiness

INTRODUCTION

InApril2015,Dr.FrankLamas,BernardVinovrski,MaxineMcDonald,TinaBeddall,andDr.AndresHernandezreleasedareportentitled“BoldNewVisionforDevelopmentalEducationandStudentSuccessatFresnoState.”ThisreportincludedseveralimplicationsfortheFirst-YearwritingprogramintheEnglishDepartmentincluding:

• RECOMMENDATION#1:reevaluatethecutoffscoresfortheSATandtheACTtobetterevaluatethecompetenceofstudents.

• RECOMMENDATION#2:UseonlytheSATorACTasappropriatebenchmarksforevaluatingstudent’scompetenceinEnglishandmathandmaketheEPTandELMoptional.

• RECOMMENDATION#5:ChangethepurposeandintentofEarlyStartcoursesfromanexperiencetoapreparationrequirementforchallengeexamsthatmustbetakenattheendofthecourse.

• RECOMMENDATION#6:ForEnglish,offerSItostudentswhoarealreadytakingtheGEEnglishthroughvariousmethodologies.

Inresponsetothe“BoldNewVisionforDevelopmentalEducationandStudentSuccessatFresnoState,”theFirst-YearWritingProgramprovidesthefollowingprogramassessmentreport.ThisreportonourFirst-YearWritingProgram,informedbythecurrentscholarshiponCompositionStudiesandWritingProgramAdministrationproposesthefollowing:

• DirectedSelfPlacement(DSP,ourcurrentplacementmechanism)withanexitassessmentisthemostreliable,appropriate,student-centeredplacementmechanismthat,asapracticeandanapproachtowardplacement,hasCSU-wideandscholarlysupport.

• Researchinourdisciplineandassessmentresearchinourprogramshowsthattestscoresarenotthebestplacementmechanismforstudentsandshouldonlybeused–ifusedatall–toadvisestudents--withinthemoreimportantcontextofstudentself-efficacy(definedbelow).

• Incomparisontoournewprogram,ourpreviousprogram,whichusedmainstreaming(onecourseforallstudentswithsupplementalinstruction)hadhigherfailureratesandlowerretentionrates,asourresearchdatashows.

Page 2: David T. Conley Redefining College Readiness · 3 critical reading and writing), Summary / Conversation (how to incorporate outside sources into writing, cite them, and avoid plagiarism),

2

• StudentsonthiscampusshouldbeexemptfromtheEarlyStartrequirementasthephilosophy(placingstudentsintoacoursebasedontestscores)isindirectoppositiontoDirectedSelf-Placement(studentsplacethemselvesbasedontheirself-efficacyaswriterswithtestscoresasaguide).

• BasedonthecurrentscholarshipinthedisciplineofRhetoricandCompositionandon

extensiveassessmentresearchinourprogram,theFirst-YearWritingProgramrecommendsthesemeasuresforimprovingstudents’retentionandgraduationrates:1)Reduceoreliminaterelianceonalltimedwritingandmultiplechoicetestsforwritingplacement,2)EliminatetheEarlyStartRequirementforEnglish,3)Reducewritingclasssizesfrom25to20,4)Reducefulltimelecturerloadfrom5writingcoursesto4writingcourses.

Pleaseseeourassessmentandanalysisbelowforfurtherexplanation.

FIRST-YEARWRITINGPROGRAMOVERVIEW

Studentsplacethemselvesintooneofthreeoptions:1)TheAcceleratedOption:English10;2)TheStretchOption:English5AandB;or3)TheOptionforMultilingualStudents:Linguistics6andthenEnglish5AandB.English10isanacceleratedclassforstudentswhoarealreadyaccomplishedandconfidentwriters.English5AandBarecoursesforaveragestudentwritersthatgivethemabroadfoundationataslowerpaceforwritingattheuniversitylevel.Linguistics6isaclasstopreparestudentsformoreacademiclanguageusage,sincecollegelevellanguagerequirementsaremorechallengingthaneverydaylanguagepractices.Allcoursesreceiveuniversitycredit;wehavenoremedialcourses.Linguistics6,English5AandEnglish10allcounttowardtheremediationrequirement.English5Band10countastheareaA-2GEwritingrequirement.

Ingeneral,about60-70%enrollintheStretch(English5A/B)option,30-40%enrollintheAcceleratedOption(English10),andabout2%enrollintheOptionforMultilingualSpeakers(Ling6,then5A/B).

Tomaketheirdecision,studentsaresentanemailthatdirectsthemtoawebpagewithanoverviewoftheoptions,aDirectedSelf-PlacementDecisionChart(seeAppendixAfortheDecisionChart),anoverviewofthecoursesineachoption,andaFAQpage.TheyalsohaveapresentationatDogDaysorientation,apagetorefertointheDogDaysbooklet,andhaveadvisorstohelpthemchoosewhichcoursewouldberightforthem.

Additionally,whenstudentsenterintotheirfirst-yearwritingcourse(English5Aor10),teachersconductafirst-weekwritingsampletocontinuetodirectstudents.Theycanbeencouragedtochooseadifferentoption,beencouragedtoenrollintheWritingCenterforsupplementalinstruction,orbegivengoalstoworktowardtheirfinalportfolio.

Becauseourprogramshiftsassessmentfromtheentrancetotheexit(seebelowforscholarshipabouthowtheDSPworks),studentsarerequiredtocreateafinalportfoliooftheirworksothattheinstructorandthestudentsthemselvescanassesswhetherornottheyhavemettherequirementsofGElevelwritingbytheendoftheirchosenoption.Ourprogramportfoliorubricincludes5dimensions:Reflection(whattheyhavelearned,howtheyhavegrownoverthecourseoftheoption),ReadingandWritingStrategies(whatstrategiestheyhavelearnedandcanuseinregardto

Page 3: David T. Conley Redefining College Readiness · 3 critical reading and writing), Summary / Conversation (how to incorporate outside sources into writing, cite them, and avoid plagiarism),

3

criticalreadingandwriting),Summary/Conversation(howtoincorporateoutsidesourcesintowriting,citethem,andavoidplagiarism),Rhetoricality(howtheycreatepurposefulwritingthatisorganizedandwelldevelopedandaddressesanaudience),andLanguageUse(includingparagraphfocus,sentencestructure,andgrammar).Thesedimensionsarescoredona6pointscale,where3ispassing.

FIRST-YEARWRITINGPROGRAMHISTORYATCSUFRESNO

Before2000,theFirst-YearWritingprogramatFresnoStatehadEnglishA,whichwasaremedial,noncreditbearingcourseforstudentswhotestedintoit,andEnglish1,whichwasthecoursethatmetthefirst-yearwritingrequirement.Thisprogramwasproblematicinavarietyofways,and,in2000,therewasnewresearchshowingthatdifferentapproaches,suchasmainstreaming(onecoursewithsupplementalinstruction),mightworkbetterforourstudentpopulation.

From2000-2006,theFirst-YearWritingprogramusedwhat’scalledinthedisciplineofComposition,amainstreamingmodel.Thismodelputallstudentsinonecredit-bearingcoursethatmetstheGEareaA-2requirement,andgavestudentswhoplacedintoremedialwritingsupplementalinstruction.Wefoundthatthisapproachworkedbetterthanthepreviousprogram,buttherewasconfusionbetweenthesupplementalinstructionstudentswerereceivingandthecontentoftheirwritingclasses.Alsoitwaschallengingtoteachthesesupplementalinstructioncourses,andstudentsdidn’twanttobethere.In2005whenthedepartmenthiredtwonewcompositionists,wefoundnewdevelopmentsinthefieldofCompositionaboutbetterwaystoplacestudents,particularlybecauseitwascommonforustofindstudentswhohadbeen“misplaced”basedontheirEPTscores.

In2006,wemovedtoDirected-SelfPlacementwithaStretchComponent.WewerethefirstlargeCSUcampustomoveinthisdirection(thefirstCSU,atall,todothiskindofFirst-YearWritingPlacementwasChannelIslands).Currently,10othercampusesuseDirectedSelf-PlacementwithaStretchoption(ChannelIslands,Chico,Humbolt,LosAngeles,SanBernadino,SanFransisco,SanJose,Stanislaus,Sacramento,andSonoma).SeventeencampusesincludeaStretchoption(allofthecampusesaboveplusBakersfield,DominguezHills,EastBay,LongBeach,Northridge,Pomona,andCalPoly).MontereyBayiscurrentlylookingintoimplementingDSPwithastretchoption.Additionally,atleast26othercollegesanduniversitiesacrossthenationalsouseDirectedSelf-PlacementwithaStretchOption(seeappendixBforalist).

DIRECTEDSELFPLACEMENTOVERVIEW

Placementdiscussionsoncampushavefocusedontheimportanceoftestscorestoplacestudentsintotheproperclasses.Researchinourdisciplineandassessmentresearchinourprogramshowthattestscoresarenotthebestplacementmechanismforstudentsandshouldonlybeusedtoadvisestudents--withinthemoreimportantcontextofstudentself-efficacy(definedbelow).

WHYNOTTESTSCORES?

TheNationalCouncilofTeachersofEnglish,oneofourleadingprofessionalorganizations,wroteapolicydocumentin2005(whentheSATandACTaddedawritingcomponenttotheirtests)ontheuseofSATandACTscoresforwritingplacemententitled“TheImpactofSATandACTTimed

Page 4: David T. Conley Redefining College Readiness · 3 critical reading and writing), Summary / Conversation (how to incorporate outside sources into writing, cite them, and avoid plagiarism),

4

WritingTests.”Intheirintroduction,theyarguethatthereareseriousconcernsforusingACTandSATkindsoftestsforwritingplacement:

“Ourinvestigationintothischapter[SATaddingawritingcomponent](andintothetimedessaycomponentoftheACT,whichisoptional)foundthatmanyoftheconcernsaboutthetestthathavebeenexpressedinthepopularpressandinprofessionalforumsarewarranted.Theseareseriousconcernsthatspeaktothepotentialofthistesttocompromisestudentwritersandunderminelongstandingeffortstoimprovewritinginstructioninthenation’sschools.”

SomeoftheirfindingsindicateareasofconcerninregardtovalidityandreliabilityofACTandSATwritingtests:

• TheSATandACTarebothtimedwritingtests.Thismeanstheyhavethesamereliabilityandvalidityasexistingtimewritingtests[suchastheEPT]

• “Thepredictivevalidityofashort,impromptu,holisticallyscoredessayisseverelylimitedwhenitcomestopredictingfirst-yearcoursegrades,first-yearwritingperformanceorretention”(3)

• “Thekindofwritingskillrequiredtodowellonshort,timedessaytestshaslittleinstructionalvalidity”(3)

• “TheSATwritingtest[andother,similartestssuchastheACT]wasdevelopedfortherelativelynarrowpurposeofcollegeadmissiondecisionsandit’snotappropriateforotherpurposes”(4)

Additionally,OlsonandTouchette,authorsofaCompositionandWritingProgramAdministrationDatabaseentitledCompFAQs“Placement:Testing,”identifiedthesereasonsNOTtousetimedwritingtestsliketheSAT,ACTorevenEPT:

• TheSATandACTwerenotdesignedforuseincourseplacement.

• Thetestspromoteproblematicunderstandingsofwhatgoodwritingis.

• Thetestsdonotprovidestudentswithan“authentic”writingsituation.Thereisnotimeforrevision,editing,etc.andhencethestudent’srealabilitiesarenottested(emphasismine).

• Traditionalstudiesthatonlylookatcorrelationsbetweenscoresandvariousgradesdonottakeallrelevantfactorsintoaccount(ie:socioeconomics,race,1stgenerationcollegestudent,etc)andhenceprovideinaccurateinformation.

• Highschoolgradesarethemostreliableindicatorofsuccessincollegecourses.

• Curriculumbasedtestsaremorevalidindicatorsofsuccess(emphasismine).

Currently,theCaliforniaStateUniversityusestheEnglishPlacementTest(EPT)toplacestudentsintoremedialwriting.TheEPTandotherstandardized,multiplechoice,timedwritingtestsdonotplacestudentsaccurately:Researchassertsthattimedessaytestsattheirbestonlyshowa0.5predictivevalidity,meaningthattheyonlyaccuratelyplacestudents50%ofthetime,therebymisplacingstudents50%ofthetime(McKendy;MatzenandJoyt;Breland,Bridgemann,andFowles).

Page 5: David T. Conley Redefining College Readiness · 3 critical reading and writing), Summary / Conversation (how to incorporate outside sources into writing, cite them, and avoid plagiarism),

5

WHYDIRECTEDSELF-PLACEMENT(DSP)?

PartofthereasontheCompositionfacultystartedlookingforalternativestotestssuchastheEPTisbecausewealreadyknewabouttheirpredictivevalidityANDwealsoexperiencedstudents’dissatisfactionwiththeirplacements.Itwascommontohavestudentsinremedialclasseswhohadbadattitudesaboutdoingtheworkofthecourse.SomestudentswhowereplacedinremedialclasseshadbeeninAPclassesinhighschoolandresistedbeinglabeledremedial,forexample.Ontheotherend,studentswhomighthavebetterbelongedinremedialclassescarryastigmaattachedtothemthataffectstheirperformanceinclasses.Thisstigmaofbeinglabeled“remedial”sendsamessageto(ourmostlynon-white,secondlanguagespeaking,firstgenerationcollegestudents)thatcollegeisnottheplaceforthem–fromtheirveryfirstsemester(ornow,beforetheyevencometocollege,becauseoftheEarlyStartrequirement.).

OurprogrammovedtoDSPtoaddressourstudentpopulation’sneedsandtoreducethestigmaofremediation.ResearchbyRoyerandGilles,PinterandSims,Chernekoff,CornellandNewton,Frus,Tompkins,andBlakesly,Harvey,andReynoldsdemonstratesthatstudentsdomakeaccurateplacementdecisionswhendirected.

Ourprogramsawthevalueofstudentsmakingtheirowneducatedchoicesbecausethatiswhatcollegeisabout:studentsthinkingcritically,makingdecisions,andmanagingtheconsequencesofthosedecisions.ResearchonDSPshowsthatstudentscanmakesuccessfuldecisionsbasedontheirsenseofself-efficacy.EricaReynoldsstudiedself-efficacyinrelationtoDSPinwritingstudies;shedefinesself-efficacy:"StudiesconductedbyMcCarthy,Meier,Rinderer(1985),Bruning,Murphy,andShell(1989),andJohnsonandPajares(1994)haveshownthatself-efficacy,whichisexpressedasasituationandsubject-specificpersonalconfidenceinone'sabilitytosuccessfullyperformtasksatagivenlevel,isastrongpredictorofactualability"(85).

Additionally,theStretchOptiontwo-semestercoursecreateslearningcommunitiesforstudents,whichcanleadtohigherpass,retention,andgraduationrates.AccordingtoGregGlau,studentsinthestretchprogramatArizonaStateUniversitypassthefirst-yearandsecond-yearwritingrequirementsatahigherratethanthosewhodonottakestretchcomposition.Inaddition,accordingtoGlau’sarticle,SouthernIllinoisUniversityatCarbondaleandWestChesterUniversityinPennsylvaniahavealsoseenimprovementinretentionandgraduationrateswiththeirstretchprogram.Ourprogramassessmenthasalsoseenimprovementoverourpreviousprograminretentionrates(seemoreonourprogramassessmentbelow).

StudentsmustpassafinalportfoliooftheirwritinginordertopasstheEnglish5Bor10.Thismovestheassessmentfortheclassfromtheentrancetotheexit(Elbow).Thebestwaytoassessstudents'writingabilitiesiswithinacontextwheretheyhavetheopportunitytopracticewritingasrealwritersdo,ratherthanbaseadecisionontheirplacementonatimedwritingtest,whichresearchersinourfieldhavedemonstrateddoesnothavereliablepredictivevalidityandalsohasanegativeimpactoncurriculum.

CSUFPROGRAM,COURSE,ANDPORTFOLIOASSESSMENTS

Page 6: David T. Conley Redefining College Readiness · 3 critical reading and writing), Summary / Conversation (how to incorporate outside sources into writing, cite them, and avoid plagiarism),

6

Ourprogramhasconductedseveralyearsofassessmentresearchthatincludesindirectmeasuresuchassurveystostudentsandteacherfocusgroupsaswellasdirectmeasures,suchasportfolioscoringandqualitativecomparisonsbetweenstudents’finalwritingportfolios.Ultimately,ourassessmentdatashowthatDSPisanacceptablyvalidplacementmechanism,studentsandteachersfeelthatstudentsplacethemselvesaccurately,teachersfeelthatthenewprogramisappropriateforthestudentlearnerswehaveoncampus,studentscreatebetterwritinginthestretchcomponent,andwehavehigherretentionandpassratescomparedwithourprevious(mainstreaming)program.

DOESDIRECTEDSELF-PLACEMENTWORK?

• DSPandEnglish5A/Band10areappropriateandeffectiveforstudentlearning:“TheFirst-YearWritingProgramAssessmentReport”(150pagesofassessmentandanalysisonthefirsttwoyearsofourprogram),preparedbyAsaoB.Inouein2008,showstheeffectivenessoftheDSPprogramandthestudentlearningoccurringinthewritingprogramfromavarietyofdirectandindirectevidence:portfolioratings,portfoliocompetencymeasures,teachercommentingdata,entryandexitsurveys,passingrates,andgradedistributions.Fromthesedata,theDSPplacementsappeartobeappropriateandeffectiveforstudentlearning.Additionally,thewritingprogramdemonstrateslearninggrowthalongalloutcomesandhighlevelsofsatisfaction.Inparticular,intheanalysissection,Inouestates,“...thedirectandindirectevidenceofstudentlearninginbothoptionssuggeststronglythatinthepopulationatlargethatDSPisacceptablyvalid.Studentshavefewproblemsinthekeyareasinwhichdatawascollected.Moststudentsdemonstratetheprogramoutcomes,passtheircoursesatacceptablerates,achieveoverallcompetencyinacceptablyhighnumbers,feelsatisfiedwiththeircourses,andfindtheircourseplacementsaccurate”(97).

• Whensurveyedoverthecourseofseveralyears(2006-2008andAY2013)andbydifferentresearchers(Crisco,Inoue,Sansone),studentsreported80-95%satisfactionwiththeirchoiceofclasses(seethetablesbelow).

Didyoumakeanaccurateplacementdecision? English5A/B English10

Spring2013(n=306) 95%

Fall2013(n=278) 83%

2007-08Entry(n=1248) 83.9% 91.2%

2007-08Exit(n=1248) 87.7% 96%

Sansone2007(n=728) 88% 94%

2006-07Entry(n=1311) 96% 93%

2006-07Exit(n=1097) 87% 94%

Page 7: David T. Conley Redefining College Readiness · 3 critical reading and writing), Summary / Conversation (how to incorporate outside sources into writing, cite them, and avoid plagiarism),

7

• Infocusgroupswithteacherswhotaughtinboththeold(mainstreaming)programandthenewprogramin2006-07,teachersreportedthatthenewprogramwasmoreappropriateforthestudentlearnersandthatstudentshadmoreconfidence.

o TeachersofbothEnglish5A/Band10reportthattherangeofstudentsintheir

classeswaslessbroad.OneEnglish10teachersaidthatteachingintheoldsystemwasverydifficultbecausehehadstudentswhoseneedsweren’tmetbecausehewouldhavetogooverbasicstuff,whichfeltfundamentaltosomeofthemoreaccomplishedstudents.AnEnglish5A/Bteachersaidthatintheoldprogram,studentsfeltlikeEnglish1wasa“dummyclass”andthatmorepreparedstudentsfeltthatotherswerebehind.Withthenewprogram,studentsdon’tfeelthattheyareaboveanyoneelsebecausetheydecidedtobethere,andmoststudentsplacedthemselvesaccuratelyinthecourse.

o Teachersofboth5A/Band10reportedthatstudentsknewtheexpectations,pacing,andworkoftheclasscomingin,sostudentswerereadytogetstarted.English5A/Bteachersreportedthatstudentsweremoreconfidentinthecoursebecausetheyknewwheretheyweresupposedtobe.Theyalsoreportedthatstudentsfeltmorecomfortableintheclassroomcommunityandbecausetheyconsciouslymadethedecisiontheyknewwhattheyneededtodo.TeachersinEnglish10reportedthatthestudentsinthatclassseemedmorepreparedandweremoreconfidentabouttheirwriting.Theteachersendedupexpectingmorefromthestudentsandtheywereabletogetmoreaccomplishedintheclass.Insomecases,studentswhoweren’tdoingwellwerebeingheldbackbytheirconfidence.

• Teacherswhoworkedintheprevious,mainstreaming,programandinthenew,DSP,

reportedthatstudents’moraleimprovedinthenewprogram.ElizabethSansone,inherthesis“DeterminingtheValidityofDSP:AStudyofPredictiveValidityofDirectedSelfPlacementatCaliforniaStateUniversity-Fresno,”reported84%ofteachersindicatedthatstudentmoralewassignificantlyorgenerallyimproved.

DOSTUDENTSNEEDASTRETCHOPTION?

• PreandposttestanalysesofstudentportfoliosbothfromblindreadersandfromteachersshowthatstudentsinEnglish10consistentlystartoutstrongerbutstudentsinEnglish5A/Bconsistentlymakemoreprogressovertime(Seetablesbelow).

Howarestudentportfoliosratedoverallinblindreadingsessions?

ENGL10 ENGL5A/5B

N Mid Final Diff N Mid Final Diff

AY2007-08* 125 83.2% 86.4% 3.2% 238 73.9% 99.6% 25.7%

AY2008-0983/77

2.46 3.440.99 272/23

52.81 3.58

0.77

Page 8: David T. Conley Redefining College Readiness · 3 critical reading and writing), Summary / Conversation (how to incorporate outside sources into writing, cite them, and avoid plagiarism),

8

AY2009-10 131 2.50 3.38 0.85 156 2.46 3.50 1.04

AY2010-1184/38

2.97 3.580.61 166/15

72.48 3.22

0.74

*In2007-08portfolios,ratingswereonly“Competent”and“NotCompetent.”Thepercentagesinthefirstrowarethenumberofportfoliosjudgedcompetent.

Howarestudentportfoliosratedbytheirteachers?

ENGL10 ENGL5A/5B

N Mid Final Diff N Mid Final Diff

AY2008-09 221 3.80 4.50 0.7 221 3.40 4.30 0.9

AY2009-10 217 3.50 4.300.8 218/24

42.80 3.90

1.1

AY2010-11 237 4.01 4.610.6 171/16

12.34 3.68

1.34

All the overall ratings listed in the above tables are on a scale of 1–6. A score of 3 or higher isconsideredproficient.

• Qualitativeresearchinthereport“FindingsfromtheFirst-yearWritingPortfolioAssessmentProject2007/08”foundthatEnglish5A/BstudentsseemedtobeworkingatamoresophisticatedlevelwiththeirwritingthanEnglish10students.Wecollected120portfoliosfrom10teachers’classes,5fromEnglish10and5fromEnglish5B.Theseportfolioswerereadandcodedforparticularoutcomes:1)JoiningAcademicConversations,2)LanguageUse,3)ReadingEngagement,4)Reflection,5)Research,6)WritingProcess,and7)WritingRhetorically.UsingDiscourseAnalysis(Fairclough,Gee),welookedforstudents’worktospeakforitself;thatis,weagreedtoreadstudentportfoliosasdescriptionofcourseoutcomes,notnecessaryassomesortof“evidence”ofstudents“right”or“wrong”demonstrationoftheoutcomes.WefoundthatwhilemanyEnglish10portfoliosrepresentedthelearningoutcomesstrongly,ingeneral,5Bstudents,asawhole,producedmorecomplexandinterestingwriting.Specifically,intheoutcomesofJoiningAcademicConversations,Reflection,ResearchandWritingRhetorically,English5Bstudentsseemtobeworkingatamoresophisticatedlevel.

• English5A/BcreatesLearningCommunities,awell-researchedpracticeforretention.Infocusgroups,English5A/Bteacherssaidthattheirclasswaslikealearningcommunitybecausebythesecondsemesterstudentskneweachotherandtheysaweachotherimprove.Theteacherwasreadytostartrightinwithoutthebeginningofthesemesterorientationstuff,andstudentswerepreparedtogetgoingaswell.

Page 9: David T. Conley Redefining College Readiness · 3 critical reading and writing), Summary / Conversation (how to incorporate outside sources into writing, cite them, and avoid plagiarism),

9

WHYNOTMAINSTREAMING(ONECOURSEWITHSUPPLEMENTALINSTRUCTION)?

InadditiontotheresearchstatedabovetoshowthatourDPSprogramisappropriateforstudents’abilitylevels,confidence,morale,andimprovementinwriting,thereareacouplemorefactorstoaddresswhymainstreamingisnotanappropriateoptionforourstudents.

• Thefailurerateshavefallenwithournewprogram,incomparisontotheoldprogram.AsaoInoue,ourpreviousassessmentcoordinator,wroteseveralarticlesaboutourFirst-YearWritingProgram.Henotesin“GradingContracts:AssessingTheirEffectivenessonDifferentRacialFormations”thatfailurerateshavefallenfrom16%withouroldprogram(pre2006-07)to9%withthenewprogram.

• Incomparison,ournewprogramisbetterforretention.ResearchbytheOfficeofInstitutionalEffectivenesscomparedourcurrentprogram(DSP)withourpreviousprogram(mainstreaming).Theyfoundthat“Eng5A/Bappearstohaveapositiveeffectonretentionrates.”

• TheCSUcampuswhereweoriginallygotthemainstreamingideafromandbasedourold

programon,has,asof2012,changedtheirapproachtoDSPwithastretchoption.

CURRENTPROGRAMDEVELOPMENT

Whilewehavelotsofevidencethatourprogramisworking,wealsorecognizethatthereisalwaysroomandopportunityforimprovement.Herearesomeofthethingsweareworkingon:

• Weregularlyupdateandrevisecurriculumandcourseresourcesbasedonteacherfeedbackaboutthecourses,ourexperienceofstudents'abilitiesinthecourses,andinrelationtonationalstandardsforwritinginthediscipline.

• WemeetwithinstructorsinEnglish5Aand5B/10toreadanddiscussstudentmidtermandfinalportfolios.Thishelpsteacherstobeonthesamepagewhenassessingstudentwriting,anditgivesourprogramcoherenceasfaraswhatapassingportfoliolookslike.

• Inthesummerof2015,wecreatedEarlyStartcurriculumthatbetterbridgesthehigh

schoolwiththecollegeexperienceandpreparesstudentsformakingthebestchoicewhentheyplacethemselvesinanappropriatefirst-yearwritingcourse.

• Inthesummerof2015,wepilotedaDirectedSelf-PlacementInventoryprocessthatwill

helpstudentstomakeabetterdecision.WearecurrentlyrevisingtheSelfInventoryandareconsideringwaystoimplementit.

THEFIRST-YEARWRITINGPROGRAM’SBOLDNEWVISION

Page 10: David T. Conley Redefining College Readiness · 3 critical reading and writing), Summary / Conversation (how to incorporate outside sources into writing, cite them, and avoid plagiarism),

10

RECOMMENDATION1:Eliminateorreducetherelianceonalltimedwriting(EPT)andmultiple-choicetests(ACTandSAT)aswaystoplacestudentsintoFirst-YearWritingcourses,andsupportDSPonthiscampusandsystemwide.

Asdemonstratedabove,boththeEPTandtestssuchastheACTandSATarenotthebestoptionforplacingstudentsinwritingcourses.Further,DSPallowswritingtobecreatedandevaluatedattheendofthesemester,afterstudentshavehadachancetowriteontopicstheychoose,gothrougharevisionprocess(thewayprofessionalwritersdo),andselecttheirbestwritingtobeevaluated.DSPisabetteroptionforstudentplacementandevaluationofwritingabilitythananytimedwritingtest.

RECOMMENDATION2:EliminatetheEarlyStartEnglishRequirement.

AsEnglishCouncil,acommitteeofEnglishfacultyacrosstheCSU,hasarguedinthe“CSUEnglishCouncilPositionStatement:MandatoryEarlyStart,”EarlyStartisdiscriminatory,punitive,placesunduefinancialburdenonstudents,hasnovalidevidencethatitworksasintended,andisindirectoppositiontothevaluesofDirectedSelf-Placement.StudentsshouldjustbeabletochoosewhichclassorsetofclassestheywanttotaketomeettheirGErequirementforcollegewritingandnothavetotakeasummercoursetostarttheirremediation.EarlyStartcreatesanadditionalandunnecessarybottleneckforstudentsgettingintotheuniversity.

RECOMMENDATION3:Lowerclasssizesfrom25to20inallFirst-YearWritingClasses.

Thismeasure,thoroughlysupportedbyresearchinourdisciplineandstronglyadvocatedbyourprofessionalorganizations,wouldallowtheinstructortogivefirst-yearwritingstudentsmoreindividualattentionandincreasetheirchancesofsuccessnotonlyinfirst-yearwritingclassesbutalsointheirentireacademiccareerattheuniversity.

RECOMMENDATION4:Lowerthefulltimeequivalentforlecturersteachingwritingcoursesfrom5to4courses.

Teachingfirst-yearwritingcourseseffectivelyrequiresfrequentextensiveresponsestostudents’writingassignments,whichmeansamuchheavierper-courseworkloadfortheinstructor.Toensureameaningfulandeffectiveteachingandlearningconditioninfirst-yearwriting,werecommendthatthefulltimeteachingloadforlecturersbereducedtofourclasses.

Additionally,forbothrecommendations3and4,AliceHorning’s“TheDefinitiveArticleonClassSize”providesimportantinformation.Inthismeta-analysisofresearchonclasssize,Horningarguesthatwritingclassesareideallypositionedforthepositiveeffectsoflowerclasssize:

• AlexanderAstin’sworkWhatMattersinCollege?useda“widerangeofmeasureofstudentsuccessandsatisfaction...[and]reportedthatlowstudent-facultyratiohasapositiveimpactonstudentsatisfactionintermsofrelationships,qualityofteachingandonvirtuallyallotheraspectsofstudents’experiences...[and]hasapositiveimpactonwhetherstudentsfinishtheirdegrees”(12).

• RichardLight’sresearchinMakingtheMostofCollegereportsonmorethansixteenhundredinterviewswithundergraduatesinover20collegesofdifferenttypesoveranumberofyears.Hefinds,“Studentafterstudentbringsuptheimportanceofclasssizeinhisorheracademicdevelopment”(15).

Page 11: David T. Conley Redefining College Readiness · 3 critical reading and writing), Summary / Conversation (how to incorporate outside sources into writing, cite them, and avoid plagiarism),

11

• NancySommersandLauraSaltz’sstudyoffourhundredstudentsoverfouryearsentitled“TheNoviceasExpert:WritingtheFreshmanYear”found“Thestudentsthemselvesreportedthatwritingisanessentialelementbywhichtheyget‘invitedintotheireducation’”(16).

• RichardHaswell’s“ClassSizesforFirst-YearRegularandBasicWritingCourses:DataCollectedfromtheWPA-L,1998-1999,2003-2004”providesaconservativeestimateoftimeinvolvedinteachingatypicalfirst-yearwritingcourse:“25students,foursubstantialoutofclassessays,onerequiredindividualconference,endofthesemesterportfolioofwriting.Thetotalis231hours.Thatisthemostconservativeestimate,andamorerealisticoneprobablywouldaddatleast20-30hours.Noticethatan8hourdayof15weeksof5workingdaysaweekaddsupto600hours.Withtwowritingcourses,andwithonethirdthepreparationtimeallowedforthesecondcourse(30minutesinsteadof90)thetotalis402hours.Withthreewritingcourses,theteacherisalreadyworkingovertime(633hours)”(17-18).

• Nationalorganizations’recommendationsforclasssizeandteachingload:CCCC(theConferenceonCollegeCompositionandCommunication,thecollegearmofNCTE)nomorethan20perclass;ideally15.Nomorethan60writingstudentsaterm.ADE(AssociationofDepartmentsofEnglish):nomorethan3sectionsperterm,nomorethan15studentspercourse,nomorethan60studentsperterm.(18-19)

Page 12: David T. Conley Redefining College Readiness · 3 critical reading and writing), Summary / Conversation (how to incorporate outside sources into writing, cite them, and avoid plagiarism),

12

APPENDIXA:DIRECTEDSELF-PLACEMENTDECISIONCHART

Page 13: David T. Conley Redefining College Readiness · 3 critical reading and writing), Summary / Conversation (how to incorporate outside sources into writing, cite them, and avoid plagiarism),

13

APPENDIXB:LISTOFCOLLEGESANDUNIVERSITIESWHOUSEDIRECTEDSELF-PLACEMENTWITHASTRETCHOPTION

DSP Stretch

CaliforniaStateUniversity,Bakersfield X

CaliforniaStateUniversityChannelIslands X X

CaliforniaStateUniversity,Chico X

CaliforniaStateUniversity,DominguezHills X

CaliforniaStateUniversity,EastBay X

CaliforniaStateUniversity,Fresno X X

CaliforniaStateUniversity,Fullerton

HumboldtStateUniversity X X

CaliforniaStateUniversity,LongBeach X

CaliforniaStateUniversity,LosAngeles X X

CaliforniaStateUniversityMaritimeAcademy

CaliforniaStateUniversity,MontereyBay Inprocess Inprocess

CaliforniaStateUniversity,Northridge X

CaliforniaStatePolytechnicUniversity,Pomona X

CaliforniaStateUniversity,Sacramento X

CaliforniaStateUniversity,SanBernardino X X

SanDiegoStateUniversity

SanFranciscoStateUniversity X X

SanJoséStateUniversity X X

CaliforniaPolytechnicStateUniversity,SanLuisObispo X

CaliforniaStateUniversitySanMarcos

SonomaStateUniversity X X

CaliforniaStateUniversity,Stanislaus X X

Page 14: David T. Conley Redefining College Readiness · 3 critical reading and writing), Summary / Conversation (how to incorporate outside sources into writing, cite them, and avoid plagiarism),

14

AuroraUniversity

BelmontUniversity,Nashville,TN

BoiseStateUniversity

ChapmanUniversity,Orange,CA

DanielWebsterCollege

DePauwUniversity

DrewUniversity,Madison,NJ

EasternConnecticutStateUniversity

GovernersStateUniversity

GrandValleyStateUniversity

IllinoisStateUniversity

IndianaUniversity–Purdue,Ft.Wayne

KutztownUniversityofPennsylvania

McDanielCollege,Westminster,MD

MiamiUniversity,Middletown

NorthCarolinaStateUniversity

PortlandStateUniversity

SetonHallUniversity

SouthernIllinoisUniversity,Carbondale

SouthernNewHampshireUniversity

SouthernOregonUniversity

UniversityofColoradoatBoulder

UniversityofIdaho

UniversityofMaine

UniversityofMichigan,AnnArbor

WakeForestUniversity

WrightStateUniversity

Page 15: David T. Conley Redefining College Readiness · 3 critical reading and writing), Summary / Conversation (how to incorporate outside sources into writing, cite them, and avoid plagiarism),

15

LISTOFPUBLICATIONSANDPRESENTATIONSABOUTDSPANDOURWRITINGPROGRAM(BYDATE)

Crisco,Ginny.“TeacherDevelopmentinaDirectedSelf-PlacementProgram:FosteringResponsibleAssessmentandEngagedLearning.”ConferenceofWritingProgramAdministrators.Boise,ID.July2015.

*Inoue,AsaoB.“TheorizingFailureinUSWritingAssessments.”ResearchintheTeachingofEnglish.48(February2014).330-352.

*Notesthatfailurerateshavefallenfrom16%withouroldprogram(pre2006-07)to9%withthenewprogram

Inoue,AsaoB.“GradingContracts:AssessingTheirEffectivenessonDifferentRacialFormations.”RaceandWritingAssessment.Eds.AsaoB.InoueandMyaPoe.PeterLangGMBH2012.

Ketai,RachelLewis.“Race,Remediation,andReadiness:Reassessingthe“Self”inDirectedSelf-Placement.”RaceandWritingAssessment.Eds.AsaoB.InoueandMyaPoe.PeterLangGMBH2012.

Inoue,AsaoB.andMyaPoe.“RacialFormationsinTwoWritingAssessments:RevisitingWhiteandThomas’FindingsontheEnglishPlacementTestafter30Years.”WritingAssessmentinthe21stCentury.EdNorbertElliotandLesPerelman.HamptonPress.2012.

Crisco,Ginny."Directed-SelfPlacementinFirst-YearWriting"CaliforniaStateUniversity-SacramentoGECompassProject.March20,2009.

Inoue,Asao.“SelfAssessmentasProgrammaticCenter:TheFirst-YearWritingProgramandItsAssessmentatCaliforniaStateUniversity,Fresno.”CompositionForum.20(summer2009).

Crisco,Ginny,JosephEng,SugieGoenSalter,KathleenKlompien,BobMayberry,andDanielMelzer.“Assessment,Placement,andInstitutionalChange:StrategiesforCreatingNewWritingRealities.”ConferenceonCollegeCompositionandCommunication.NewOrleans,LA,April2008.

Crisco,Ginny(chair),JoshGeist,RickHansen,JaclynHardy,JenniferMayer,andAndreaOsteen:“ComingtoAgencyThroughDirectedSelf-Placement”ConferenceonCollegeCompositionandCommunication,NewOrleans,LA,April2008.

Sansone,ElizabethM.“DeterminingtheValidityofDSP:AStudyofthePredictiveValidityofDirectedSelf-PlacementatCaliforniaStateUniversityFresno.”ThesisCaliforniaStateUniversity-Sacramento.2007.Print.

Crisco,Ginny.“TheDirectedSelf-PlacementProgramatCSUFresno:PromotingStudentAgencythroughBestPracticesinPlacementandAssessment”EnglishCouncil,Burlingame,CA,March2007.

Page 16: David T. Conley Redefining College Readiness · 3 critical reading and writing), Summary / Conversation (how to incorporate outside sources into writing, cite them, and avoid plagiarism),

16

WORKSCITED

Ball,Arnetha,LindaChristensen,CatheyFleischer,RichHaswell,JeanKetter,RobertYagelski,KathleenYancey.“TheImpactofSATandACTTimedWritingTests.”NationalCouncilofTeachersofEnglish.2005.05Oct1015.Web.

Blakesley,David,ErinJ.Harvey,andEricaJ.Reynolds.“SouthernIllinoisUniversityCarbondaleasanInstitutionalModel:TheEnglish100/101StretchandDirectedSelf-PlacementProgram.”DIRECTEDSELF-PLACEMENT:PRINCIPLESANDPRACTICES.EdsDanielJ.RoyerandRogerGilles.Cresskill,NJ:HamptonPress,2003.207-242.Print.

Breland,Hunter,BrentBridgemannandMaryE.Fowles.WRITINGASSESSMENTINADMISSIONSTOHIGHEREDUCATION:REVIEWANDFRAMEWORK.NewYork:DEEB,1999.Web.

Conley,DavidT.REDEFININGCOLLEGEREADINESS.BillandMelindaGatesFoundation.March2007.5Oct2015.Web.

Cornell,CynthaE.andRobertD.Newton.“TheCaseofaSmallLiberalArtsUniversity:DirectedSelf-PlacementatDePauw.”DIRECTEDSELF-PLACEMENT:PRINCIPLESANDPRACTICES.EdsDanielJ.RoyerandRogerGilles.Cresskill,NJ:HamptonPress,2003.149-178.Print.

Chernekoff,Janice.“IntroducingDirectedSelf-PlacementtoKutztownUniversity.”DIRECTEDSELF-PLACEMENT:PRINCIPLESANDPRACTICES.EdsDanielJ.RoyerandRogerGilles.Cresskill,NJ:HamptonPress,2003.127-148.Print.

Crisco,VirginiaandJenniferMayer.“TheFirst-YearWritingPortfolioAssessmentProjectReport.”CaliforniaStateUniversity-Fresno.DepartmentofEnglish:First-YearWritingProgram.2007.05Oct2015.Web.

CSUEnglishCouncil.“PositionStatement:MandatoryEarlyStart”CSUEnglishCouncil.2010.05Oct2015.Web.

Elbow,Peter.“DirectedSelf-PlacementinRelationtoAssessment:ShiftingtheCrunchfromEntrancetoExit.”DIRECTEDSELF-PLACEMENT:PRINCIPLESANDPRACTICES.EdsDanielJ.RoyerandRogerGilles.Cresskill,NJ:HamptonPress,2003.15-30.Print.

Frus,Phyllis.“DirectedSelf-PlacementataLargeResearchUniversity:AWritingCenterPerspective.”DIRECTEDSELF-PLACEMENT:PRINCIPLESANDPRACTICES.EdsDanielJ.RoyerandRogerGilles.Cresskill,NJ:HamptonPress,2003.179-192.Print.

Glau,Greg.“Stretchat10.”JOURNALOFBASICWRITING.26.2(2007).Print.

Horning,Alice.“TheDefinitiveArticleonClassSize.WPA:WRITINGPROGRAMADMINISTRATION.31.1-2.(Fall/Winter2007).Print.

Inoue,AsaoB.“FYWProgramAssessment–AcademicYear2007-2008.”CaliforniaStateUniversity-Fresno.DepartmentofEnglish:First-YearWritingProgram.2008.05Oct2015.Web.

Inoue,AsaoB.“TheorizingFailureinUSWritingAssessments.”ResearchintheTeachingofEnglish.48(February2014).330-352.

Page 17: David T. Conley Redefining College Readiness · 3 critical reading and writing), Summary / Conversation (how to incorporate outside sources into writing, cite them, and avoid plagiarism),

17

Leimer,TinaandHongtaoYue.“SummaryReportofDSPProgramEvaluation.”CaliforniaStateUniversity-Fresno.DepartmentofEnglish:First-YearWritingProgram.2009.05Oct2015.Web.

Matzen,RichardN.,JeffE.Hoyt.“BasicWritingPlacementwithHolisticallyScoredEssays:ResearchEvidence.”JOURNALOFDEVELOPMENTALEDUCATION.28.1(2004):2-4,6,8,10,12,34.

McKendy,Thomas.“LocallyDevelopedWritingTestsandtheValidityofHolisticScoring.”RESEARCHINTHETEACHINGOFENGLISH.26.2(1992):148-166.

Olson,SarahandDebraTouchette.“Placement:Testing”CompFAQsfromCompPile.2011.05Oct2015.Web.

Pinter,RobbieandEllenSims.“DirectedSelf-PlacementatBelmontUniversity:SharingPower,FormingRelationships,FosteringReflection.”DIRECTEDSELF-PLACEMENT:PRINCIPLESANDPRACTICES.EdsDanielJ.RoyerandRogerGilles.Cresskill,NJ:HamptonPress,2003.107-126.Print.

Reynolds,EricaJ.“TheRoleofSelf-EfficacyinWritingandDirectedSelf-Placement.”DIRECTEDSELF-PLACEMENT:PRINCIPLESANDPRACTICES.EdsDanielJ.RoyerandRogerGilles.Cresskill,NJ:HamptonPress,2003.73-104.Print.

Royer,DanielJ.andRogerGilles.“ThePragmatistFoundationsofDirectedSelf-Placement.”DIRECTEDSELF-PLACEMENT:PRINCIPLESANDPRACTICES.EdsDanielJ.RoyerandRogerGilles.Cresskill,NJ:HamptonPress,2003.49-72.Print.

Sansone,ElizabethM.“DeterminingtheValidityofDSP:AStudyofthePredictiveValidityofDirectedSelf-PlacementatCaliforniaStateUniversityFresno.”ThesisCaliforniaStateUniversity-Sacramento.2007.Print.

Tompkins,Patrick.“DirectedSelf-PlacementinaCommunityCollegeContext.”DIRECTEDSELF-PLACEMENT:PRINCIPLESANDPRACTICES.EdsDanielJ.RoyerandRogerGilles.Cresskill,NJ:HamptonPress,2003.193-206.Print.