October 8-10, 2018The University of Kansas

Lawrence, KS

NCME Special Conference on Classroom Assessment:

Welcome- 2

General Conference Information- 3-4

Conference URL

Media Permission

Name Badges

Print Services

Lactation Room

Gender Neutral Restrooms

ReflectionRoom

Lost and Found

Local Time

Tuesday Night: Downtown Lawrence

Downtown Lawrence Passport

Learn more about Lawrence

Schedule At-A-Glance- 4

Conference Schedule- 5

KansasUnionMap-11(allmealsandsessionswillbeheldonthe5thand6thfloors)

TABLE of CONTENTS

12017 NCME Special Conference on Classroom Assessment

As president of the National Council on Measurement in Education, I’m delighted to welcome you to NCME’s second Special Conference on Classroom Assessment. I believe that NCME members have a great deal to learn, and a great deal to contribute in this area. We are appreciative of the dedication of the Classroom Assessment Task Force, established by Mark Wilson and headed by Dale Whittington and Kristen Huff, in planning the conference program and are grateful to Neal Kingston and the staff of the University of Kansas Achievement and Assessment Institute for serving as our hosts once again. Thanks, too, to all of you for joining the conference as organizers, speakers, and audience members. I look forward to attending the conference sessions and meeting as many of you as possible.

Rebecca ZwickPresident, NCME

WelcomealltothesecondNationalCouncilonMeasurementinEducation(NCME)conferenceonclassroom assessment. The theme of this year’s conference addresses is classroom assessment in the disciplines. During the next day and a half many of the sessions will either be discipline specificorfocusondifferencesorsimilaritiesofbestpracticesindifferentdisciplines.

For those of you who were here last year, welcome back to Lawrence, Kansas and the University of Kansas(Rockchalk,Jayhawk,KU!).Forfirst-timers,Ihopeyouenjoytheexperienceandcomebacksoon!EnjoyyourtimehereandIhopeyoufindtheconferenceinformativeandthoughtprovoking.

It takes a village to raise a child, but also a village to host a conference. While I am honored to have been asked organize and host this conference it would not have occurred without the efforts of many. The idea of NCME adding focus to classroom assessment was one of Mark Wilson’s presidential initiatives. Former NCME Board members Dale Whittington and Kristen Huff were asked to lead an NCME Classroom Assessment Task Force, whose members include Heidi Andrade, Alison Bailey, Susan Brookhart, Caroline Wiley, Mark Wilson, and me.

Amy Clark served as program chair and was responsible for proposal review and session scheduling. As the conference project manager, Michelle Wilson provided the logistical support, without which this conference would not have occurred.

Your host,

Neal Kingston

WELCOME

2

Conference URLhttps://aai.ku.edu/ncme17-special-conference/registration

Media PermissionBy registering for this conference, you grant permission to the National Council on Measurements inEducation(NCME)andAchievementandAssessmentInstitute(AAI)atTheUniversityofKansasto photograph, videotape, audiotape, and otherwise record images as part of the program identifiedbelow.YoureleaseNCME,AAIandtheUniversityfromanyandallliabilityresultingfrom the publication of said photos, videos, or remarks. Publications may include but are not limited to website, publications, social media, and presentations.

Name BadgesName badges are not only a distinctive fashion statement, they are an important way for conference staff to identify conference attendees. Please wear your name badge in all sessions.

Print ServicesJayhawkInkislocatedonthe2ndfloor(thetradebookstoreonthewestside)canmakecopiesandprintfromaflashdrive(seeKansasUnionMap-8).

Lactation RoomTheLactationRoomislocatedonthe5thfloorintheRegionalistRoom(seeKansasUnionMap-46).

Gender Neutral RestroomA Gender Neutral Restroom is located in the Student Involvement and Leadership area on the 4th floor.YoumayaskfordirectionsattheWelcomeDeskonthe4thfloor(seeKansasUnionMap-29a).

Reflection SpaceThereisaReflectionSpacelocatedonthe4thfloor(seeKansasUnionMap-30d).

Lost and FoundIfyoufindanitemoraremissinganitem,pleasecometotheConferenceRegistrationCheck-indesk,locatedonthe5thfloor,turninanitemorinquireaboutamissingitem.TheUnion’sLostandFoundislocatedintheHawkShopConvenienceStoreonthe4thfloor(seeKansasUnionMap-23)

Local TimeKansas time zone is: Central Time Zone

Tuesday Night: Downtown LawrenceSometimes the best kind of breakout session is the one you didn’t have to plan. After getting down to conference business Tuesday, you’ll have the opportunity to hop on a shuttle bus and experience an evening in our historic downtown, a lively, easily walkable district packed with food, fun, shopping, visual art, live music, and more.

GENERAL CONFERENCE INFORMATION

3

Monday, October 8 5:00 pm – 6:30 pm

6:00 pm – 8:00 pm

Tuesday, October 9 8:00 am – 5:00 pm

8:00 am – 9:30 am

9:00 am – 10:00 am

10:00 am – 10:30 am

10:30 am - noon

Noon – 1:00 pm

1:00 pm - 2:15 pm

2:20 pm – 3:35 pm

3:35 pm – 4:00 pm

4:00 pm – 5:15 pm

5:15 pm – 6:00 pm

Wednesday, October 10 8:00 am – 10:00 am

8:00 am – 9:30 am

8:30 am – 9:30 am

9:35 am – 10:35 am

10:35 am – 11:00 am

11:00 am – 12:15 pm

12:15 pm – 1:15 pm

1:15 pm - 2:15 pm

2:20 pm – 3:30 pm

Conference Registration Check-In at DoubleTree, Regency AB

Opening Reception with Appetizer Buffet & Cash Bar at DoubleTree,

Regency AB*

Conference Registration Check-In at Kansas Union, 5th Floor

Breakfast Buffet*

Opening keynote

Refreshment Break*

Session 1

Lunch Buffet*

Session 2

Session 3

Refreshment Break*

Session 4

Classroom Assessment Task Force Fireside Chat

Conference Registration Check-In at Kansas Union, 5th Floor

Breakfast Buffet*

Session 5

Session 6

Refreshment Break*

Session 7

Lunch Buffet*

Session8

Closing plenary session

Downtown Lawrence Passport(found in bag at conference registration check-in)• Deals and discounts at over 25 Downtown Lawrence Inc. member businesses•Presentpassportattimeofpurchase.Offersgoodthrough12/31/18&areone-timeonlyuse.

Learn more about Lawrence• Local food, arts, and entertainment: LAWRENCE.COM• Visitors guide: EXPLORELAWRENCE.COM• Local news & weather: LJWORLD.COM

SCHEDULE AT-A-GLANCE

4*meals included in registration

Monday, October 8DoubleTree by Hilton Hotel, 200 McDonald Dr, Lawrence, KS

5:00 pm – 6:30 pm | Conference Check-In

6:00 pm – 8:00 pm | Opening Reception with Appetizer Buffet & Cash Bar at DoubleTree* Location: Regency AB

Tuesday, October 9University of Kansas, Kansas Union, 1301 Jayhawk Blvd, Lawrence, KS

8:00 am – 9:30 am | Breakfast Buffet*

8:00 am – 5:00 pm | Conference Check-In Location: 5th Floor, Kansas Union

9:00 am – 10:00 am | Opening Plenary Session: Dylan Wiliam, Keynote Speaker Location: Woodruff Auditorium

Keynote Presentation: Formative and summative classroom assessment: Where we are and where we might go. Since the pioneering work of Benjamin Bloom on mastery learning in 1968, there has been increasing acceptance that teaching should be a contingent activity. What a student learns from a particular sequence of instructional activities is impossible to predict with any accuracy, and since effective instruction must begin from what the learner already knows, assessment is a central process in instruction—the bridge between teaching and learning. However, the role of assessment in guiding instruction is much less straightforward where, as they do in the United States, teachers have responsibility both for instructing their students and for certifying their achievements. In this keynote presentation, Dylan Wiliam will review developments in classroom assessment over the last 50 years, focusing in particular on what we have learned about the role of assessment in improving learning, the evidence about the impact that such practices can have on student achievement, and how teachers can be supported in using

assessment to improve their the quality of their instruction and at the same time produce useful information for key stakeholders about the extent of their students’ achievements.

CONFERENCE SCHEDULE

5

10:00 am – 10:30 am | Refreshment Break* Location: Big 12 Room

10:30 am - noon | Session 1

1A: Why Purpose and Grain-Size Matters in the Design of Learning Trajectories/Progressions- Based Classroom Assessment- Jere Confrey, Leanne Ketterlin Geller, Michele Carney, Edith Aurora Graf, & Julie Christensen Location: Malott Room

66

1B: Promoting Educator Use of Effective Formative Assessment Practice: The Michigan FAME Program- Edward Roeber, Kristy Walters, Ellen Vorenkamp, & Tara Kintz Location: Centennial Room

1C: Exploring the Relationship Between Large-Scale and Local Assessments- Ellen Forte, Daisy Rutstein, Kristen Huff, & Sara Cooper Location: Pine Room1D: Continuing the Conversation and Strengthening the Connections- Scott F. Marion, Lorrie Shepard, Mark Wilson, Heather Wheeler, Sue Brookhart, & Dylan Wiliam Location: Kansas Room

1E: Assessment 101: Narrowing the Gap Between the Assessment Industry and Your Classroom- Susan McNally & Peggy Seifert Location: English Room

Noon – 1:00 pm | Lunch Buffet* Location: Ballroom 1:00 pm - 2:15 pm | Session 2

2A: Actionable, meet Reliable. Reliable, Actionable. A new collaboration in Classroom Assessment- Laine Bradshaw, Eric Arena, Patty Bradshaw, & Jennifer White Location: Centennial Room

2B: Assessment in Maker-Centered Learning: Struggles and Opportunities- YJ Kim, Peter Wardrip, Adam Maltese, Chad Ratliff, & Stephanie Chang Location: Pine Room

2C: Classroom assessments to support individualized intervention design: Instantiated examples of data-based individualization- Leanne R. Ketterlin-Geller, Erica Lembke, Stacy Hirt, Erica Mason, & Susan Elliott Location: English Room

2D: Paper Session - Assessment Design Location: Malott Room • Evidence-centered Classroom Assessment Design- Russell Almond, Jeannine Turner, & YJ Kim • Improving Early Literacy Formative Assessments: Item Sampling and Progressive Form Difficulty- Patrick C. Kennedy • Comparing Validation Arguments for classroom assessments across different mathematics learning trajectories- Emily Toutkoushian & Jere Confrey • EdTech’s Role in Increasing Cultural Sensitivity in the Classroom- Christy Spivey, Ketsia Hamilton, Frank Clint, & Kristi Dorman

2E: Multiple Perspectives: How the Reflective Nature of Learning Progressions Can Inform Best Practices- Karin Hess, Bridget Cantrell, Linda Paulus, Stephon Bady, & Julianne Robar Location: Kansas Room

2:20 pm – 3:35 pm | Session 3

3A: Classroom Use of a Cognitive Diagnostic Reading Comprehension Assessment: MOCCA- Ben Seipel, Patrick Kennedy, & John DeFlaminis Location: Centennial Room

3B: Poster Session Location: Jayhawk Room • Middle and High School Mathematics Teachers’ Assessment Practices: Frequency and Confidence- Dorinda J. Gallant • Interim Mini-tests: A Resource for Classroom Assessment- Jie Chen & Wenhao Wang • Improving Math Teachers’ Formative Assessment Training- Tuba Gezer • Effects of Peer Assessment on Student’s Non-Cognitive Outcomes- Hongli Li, Yao Xiong, CharlesVincentHunter,XiuyanGuo,&JacquelynBialo • Evaluation of content maps to help the cause of targeted instruction and learning- Johnny Denbleyker & Ye Ma • Validating classroom assessments of multidimensional science and engineering competencies using Bayesian diagnostic models- Jonathan Templin, Brian Gane, Kerrie Douglas, Sania Zaidi, & Jim Pellegrino • Assessment in the science classroom: A professional learning community centered around assessment practice- Brian Gane, Donald Wink, Nell Kemp, Lauren Levites, & Jenny Sarna • Review of concept inventories to inform multidimensional task-level classroom assessment of electrical engineering fundamentals- David R. Waller, Kerrie A. Douglas, Maryam A. Al-Othman, John H. Cole, & Dimitrios Peroulis • Student Motivation and Grit: Using Extrinsic Motivational Techniques in the Digital Setting- Elizabeth Anderson • Using NGSA to investigate students’ three-dimensional science learning and provide opportunities for individualized instruction- Krystal Madden & Diksha Gaur • How does classroom learning impact large scale achievement testing? —a differential distractor functioning approach- Yi-Ling Cheng • Reliability with Undergraduate Graders in Large-Scale, Multi-Section Courses- Nathan M. Hicks & Kerrie A. Douglas • What Accounts For Mathematics Achievement Motivation Differences Among Various Groups of Nigerian Secondary Schools’ Students?- Oluwatoyin C. Obadare-Akpata • Validating Learning Structures Using Bayesian Inference Networks- Richard Schwarz • Procrustean Assessment: Testing in the Social Studies- Zachary Feldberg

3C: Concurrent Demonstration Session Location: Jayhawk Room • Preview the Digital NCME ITEMS module for the Classroom Assessment Standards- Caroline Wylie • Classroom Progressive Formative Assessments Aligned to State Outcomes- Jewlana Smith-Hunter

3D: NCME Diversity in Testing Committee: Promoting Equity in Classroom Assessments- Lorrie Shepard, Meagan Karvonen, Laura Wright, & Leanne R. Ketterlin-Geller Location: Kansas Room

3E: Paper Session - NGSS Location: Malott Room • Considering the Design and Role of Interim Assessments in the Context of a Next Generation Science Standards System of Assessments- Nathan Dadey & Sara Cooper • The NGSS and New Challenges for Instruction and Assessment- Mary Norris • Using a Novice-Expert Perspective to Structure State and Classroom Assessment Claims/ Interpretations of the NGSS- Brian Gong & Mary Norris

3F: Playful assessment: What is wrong with making assessment fun? - YJ Kim, Kevin Miklasz, Matt Gaydos, & Kris Schwengel Location: Pine Room

7

8

3G: Leveraging the Principles of Automatic Item Generation for Classroom Assessment Item Development- Justin Paulsen Location: English Room

3:35 pm – 4:00 pm | Refreshment Break* Location: Big 12 Room

4:00 pm – 5:15 pm | Session 4

4A: Learning map models in teaching, learning, and assessment: How can we better facilitate teachers’ use?- Lori Andersen, Russell Swinburne Romine, Cary Rogers, & Thresa Bowman Location: Pine Room

4B: A Principled Approach to Assessment Literacy- Scott F. Marion, Carla Evans, Heather Wheeler, & Ryan Lemieux Location: Malott Room

4C: Implementation of Next Generation Science Standards’ Assessments: Views from the classroom, state, and nation- Allison Greenburg, Dawn Cope, & Brian Gong Location: Divine Nine Room

4D: Paper Session - Methods Location: Centennial Room • Effects of Assessment Types on Value-Added Measurement of Educator Effectiveness- Yang Caroline Wang • Clustering Students in a State Classroom Assessment System: Exploring the Usages of Classroom Assessment- Wenhao Wang, Zhi Zheng, & Jie Chen • Reflections on Positioning Diagnostic Classification Modeling in Classroom Assessment- Justin Paulsen & Chris Andrews • Learning Sciences meets Psychometrics: A two-pronged approach to validating classroom assessments aligned to learning trajectories- Meetal Shah & Jere Confrey

4E: A Mapping Journey on the Road to Better Assessment Measurements- Shontell Stanford Location: English Room

4F: Formative Assessment from a Disciplinary Perspective- Heidi Andrade, Paul Deane, Caroline Wylie, Dylan Wiliam, & Neal Kingston Location: Kansas Room

5:15 pm – 6:00 pm | Classroom Assessment Task Force Fireside Chat- Mark Wilson, Dale Whittington, & Kristen Huff Location: Kansas Room

Wednesday, October 10University of Kansas, Kansas Union, 1301 Jayhawk Blvd, Lawrence, KS

8:00 am – 9:30 am | Breakfast Buffet*

8:00 am – 10:00 am | Conference Check-In Location: 5th Floor, Kansas Union

8:30 am – 9:30 am | Session 5

5A: Implementation and Use of Results of Needs Assessment Tools for Local Assessment Systems- Andrew Wiley, Rhonda True, & Shannon Nepple Location: Malott Room

5B: Design and use of innovative science testlets for struggling learners- Lori Andersen, Gail Tiemann, & Michelle Shipman Location: Centennial Room5C: Beyond Multiple Choice Assessments: A Large Urban School District’s Implementation of Curriculum Embedded Performance Tasks- Elizabeth Blackmon & Miranda McLaren Location: Pine Room

5D: Three Principles of Mathematics Assessments- Bryan R. Drost Location: English Room

5E: Uncovering conceptual misunderstandings that lead to short- and long-term challenges in mathematics- Pamela Paek, Sweet San Pedro, Andrew Coulson, & Anthony Claypool Location: Kansas Room

9:35 am – 10:35 am | Session 6

6A: Supporting Teacher Use of Score Reports- Leanne Ketterlin Geller, Amy Clark, Dawna Duke, & Cary Rogers Location: Malott Room

6B: Using teaching simulations to assess and develop skill with interpreting student thinking- Erin Pfaff, Meghan Shaughnessy, & Tim Boerst Location: English Room

6C: Math Assessments for All – identifying and removing barriers for students with disabilities- Anita Harvin & Audra Batson Location: Centennial Room

6D: Evidence of Impact: The Intersection between Assessment, Technology, and Thinking Routines- Bryan R. Drost Location: Pine Room

10:35 am – 11:00 am | Refreshment Break* Location: Big 12 Room

11:00 am – 12:15 pm | Session 7

7A: Invited Session: Progress on progressions (or can we find the state of the art on a map?)- Neal Kingston, Jere Conrefy, Mark Wilson, Karen Barton, Leanne Ketterlin Geller Location: Kansas Room

7B: Using Cognitive Labs to Develop Assessments for Your Advanced Placement Courses- Tia Fechter, Jennifer G. Cromley, Frank Nelson, & Ting Dai Location: Centennial Room

7C: Classroom Assessment Perspectives from Progressive Education: Panelists from Montessori, Reggio Emilia-inspired and Waldorf schools- Angela K. Murray, Bruce Frey, Jennifer Baker Powers, Eric Matthews, Polly Prendergast, & Matthew Steinle Location: Pine Room 9

7D: Paper Session - Classroom Assessment Considerations Location: English Room • Teach to the Test? : A Role of Classroom Assessment to Improve Ambitious Teaching and Students’ Opportunity to Learn- Hyeri Hong • Promoting understanding and applications of validity for teachers’ classroom assessment- Davis Gerber, Jonathan Bostic, & Matthew Lavery

7E: Using Performance Level Descriptors to Guide Development of Classroom Assessments and Rubrics- Catherine Taylor, Cindy Walker, & FengYi Hung Location: Malott Room

12:15 pm – 1:15 pm | Lunch Buffet* Location: Ballroom

1:15 pm - 2:15 pm | Session 8

8A: ELA Assessment Passages: Appropriateness, Multiculturalism, and Classroom Alignment- Brooke Palmer, Brandon Wallace, Christal N. Williams, Danie Jeans, & Tara Wenger Location: Kansas Room

8B: The Psychometrician and the English Teacher: Designing Classroom Based Assessments that Measure and Motivate- Bryan R. Drost Location: Malott Room

2:20 pm – 3:30 pm | Closing Plenary Session Keena Arbuthnot, Keynote Speaker Location: Woodruff Auditorium

10*meals included in registration

Keynote Presentation: MeasuringU.P.(UnderrepresentedPopulations):The Role of Fairness in Assessing Student LearningThe keynote address will utilize Dr. Arbuthnot’s new book, Global Perspectives on Educational Testing: Examining Fairness, High-Stakes and Policy Reform to provide a detailed understanding of the way in which different cultural groups approach and perform on tests and assessments. Dr. Arbuthnot will provide details about The Arbuthnot Assessment Fairness Framework (TAAF), which was developed as a method to evaluate differential performance patterns between test takers on international large scale assessments. Dr. Arbuthnot will show how employing the TAAF Framework can be instrumental in helping policy makers and practitioners better understand the way in which test takers from different groups perform on large scale standardized tests and classroom assessments. The research focuses primarily on The Trends in International Mathematics andScience Study (TIMSS) mathematics test data to explore these differences. Dr. Arbuthnot will challenge the audience to think more critically about cultural differences and highlight ways that practitioners can utilize this research to improve classroom assessments.

LEVEL 3

11 Human Resources

Union Business O�ces, KU Dining Administration, Union IT

12 The Market Food Court13

14 KJHK Studio 366New Dining Concept15

16 Quiet Zone

1718

Impromptu Cafe

19 KJHK 90.7 FM Studios

20 Union Square

21e

Registered Dietitian21a Alcove A

23 Hawk ShopThe CrossroadsBuilding Manager O�ce

24 25 26 Alderson Auditorium27 KU Card Center28 Commerce Bank29 Jayhawk Walk

29a Kansas Union Welcome Desk29b KU Info

30 Student Involvement & Leadership CenterWheat Room Center for Sexuality&Gender Diversity

31 Main Lobby / Traditions Lounge30c Campus Cupboard 30d Reflection Space

32 Marketing, Media & Programs/Student Union Activities33 Administration/Event Services/Catering34 Kansas Union Gallery35 Roasterie Co�ee & Smoothies36 ATM (outside)

LEVEL 1

1 The Jay2 The Cove3 4

Roll20 Esports LoungeBaumgartner Terrace

5 KU Ambassadors

LEVEL 2

6 KU Bookstore7 The Tech Shop8 Jayhawk Ink9 Jayhawk Collection

10 Textbooks

LEVEL 6

48 English Room49 Centennial Room50 Kansas Room51 Pine Room

52 Malott Room53 Divine Nine Room54 Curry Room

LEVEL 5

38 Jayhawk Room39 Parlors40 Ballroom41 Woodru� Auditorium42 International Room

43 Governors RoomMarketing, Media & Programs44

45 Women’s Hall of Fame46 Regionalist Room47 Big 12 Room

KANSAS UNION

PARKING GARAGE WALKWAY IS ON LEVEL 2

E

S

W

N

LOCATION LEVEL LOCATION LEVEL LOCATION LEVEL LOCATION LEVELAdministrationAlcovesAlderson Auditorium ATMBallroomBaumgartner Terrace Big 12 RoomBuilding Manager O�ceCatering O�ce Centennial RoomCenter for Sexuality&Gender DiversityClass Banner DisplayCommerce Bank

Curry RoomThe Crossroads

Union Square

Divine Nine Room English RoomEvent Services/ReservationsGallery Gender Inclusive RestroomGovernors Room Hawk Shop Convenience Store Human Resources Impromptu Café International RoomThe Jay Jayhawk Collection Jayhawk InkJayhawk RoomJayhawk WalkKansas Room

Kansas Union Welcome Desk/Box O�ceKJHK 90.7 FM StudiosKU BookstoreKU Card CenterKU Dining Administration O�ces

KU Women's Hall of FameKU Info

Main Lobby/Traditions Lounge Malott RoomThe Market Food CourtMarketing, Media & ProgramsParking Garage WalkwayParlors Pine RoomCampus Cupboard

Regionalist RoomRegistered DietitianRoasterie Co�ee & SmoothiesRoll20 Esports LoungeRoundtable Room The CoveStudent Union ActivitiesTech Shop

Traditions LoungeTextbooks

Union Business O�cesUnion IT DepartmentWheat RoomWoodru� AuditoriumReflection Space

LEVEL 4LOBBY

AED ATM Elevator Exit Restroom Stairs YOU ARE HERE KU Parking

434451544645,64463

6644454335122546

43243454634,52564

534131422433454

Gender InclusiveRestroom

To MulticulturalResource Center

Walkway To KU Parking Garage

ENTER HEREENTER HERE

ENTER HERE

ENTERHERE

ENTER HERE

30a

Alcove E21f Alcove F22 Roundtable Room

21d Alcove D 21b Alcove B

Patio

Tunnel BelowMiss. St.

30b

11

**

*

**

*

*

*

*