Personalized Learning Message Testing - excelined.org · Where students advance to higher levels of learning when they personally demonstrate mastery of concepts and skills, regardless

@ExcelinEd | www.ExcelinEd.org| © 2018

Personalized Learning Message TestingKarla Phillips

Policy Director, Personalized Learning

March 2018


National Trends

1. Deliberate shift in terminology; from competency-based education toward the broader, more encompassing term “personalized learning”.

2. Significant increase in interest and implementation at both the state and local level. From these pioneers, we are learning key lessons.

3. The biggest takeaway has been the critical role of strategic communication and outreach strategies.


What is this new program I heard

about?

What is your elevator pitch?


The Project

• These trends prompted ExcelinEd to conduct a digital landscape analysis and message testing to explore how to most effectively communicate with stakeholders.

• The national message testing survey included 800 registered voters. The questions asked were carefully constructed from lessons learned through research, understanding of emerging trends and the digital landscape report.

• The message testing results revealed that there are important nuances in both describing personalized learning as well as making the case for it.


What’s In a Name? Competency-Based

• Competency-based education is a niche topic.

• It has been closely associated with discussion of education reform conferences on Twitter as well as micro-credentials and digital badges in a higher education context.

• Personalized learning is more widely used on social media than competency-based education and related terms (proficiency or mastery-based).


Mastery vs. Competency

• Mastery indicates a deeper level of understanding than competency.

• Mastery signals that a student is ready to learn more advanced material, while competency leaves room for doubt.


What’s In a Name? Personalized Learning• Almost half say they have heard the phrase personalized

learning.• But there are significant race and education gaps.

68% of Hispanic voters said no and likewise 59% of voters with only a high school diploma said no.

• The term personalized learning communicates the message well on its own and appears to be intuitive.

“Education catered to individual students focused on their strengths and interests.” –47 year old man

“Learning methods that are adjusted to best meet the needs of each student.” – 59 year old woman.

• Personalized learning is generally well-received but not well-known.


Testing, Testing 1-2-3

Where students advance to higher levels of learning when they personally demonstrate mastery of concepts and skills, regardless of time, place, or pace. It moves us

beyond our current system of grades and credits to one where students must show they have mastered a skill or body of knowledge before moving on to the next concept

or skill.

Having just read this description, do you think this generally sounds like a good idea or a bad idea?

Very Good Idea 35%

Good Idea 45%


MESSAGE TESTING


What Do Voters Want to Know?

We Asked . . . .

“Across the country schools are beginning to adopt “personalized learning” where students advance to higher

levels of learning when they personally demonstrate mastery of concepts and skills, regardless of time, pace, or place. It moves us beyond our current system of grades and credits to one where students must show they have mastered a skill or body of knowledge before moving on to the next concept or

skill.”

Having just read this description, what questions come to mind about this idea?


How Do We Address These Questions?• “How well will the students adjust to this? Will it hurt the students

socially amongst their peers if they advance at a quicker rate or vice versa? Who will be responsible to make sure the student fully grasps the subject at hand? Who determines the "acceptable level" that the students are attempting to attain?”

• “Regarding the term "mastery", is there a federal minimum standard or are the standards left to the states to define?”

• “How will mastery be determined? What will be done to prevent unmotivated students from simply giving up? Is there some sort of bias for which types of students are more likely to be able to succeed (due to resources, time, etc.)”

• “How does it work in practice? What criteria must a student meet to advance to the next level? How is the program evaluated? What are the results so far?”


The Key Messages??

12

THE QUESTION:You will now see a series of statements describing the benefits of “personalized learning” and how it works. For each of the following, please tell me if you think the statement makes you more or less interested in the schools in your area implementing personalized learning”.

• Much more interested?• Somewhat more interested?• Neither more nor less • Somewhat less interested?• Much less interested

Additionally, please choose any words or phrases that stick out to you as particularly important to why the statement makes you more or less interested.


QUICK OBSERVATIONS

13

• Voters were able to choose more than one word, yet in most questions there were clearly words that sparked interest.

• Notice that many times the same word or phrases caught the attention of both voters more and less interested.

• Based on the responses to the open-ended questions, it may be that some words prompted voters to become less interested because the words prompted even more questions for them or their difficulty understanding how it would work.


STUDENT ENGAGEMENT

After hearing the statement below, voters were 76% more interested, 42% much more.

Instruction will be tailored to a student’s strengths and interest to keep them more engaged in their learning

20

60

42

66

57

12

47

1813

47

37

2331

14

29

11

Instruction will be tailored to a student's strengths and interests to keep them more engaged in their learning

More interested Less interested


SEAT-TIME


11

24

10

37

66

55

48

39

13

25

6 61

4

11

20 1821

9

17

43

4 5

Student's progress in school will beevaluated

based on theknowledge

and skills they candemonstrate

successfully rather thanthe

seat time' they havespent

as a student


Students progress in school will be evaluated based on knowledge and skills they can demonstrate successfully

rather than the ‘seat time’ they have spent as a student.


MEANINGFUL DIPLOMAS


24

3530

59 62

42

22 20 2319

36

49 11

16 14

3227

Diplomas will trulyrepresent

that a graduate is preparedwith

the knowledgeand skills

to succeed aftergraduation

givingemployers

confidence

Please click on any words or phrases in the statement below that stick out to you as particularly important to why the statement makes you more/less interested in having ‘personalized learning’ in

schools in your area


Diplomas will truly represent that a graduate is prepared with the knowledge and skills to succeed

after graduation, giving employers confidence.


STUDENT AGENCY


2917

63

2234 32 26

38 3947 50

3924

80

21 24 18 13 1119 21 19

Students will be able to have input into thetypes

of projects andactivities

that helpthem

learn best, increasingtheir

interest and motivation

Please click on any words or phrases in the statement below that stick out to you as particularly important to why the statement makes you more/less interested in having ‘personalized

learning’ in schools in your area


Students will be able to have input into the types of projects and activities that help them learn best

increasing their interest and motivation.


ADVANCEMENT


14

30

48

36

6269

44

19 23

11 15 1711

3732

17

2 3

Students will move to new concepts and skills when theydemonstrate

mastery of the skills that need to come before it

Please click on any words or phrases in the statement below that stick out to you as particularly important to why the statement makes you more/less interested in having ‘personalized

learning’ in schools in your area


Students will move to new concepts and skills when they demonstrate mastery of the skills that need to

come before it.


PACEAfter hearing the statement below, voters were

74% more interested, 38% much more.

Students can learn at a flexible pace that’s right for them in order to ensure they have thoroughly learned

the material.

12

22

72

56

30 28 25

4440

23

1

11

68

53

26 27

8 6

Students can learn at a flexible pace that's right for them in order toensure

they havethoroughly

learned the material



MEETING STUDENTS WHERE THEY AREAfter hearing the statement below, voters were


Teachers will have tools to meet each student where they are in the learning process.

27

67

33

46

26

352826

4135

47

21

3022

Teachers will have tools to meet each student where they are in the learning process



TEACHER FLEXIBILITYAfter hearing the statement below, voters were


Schools may change classroom design, school schedules, and use new technology tools to give teachers more flexibility to help all students.

11

23

3137 36

56

3027

58

242931

50 4955

34

41

8 6

14

14

Schools may change classroomdesign

schoolschedules

and use new technology tools to giveteachers

moreflexibility

to help all students



MEANINGFUL GRADESAfter hearing the statement below, voters were


Student grades will be based on their mastery of content and skills rather than things like attendance, participation and extra credit which don’t necessarily reflect mastery.

3135

73

63 61

1418 17 16

101314

10

2218 20

36

6359

35

1815

Studentgrades

will be based on theirmastery

of content and skills rather thanthings

likeattendance

participation and extracredit

which don'tnecessarily

reflectmastery



Negative Messages

• Students will be evaluated on test after test, meaning even more standardized testing in schools.

• Learning at their own pace means students will do more learning on computers and less interactingwith peers and teachers.

• Teachers will be overworked and expected to do too much for too many students.


Negative Messages

• Schools will not be able to successfully implement this because it will cost too much to get enough teachers and materials to personalize lessons for each students.

• Schools will make their curriculum easier and set low expectations in order to make it look like students aren’t falling behind.


NEW DEFINITIONPersonalized Learning• Personalized learning tailors a student’s

educational experience to meet their unique strengths, interests and needs. In addition, it provides opportunities for increased interaction with teachers and peers and higher levels of student engagement. Students are encouraged to play a greater role – and be more invested - in their learning.

• Coupled with flexibility in pace and delivery, personalized learning is grounded in the idea that students should progress when they demonstrate mastery of key content and skills regardless of the time spent in class or even where instruction takes place.

Building the Foundation

for Personalized

Learning

Mastery-Based Education


Change? Why are we doing

this?

Making the Case


Making the Case

Do you think that students today who graduate with a high school diploma and with good enough grades to get into college are generally ready to succeed in college or career?

Yes, most = 18% - Yes, some = 56%

Do we need to think differently about how school works in America these days?

Strongly agree = 51% - Somewhat agree = 36%


Making the Case

Schools in America are inadequate and therefore we should rethink how we educate children.


Schools in America are outdated and therefore we should rethink how we educate children.



53%

52%

51%

49%

79%

79%

77%

79%

Schools have a one-size-fits all approach to teachingstudents, leaving students who are confused or

struggling behind

Students are not learning the knowledge and skillsthey need in the real world

Many low-income students do not receive a qualityeducation

Teachers aren't given the time or support to addressevery student's individual needs

Major concern Moderate concern

Making the Case - Parents

Below is a list of concerns some have about education today. Please say whether each is a major concern, a moderate concern, a minor concern, or not really a concern to you

personally.

Parents – Top Tier Concerns

Darker colors indicate intensity


Talking Points - Parents

Focus on the future

Knowledge and Skills (transparency)

More interaction with teachers

One-size-fits-all.


About 70% of teachers think they are using personalized learning, and about half of parents think this is practiced in their children’s classrooms.

19%

31%29%

21%

Definitelynot

Not sureYes, Ithink so

Yes,definitely

Parents: To the best of your knowledge, do teachers practice

personalized learning in any of your children’s classrooms?

14%16%

39%

31%

Definitelynot

Not sureYes, Ithink so

Yes,definitely

Teachers: To the best of your knowledge, are you using

personalized learning in the classes you teach?

Reality check


Below is a list of concerns some have about education today. Please say whether each is a major concern, a moderate concern, a minor concern, or not really a concern to you

personally.

63%

61%

47%

43%

86%

86%

80%

76%

Teachers aren't given the time or support to addressevery student's individual needs

Students and teachers must spend too much time ontesting

Students are not learning the knowledge and skillsthey need in the real world

Students aren't taught critical thinking skills

Major concern Moderate concern

Making the Case - Teachers

Teachers – Top Tier Concerns

Darker colors indicate intensity


Talking Points - Teachers

NOT A NEW REFORM.Building off current work and school initiatives

Giving teachers the tools, flexibility and support they need to meet the needs of all kids.

The students will be truly prepared for the next class, grade, semester.


Making the Case – The Public

Nellie Mae Education Foundation: While about half of New Englanders think public high school graduates are prepared for college and career, the majority agree the reality of remedial

course-taking is not acceptable.


Perception - Identifying The Problem

of surveyed community college students believethey are academically prepared for college

Diplomas and credits based on seat time and passing grades have been sending mixed messages.

86% take developmental education.

68%

of parents believe their children are at or above grade level in reading

90% of students are proficient in reading.34%

YET

YET

83% YETearn a degree or certificate within six years.39%

of community college students who were “A” students in high school believe they are on-track


Talking Points – The Public

Meaningful diplomas

Remediation

False signals and mixed messages

Knowledge and skills


The Most Important Message

1. LOCAL2. LOCAL3. LOCAL


New Resource

38

Incorporating results of recent message testing, the Communications Guide offers:

• Lessons Learned• Making the Case for

Change• Parent Priorities• Winning Messages


Resources

39

Toolkits

CBE State Policy Communications ToolkitCommunications Planning for Innovation

Videos

Competency-Based Education: Engaging Students and Personalizing

Learning

Competency-Based Education: Building a Foundation for

Personalized Learning

Achieve Communications ToolkitCompetency-Based Education Toolkit

Competency Education and Personalized Learning

https://www.youtube.com/watch?v=tj2IOpxj1ys&index=1&list=PLamKh0vaiRJOXLFiTuUyTo72N3Rv2AFoE

https://www.youtube.com/watch?v=MRtd4lrXn_A

http://www.excelined.org/wp-content/uploads/02.23.2016-CBE-State-Communications-Toolkit.pdf

http://learningaccelerator.org/media/755d5d44/CommunicationsGuide.pdf

https://www.youtube.com/watch?v=MRtd4lrXn_A&t=12s

https://www.youtube.com/watch?v=tj2IOpxj1ys&t=3s

http://www.achieve.org/CBPCommunicationsToolkit

https://www.edelements.com/competency-based-education-toolkit

https://www.youtube.com/watch?v=IGLJWAQn1CU



https://www.youtube.com/watch?v=tj2IOpxj1ys&index=1&list=PLamKh0vaiRJOXLFiTuUyTo72N3Rv2AFoE

https://www.youtube.com/watch?v=MRtd4lrXn_A


Foundation for Excellence in Education

P.O. Box 10691

Tallahassee, FL 32302

850.391.4090

[email protected]

www.ExcelinEd.org

Thank You!

Karla PhillipsPolicy Director, Personalized Learning

[email protected]@azkarla

mailto:[email protected]

http://www.excelined.org/

mailto:[email protected]

Documents

Personalized Learning Message Testing - excelined.org · Where students advance to higher levels of learning when they personally demonstrate mastery of concepts and skills, regardless