37
flipped classroom does not automatically result in higher pass rates a case study for the course Applied Mechanics part 1, 1 st Bachelor, Engineering Science Evert Vanecht student counselor Faculty of Engineering Science KU Leuven

flipped classroom does not automatically result in higher pass rates

  • Upload
    axl

  • View
    44

  • Download
    2

Embed Size (px)

DESCRIPTION

flipped classroom does not automatically result in higher pass rates . a case study for the course Applied Mechanics part 1, 1 st Bachelor, Engineering Science Evert Vanecht student counselor F aculty of Engineering Science KU Leuven. content. higher education in Belgium? - PowerPoint PPT Presentation

Citation preview

Page 1: flipped  classroom does  not automatically result in higher pass rates

flipped classroom does not automatically result in higher pass rates a case study for the course Applied Mechanics part 1, 1st Bachelor, Engineering Science

Evert Vanechtstudent counselorFaculty of Engineering ScienceKU Leuven

Page 2: flipped  classroom does  not automatically result in higher pass rates

2

content

• higher education in Belgium?• what is flipped teaching?• how is this put into practice?• were the students activated?• what is the impact on learning outcomes?• what is the perception of the students?• what does literature say?• how to proceed?

Page 3: flipped  classroom does  not automatically result in higher pass rates

higher education in Flanders?

Page 4: flipped  classroom does  not automatically result in higher pass rates

4

higher education in Flanders?• Flanders

o 5 universities and 22 university collegeso we have a bachelor and master structure (Bologna)o the general admission requirement for Bachelor

Programmes is the Flemish secondary education diploma

o No entrance exams

Page 5: flipped  classroom does  not automatically result in higher pass rates

5

higher education @ KU Leuven ?

• heart of Western Europe• founded in 1425• Belgium's largest and highest-ranked university• one of the oldest and most renowned universities in Europe• caters to more than 40,000 students spread out over 16

faculties• Faculty of Engineering Science has a total of 1,600 students• 523 new first year bachelor students started at our faculty

Page 6: flipped  classroom does  not automatically result in higher pass rates

what is flipped teaching?

Page 7: flipped  classroom does  not automatically result in higher pass rates

7

what is flipped teaching?

• flipped teaching o flipped classroom, backwards classroom, Thayer methodo “blended learning”

• students study new content online (usually at home) • former homework is done in class

o in the classroom: coaching and interaction instead of passive one-way information transfer

source: http://www.knewton.com/flipped-classroom/

Page 8: flipped  classroom does  not automatically result in higher pass rates

8

what is flipped teaching?

source: http://www.knewton.com/flipped-classroom/

Page 9: flipped  classroom does  not automatically result in higher pass rates

9

what is flipped teaching?why flip?

o increase learning outcomes• by beter use of face-to-face time• by activating students during alle phases (before, during, and after

class)

o technology easily available• Many options for recording videos• Many options for streaming

• videolab – Toledo• youtube

Page 10: flipped  classroom does  not automatically result in higher pass rates

how is this put into practice?

Page 11: flipped  classroom does  not automatically result in higher pass rates

11

how is this put into practice?bachelor Engineering Science • Applied Mechanics – part 1 (5 ECTS)

o when: 1st bachelor, 1st semestero teaching team: Prof. Jos Vander Sloten, Prof. Dirk

Vandepitte, Riet Callens, Tinne De Laet, Evert Vanechto number of students: 638 (2 groups)

implemented for the first time this academic year

Page 12: flipped  classroom does  not automatically result in higher pass rates

12

how is this put into practice?traditional?• lectures, practice sessions, exam• limited theory!• exercise exam!

goal: students make exercises during the semester (active/independent)

how did we flip?• before each lesson (except 1st), watch one or more short video’s (max. 15

minutes) • in class:

o brief summaryo exercise on blackboard by teachero solve problem under guidance of teacher and assistent

Page 13: flipped  classroom does  not automatically result in higher pass rates

13

how is this put into practice?• web clips recorded via tablet-screencasts:

• digital recording of tablet screen output, including audio recording (ExplainEverything-app)

• combining ‘development by hand’ (cfr. chalkboard) and pieces of prepared text, graphics and voice recording

• streamed via virtual learning platform (videolab and Toledo)

Page 14: flipped  classroom does  not automatically result in higher pass rates

were the students activated?

Page 15: flipped  classroom does  not automatically result in higher pass rates

15

were the students activated?• during interactive lecture: Yes …

o students made excercises and asked questions

• 15 student representatives (hearing 13 November 2013)o were very enthusiastic about the approach o suggested to implement in other courseso web lectures are a good preparation for the lessonso web clips should not last much longer than 10 minutes

Page 16: flipped  classroom does  not automatically result in higher pass rates

169/2

2/201

3

9/26/2

013

9/30/2

013

10/4/

2013

10/8/

2013

10/12

/2013

10/16

/2013

10/20

/2013

10/24

/2013

10/28

/2013

11/1/

2013

11/5/

2013

11/9/

2013

11/13

/2013

11/17

/2013

11/21

/2013

11/25

/2013

11/29

/2013

12/3/

2013

12/7/

2013

12/11

/2013

12/15

/2013

12/19

/2013

12/23

/2013

12/27

/2013

12/31

/2013

1/4/20

14

1/8/20

14

1/12/2

014

1/16/2

014

1/20/2

014

1/24/2

014

1/28/2

014

0

50

100

150

200

250

300

350

400

group A

Act

ivity

leve

l

Lect

ure

2

Lect

ure

1 (n

o cl

ip)

Lect

ure

3L

4L

5 L 6

L 7

L 8

L 9

L 11

(TTT

)

L 12

L 13 L

14

L 15

were the students activated?• before interaction college:

#stud = 257

Page 17: flipped  classroom does  not automatically result in higher pass rates

179/2

2/201

3

9/26/2

013

9/30/2

013

10/4/

2013

10/8/

2013

10/12

/2013

10/16

/2013

10/20

/2013

10/24

/2013

10/28

/2013

11/1/

2013

11/5/

2013

11/9/

2013

11/13

/2013

11/17

/2013

11/21

/2013

11/25

/2013

11/29

/2013

12/3/

2013

12/7/

2013

12/11

/2013

12/15

/2013

12/19

/2013

12/23

/2013

12/27

/2013

12/31

/2013

1/4/20

14

1/8/20

14

1/12/2

014

1/16/2

014

1/20/2

014

1/24/2

014

1/28/2

014

0

50

100

150

200

250

300

350

400

group A

Act

ivity

leve

l

Lect

ure

2

Lect

ure

1 (n

o cl

ip)

Lect

ure

3L

4L

5 L 6

L 7

L 8

L 9

L 11

(TTT

)

L 12

L 13

wor

k co

llege

L 14

L 15

were the students activated?• before interaction college: No

16%

35%

42%

52%

66%60%

71%

#stud = 257

percentage of students that did not watch

Page 18: flipped  classroom does  not automatically result in higher pass rates

what is the impact on learning outcomes?

Page 19: flipped  classroom does  not automatically result in higher pass rates

what is the impact on learning outcomes?

19

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 200

10

20

30

40

50

60

70

80

score

#stud = 638 mean = 7.3/20standard deviation= 3.6passing rate 29%

Score /20

# st

uden

tsdistribution exam scores all students

Page 20: flipped  classroom does  not automatically result in higher pass rates

what is the impact on learning outcomes?

20

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 200

10

20

30

40

50

60

70

80

score

#stud = 638 mean = 7,3standard deviation= 3,6passing rate 29%

Score /20

# st

uden

tsdistribution exam scores all students

NONE?

Page 21: flipped  classroom does  not automatically result in higher pass rates

21

what is the impact on learning outcomes?correlation between activity level and exam score

Page 22: flipped  classroom does  not automatically result in higher pass rates

22

contradiction!student representatives perceive ‘flipped classroom’

as more activating

many students are not activated before the interactive lecturelearning outcomes are not better

survey• did students got more activated? • were they better prepared for class?• did they study more efficient/effective?

Page 23: flipped  classroom does  not automatically result in higher pass rates

what is the perception of the students?

Page 24: flipped  classroom does  not automatically result in higher pass rates

24

what is the perception of the students?

25% participated in survey35% of these students gave additional feedback17% engineer-architect/ 83% engineer

0

10

20

30

40

50

60

70

80

all students

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20

participants survey

Page 25: flipped  classroom does  not automatically result in higher pass rates

25

what is the perception of the students?- flipped teaching

I’m enthusiastic about the current approach (flipped teaching)

this approach suits me because it forces me to make exercises in class

this approach is not good for me because I could not keep up

full agreement tend to agree tend to disagree totally disagree0%

10%

20%

30%

40%

50%

60%

70%

24%

63%

11%

2%

full agreement tend to agree tend to disagree totally disagree0%

10%

20%

30%

40%

50%

60%

13%

50%

32%

6%

full agreement tend to agree tend to disagree

totally disagree0%

10%

20%

30%

40%

50%

60%

6%

24%

57%

13%

Page 26: flipped  classroom does  not automatically result in higher pass rates

26

what is the perception of the students?- web clips

I found the web clips useful I did not look at the webclips

I prepared myself well for the interactive lectures viewing the web clips before class should be mandatory

?full agreement tend to agree tend to

disagreetotally

disagree

0%

10%

20%

30%

40%

50%

60%

29%

48%

16%

5%

full agreement tend to agree tend to disagree

totally disagree0%

10%

20%

30%

40%

50%

60%

70%

4%11%

24%

61%

full agreement tend to agree tend to disagree

totally disagree0%

10%

20%

30%

40%

50%

6%

41%

47%

4%

full agreement tend to agree tend to disagree

totally disagree0%

10%

20%

30%

40%

50%

15%

41%

31%

12%

Page 27: flipped  classroom does  not automatically result in higher pass rates

27

what is the perception of the students?- interactive lectures

I made excercises in an independent manner during the interactive lectures

I could not keep up during the interactive lectures because I did not master the new concepts yetfull agreement tend to agree tend to disagree totally disagree

0%

10%

20%

30%

40%

50%

60%

9%

53%

36%

2%

full agreement tend to agree tend to disagree totally disagree0%

10%

20%

30%

40%

50%

10%

38% 40%

11%

Page 28: flipped  classroom does  not automatically result in higher pass rates

28

what is the perception of the students?– making excercises

I have made exercises actively and independently during the semester

full agreement tend to agree tend to disagree totally disagree0%

10%

20%

30%

40%

50%

24%

42%

29%

5%

Page 29: flipped  classroom does  not automatically result in higher pass rates

29

what is the perception of the students?– suggestions for us

• webclips should be shorter (boring, too slow) - 27%• slides should be available (to study at own pace) - 11%• content of web clips was repeated at start of class (web clips

redundant and/or first 15 min of interactive lecture of little interest) - 16%

Page 30: flipped  classroom does  not automatically result in higher pass rates

30

what is the perception of the students?– suggestions for themselves

• "I should have made a lot of exercises on a regular basis and not all exercises at the end of the semester"

• “you just have to make enough exercises"• “just do a lot of exercises and start early!"• "I obviously need to practice more during the semester"• "exercises are much more important than theory. I would make

more exercises and then go back to theory when something is unclear. Now I wanted to first understand the theory, and then make exercises. However, this strategy was not correct"

Page 31: flipped  classroom does  not automatically result in higher pass rates

what does literature say?

Page 32: flipped  classroom does  not automatically result in higher pass rates

32

what does literature say?• Freeman et al.

- a meta-analysis of 225 studies that reported data on traditional lectures versus active learning in undergraduate STEM courses

- average examination scores raised by 6%- average failure rate decreased from 34% to 22%- less effective for large class sizes (>110)

• Kettle - watching videos = least enjoyable part for the students- weaker, less diligent students were not equipped for the problem-solving lesson after watching a video

lecture

Freeman et al, PNAS, 2014M. Kettle, Physics Eduction, 2013

Page 33: flipped  classroom does  not automatically result in higher pass rates

33

what does literature say?

• Toto and Nguyen suggest the use of a ‘door check’ quiz- 1 to 3 question quiz to encourage the students to view the web clips

• Lucke et al. suggest the use of a Class Response System (CRS)

- allows students to use their mobile devices to respond to a variety of (graded) questions during class

- encourages student engagement and participation - providing immediate feedback to both students and

instructors- particularly in large classes

R, Toto and H. Nguyen, Frontiers in Education Conference, 2009Lucke et al, Frontiers in Education Conference, 2013

Page 34: flipped  classroom does  not automatically result in higher pass rates

how to proceed?

Page 35: flipped  classroom does  not automatically result in higher pass rates

35

how will we proceed?• we keep on flipping!• interactive lectures

o no summary of the web clip content at the start of class• web colleges

o emphasize importance of preparation o where possible shorter and more powerfulo mandatoryo activating questions during web lecture (grade)o monitor viewing habits and send warnings

Page 36: flipped  classroom does  not automatically result in higher pass rates

36

acknowledgement• thanks to

o Dirk Vandepitte, Jos Vander Sloten, Riet Callens, Kathleen Geraedts, Tinne De Laet

Page 37: flipped  classroom does  not automatically result in higher pass rates

37

questions?suggestions?

Evert Vanechtstudent counselorFaculty of Engineering Science