Embed Size (px)
Citation preview
Digital Assessments in Flipped Classrooms Workshop
George SzantoDocent Marketing [email protected] @hippity7Fontys Toetsconferencie 2014
2Voettekst
• 14:55 – 15:05 Introduction of workshop participants
• 15:05 – 15:20 Introduction to my flipped classroom; case & dilemmas
• 15:20 – 15:30 work on dilemmas in pairs
• 15:30 – 15:50 discuss answers to dilemmas as group
• 15:50 – 16:10 Review of George’s efforts & dilemmas: quantitative & qualitative testing
• 16:10 – 16:15 Wrap-up , Q & A.
Agenda
3Voettekst
• Name• Institute or Fontys Service• Classes/Subjects that you teach• Yes/No Digital testing experience• Yes/No Flipped class teaching experience
BRIEF Participant Introductions
Why Flip My Class Motivations of George
International Exchange Students
Student Complaints
Poor Quality Group Work
Fighting, Disputes in Groups
Limited Resources
History of IBMS Sem. 6 eMarketing Strategy class 2011 - 2014
Classical Teaching Flipped Classroom Teaching
Fall 2011
Spring 2011
Fall 2012
Spring 2013
Fall 2013
Spring 2014
Fall 2014
Live Lectures 4 4 4 2
Recorded Lectures 6 26 26 27
Live Workshops 1 2 2 5 5 6 6
Group Presentation in Class 1
Individual Presentation in Class or Video Recording
Indiv
20%Indiv
%30% Indiv In pairs50%
In pairs60%
Extra Group Assignment (20%) 20% 20% 20% 20%
Main Group Assignment Report (80%) 80% 80%
Sit down individual final exam (50 - 80%) 60% 50% 80% 5/6 Individual Open Book/Notes In Class
Quizzes 40 % 40 %
Online discussion board / class participation 20% 10% Peer Grading
Assessments
Digital On Demand SaaS Quizzes
€ 45 per year € 350 per year / 200 students / 1 Lecturer
~ € 2000 per year
14
10 – 14 Minute Executive Level Emarketing Stratety Pitch
15
Introducing the digital testing dilemmas for this workshop
1. BYOD or Fontys Computers?
2. Wifi/Computer Network down – now what?
3. Asynchronous testing & cheating
4. Participation in formative quizzes < 20%
5. Archiving test results for accreditation
6. Technical issues for a few students/quiz
7. Online quizzes – full use of Internet/open resources or not?
8. How to handle students with learning disabilities ?
9. Summative quizzes do not help raise final score of project – now what?
10. Can student take summative quiz outside of workshop?
16
Digital Testing Dilemmas
• For the next 5 minutes, please work in pairs discussing solution(s) to your assigned dilemma
17
Your Solutions to Dilemmas 1-5
18
Your Solutions to Dilemmas 6-10
19Voettekst
• Do digital quizzes improve the performance and quality of the final eMarketing Strategy Plan submitted by students in a flipped classroom?
• What kind of positive and negative feedback is given about the digital quizzes by students who have taken the class?
Key Questions of my Research
Voettekst 20
Dependent & Independent Variables
Final Projec
t Grade
Quiz Scores
Quantity Quality Videos
In-class participatio
n
Student Motivation
Past student
knowledge
# of hrs. studied outside class
Assigned Case
Results Final Exam Spring 2013 (no formative quizzes) N=48
1 1.5 2 2.5 3 3.5 4 4.5 5 5.5 6 6.5 7 7.5 8 8.5 9 9.5 100
2
4
6
8
10
12
Histogram of Grades Using 2 Grading Methods Spring 2013
5.5 Linear Cutoff
Average Grading (Ave - 3/4 One Std. Dev.)
GRADE (Average Grade = 46; Std = 12 )
Num
ber o
f Stu
dent
s
Spring 2013Linear = 23 failures
Average = 11 Failures
22
Results Fall 2013 (where 70% of final grade is from the exam; +formative quizzes)
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100 105 1100
1
2
3
4
5
6
7
Final Exam Scores - Fall 2013 (N=30)
partial creditNo partial credit
Exam Score in Points
Num
ber
of
Stu
dents
No partial credit 24 fail
With partial credit 4 fail
Fall 2013 Poor correlation between formative quiz results and final exam score (but N is small!)
Fall 2013 How about students who take few formative quizzes?
Student Expectations – baseline survey before class starts (N= 24)
Fall 2013 Other Independent Variables – Videos Watched (no correlation, N is small)
Independent Variable – class participation (No correlation, N is small)
Fall 2013 Independent Variable – past GPA full time students (poor correlation, N is small)
Spring & Fall 2014 Summative Quizzes
40.00 50.00 60.00 70.00 80.00 90.00 100.000
2
4
6
8
10
12
f(x) = NaN x + NaNR² = 0 Video Pitch Final Grade vs Quiz Grades (N=67)
Total Quiz Grades (5 or 6 quizzes; maximum total score 100 pts)
Fina
l Vid
eo P
itch
Gra
de
30Voettekst
• Digital summative quizzes don’t seem to help produce quality video pitches
• Student feedback:– Positive, force students to keep up in class– Test deeper understanding of theoretical
concepts• Considering reducing time limits; and
introducing harder questions.
Conclusions
31Voettekst
• SURF website – see:• https://
www.surf.nl/kennis-en-innovatie/kennisbank/onderwerp/leren-en-toetsen/onderwerp/digitaal-toetsen
Additional Resources
Thank You – Q & A
33
