Nijs_Meryc

7/27/2019 Nijs_Meryc

http://slidepdf.com/reader/full/nijsmeryc 1/54

Interactive Technologiesin the Instrumental Classroom

Luc Nijs, MMus, MA, PhDGhent University - IPEM

A ca se s t ud y w i t h t h e Mus i c Pa i n t Mach i ne

1



Longitudinal study: Learning to play the clarinet

Overview

Context

Conclusion

The Music Paint Machine

Embodied Music CognitionTechnology in education

Goals

Features

GoalsMethod

Results

System

2



ContextEmbodied Music Cognition

3



musical experience ~ bodily experience

Context: Embodied Music Cognition

musical understanding is grounded in bodily experience

Use movement to develop musical understanding

⇧

⇧

4



musical experience ~ bodily experience


musical understanding is grounded in bodily experience

Use movement to develop musical understanding

⇧

when learning to playing a musical instrument?

⇧

4



Tristan, 5 yrs old, 2 months of violin


5



Tristan, 5 yrs old, 2 months of violin


5




6



“Riverdancing violinists”Igudesman & Kremer (violin), Joo (piano), Kremerata Baltica


6



expertise ~ bodily motility


6



expertise ??bodily motility➛


7



ContextTechnology in Education

8



Context: Technology in Education

AMIR (I-Maestro)Larkin et al.

WinsingadHoward et al.

9




Practice spaceBrandmeyer et al.

10



Positive

multimodal learning

objective measurement

powerful learning environment

appealing to young people


11



Negative

cognitive load - dependency - internal focus

technology overrules pedagogy

support master-apprentice model

lack of in-depth empirical studies


11



Context: Research Question

How and to what degree

can an interactive music system contribute

to the development of an embodied understanding of music

when learning how to play a musical instrument ?

12



The Music Paint Machine

13



sound

movement

movement

“painting”

Overview of the system

Music Paint Machine

software

14



Mapping

Music Paint Machine

15



music

movement

pitch

amplitude

length

vertical position

stroke thickness

length

bend

turn/twist

step

colour transparancy

drawing direction

colours

Mapping

Music Paint Machine

15



music

movement

pitch

amplitude

length

vertical position

stroke thickness

length

bend

turn/twist

step

colour transparancy

drawing direction

colours

Mapping

Music Paint Machine

15



Objective and goals

Music Paint Machine

musical creativity * playfulness * flow experience

embodied understanding * body movement * multimodality

optimal relationship with instrument * body movement &playing music

stimulate & facilitate learning to play a musical instrument

16



Music Paint Machine

visualization

movement

free play: explore/experiment

monitor

modelling

varied practicesoptimal experience

flow experience presence: bodily engagement

variability

embodied interaction

active role (controller)

external focus of attention

creative visualization

flexible mapping

4 basic aspects & features of the Music Paint Machine

17



Longitudinal studyLearning to play the clarinet with the Music Paint Machine

Winner of the EAPRILBest Research and Practice

Project Award 2012

18



Longitudinal S tudy

12 children Grade 1-2

learn to play the clarinet

IN A NUTSHELL ...

9 months of weekly 1 hour lessonteacher-researcher

19





Longitudinal S tudy

NON-EQUIVALENT GROUPS DESIGN

PRE-TEST TREATMENT TREATMENT TREATMENT

NR O1 O2 O3 O4

NR O1 O2 O3 O4

NR O1 X O2 X O3 X O4


20



Longitudinal S tudy

NON-EQUIVALENT GROUPS DESIGN


NR O1 O2 O3 O4

NR O1 O2 O3 O4



21



Longitudinal S tudy


NR O1 O2 O3 O4

NR O1 O2 O3 O4



home musical environment

personality

self-regulation

learning style

motor abilities

musical aptitude

HMEQ

HiPIC

Schwarzer

VAK

M-ABC-2

PMMA

PRE-TESTS & POST-TEST

21



Longitudinal S tudy



NR O1 O2 O3 O4

NR O1 O2 O3 O4



home musical environment

personality

self-regulation

learning style

motor abilities

musical aptitude

HMEQ

HiPIC

Schwarzer

VAK

M-ABC-2

PMMA

22



Longitudinal S tudy



NR O1 O2 O3 O4

NR O1 O2 O3 O4



x = instruction with MPM

same lesson content

22




NR O1 O2 O3 O4

NR O1 O2 O3 O4



Longitudinal S tudy


x = instruction with MPM

BUT same lesson content

23




NR O1 O2 O3 O4

NR O1 O2 O3 O4



Longitudinal S tudy


music aptitude test

23



Longitudinal S tudy

OTHER REPEATED MEASURES

Classroom Experience Student Agenda Video

132hrs

MPM

“paintings”

logs

practice time

practice support

24



Longitudinal S tudy

Good practices

25

L i di l S d



Free exploration

Guided exploration

Learning trajectory

Longitudinal S tudy

26

L i di l S d



Freeexploration

Longitudinal S tudy

26

L i di l S d



Freeexploration Guided exploration

Make a painting with lots of colours

Play some music while

you turn freely from the left to the rightor vice versa

Longitudinal S tudy

26

M i P i M hi



Learning Trajectory

Music Paint Machine

note values

27

M i P i t M hi



Learning Trajectory

Music Paint Machine

note values

1 2 3 4

28

M i P i t M hi



strong & weak beats

Learning Trajectory

Music Paint Machine

different colour

per half note

29

M i P i t M hi



Music Paint Machine

si

melodic/rhythmic patterns

Text

new note (Bb)& scale (F maj)

semitonesemitone

G Maj

G

F B C BbA

Learning Trajectory

30

L it di l St d



Longitudinal S tudy

Effectiveness

developmental music aptitude (E. Gordon)Primary/Intermediate Measures of Music Audiation

31

L it di l St d



Longitudinal S tudy

• Personality: concentration & anxiety• HME: singing

• small sample• no MPM at home• practices under development

32



Longitudinal Study



Longitudinal S tudy

teacherbehaviour

studentbehaviour

instructionalcontent

teacher-childinteraction

33

Longitudinal Study



Longitudinal S tudy

transformativeimpact

teacherbehaviour

studentbehaviour



33

Longitudinal Study



Longitudinal S tudy

transformativeimpact

teacherbehaviour

studentbehaviour



34



Conclusion

35

Conclusion



Conclusion

(original: Mishra & Koehler)

Music educational technology research

potentially leads to

innovative and conceptually sophisticated solutions

to authentic pedagogical problemsthrough the creative reinterpretation and re-purposing

of existing technologies.

36

Conclusion



Conclusion

Music educational technology research

potentially leads to

innovative and conceptually sophisticated solutions

to authentic pedagogical problems* through the creative reinterpretation and re-purposing

of existing technologies

and

* by providing a pedagogically grounded and practice-

based framework for the development of innovative

educational technologies.

37

Last slide



Last slide...

Thank YOU for your attention!

Questions, remarks, ... ?

38



www.musicpaintmachine.be

www.lucnijs.be

Documents

Nijs_Meryc