33
Multimodal Transduction in Secondary School Physics Trevor S. Volkwyn 1,2 John Airey 1,3 Bor Gregorcic 1 Filip Heijkenskjöld 1 3 Department of Languages Linneaus University, Sweden 1 Physics Education Research Group Uppsala University, Sweden 2 Department of Physics and Astronomy University of the Western Cape, South Africa

Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

  • Upload
    others

  • View
    12

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Multimodal Transduction in Secondary School Physics

Trevor S. Volkwyn1,2 John Airey1,3

Bor Gregorcic1 Filip Heijkenskjöld1

3Department of Languages Linneaus University,

Sweden

1Physics Education Research Group Uppsala University,

Sweden

2Department of Physics and Astronomy

University of the Western Cape, South Africa

Page 2: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Page 3: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Want students to work with magnetic field to experience movability of a coordinate system

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Learning goal

Page 4: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Illustrate three types of transduction

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Page 5: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

A critical constellation •  Disciplinary meaning is distributed across modes.

•  Airey & Linder (2009) suggested students need fluency in a critical constellation of modes.

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Scientific Concept

Page 6: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

A persistent resource

•  Students need a persistent semiotic resource that functions as a coordinating hub (Fredlund et al. 2012).

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Page 7: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Theory

Multimodal learning sequence:

1. Set of non-persistent semiotic resources 2. Coordinated around a persistent semiotic resource 3. Creates a critical constellation 4. “Aha!” moment of understanding 5. Confirmatory transduction (this work adds an extra phase to the above established sequence)

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Page 8: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

The need for mediating tools

•  Many physics phenomena are not directly accessible to our senses.

•  Need mediating tools to transduct the meaning potential to a modality that is available to the senses Bezemer & Kress (2008), Newfield (2017).

•  Example: The Earth’s magnetic field.

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Page 9: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

The Earth’s magnetic field

Page 10: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Mediating tool: Compass

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

•  Interests of signmaker: Navigational.

•  Shows direction of magnetic field along surface of the Earth. It points North

•  But this is not the direction of the magnetic field (compass needles are weighted).

Page 11: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Mediating tool: IOLab

•  Device with a coordinate system printed on it (NB!).

•  Gives visual display (graph) on a laptop.

•  Interests of signmaker: pedagogical, but generic.

Page 12: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

•  Want students to work with magnetic field to experience movability of a coordinate system

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Learning goal

Page 13: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

In books coordinates appear fixed:

One major disciplinary affordance of coordinate systems is that they are not fixed.

Pedagogical affordance? How can students experience this movability of a coordinate system?

Example: use a physical coordinate system with three wooden rods in mutually orthogonal arrangement); but no physicist does disciplinary work with this!

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Coordinate Systems y

x

Page 14: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

The task and setup •  Students

worked in pairs •  No detailed

instructions or what they had in front of them

•  Task statement: “Find the magnetic field of the earth in room and paste red arrow to show it.”

Page 15: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Speech

Gaze

Graph

Manipulation – proprioceptory

A multimodal ensemble

Page 16: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

What happens if we move it? … Look at that, holy crap!

Students explore

Page 17: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Speech

Getting a feel for the system

Gaze

Graph

Manipulation – proprioceptory

Page 18: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Help from the teacher

Page 19: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Transduction to an arrow…

Page 20: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Gaze

Graph

Manipulation – proprioceptory

Speech

A critical constellation

Arrow Fredlund et al. (2012) persistent representation as a coordinating hub for meaning making

persistent representation acts as coordinating hub

Page 21: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Theory (so far …)

Multimodal learning sequence:

1. Set of non-persistent semiotic resources 2. Coordinated around a persistent semiotic resource 3. Creates a critical constellation 4. “Aha!” moment of understanding

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Page 22: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

The Aha! Moment…

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

It’s a 90 degree angle there. Aha! That is so cool … Yes!!

Yeah, that makes sense.

Page 23: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

But what happens next?

Page 24: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Confirmatory transduction

New meaning quickly transducted to iconic gesture – a new semiotic resource

Page 25: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Confirmatory transduction

More iconic gesture – using arrow as coordinating hub (Fredlund et. Al. 2012)

Page 26: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Theory

Multimodal learning sequence:

1. Set of non-persistent semiotic resources 2. Coordinated around a persistent semiotic resource 3. Creates a critical constellation 4. “Aha!” moment of understanding 5. Confirmatory transduction

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Page 27: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Three types of transduction

1.  IOLab transducts meaning potential in the room to something available to our senses (graph)

2.  Students can then transduct meaning from the set of resources to a persistent representation (the arrow)

3.  Once students experience the critical constellation, they quickly transduct meaning to a new semiotic resource (gesture) to confirm their new understanding.

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

Page 28: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Conclusions for teachers

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

•  Disciplinary meaning is distributed across semiotic resources (modes).

•  So there is a critical constellation of semiotic resources that is needed.

Page 29: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Conclusions for teachers

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

•  Task must facilitate appropriate coordination.

•  Need to carefully decide what the persistent coordinating semiotic resource will be.

•  Should look for confirmatory transduction to new semiotic resources as signal that learning is taking place.

Page 30: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

References Airey, J. (2009). Science, language, and literacy: Case studies of learning in Swedish university physics (Doctoral dissertation, Acta

Universitatis Upsaliensis). http://publications.uu.se/theses/abstract.xsql?dbid=9547 Airey, J. (2011a). Initiating Collaboration in Higher Education: Disciplinary Literacy and the Scholarship of Teaching and Learning.

Dynamic content and language collaboration in higher education: theory, research, and reflections (pp. 57-65). Cape Town, South Africa: Cape Peninsula University of Technology.

Airey, J. (2011b). The Disciplinary Literacy Discussion Matrix: A Heuristic Tool for Initiating Collaboration in Higher Education. Across the Disciplines, 8(3), unpaginated. Retrieved from http://wac.colostate.edu/atd/clil/airey.cfm

Airey, J. (2013). Disciplinary Literacy. In E. Lundqvist, L. Östman, & R. Säljö (Eds.), Scientific Literacy – teori och praktik (pp. 41-58): Gleerups.

Airey, J. (2014) Representations in Undergraduate Physics. Docent lecture, Ångström Laboratory, 9th June 2014. From http://urn.kb.se/resolve?urn=urn:nbn:se:uu:diva-226598

Airey, J. (2015). Social Semiotics in Higher Education: Examples from teaching and learning in undergraduate physics. In Concorde Hotel/National Institute of Education, Singapore, 3-5 November 2015 (p. 103). Swedish Foundation for International Cooperation in Research in Higher Education (STINT).

Airey, J., & Eriksson, U. (2014). A semiotic analysis of the disciplinary affordances of the Hertzsprung-Russell diagram in astronomy. In The 5th International 360 Conference, Encompassing the Multimodality of Knowledge, May 8-10 2014, Aarhus University, Denmark (p. 22). Aarhus University. Airey, J., Eriksson, U., Fredlund, T., & Linder, C. (2014). The concept of disciplinary affordance. In The 5th International 360

Conference. Encompassing the Multimodality of Knowledge, May 8-10 2014, Aarhus University, Denmark (p. 20). Airey, J., & Linder, C. (2009). A disciplinary discourse perspective on university science learning: Achieving fluency in a critical

constellation of modes. Journal of Research in Science Teaching, 46(1), 27-49. Airey, J., & Linder, C. (2015). Social semiotics in university physics education: leveraging critical constellations of disciplinary

representations. In The 11th Conference of the European Science Education Research Association (ESERA), Aug. 31-4 Sept., 2015 Helsinki. European Science Education Research Association.

Airey, J. & Linder, C. (in press) Social Semiotics in University Physics Education: Multiple Representations in Physics Education Springer.

Page 31: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

References Bezemer, J., & Kress, G. (2008). Writing in multimodal texts: A social semiotic account of designs for learning. Written

Communication, 25(2), 166-195. Christensen, W. M., & Thompson, J. R. (2012). Investigating graphical representations of slope and derivative without a physics

context. Physical Review Special Topics-Physics Education Research, 8(2), 023101. Duval, R. (2006). A cognitive analysis of problems of comprehension in a learning of mathematics. Educational Studies in

Mathematics, 61(1), 103-131. Eriksson, U., Linder, C., Airey, J., & Redfors, A. (2014). Who needs 3D when the Universe is flat?. Science Education, 98(3),

412-442. Eriksson, U., Linder, C., Airey, J., & Redfors, A. (2014). Introducing the Anatomy of Disciplinary Discernment: An Example from

Astronomy. European Journal of Science and Mathematics Education, 2(3), 167-182. Fairclough, N. (1995). Critical discourse analysis. The critical study of language. Language in social life series. Fredlund, T. (2015). Using a Social Semiotic Perspective to Inform the Teaching and Learning of Physics (Doctoral dissertation,

Acta Universitatis Upsaliensis). Fredlund, T., Airey, J., & Linder, C. (2012). Exploring the role of physics representations: an illustrative example from students

sharing knowledge about refraction. European Journal of Physics, 33, 657-666. Fredlund, T., Airey, J., & Linder, C. (2015a). Enhancing the possibilities for learning: variation of disciplinary-relevant aspects in

physics representations. European Journal of Physics, 36(5), 055001. Fredlund, T., Linder, C., & Airey, J. (2015b). Towards addressing transient learning challenges in undergraduate physics: an

example from electrostatics. European Journal of Physics, 36(5), 055002. Fredlund, T., Linder, C., & Airey, J. (2015c). A social semiotic approach to identifying critical aspects. International Journal for

Lesson and Learning Studies, 4(3), 302-316. Fredlund, T., Linder, C., Airey, J., & Linder, A. (2014). Unpacking physics representations: Towards an appreciation of disciplinary

affordance. Physical Review Special Topics-Physics Education Research, 10(2), 020129. Gibson, J. J. (1979). The theory of affordances The Ecological Approach to Visual Perception (pp. 127-143). Boston: Houghton

Miffin. Halliday, M. A. K. (1978). Language as a social semiotic. London: Arnold. Hodge, R., & Kress, G. R. (1988). Social Semiotics. Cambridge: Polity Press. Kelly, A. E., Lesh, R. A., & Baek, J. Y. (2014). Handbook of design research methods in education: Innovations in science,

technology, engineering, and mathematics learning and teaching. Routledge. Kress, G. (2010). Multimodality : A Social Semiotic Approach to Contemporary Communication. London: Routledge.

Page 32: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Lemke, J. L. (1998). Teaching all the languages of science: Words, symbols, images, and actions. In Conference on Science Education in Barcelona.

Linder, A., Airey, J., Mayaba, N., & Webb, P. (2014). Fostering Disciplinary Literacy? South African Physics Lecturers’ Educational Responses to their Students’ Lack of Representational Competence. African Journal of Research in Mathematics, Science and Technology Education, 18(3), 242-252. doi:10.1080/10288457.2014.953294

Lo, M. L. (2012). Variation theory and the improvement of teaching and learning (Vol. 323). Gothenburg: Göteborgs Universitet. Marton, F. (2015). Necessary conditions of learning. New York: Routledge. Marton, F., & Booth, S. (1997). Learning and awareness. Mahwah, NJ: Lawrence Erlbaum Associates.

Marton, F., Tsui, A. B., Chik, P. P., Ko, P. Y., & Lo, M. L. (2004). Classroom Discourse and the Space of Learning. Routledge.

Mavers, D. Glossary of multimodal terms Retrieved 6 May, 2014, from http://multimodalityglossary.wordpress.com/affordance/

McDermott, L. C., & Redish, E. F. (1999). Resource letter: PER-1: Physics education research. American journal of physics, 67(9), 755-767.

Meltzer, D. E. (2002). The relationship between mathematics preparation and conceptual learning gains in physics: A possible “hidden variable” in diagnostic pretest scores. American Journal of Physics, 70(12), 1259-1268.

Mestre, J. P. (Ed.). (2005). Transfer of Learning from a Modern Multidisciplinary Perspective. IAP. Middendorf, J., & Pace, D. (2004). Decoding the disciplines: A model for helping students learn disciplinary ways of thinking. New

directions for teaching and learning, 2004(98), 1-12. Norman, D. A. (1988). The psychology of everyday things. New York: Basic Books. Northedge, A. (2002). Organizing excursions into specialist discourse communities: A sociocultural account of university

teaching. Learning for life in the 21st century: sociocultural perspectives on the future of education, 252-264.

Redish, E. F. (2004). A theoretical framework for physics education research: Modeling student thinking. arXiv preprint physics/0411149.

Sherin, B. L. (2001). How students understand physics equations. Cognition and instruction, 19(4), 479-541.

Thibault, P. (1991). Social semiotics as praxis. Minneapolis: University of Minnesota Press.

Tobias, S. (1986). Peer perspectives: On the teaching of science. Change: The Magazine of Higher Learning, 18(2), 36-41. Van Leeuwen, T. (2005). Introducing social semiotics. London: Routledge. Wu, H-K, & Puntambekar, S. (2012). Pedagogical Affordances of Multiple External Representations in Scientific Processes. Journal

of Science Education and Technology, 21(6), 754-767.

References

Page 33: Multimodal Transduction in Secondary School Physics1081896/FULLTEXT01.pdf · Multimodal Transduction in Secondary School Physics ... Handbook of design research methods in education:

Volkwyn et. al, 8icom, Cape Town, 7-9 December 2016

? Questions