16
University of Washington Collaborative Problem Solving 1 Research Issues in Computer Support for Collaborative Problem Solving Steven L. Tanimoto Collaborative Problem Solving Problem-Based Computer-Supported Collaborative Learning 2 Steven L. Tanimoto University of Washington Collaborative Problem Solving Outline Introduction Collaborative Learning Problem-Based Learning Teaching Problem Formulation Examples Educational Assessment for PBCSCL Conclusions 3 Collaborative Problem Solving Quick Review Crowdsourcing Open call Large network of potential laborers (JeHowe) A question and a meta-question... (TBA) 4 1 2 3 4

Problem-Based Computer-Supported Collaborative · PDF fileCollaborative Problem Solving Problem-Based Computer-Supported ... •Custom-made software: EasyDSP. • Malakuti, Kaveh,

Embed Size (px)

Citation preview

Page 1: Problem-Based Computer-Supported Collaborative · PDF fileCollaborative Problem Solving Problem-Based Computer-Supported ... •Custom-made software: EasyDSP. • Malakuti, Kaveh,

University of WashingtonCollaborative Problem Solving 1

Research Issues in Computer Support for Collaborative Problem Solving

Steven L. Tanimoto

Collaborative Problem Solving

Problem-Based Computer-Supported Collaborative Learning

2

Steven L. TanimotoUniversity of Washington

Collaborative Problem Solving

Outline• Introduction• Collaborative Learning• Problem-Based Learning• Teaching Problem Formulation• Examples• Educational Assessment for PBCSCL• Conclusions

3

Collaborative Problem Solving

Quick Review• Crowdsourcing

– Open call– Large network of potential laborers

• (Jeff Howe)• A question and a meta-question...• (TBA)

4

1

2

3

4

Page 2: Problem-Based Computer-Supported Collaborative · PDF fileCollaborative Problem Solving Problem-Based Computer-Supported ... •Custom-made software: EasyDSP. • Malakuti, Kaveh,

Collaborative Problem Solving

Outline• Introduction• Collaborative Learning• Problem-Based Learning• Teaching Problem Formulation• Examples• Educational Assessment for PBCSCL• Conclusions

5

Collaborative Problem Solving

Why PB-CSCL?• Problem-based: “Authentic,” content is

motivated by the problem; top-down and not bottom-up.

• Collaboration: socially grounded, integrated with communication

• Scalable to complex problems.

6

Collaborative Problem Solving 7

Collaborative Problem Solving

• Students today grow up with technology.

8

5

6

7

8

Page 3: Problem-Based Computer-Supported Collaborative · PDF fileCollaborative Problem Solving Problem-Based Computer-Supported ... •Custom-made software: EasyDSP. • Malakuti, Kaveh,

Collaborative Problem Solving

Meeting Student Expectations

The rapid pace of technological advancement has created a gap between formal education and the expectations of learners who live in an “online experiential environment.”

Borgman, C. L., Abelson, H., Dirks, L., Johnson, R., Koedinger, K. R., Linn, M. C., Lynch, C. A., et al. 2008. Fostering Learning in the Networked World: The Cyberlearning Opportunity and Challenge. (Report of the NSF Task Force on Cyberlearning). http://www.nsf.gov/pubs/2008/nsf08204/nsf08204.pdf

9

Collaborative Problem Solving

New Forms of Engagement• MOOCs attract many participants• Their lectures are effective• Lab activities less so• New forms of online engagement are

needed• Need assessability

10

Collaborative Problem Solving

Teach Collaboration• Develop communication skills• Develop ability to contribute to group• Learn to resolve conflicts• Learn to use collaboration tools

11

Collaborative Problem Solving

Collaborative Learning is More Fun

Students are better motivated.

Employers want engineers who have learned how to work with others.

Collaboration in learning is both a means and an end.

12

Image Provided by Classroom Clipart

9

10

11

12

Page 4: Problem-Based Computer-Supported Collaborative · PDF fileCollaborative Problem Solving Problem-Based Computer-Supported ... •Custom-made software: EasyDSP. • Malakuti, Kaveh,

Collaborative Problem Solving

Students Need to Know PS“the only legitimate goal of education and training should be problem solving.”

--David Jonassen

Learning to Solve Problems: An Instructional Design Guide.San Francisco: Pfeiffer, 2004.

13

Collaborative Problem Solving

Students Need to Know CPSUniversities need to teach students:

Collaborative Problem-Solving

(Both Theory and Skills)

14

Collaborative Problem Solving

Learning from Peers• In a collaboration, the participants may

bring diverse perspectives, and they can learn from each other...

• (even if they are all physicists)

15

Collaborative Problem Solving

Einstein, Newton, and Pascaldecide to play a game of hide-and-seek.It’s Einstein’s turn to count to ten, so he covers his eyes and starts counting to ten. Pascal runs off and hides. Newton draws a one-meter by one-meter square on the ground in front of Einstein and stands in the middle of it. Einstein reaches ten and uncovers his eyes. He sees Newton and immediately exclaims, “Newton, I found you. You’re it!”

Newton smiles and says, “You didn’t find me. You found a Newton over a square meter. You found Pascal!”

16

13

14

15

16

Page 5: Problem-Based Computer-Supported Collaborative · PDF fileCollaborative Problem Solving Problem-Based Computer-Supported ... •Custom-made software: EasyDSP. • Malakuti, Kaveh,

Collaborative Problem Solving

Outline• Introduction• Collaborative Learning• Problem-Based Learning• Teaching Problem Formulation• Examples• Educational Assessment for PBCSCL• Conclusions

17

Collaborative Problem Solving

Foundations of CSCL• Computer-Supported Collaborative

Learning• Constructivist Pedagogy• Socially Grounded Learning• Roles for Computers

18

Collaborative Problem Solving

CSCL Emerged in the early 90s• Roschelle, J. and Teasley, S. 1995. The construction

of shared knowledge in collaborative problem solving. In C. E. O’Malley (ed): Computer Supported Collaborative Learning. Heidelberg: Springer-Verlag, pp.69-97.

• Conferences on CSCL.• Lauren J. Bricker, Steven L. Tanimoto, Alex I.

Rothenberg, Danny C. Hutama, Tina H. Wong — 1995. Multiplayer Activities that Develop Mathematical Coordination. CSCL 95 Conference Proceedings.

19

Collaborative Problem Solving

Definition of Roschelle & Teasley

“Collaboration is a coordinated, synchronous activity that is the result of a continued attempt to construct and maintain a shared conception of a problem.”

(note that having a problem is fundamental to this notion of collaboration)

20

17

18

19

20

Page 6: Problem-Based Computer-Supported Collaborative · PDF fileCollaborative Problem Solving Problem-Based Computer-Supported ... •Custom-made software: EasyDSP. • Malakuti, Kaveh,

Collaborative Problem Solving

Deconstructing the R&S Def’nThe JPS (Joint Problem Space) is a shared knowledge structure that supports problem solving activity by integrating:

(a) goals,(b) descriptions of the current problem state,(c) awareness of available problem-solving actions,(d) associations that relate goals, features of the current problem state, and available actions.

21

Collaborative Problem Solving

Early Example of CSCLCSILE (aka Knowledge Forum)-- Wiki-like forum for co-constructing knowledge through textual externalizationBereiter & Scardemalia

22

Collaborative Problem Solving

ConstructivismPedagogical framework based on the assumption that each learner must build his/her own mental representations of knowledge through interactive processes, rather than simply assimilate it by listening or reading.

23

Collaborative Problem Solving

John Dewey: An Early Constructivist

“The teacher is not in the school to impose certain ideas or to form certain habits in the child, but is there as a member of the community to select the influences which shall affect the child and to assist him in properly responding to these Thus the teacher becomes a partner in the learning process, guiding students to independently discover meaning within the subject area. This philosophy has become an increasingly popular idea within present-day teacher preparatory programs.” (1897)

24

1859-1952

21

22

23

24

Page 7: Problem-Based Computer-Supported Collaborative · PDF fileCollaborative Problem Solving Problem-Based Computer-Supported ... •Custom-made software: EasyDSP. • Malakuti, Kaveh,

Collaborative Problem Solving

To Support Construction of Knowledge

• Provide physical objects/environments• Situate learning socially• Provide meaningful problems• Be a guide on the side, rather than

sage on the stage• Offer tools for communication,

externalization, knowledge processing

25

Collaborative Problem Solving

Socially Grounded Learning• Learning takes place most effectively within

“communities of practice.”• COP: a group of people who interact together in a

social, work context.• Apprenticeships, internships, workshops,

archaeological digs, military training, cooperative education.

• Jean Lave and Etienne Wenger (1991) Situated Learning. Legitimate peripheral participation, Cambridge: University of Cambridge Press.

26

Collaborative Problem Solving

Other CSCL Issues• Group formation & monitoring• Group dynamics -- leadership,

coasting, focus on or distraction from the problem

• Assessment: individual vs. group.

27

Collaborative Problem Solving

Measure the extent• to which a diversity of perspectives is

expressed during the course of a group activity...

28

25

26

27

28

Page 8: Problem-Based Computer-Supported Collaborative · PDF fileCollaborative Problem Solving Problem-Based Computer-Supported ... •Custom-made software: EasyDSP. • Malakuti, Kaveh,

Collaborative Problem Solving

Werner Heisenberg,Kurt Gödel, and Noam Chomsky walk into a bar. Heisenberg turns to the other two and says, “Clearly this is a joke, but how can we figure out if its funny or not?” Gödel replies, “We can’t know that because we’re inside the joke.” Chomsky says, “Of course it’s funny. You’re just telling it wrong.”

29

Collaborative Problem Solving

Jigsaw-Puzzle Activity Structure

• To foster engagement by all group members, structure the activity to provide individual responsibilities.

• Each student finds or builds and learns a different piece of knowledge required in the solution, and is responsible for bringing it to the group.

30

Collaborative Problem Solving

Constructivism in CS Educ.• Before moving on to Problem-Based

Learning, we return to the subject of computer tools that support the expression of algorithms in novel ways.

• Recall our discussions of transparency and liveness in Lecture 3 ...

• (refer to Lecture 3 handout, slides 69-102)

31

Collaborative Problem Solving

Outline• Introduction• Collaborative Learning• Problem-Based Learning• Teaching Problem Formulation• Examples• Educational Assessment for PBCSCL• Conclusions

32

29

30

31

32

Page 9: Problem-Based Computer-Supported Collaborative · PDF fileCollaborative Problem Solving Problem-Based Computer-Supported ... •Custom-made software: EasyDSP. • Malakuti, Kaveh,

Collaborative Problem Solving

Problem-Based Learning• Howard Barrows (1928-2011), medical educator• Students were unmotivated with the traditional

pedagogy• PBL took the forms of diagnosing simulated

patients, solving authentic clinical problems, analyzing knowledge deficiencies, emulating practitioners.

33

Collaborative Problem Solving

Problem-Based Learning (def)“an instructional method that initiates students’ learning by creating a need to solve an authentic problem. During the problem-solving process, students construct content knowledge and develop problem-solving skills as well as self-directed learning skills while working toward a solution to a problem.” (Hung, Jonassen & Liu, 2008).

34

Collaborative Problem Solving

Motivational Aspects• Old-school pedagogy: “drill and kill”

– lack of intellectual motivation• PBL pedagogy:

– the problem motivates the learning of disciplinary knowledge

35

Collaborative Problem Solving

PBL -- Possible Downsides• Potentially higher costs of facilitating

multiple learners or groups at different stages of solving.

• Challenges of obtaining authentic problems and real tools

• Curriculum may be incompletely covered.• Dewey argued for balanced approaches

between student-centered and curriculum-centered.

36

33

34

35

36

Page 10: Problem-Based Computer-Supported Collaborative · PDF fileCollaborative Problem Solving Problem-Based Computer-Supported ... •Custom-made software: EasyDSP. • Malakuti, Kaveh,

Collaborative Problem Solving

Aspects of PBL• Who does the formulation (instructor or

students)?• Brainstorming and information gathering *

(aside: “Support for Creativity”)• Solving process -- is it hosted on a

computer? CoSolve-like system?• Assessment (traditional or PBL-oriented)?

37

Collaborative Problem Solving

Outline• Introduction• Collaborative Learning• Problem-Based Learning• Teaching Problem Formulation• Examples• Educational Assessment for PBCSCL• Conclusions

38

Collaborative Problem Solving

Teaching Problem Formulation• D. Jonassen’s process• Coding• Computational Thinking• Software Engineering and Problem

Posing

39

Collaborative Problem Solving

Scaffolding Problem Formulation

• Providing Preformulations• Providing Formulation Examples• Low-fidelity prototypes• Iterative formulation

40

37

38

39

40

Page 11: Problem-Based Computer-Supported Collaborative · PDF fileCollaborative Problem Solving Problem-Based Computer-Supported ... •Custom-made software: EasyDSP. • Malakuti, Kaveh,

Collaborative Problem Solving

Problem Formulation and Software Engineering• Teaching of problem formulation

shares much in common with teaching of software engineering.

• (refer to Lecture 2 handout, slides 107-113)

41

Collaborative Problem Solving

Outline• Introduction• Collaborative Learning• Problem-Based Learning• Teaching Problem Formulation• Examples• Educational Assessment for PBCSCL• Conclusions

42

Collaborative Problem Solving

PBL in Digital Signal Processing• Course on DSP at the Univ. of Victoria (British Columbia,

Canada) Dept. of Electrical Engineering.• PBL component added to improve student engagement

and ability to solve problems.• Custom-made software: EasyDSP.• Malakuti, Kaveh, and Alexandra Branzan Albu. "EasyDSP: Problem-Based

Learning in Digital Signal Processing." Proceedings of the Canadian Engineering Education Association (2011).

43

Collaborative Problem Solving

PBL in DSP at U. Vic. (cont.)Two examples of problem categories were given to students:• Speech signal enhancement.

– unshielded mic. cable -> 60 hz hum. & Low S/N ratio.– students select SP blocks, justify the selections, tune parameters.

• Webcam face image enhancement for printing.– Low res., inexpensive sensor, overexposure, poor contrast.– students identify methods (e.g., de-noising, sharpening, histogram

equalization, removal of specular regions), implement the sequences of steps, and tune parameters.

Lessons learned:– 1st offering was an intensive learning experience for the instructors.– challenging to teach: 70 students with one T.A. and instructor.– only 15% of students chose to formulate their own problems, in spite of

extra credit for this.

44

41

42

43

44

Page 12: Problem-Based Computer-Supported Collaborative · PDF fileCollaborative Problem Solving Problem-Based Computer-Supported ... •Custom-made software: EasyDSP. • Malakuti, Kaveh,

Collaborative Problem Solving

Collaborative Game Design and PixelMath

• Problem: Design a game that involves image processing. The game should be fun and educational.

• Collaboration: Work in teams of 3 or 4.• Make use of the PixelMath software• Context: “Introduction to Image

Processing and Python” (U.W. course)

45

Collaborative Problem Solving

Example Game for Students• “Transcentration” (related to the card

game “Concentration” and • relating image processing

transformations to the formulas that express them)

46

Collaborative Problem Solving

Problem-Based vs Project-Based

• Problem ∼ Project• Often differences of scale• “Term project” but not “Term problem”• Both may involve design and/or analysis.• Problem -- comports with the Classical

Theory. A project might not.

47

Collaborative Problem Solving

Outline• Introduction• Collaborative Learning• Problem-Based Learning• Teaching Problem Formulation• Examples• Educational Assessment for PBCSCL• Conclusions

48

45

46

47

48

Page 13: Problem-Based Computer-Supported Collaborative · PDF fileCollaborative Problem Solving Problem-Based Computer-Supported ... •Custom-made software: EasyDSP. • Malakuti, Kaveh,

Collaborative Problem Solving

Educational Assessment for PBCSCL

• The challenge of assessment• Facet-based instruction• Event history approach• Object-centered assessment• Hybrid methods

49

Collaborative Problem Solving

The Challenge of Assessment• Did each student learn what s/he was

supposed to learn?• What did each group accomplish?• What did each group learn?• Unobtrusive vs intrusive assessment

50

Collaborative Problem Solving

Facet-Based Pedagogy• A facet is a conception or misconception about

some aspect of a concept.– “Objects in motion tend to come to rest.”

• In disciplines such as physics, catalogs of common facets can be built in advance.

• Assessment reduces to diagnosing what facets a student holds.

• Hunt, E.B. and Minstrell, J. A Cognitive Approach to the Teaching of Physics. In: McGilly, K. (Ed.), Classroom Lessons: Integrating Cognitive Theory and Classroom Practice. Cambridge, MA: MIT Press, 1994, pp. 51-74.

51

Collaborative Problem Solving

INFACT

• INFACT -- Integrated, Networked, Facet-based Assessment Capture Tool.

• The instructor (with computer assistance) diagnoses facets based on students’ forum postings.

• The diagnosis can inform the teacher’s suggestions to students or even re-grouping of teams.

• Tanimoto, S., Carlson, A., Husted, J., Hunt, E., Larsson, J., Madigan, D., & Minstrell, J. (2002, January). Text forum features for small group discussions with facet-based pedagogy. In Proceedings of the conference on computer support for collaborative learning: Foundations for a CSCL community (pp. 554-555). International Society of the Learning Sciences.

52

49

50

51

52

Page 14: Problem-Based Computer-Supported Collaborative · PDF fileCollaborative Problem Solving Problem-Based Computer-Supported ... •Custom-made software: EasyDSP. • Malakuti, Kaveh,

Collaborative Problem Solving

The INFACT Pedagogical Cycle

• Monday: Teacher posts a problem.• Tuesday: Students independently propose solutions

or approaches. Then “curtain” is lifted, so they can see groupmates’ answers.

• Wednesday: Online group discussions.• Friday: Each group posts its consensus solution.

53

Collaborative Problem Solving

Event History Approach• Each student action is logged as an

event.• The event history is analyzed, and

contributions are measured in terms of their intrinsic properties. E.g.,– Average length of discussion post;– Amount of turn-taking;– Use of particular PS operators;

54

Collaborative Problem Solving

Assessing P.S. Collaboration

55

Collaborative Problem Solving

Object-Centered Assessment• Begin with the solution. (e.g., a constructed object)• For each of its components, examine the history of

actions applied to it.• Determine the functional role played by each

student in each action.• Ascribe quality the solution or solution piece to the

quality of a student’s action.

• N. M. Avouris, A. Dimitracopoulou, V. Komis, and C. Fidas. 2002. OCAF: an object-oriented model of analysis of collaborative problem solving. . In Proceedings of the Conference on Computer Support for Collaborative Learning: Foundations for a CSCL Community (CSCL '02), Gerry Stahl (Ed.). International Society of the Learning Sciences 92-101.

56

53

54

55

56

Page 15: Problem-Based Computer-Supported Collaborative · PDF fileCollaborative Problem Solving Problem-Based Computer-Supported ... •Custom-made software: EasyDSP. • Malakuti, Kaveh,

Collaborative Problem Solving

Hybrid Assessment MethodsArticulated assessment:

• Unobtrusive assessment happens continually, behind-the-scenes.• On demand (of decision-making processes or teachers), either in-situ interviewing or separate quizzing or testing is administered.• Triggering depends on both demand for assessment, and an evaluation of the quality of the current assessment through probabilistic reasoning.

57

Collaborative Problem Solving

Outline• Introduction• Collaborative Learning• Problem-Based Learning• Teaching Problem Formulation• Examples• Educational Assessment for PBCSCL• Conclusions

58

Collaborative Problem Solving

Conclusions– Collaborative Learning is a mainstream

approach to pedagogy in STEM fields.– Problem-based learning is also mainstream.– CSPBCL puts the two together.– Students should learn how to manage work,

control agents, as well as formulate and solve.– Assessment methodologies should include a

mix of session based and traditional.– Allowing students to work in international

teams can add relevance for the global nature of future work.

59

Collaborative Problem Solving

Research Issues– How best to foster the learning of problem

formulation.– How best to integrate general computational

tools and communication tools with problem-solving tools.

– Design and analysis of means to interlink problem-based learning and traditional curricula.

– Design and evaluation of articulated assessment systems for measuring student learning during collaborative problem solving.

– Design of supports for creativity plus disciplined solving.

60

57

58

59

60

Page 16: Problem-Based Computer-Supported Collaborative · PDF fileCollaborative Problem Solving Problem-Based Computer-Supported ... •Custom-made software: EasyDSP. • Malakuti, Kaveh,

Collaborative Problem Solving

But what if one has no collaborators?

61

Collaborative Problem Solving

Outline• Introduction• Collaborative Learning• Problem-Based Learning• Teaching Problem Formulation• Examples• Educational Assessment for PBCSCL• Conclusions

62

Collaborative Problem Solving

Thank you

63

61

62

63