Download pdf - Making Conversations Visible

Making Conversations Visible: The Rocky Road from Dream to Reality…

1

Imperial College London, 2 Sept. 2010

http://creativecommons.org/licenses/by-nc/2.0/uk

Simon Buckingham Shum

Knowledge Media Institute Open University UK http://people.kmi.open.ac.uk/sbs

http://people.kmi.open.ac.uk/sbs

http://creativecommons.org/licenses/by-nc/2.0/uk

My Space…

2

Learning

Sensemaking

Collective Intelligence

Wicked Problems

Computer-Supported…

dialogue

deliberation

argumentation http

://m

edia

.pho

tobu

cket

.com

/imag

e/yi

nyan

g/pe

nelo

peca

ssan

dre/

Tao_

YinY

angE

arth

2.jp

g

participatory inquiry

http://media.photobucket.com/image/yinyang/penelopecassandre/Tao_YinYangEarth2.jpg










3

the journey

Domain

Discourse

Human-Centred Computing for Sensemaking (including Design Rationale, and arguably, many RE tools?)

Domain

Services Interoperability

Discourse

Interaction Design


Learning Curve

Mastery

Domain


Discourse

Interaction Design


7

Compendium has played a number of roles in the design of socio-technical systems

Storyboarding

Requirements Construction

Design Reviews

Data Analysis

Specification

Decision/Design Rationale

Presentations

Knowledge Management

Documentation

Meeting Replay Domain

Modelling

Learning Curve

Mastery

Human-Centred Computing for Sensemaking


Interaction Design

Domain

Discourse

9

Horst Rittel’s IBIS (1972): Issue-Based Information System

10

MacLean et al’s (1987) Design Space Analysis using QOC: Questions/Options/Criteria

Libraries of IBIS templates with critical questions to probe different kinds of arguments

11

Libraries of IBIS templates with critical questions to probe different kinds of arguments

12

Learning Curve

Mastery



Interaction Design

Domain

Discourse

14

http://compendium.open.ac.uk/institute

Compendium “it’s like Excel, but for knowledge”

Originally motivated by the requirement at NYNEX

Science & Technology, for a tool capable of integrating

formal organisational/system modelling with qualitative,

narrative accounts from workplace ethnographers

http://compendium.open.ac.uk/institute

15

Compendium software tool

16

Compendium Java application (from ~1998): visual hypermedia for managing the connections between ideas flexibly

Buckingham Shum, S., Selvin, A., Sierhuis, M., Conklin, J., Haley, C. and Nuseibeh, B. (2006). Hypermedia Support for Argumentation-Based Rationale: 15 Years on from gIBIS and QOC. In: Rationale Management in Software Engineering (Eds.) A.H. Dutoit, R. McCall, I. Mistrik, and B. Paech. Springer-Verlag: Berlin. http://oro.open.ac.uk/3032

http://oro.open.ac.uk/3032

17

gIBIS: graphical IBIS (MCC research prototype, 1989, running in GERM)

18

CM/1, renamed QuestMap (Corporate Memory Systems 1992, spinoff from MCC’s gIBIS)

Issue/Argument Mapping comes of age… (Rob Bracewell, U. Cambridge: DRed: Decision Rationale editor )

Issue/Argument Mapping comes of age…

20

Online Deliberation: Emerging Tools Workshop Online Deliberation 2010, Leeds UK (30 June – 2 July)

www.olnet.org/odet2010

http://www.olnet.org/odet2010

Issue/Argument Mapping comes of age… (David Price, Debategraph.org)

21

Issue/Argument Mapping comes of age… (David Price, Debategraph.org)

22

Issue/Argument Mapping comes of age… (Tim van Gelder, AusThinkConsulting.com)

23

bCsive Online


ShowCase


  Word document with macros

  Turns Word into an argument mapping application

ShowCase


Using Compendium to map and automatically index

replayable video conferences

CoAKTinG Project: www.aktors.org/coakting

Memetic Project: www.memetic-vre.net

e-Dance project: kmi.open.ac.uk/projects/e-dance

http://www.aktors.org/coakting

http://www.memetic-vre.net

28

Collaborative sensemaking in e-Science: Meeting Replay tool for Earth scientists, synchronising video of Mars crew’s discussion as they annotate their mission plans

Copyright, 2004, RIACS/NASA Ames, Open University, Southampton University Not to be used without permission

NASA MR Clip: 00:50

29

Memetic Meeting Replay The CoAKTinG project’s results are now mainstreamed in the Access Grid by the JISC Memetic VRE project

30

Annotation of video inside Compendium The JISC Memetic VRE project led to the e-Dance Project (EPSRC/AHRC/JISC) http://projects.kmi.open.ac.uk/e-dance

http://podcast.open.ac.uk/oulearn/computing-and-ict/podcast-e-dance

http://projects.kmi.open.ac.uk/e-dance

http://podcast.open.ac.uk/oulearn/computing-and-ict/podcast-e-dance

Integrating Compendium with web services (Emergency response coordination scenario)

31 Potter, S. et al. (2007) The Application of Advanced Knowledge Technologies for Emergency Response. Proceedings 4th International Information Systems for Crisis Response and Management (ISCRAM 07) Conference, Delft, The Netherlands. http://eprints.aktors.org/602

http://eprints.aktors.org/602

Integrating Compendium with web services (Emergency response coordination scenario)

32 Potter, S. et al. (2007) The Application of Advanced Knowledge Technologies for Emergency Response. Proceedings 4th International Information Systems for Crisis Response and Management (ISCRAM 07) Conference, Delft, The Netherlands. http://eprints.aktors.org/602


33

http://cohere.open.ac.uk

web annotation for sensemaking

(A winner in the Mozilla/MacArthur Foundation Jetpack for Learning Design Challenge)

http://cohere.open.ac.uk

— Web 2.0 IBIS++ structured deliberation

34

— annotating documents with Firefox plugin

35 De Liddo, A. and Buckingham Shum, S. (2010). Cohere: A prototype for contested collective intelligence. In: ACM Computer Supported Cooperative Work (CSCW 2010) - Workshop: Collective Intelligence In Organizations, February 6-10, 2010, Savannah, Georgia, USA. http://oro.open.ac.uk/19554


36

seeing the connections people make as they annotate the web using Cohere

De Liddo, A. and Buckingham Shum, S. (2010). Cohere: A prototype for contested collective intelligence. In: ACM Computer Supported Cooperative Work (CSCW 2010) - Workshop: Collective Intelligence In Organizations, February 6-10, 2010, Savannah, Georgia, USA. http://oro.open.ac.uk/19554

Visualizing all the connections that a set of analysts have made between web resources

— but this may also be confusing


Visualizing multiple learners’ interpretations of

global warming sources

Connections have been filtered by a set of

semantic relationships grouped as Consistency

— semantic filter of argument map

De Liddo, A. and Buckingham Shum, S. (2010). Cohere: A prototype for contested collective intelligence. In: ACM Computer Supported Cooperative Work (CSCW 2010) - Workshop: Collective Intelligence In Organizations, February 6-10, 2010, Savannah, Georgia, USA. http://oro.open.ac.uk/19554


“Semantic Google Scholar”: Query: What is the lineage of this idea?

39

Buckingham Shum, S.J., Uren, V., Li, G., Sereno, B. and Mancini, C. (2007).Modelling Naturalistic Argumentation in Research Literatures: Representation and Interaction Design Issues. International Journal of Intelligent Systems, (Special Issue on Computational Models of Natural Argument, Eds: C. Reed and F. Grasso, 22, (1), pp.17-47. http://oro.open.ac.uk/6463



— geospatial mashup of ideas

Nodes in the semantic network containing

geolocation data can be visualized in Google Maps

— timeline viz. mashup of ideas

Nodes in the semantic network containing temporal data can be visualized in MIT

Simile’s timeline



Interaction Design

Domain

Discourse

Learning Curve

Mastery

43 Selvin, A., Buckingham Shum, S.J. & Aakhus, M. (2010). The Practice Level in Participatory Design Rationale: Studying Practitioner Moves and Choices. Human Technology: An Interdisciplinary Journal of Humans in ICT Environments (Special Issue on Creativity and Rationale, Ed. Jack Carroll), May 2010. http://oro.open.ac.uk/20948

Knowledge Art (Al Selvin) How can we add immediate value to team meeting with Design Rationale representations? Extract from a generic framework:








Learning Curve

Mastery

Domain


Discourse

Interaction Design


47

Dialogue Mapping

(Jeff Conklin)

Facilitating real time discussion

by mapping contributions

Capturing stakeholder viewpoints in real time to build a visual database

48

Capturing stakeholder viewpoints in real time to build a visual database

49

Ways to cope with overwhelming complexity…

The Power of Pull How Small Moves, Smartly Made, Can Set Big Things in Motion

John Hagel III John Seely Brown Lang Davison

Summary article in Harvard Business Review blog: http://blogs.hbr.org/bigshift/2010/04/a-brief-history-of-the-power-o.html

http://blogs.hbr.org/bigshift/2010/04/a-brief-history-of-the-power-o.html

51

Compendium Argument Map summarising Hagel et al’s (2010) “The Power of Pull”

Ways to cope with overwhelming complexity…

The Leader’s Edge Six Creative Competencies for Navigating Complex Challenges

Charles J. Palus David M. Horth

Summary article in Ivey Business Journal: http://www.iveybusinessjournal.com/article.asp?intArticle_ID=582

http://www.iveybusinessjournal.com/article.asp?intArticle_ID=582

Creative competencies for complex challenges (Palus & Horth 2002: Center for Creative Leadership)

53

Complexity & Chaos

Paying Attention

Personalizing

Imaging Serious Play

Co-Inquiry

Shared Understanding & Sensible Action

Crafting

Based on analysing and mentoring many senior leaders, Palus & Horth recognise a new pattern of competencies in leaders who cope well with overwhelming complexity. CCL has developed practical tools to scaffold these competencies

…how do we nurture these in ourselves (and the next generation)?

Compendium to scaffold CCL’s C2 Competencies

54

2 images from Visual Explorer

http://cclve.blogspot.com

Selvin, A., Buckingham, S., Horth, D., Palus, C. & Sierhuis, M. (2002). Knowledge Art: Visual Sensemaking Using Combined Compendium and Visual Explorer Methodologies. Presented at: The Art of Management and Organisation Conference, King's College London, 3-6 September 2002. http://compendium.open.ac.uk/institute/compendium/papers/aomo2002Compendium.doc

http://cclve.blogspot.com

http://compendium.open.ac.uk/institute/compendium/papers/aomo2002Compendium.doc


55

Cluster images and discussion in Compendium




56

Organise emerging issues for next phase of analysis



57

Conversational Modelling

(Al Selvin & Maarten Sierhuis)

Facilitating real time discussion by

modelling with IBIS templates + other

visual languages

58

Modelling organisational processes in Compendium using a Template

Selvin, A.M. and Buckingham Shum, S.J. (2002) Rapid Knowledge Construction: A Case Study in Corporate Contingency Planning Using Collaborative Hypermedia. Journal of Knowledge and Process Management 9(2):pp. 119-128. http://eprints.aktors.org/48


59

Completing a Compendium template



60

Generating custom documents and diagrams from Compendium templates

BuildAssignableInventory

AssignableInventory

Deviations/Changes

(Engr Sched)Approvals

Integrated/Revised

Requirements

FieldSpecific

Assignments/Assignment

List

InstallationDetails/

Specs/NDO

AssignableInventory

Notice (E1)



61

NASA Compendium session

62

End-user defined modelling stencil

Using Compendium for personnel recovery planning

Example of Conversational Modelling: real time dialogue mapping combined with model driven

templates (AI+IA)

Co-OPR Project (with Austin Tate): http://www.aiai.ed.ac.uk/project/co-opr

http://www.aiai.ed.ac.uk/project/co-opr

64

Personnel Recovery: Planning Cell

Doctrine for Situation Analysis extracted as an Issue Template

Link to the source doctrine document

Issues that require attention (as specified in the doctrine document)

Relevant extract from doctrine publication inside the node for reference

66

Mission Briefing: Intent template

Options may be constrained by predefined ‘doctrine’

67

Capturing political deliberation/rationale

The collective intelligence available in the room and online:

Dialogue Map capturing the team’s deliberations

Visual background structures the display for planning

Option Comparison matrix

Summary of how options trade off against each other, derived from each option analysis

Constraints

Restraints

69

I-X Planning Engine input to Compendium

Issues on which the I-X planning engine provided candidate Options

Large scale NASA e-science field trials:

Interoperability with other databases, software agents and collaboration tools

www.kmi.open.ac.uk/projects/coakting/nasa

Clancey, W.J., Sierhuis, M., Alena, R., Berrios, D., Dowding, J., Graham, J.S., Tyree, K.S., Hirsh, R.L., Garry, W.B., Semple, A., Buckingham Shum, S.J., Shadbolt, N. and Rupert, S. (2005). “Automating CapCom Using Mobile Agents and Robotic Assistants.” 1st Space Exploration Conference, American Institute of Aeronautics and Astronautics, 31 Jan-1 Feb, 2005, Orlando, FL. Available from: AIAA Meeting Papers on Disc [CD-ROM]: Reston, VA, and as Advanced Knowledge Technologies ePrint 375: http://eprints.aktors.org/375

http://www.kmi.open.ac.uk/projects/coakting/nasa


71

NASA e-science field trials (2004 and 2005)

Distributed Mars-Earth planning and data analysis tools for Mars Habitat field trial in Utah desert, supported from US+UK

www.kmi.open.ac.uk/projects/coakting/nasa

http://www.kmi.open.ac.uk/projects/coakting/nasa

72

Collaboration Configuration

Scientist (Mars)

Scientist (Earth)

Scientist (Earth)

Scientist (Mars)

Scientist (Earth)

Software Agent Architecture

(Mars)

Compendium used as a collaboration medium at all intersections: humans+agents, reading+writing maps

RST-telecon-2005-04-11.i.avi 00:49:08

73

NASA testbed: Compendium activity plans for surface exploration, constructed by scientists on ‘Earth’, interpreted by software agents on ‘Mars’

The Compendium nodes and relationships in this plan were interpreted by Brahms software agents for monitoring and coordinating astronaut and robot activity during surface explorations.


RST-telecon-2005-04-11.i.avi 1:11:57

74

NASA testbed: Compendium science data map, generated by software agents, for interpretation by Mars+Earth scientists

The Compendium maps were autonomously created and populated with science data by Brahms software agents that use models of the mission plan, work process, data flow and science data relationships to create the maps.


75

NASA testbed: Compendium-based photo analysis by geologists on ‘Mars’


76

NASA testbed: Compendium scientific feedback map from Earth scientists to Mars colleagues


Reqts Eng = sensemaking in complex adaptive

systems?

77

Cynefin sense-making framework (Kurtz & Snowden, 2003)

78

Sensemaking phenomena (work in progress)

79

Sensemaking Phenomenon in Complex Domains

Sensemaking Infrastructure Opportunity

Dangers of entrained thinking from experts who fail to recognise a novel phenomenon

Complex systems only seem to make sense retrospectively: narrative is an appropriately complex form of knowledge sharing and reflection for such domains Patterns are emergent

Much of the relevant knowledge is tacit, shared through discourse, not formal codifications

Many small signals can build over time into a significant force/change

Sensemaking phenomena and tool requirements

80

Sensemaking Phenomenon in Complex Domains

Sensemaking Infrastructure Opportunity

Dangers of entrained thinking from experts who fail to recognise a novel phenomenon

•  Pay particular attention to exceptions •  Open up to diverse perspectives

Complex systems only seem to make sense retrospectively: narrative is an appropriately complex form of knowledge sharing and reflection for such domains

•  Stories and coherent pathways are important

•  Reflection and overlaying of interpretation(s) is critical

Patterns are emergent •  In addition to top-down, anticipated patterns, generate views bottom-up from the data to expose unexpected phenomena

Much of the relevant knowledge is tacit, shared through discourse, not formal codifications

•  Scaffold the formation of significant inter-personal, learning relationships

Many small signals can build over time into a significant force/change

•  Enable individuals to highlight important events and connections which are then aggregated

•  Suggest connections based on different kinds of significant relationship

Articles, books, news, movies, software, community…

81

CompendiumInstitute

http://projects.kmi.open.ac.uk/hyperdiscourse

http://projects.kmi.open.ac.uk/hyperdiscourse

82

Milestone publications in

human-centred

design rationale research

83

Special Issue on Design Rationale Human-Computer Interaction Journal, 1991 Eds. Carroll and Moran

84

Design Rationale (1996) Eds. Carroll and Moran, LEA

85

Visualizing Argumentation (2003)

www.VisualizingArgumentation.info

Argument mapping for collective sensemaking and organisational memory in design, scholarly publishing, scientific and public policy debates, education

Including 3 chapters about descendants of gIBIS, two of them practice-oriented

http://www.VisualizingArgumentation.info

86

Dialogue Mapping Jeff Conklin (2006)

The craft skill of IBIS mapping to add immediate value in meetings (design rationale’s value proposition cannot be that some unknown person in the future may benefit from your DR)

CogNexus Institute Training in Dialogue and Issue Mapping www.CogNexus.org

http://www.CogNexus.org

87

Rationale Management in Software Engineering (2006). Eds. Dutoit, McCall, Mistrik, and Paech. Springer-Verlag

Creativity and Rationale Special Issue of Human Technology: An Interdisciplinary Journal of Humans in ICT Environments. Ed. John Carroll. www.humantechnology.jyu.fi

88

http://www.humantechnology.jyu.fi