26
Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone, Robert, Franco Pestilli, and Katy Börner. 2015. Trends in Cognitive Sciences, doi:10.1016. Presentation at http://events.brainhack.org/global 2017 3/4/2017

Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function

By Goldstone, Robert, Franco

Pestilli, and Katy Börner. 2015.

Trends in Cognitive Sciences,

doi:10.1016.

Presentation at

http://events.brainhack.org/global

2017

3/4/2017

Page 2: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

Overview

• A complete understanding of the brain must incorporate

information about 3D neural location, activity, timing, and task.

• Data mining, high-performance computing, and visualization can

serve as tools that augment human intellect.

• Visualizations must take into account human abilities and

limitations to be effective tools for exploration and communication.

This review discusses key challenges and opportunities that arise when

leveraging the sophisticated perceptual and conceptual processing of

the human brain to help researchers understand brain structure,

function, and behavior.

Page 3: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

VI.2 The Human Connectome - Patric Hagmann and Olaf Sporns - 2008

Page 4: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,
Page 5: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,
Page 6: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,
Page 7: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,
Page 8: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,
Page 9: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

Register for free: http://ivmooc.cns.iu.edu. Class started Jan 10, 2017.

Page 10: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

The Information Visualization MOOCivmooc.cns.iu.edu

Students from more than 100 countries350+ faculty members

#ivmooc

10

Presenter
Presentation Notes
Page 11: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

Course SchedulePart 1: Theory and Hands-On• Session 1 – Workflow Design and Visualization Framework• Session 2 – “When:” Temporal Data• Session 3 – “Where:” Geospatial Data• Session 4 – “What:” Topical DataMid-Term• Session 5 – “With Whom:” Trees• Session 6 – “With Whom:” Networks• Session 7 – Dynamic Visualizations and DeploymentFinal Exam

Part 2: Students work in teams on client projects.

Final grade is based on Homework and Quizzes (10%), Midterm (20%), Final (30%), Client Project (30%), and Class Participation (10%).

11

Page 12: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

12

Find your way

Find collaborators, friends

Identify trends

Terabytes of data

Descriptive &Predictive

Models

12

Different Question Types

Presenter
Presentation Notes
Taking an engineering approach and Believing that anyone can be taught to design meaningful visualizations Different Qs – where, with whom, when
Page 13: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

13

Different Levels of Abstraction/Analysis

Macro/GlobalPopulation Level

Meso/LocalGroup Level

MicroIndividual Level

Presenter
Presentation Notes
Multi-level system, different data, approaches, dynamics, questions,
Page 14: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

Tasks

14See page 5

Page 15: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

Needs-Driven Workflow Design

Stakeholders

Data

READ ANALYZE VISUALIZE

DEPLOY

Validation

Interpretation

Visually encode

data

Overlay data

Select visualiz.

type

Types and levels of analysis determinedata, algorithms & parameters, and deployment

Presenter
Presentation Notes
Focus on Visualization Q type – when where Q level – micro to macro Read = download, survey Analyze = preprocess (annotate, clean, interlink, unify names, extract networks) Iterative refinement
Page 16: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

Needs-Driven Workflow Design

Stakeholders

Data

READ ANALYZE VISUALIZE

DEPLOY

Validation

Interpretation

Visually encode

data

Overlay data

Select visualiz.

type

Types and levels of analysis determinedata, algorithms & parameters, and deployment

Presenter
Presentation Notes
Focus on Visualization Q type – when where Q level – micro to macro Read = download, survey Analyze = preprocess (annotate, clean, interlink, unify names, extract networks) Iterative refinement
Page 17: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,
Page 18: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

See page 24

Visualization Framework

Presenter
Presentation Notes
Focus on Visualization Q type – when where Q level – micro to macro Read = download, survey Analyze = preprocess (annotate, clean, interlink, unify names, extract networks) Iterative refinement
Page 19: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

19

Visualization Framework

Page 20: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

See page 24

Visualization Framework

Presenter
Presentation Notes
Focus on Visualization Q type – when where Q level – micro to macro Read = download, survey Analyze = preprocess (annotate, clean, interlink, unify names, extract networks) Iterative refinement
Page 21: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

21

Page 22: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

22

Page 23: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

Load One File and Run Many Analyses and Visualizations

23

Times Cited

Publication Year

City of Publisher Country Journal Title (Full)

Title Subject Category Authors

12 2011 NEW YORK USA COMMUNICATIONS OF THE ACM

Plug-and-Play Macroscopes Computer Science Borner, K

18 2010 MALDEN USA CTS-CLINICAL AND TRANSLATIONAL SCIENCE

Advancing the Science of Team Science

Research & Experimental Medicine

Falk-Krzesinski, HJ|Borner, K|Contractor, N|Fiore, SM|Hall, KL|Keyton, J|Spring, B|Stokols, D|Trochim, W|Uzzi, B

13 2010 WASHINGTON USA SCIENCE TRANSLATIONAL MEDICINE

A Multi-Level Systems Perspective for the Science of Team Science

Cell Biology |Research & Experimental Medicine

Borner, K|Contractor, N|Falk-Krzesinski, HJ|Fiore, SM|Hall, KL|Keyton, J|Spring, B|Stokols, D|Trochim, W|Uzzi, B

Page 24: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,

Load One File and Run Many Analyses and Visualizations

24

Times Cited

Publication Year

City of Publisher Country Journal Title (Full)

Title Subject Category Authors

12 2011 NEW YORK USA COMMUNICATIONS OF THE ACM

Plug-and-Play Macroscopes Computer Science Borner, K

18 2010 MALDEN USA CTS-CLINICAL AND TRANSLATIONAL SCIENCE

Advancing the Science of Team Science

Research & Experimental Medicine

Falk-Krzesinski, HJ|Borner, K|Contractor, N|Fiore, SM|Hall, KL|Keyton, J|Spring, B|Stokols, D|Trochim, W|Uzzi, B

13 2010 WASHINGTON USA SCIENCE TRANSLATIONAL MEDICINE

A Multi-Level Systems Perspective for the Science of Team Science

Cell Biology |Research & Experimental Medicine

Borner, K|Contractor, N|Falk-Krzesinski, HJ|Fiore, SM|Hall, KL|Keyton, J|Spring, B|Stokols, D|Trochim, W|Uzzi, B

Co-author and many other bi-modal networks.

Page 25: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,
Page 26: Self-portraits of the brain: Cognitive science, · Self-portraits of the brain: Cognitive science, data visualization, and communicating brain structure and function By Goldstone,