30
FINDING PATTERNS IN TEMPORAL DATA KRIST WONGSUPHASAWAT TAOWEI DAVID WANG CATHERINE PLAISANT BEN SHNEIDERMAN HUMAN-COMPUTER INTERACTION LAB UNIVERSITY OF MARYLAND 27th HCIL Symposium May 27, 2010

Finding Patterns in Temporal Data

Embed Size (px)

DESCRIPTION

Talk given at the 27th HCIL Annual Symposium, University of Maryland, College Park, MD, USA.

Citation preview

Page 1: Finding Patterns in Temporal Data

FINDING PATTERNS IN TEMPORAL DATA KRIST WONGSUPHASAWAT

TAOWEI DAVID WANG

CATHERINE PLAISANT BEN SHNEIDERMAN

HUMAN-COMPUTER INTERACTION LAB UNIVERSITY OF MARYLAND

27th HCIL Symposium!

May 27, 2010!

Page 2: Finding Patterns in Temporal Data

FINDING PATTERNS IN TEMPORAL DATA KRIST WONGSUPHASAWAT

TAOWEI DAVID WANG

CATHERINE PLAISANT BEN SHNEIDERMAN

HUMAN-COMPUTER INTERACTION LAB UNIVERSITY OF MARYLAND

27th HCIL Symposium!

May 27, 2010!

Page 3: Finding Patterns in Temporal Data

Patient ID: 45851737 !"#$"#"$$%&!'(") &*++,-./&!"#$"#"$$%&!'(0) &123+43567&!"#$"#"$$%&""('' &89:&!"#$;#"$$%&$;($< &=/>>+&!"#!'#"$$%&$)(!? &1@,A&& Time

Emergency ICU

Floor Exit

TEMPORAL CATEGORICAL DATA •  A type of time series

$'#")#"$!$&!$($$ &0!B$0&$'#")#"$!$&!$(!; &0!B$!&$'#")#"$!$&!$(0$ &0!B$"&$'#")#"$!$&!$('; &0!B$%&$'#")#"$!$&!!($$ &0!B!)&

Event !Category!

Stock: Microsoft

Numerical!

Arrival

Event !

Page 4: Finding Patterns in Temporal Data

TEMPORAL CATEGORICAL DATA

Electronic Health Records: symptoms, treatment, lab test"Traffic incident logs: arrival/departure time of each unit"Student records: course, paper, proposal, defense, etc.""Others: web logs, usability study logs, etc."

Page 5: Finding Patterns in Temporal Data

10+ years work on temporal visualization (mostly on Electronic Health Records)

Page 6: Finding Patterns in Temporal Data

LIFELINES

SINGLE RECORD

[Plaisant et al. 1998] http://www.cs.umd.edu/hcil/lifelines

Page 7: Finding Patterns in Temporal Data

LifeLines – Single Patient

Page 8: Finding Patterns in Temporal Data

working with physicians at WASHINGTON HOSPITAL CENTER

Page 9: Finding Patterns in Temporal Data

EXAMPLE DATA •  Patient transfers

ARRIVAL Arrive the hospital

EMERGENCY Emergency room

ICU Intensive Care Unit

INTERMEDIATE Intermediate Medical Care

FLOOR Normal room

EXIT-ALIVE Leave the hospital alive

EXIT-DEAD Leave the hospital dead

Page 10: Finding Patterns in Temporal Data

TASKS

within 2 days

ICU Floor ICU

•  Example: Finding “Bounce backs”

Page 11: Finding Patterns in Temporal Data

LIFELINES 2

RECORD RECORD

RECORD

RECORD

RECORD

[Wang et al. 2008, 2009] http://www.cs.umd.edu/hcil/lifelines2

Page 12: Finding Patterns in Temporal Data

LifeLines2 – Search and Visualize

ARF (Align-Rank-Filter) Framework

Temporal Summary

Multiple Records

Page 13: Finding Patterns in Temporal Data

ALIGNMENT •  Sentinel events as reference points

Time

Patient #45851737 Arrival Emergency

ICU Floor

Exit

Patient #43244997 Arrival Emergency

ICU Floor

Exit

June July August

Page 14: Finding Patterns in Temporal Data

ALIGNMENT (2) •  Time shifting

Time

Patient #45851737 Admit Emergency

ICU Floor

Exit

Patient #43244997 Admit Emergency

ICU Floor

Exit

0 1 M 2 M

Page 15: Finding Patterns in Temporal Data

SIMILAN

RECORD RECORD

RECORD

RECORD

RECORD

[Wongsuphasawat & Shneiderman 2009] http://www.cs.umd.edu/hcil/similan

Page 16: Finding Patterns in Temporal Data

Similan – Search by Similarity

Page 17: Finding Patterns in Temporal Data

Similan – Search by Similarity

Page 18: Finding Patterns in Temporal Data

FINDING “BOUNCE BACKS” Before After

•  Much faster to specify new query •  Visualizing the results gives better understanding

Page 19: Finding Patterns in Temporal Data

USER STUDIES: SEARCH

Exact !MUST have A, B, C

Record#1

Record#2

Record#3

more similar

Similarity-based!SHOULD have A, B, C

Similan LifeLines2

Query

Record#2

Record#1

Record#3

Query

Page 20: Finding Patterns in Temporal Data

USER STUDIES: SEARCH

Exact !MUST have A, B, C

Similarity-based!SHOULD have A, B, C

Query

Record#1

Record#2

Record#3

more similar

Query

Record#2

Record#1

Record#3

Similan LifeLines2

1

Page 21: Finding Patterns in Temporal Data

NEW STUFF Needs for an overview -> LifeFlow! !

Page 22: Finding Patterns in Temporal Data

TASKS

within 2 days

ICU Floor ICU

•  Example: Finding “Bounce backs”

•  Other questions Arrival

ICU

?

? ?

Page 23: Finding Patterns in Temporal Data

LIFEFLOW

RECORD

RECORD

RECORD

RECORD

RECORD

RECORD

RECORD

RECORD

AGGREGATE Merge multiple records into tree

VISUALIZE Display the aggregation

Page 24: Finding Patterns in Temporal Data

AGGREGATE •  Aggregate by prefix

#1

#2

#3

#4

Example with 4 records

Page 25: Finding Patterns in Temporal Data

AGGREGATE •  Aggregate by prefix

#1

#2

#3

#4

Page 26: Finding Patterns in Temporal Data

VISUALIZE •  Inspired by the Icicle tree [Fekete 2004]

Number of files!

Page 27: Finding Patterns in Temporal Data

VISUALIZE (2) •  Use horizontal axis to represent time •  Video

Page 28: Finding Patterns in Temporal Data

DEMO – LIFEFLOW When the lines are combined into flow !

Page 29: Finding Patterns in Temporal Data

FUTURE WORK •  Comparison

Jan-Mar 2008 April-June 2008

Intermediate ICU

Intermediate ICU

Floor

Page 30: Finding Patterns in Temporal Data

TAKE-AWAY MESSAGE

Information visualization is a powerful way to explore temporal patterns.

You can work with us on new case studies.