Upload
parvati-dev
View
1.429
Download
3
Tags:
Embed Size (px)
DESCRIPTION
This slide set was part of an AMIA 2009 tutorial on Virtual Environments led by Ed Hammond of Duke University.
Citation preview
© 2009, Dev AMIA 2009 Tutorial1 of 80
© 2009, Dev AMIA 2009 Tutorial2 of 80
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
Simulation
Parvati Dev, PhD, FACMIPresident, Innovation in Learning Inc.Distinguished Scholar, Media-X, Stanford UniversityFormer Director, SUMMIT Lab, Stanford University
© 2009, Dev AMIA 2009 Tutorial3 of 80
Overview
• Visualization, simulation , 3D models and spaces in virtual worlds
• Comparison of using scripted objects vs role playing with real people controlling characters
• Using reflection and discussion to build on virtual experiences
• Using virtual world to capture activities in the real world
• Future of simulation
© 2009, Dev AMIA 2009 Tutorial4 of 80
Browse … Experience … Act
• Virtual world as a social space• Virtual world as a space with interactive simulations
• Building a Clinic space• Simulated patients• Richly interactive virtual medical environments
• Movie – a Virtual Emergency Department
© 2009, Dev AMIA 2009 Tutorial5 of 80
Social spaces
(Second Life)
© 2009, Dev AMIA 2009 Tutorial6 of 80
Piet Hut, astronomer
“I realized how different this type of medium of communication is from anything I had tried before, whether telephone or email or instant messaging or shared screens.
There was a sense of presence together with others that was far more powerful and engaging than I had expected. I quickly realized the great potential of these worlds for remote collaboration on research projects.”
© 2009, Dev AMIA 2009 Tutorial7 of 80
The world feels real - “concrete”
Teleplace, previously Qwaq Forums
© 2009, Dev AMIA 2009 Tutorial8 of 80
The world feels concrete - because it is an authentic
simulation• The 3D world itself is a simulation
– of a real space, or a designed space
• Being a simulation, you can “operate” it– A “left turn” is the same in the real and virtual worlds
• Our brain “understands” 3D space– We know how to function in a 3D space
© 2009, Dev AMIA 2009 Tutorial9 of 80
Collaboration using visualization
Green Phosphor and GlassHouse: http://www.youtube.com/watch?v=Z-EU3LITMmQ
© 2009, Dev AMIA 2009 Tutorial10 of 80
Visualizing microarray data
Green Phosphor and GlassHouse
© 2009, Dev AMIA 2009 Tutorial11 of 80
Medical visualization
Teleplace.com; Cleft Palate patient from NYU Medical Center
© 2009, Dev AMIA 2009 Tutorial12 of 80
Simulated experiences
(Forterra Systems)
© 2009, Dev AMIA 2009 Tutorial13 of 80
Interactive simulations
(Pulse!! - Breakaway)
© 2009, Dev AMIA 2009 Tutorial14 of 80
Building a 3D space
© 2009, Dev AMIA 2009 Tutorial15 of 80
From real to “mirror” world
Forterra Systems
© 2009, Dev AMIA 2009 Tutorial16 of 80
Virtual Stanford
Forterra Systems
© 2009, Dev AMIA 2009 Tutorial17 of 80
3D medical spaces
© 2009, Dev AMIA 2009 Tutorial18 of 80
Building a 3D clinic
© 2009, Dev AMIA 2009 Tutorial19 of 80
Building Virtual Patients
Appearance - normal plus trauma or disease
Behavior - movement plus other actions
© 2009, Dev AMIA 2009 Tutorial20 of 80
Building an Avatar(Poser, )
© 2009, Dev AMIA 2009 Tutorial21 of 80
Adding trauma appearance(Forterra)
© 2009, Dev AMIA 2009 Tutorial22 of 80
Specialized Behaviors
Simulating Physiology
© 2009, Dev AMIA 2009 Tutorial23 of 80
HealthyHealthy SickSick Very sickVery sick
Hit by car
Bleeds profusely
Stable,Stable,recoverrecover
Patient state
© 2009, Dev AMIA 2009 Tutorial24 of 80
‘PATIENT’ STATE
QUERYINTERFACE
TEXT
SPEECH
GRAPHICS
ANIMATION
INTERVENTIONINTERFACE
PHYSIOLOGY PROCESS
TIME STEP
Patient Model
© 2009, Dev AMIA 2009 Tutorial25 of 80
TEXT 45 y/o female clerk: open, angulated open fracture. rt. upper humerus, C/o severe pain, feeling faintBrisk arterial and venous bleeding, EOIS = 4 (of 6)
GRAPHICS
#15#12
ANIMATION
QuickTime™ and aTIFF (Uncompressed) decompressor
are needed to see this picture.
SPEECH
© 2009, Dev AMIA 2009 Tutorial26 of 80
QUERYINTERFACE
INTERVENTIONINTERFACE
Patient Model
© 2009, Dev AMIA 2009 Tutorial27 of 80
Vol BP HR Sa02 RR
• trauma ––> blood loss
• blood loss ––> reduced blood volume
• reduced blood vol ––> reduced pressure
• reduced pressure ––> increased heart rate
• increased heart rate ––> decreased Sa02
• decreased Sa02 ––> increased resp. rate
QuickTime™ and aTIFF (Uncompressed) decompressor
are needed to see this picture.
Basic Logic for Traumatic Hemorrhage Model
© 2009, Dev AMIA 2009 Tutorial28 of 80
Model for Traumatic Hemorrhagic ShockVictim 12: 45 yr old woman: EOIS=4
0
50
100
150
200
250
1:42 1:45 1:50 1:55 2:00 2:05 2:10 2:15 2:20 2:25
Time in minutes
Response of model
Sa02%
PR
RR
BP-S
Fractured humerus, Hemorrhage rate: 83 ml/min = 2520ml/30min
Cardiacarrest
. . 35min to ‘death’
© 2009, Dev AMIA 2009 Tutorial29 of 80
250
200
150
100
50
0
Fractured humerus, Hemorrhage rate: 83 ml/min= 2520ml/30min
Victim 12: 45 year old Woman: EOIS = 4
1:42 1:45 1:50 1:55 2:00 2:05 2:10 2:15 2:20 2:25
Time in Minutes
Res
po
nse
of
Mo
del
PR
Sa02
XX
X X XX X
XX X X BP-S
RR
Compressionbandage
IV Nacl Dobutamide
Trendelenberg
Transfuse
Send tosurgery
. . . Home in 36hrs
Model for Traumatic Hemorrhagic Shock
© 2009, Dev AMIA 2009 Tutorial30 of 80
B-man, LUQ blow, pain, hemoperitoneum, hypotension, confusedM48521
Af-Am, 24wk preg, vag. bleeding, FHT180, S-S anemia, low BPF23520
Obese retiree, RUAbd bruise, hypotension, hemoperitoneumM69519
Exec., traumatic rt. knee disruption, brisk bleeding, hypotensionM38518
Athlete, open. frax, rt. tibia & fibula, brisk bleeding, pain, labile BPM22517
Grad. Student, 10cm SQ hematoma, rt mid-thigh, anxiousF27116
RLQ penetrating shard, hemoperitoneum, pain, hypotensionF58515
Construction worker, crushed chest, ribs visible bilat., hemoptysisM30613
Clerk: open, angulated frax. Rt. humerus, pain, brisk bleeding F45412
Healthy Prof., bleeding lacerations of forearm, anxious, htnM60111
EOIS/THC Score = (0 – 6) based upon anatomic structure, and severity of injury
# EOIS Gender-age Description
#12 illustrated;#13 near death;
#11 & 16 walking-wounded
Ten Trauma Cases
© 2009, Dev AMIA 2009 Tutorial31 of 80
ORGAN EOI-SCALE 1-3 EOI-SCALE 4-5
1) THORACIC VASCULAR CHEST WALL VESSELS VASCULAR TREE
2) LUNG CONTUSION, SIMPLE LAC. LOBAR, VASCULAR
3) HEART BLUNT, NON-PENETRATING BLUNT, DYSFUNCTION, AND PENETRATING
4) CHEST WALL LACERATIONS, RIB FRAX, FLAIL, CRUSHED CHEST
5) DIAPHRAM LACERATIONS, RUPTURE
6) SPLEEN LACERATIONS, SUB-CAPSULAR HEMORRHAGE
LACERATIONS OF HILAR VESSELS
7) LIVER LACERATIONS, SUB-CAPSULAR HEMORRHAGE
PARENCHYMAL INJURY > 25%, JUXTA-HEPATIC VESSEL LACERAT–
8) ABDOMINAL VASCULAR ALL VISCERAL VESSELS VENA CAVA, ABD. AORTA
9) KIDNEY MINOR LACERATIONS MAJOR PARENCHYMAL LACERATIONS, HILAR VESSELS
10) URETER ALL INJURIES
11) BLADDER LACERATIONS < 2CM LACERATIONS > 2CM
12) URETHRA ALL LACERATIONS AVULSION
Org
an In
jury
Sca
leE
xten
ded
–
13) NECK LACERATIONS MAJOR VASCULAR INJURY, FRACTURES
14) GI TRACT PERFORATIONS, LACERATIONS MAJOR VASCULAR INJURY
15) UPPER EXTREMITY – Rt. LACERATIONS, CLOSED FRACTURES MAJOR VASCULAR INJURY, OPEN FRACTURES
16) UPPER EXTREMITY – Lt. LACERATIONS, CLOSED FRACTURES MAJOR VASCULAR INJURY, OPEN FRACTURES
17) LOWER EXTREMITY – Rt. LACERATIONS, CLOSED FRACTURES MAJOR VASCULAR INJURY, OPEN FRACTURES
18) LOWER EXTREMITY – Lt. LACERATIONS, CLOSED FRACTURES MAJOR VASCULAR INJURY, OPEN FRACTURES
19) BACK, BUTTOCKS LACERATIONS, CLOSED CONTUSIONS MAJOR MUSCULAR INJURY, VERTEBRAL FRACTURES
20) PELVIS PELVIC WALL VESSELS, REPRODUCTIVE ORGANS
MAJOR VASCULAR INJURY, OPEN OR CLOSED FRACTURES
21) EXTERNAL GENITALS ALL LACERATIONS AVULSION
Quantifies the Injuries
© 2009, Dev AMIA 2009 Tutorial32 of 80
Blood Volume-driven system: e.g., hemorrhage Vol BP HR Sa02 RR Class: 0 = 0 ml MAP 96.0 70 98 14 Class 1 = 750 ml 87.7 75 97 16 Class 2 = 1500ml 88.6 86 96 20 Class 3 = 1980ml 57.7 140 80 35
Rooke, et al. 1995 Anesth Analg 80:925-32
Class 4 = 2520ml 47.7 180-irreg. 50 45 Class 5 = 3240ml 37.7 200–AF 30 55Class 6 = 3880ml 0 0 0 0(Agonal) (Average Blood Volume = 5000ml)
Quantifies the Blood Loss
Traumatic Hemorrhage Classes (THC) determine Blood Volume Deficit. ATLS
Guideline & Rooke, et al.
© 2009, Dev AMIA 2009 Tutorial33 of 80
A Medical Virtual World
© 2009, Dev AMIA 2009 Tutorial34 of 80
Scripted objects vs role playing
• Comparison of using scripted objects vs role playing with real people controlling characters– Virtual patients– Human Patient Simulator mannequin as example of human-controlled character
– Turning behaviors on and off– Computer-controlled behaviors– A dynamic model of pathophysiology – trauma and hypovolemic shock
– Advantages of a dynamic model
© 2009, Dev AMIA 2009 Tutorial35 of 80
Reflection and Discussion
© 2009, Dev AMIA 2009 Tutorial36 of 80
Using reflection and discussion to build on virtual
experiences
– Preparation for a medical virtual experience• knowledge prerequisites• use of virtual worlds
– Assessment during the experience• Assessment instruments
– Facilitated reflection and discussion after the experience
© 2009, Dev AMIA 2009 Tutorial37 of 80
Clinical Scenarios for Virtual ED
1. Male: pneumothorax and femur fracture after auto collision2. Male; bicycle rider falls from bike path, suffers spleen
rupture3. Male; car driver, hypoglycemia and femur fracture4. Male; ethanol induced fall, with head injury, obstructed
airway5. Female;(2nd trimester pregnancy); with renal laceration
after auto collision6. Male; construction worker fall, liver rupture, fracture of
femur7. Male: construction worker, flail chest and dislocated
shoulder8. Male: bicycle rider with severe hand and abdominal injury
after auto collision and being ‘run-over’ 9. Female; elderly pedestrian with facial fractures and
unconsciousness after auto collision.10. Female (3rd trimester pregnancy); auto collision with
femoral neck fracture, and vaginal bleeding (placental abruption)
© 2009, Dev AMIA 2009 Tutorial38 of 80
Roles
Role player Learner
Facilitator
© 2009, Dev AMIA 2009 Tutorial39 of 80
EMCRM Performance Rating Scale
SUBJECT ID: __________________ EVALUATOR ID: _______________ Ten behavioral components of Emergency Medicine Crisis Resource Management are listed below. For each component circle the number that best describes the participant’s performance. 1 = not acceptable 2 = poor 3=acceptable 4=good 5 = excellent
1. Knowledge of the Environment 1 2 3 4 5
2. Anticipation of & Planning for Potential Problems
1 2 3 4 5
3. Assumption of Leadership Role
1 2 3 4 5
4. Communication with Other Team Members
1 2 3 4 5
5. Distribution of Workload/Delega-tion of Responsibility
1 2 3 4 5
6. Attention Allocation
1 2 3 4 5
7. Utilization of Information
1 2 3 4 5
8. Utilization of Resources
1 2 3 4 5
9. Recognition of Limitations/Call for Help Early Enough
1 2 3 4 5
10. Professional Behavior/Inter-personal Skills
1 2 3 4 5
11. Overall Behavioral Crisis Management Skills
1 2 3 4 5
© 2009, Dev AMIA 2009 Tutorial40 of 80
A debrief session
© 2009, Dev AMIA 2009 Tutorial41 of 80
EMCRM Performance scores
0.00
10.00
20.00
30.00
40.00
50.00
HPS Group
Pretest Sum Scores
Posttest Sum Scores
Pretest Sum Scores
Posttest Sum Scores
Virtual ED GroupN=15 N=16
© 2009, Dev AMIA 2009 Tutorial42 of 80
Summary
• Virtual worlds where you can do work• World simulates authentic work environment
• Embedded documents, models and simulations– Make the world interactive– (beyond navigation, browsing, socializing)
• Scenarios for relevant work experiences• Metrics, reflection and discussion needed for experiential learning
© 2009, Dev AMIA 2009 Tutorial43 of 80
Links to our movies
Virtual Emergency Department (VEDII) - Users
Virtual Emergency Department (VEDII) Interface - GUI
Virtual Emergency Department (VEDII) - entire video (2:11 min)
http://www.youtube.com/watch?v=zUb2Z8ZTl6g
http://www.youtube.com/watch?v=6FEdUndV1Aw
http://www.youtube.com/watch?v=7KfO4vjf_II