Virtual Reality and Health - UNC Health Sciences Library · Virtual Reality and Health Jason...

Preview:

Citation preview

Jason Jerald, PhD @TheVRBook

Virtual Reality and Health

Jason Jerald, PhD

@TheVRBook

Jason Jerald, PhD @TheVRBook

Jason Jerald, PhD20+ years of VR expertise40+ organizations70+ projects

2

Jason Jerald, PhD @TheVRBook

What is Virtual Reality?

“A computer-generated digital environment

that can be experienced as if that

environment was real.”

—The VR Book

3

Jason Jerald, PhD @TheVRBook

What is Virtual Reality(video)

4

Jason Jerald, PhD @TheVRBook

The XR Continuum

Real

Reality

Virtual

Reality

5

Jason Jerald, PhD @TheVRBook

VR is not New!1830s to 1990s

Images Courtesy of The VR Book (with permissions from original sources)

6

Jason Jerald, PhD @TheVRBook

VR Applications Beyond Entertainment• Real Estate• Medical Visualization• Command & Control• Scientific Visualization• Computer-Aided Design• Education• Simulation & Training• Telepresence• Tourism• Design Review/Markup• Proposals

• Advertising and Marketing• Location Based Exhibits• Retail• Crime Scene Investigation• Psychological studies• Human performance/factors

engineering• Rehabilitation• Pain Distraction• Immersive Film• Sports

7

Jason Jerald, PhD @TheVRBook

Today’s Two VR Applications

• Medical Visualization• Neuroscience Education

8

Jason Jerald, PhD @TheVRBook

Today’s Two VR Applications

• Medical Visualization• Neuroscience Education

9

Jason Jerald, PhD @TheVRBook

Medical Visualization

iMedic by Immersive Medical Environment for Distributed Interactive Consultation

Congressional funding provided by the U.S Army’s Telemedicine & Advanced Technology Research Center

10

Jason Jerald, PhD @TheVRBook

Medical Visualization

iMedic by Immersive Medical Environment for Distributed Interactive Consultation

Congressional funding provided by the U.S Army’s Telemedicine & Advanced Technology Research Center

11

Jason Jerald, PhD @TheVRBook

Medical Teleconsultation

iMedic by

12

Jason Jerald, PhD @TheVRBook

Medical Visualization

iMedic by

(video)

13

Jason Jerald, PhD @TheVRBook

Medical Visualization

iMedic—how does it work?

– 3D Multitouch• Appropriate for abstract non-realistic interactions• Content/data independent• Written Specifically for immersive interaction• Solves gorilla arm• Reduces sim sickness

14

Jason Jerald, PhD @TheVRBook

Today’s Two VR Applications

• Medical Visualization• Neuroscience Education

15

Jason Jerald, PhD @TheVRBook

Education• What does our workforce need in the future?

• The ability to operate across a broader span of tasks and

situations, creating new demands:

–Increased complexity of work

–Continuous competency development

–Different ways of thinking

–Cognitive overloadSource: US General Services Administration

16

Jason Jerald, PhD @TheVRBook

Education

“Tell me and I will forget.Teach me and I will remember.Involve me and I will learn.”

—Benjamin Franklin

17

Jason Jerald, PhD @TheVRBook

Education

Image Courtesy of The VR Book (adapted from Dale [1969])

18

Jason Jerald, PhD @TheVRBook

Neuroscience education by

Education

19

Funding provided by

Jason Jerald, PhD @TheVRBook

Education(video)

20

Jason Jerald, PhD @TheVRBook

Education(video)

21

Jason Jerald, PhD @TheVRBook

Education(video)

22

Jason Jerald, PhD @TheVRBook

EducationVR Immigrants

• Conventional speed• Linear processing• Text first• Step by step• Stand-alone• Passive• Work• Patience• Reality• Technology-as-foe

VR Natives

• Twitch speed• Parallel processing• Graphics first• Random access• Connected• Active• Play• Payoff• Fantasy• Technology-as-friend

23

Jason Jerald, PhD @TheVRBook

Education

“The illiterate of the 21st century will not be

those who cannot read and write, but those

who cannot learn, unlearn, and relearn.”

—Alvin Toffler

24

Jason Jerald, PhD @TheVRBook 25

Jason Jerald, PhD @TheVRBook

Questions

26

Jason Jerald, PhD @TheVRBook

Additional Slides

27

Jason Jerald, PhD @TheVRBook

Adverse Health Effects—Challenges• Injury• Motion sickness• Headset Fit• Hygiene• Aftereffects• Seizures

• Physical Fatigue• Eye strain

– Flicker– Accommodation-vergence

conflict– Occlusion-binocular

Conflict

28

Jason Jerald, PhD @TheVRBook

Factors of Adverse Health EffectsSystem

• Latency• Calibration• Tracking accuracy & precision• Field of View• Refresh rate• Judder & Flicker• Display response & persistence• Vergence/Accommodation• Stereoscopic cues• Real world peripheral vision• Fit/Weight/center of mass• Motion platforms• Hygiene• Temperature• Dirty screens

Application

• Frame rate• Locus of control• Visual acceleration• Physical head motion• Duration• Vection• Binocular-occlusion conflict• Virtual rotation• Gorilla arm• Standing vs sitting• Rest frames• Binocular disparity• VR entrance & exit• Luminance• Repetitive strain

Human

• History of motion sickness• VR experience• Health• Thinking about Sickness• Belief• Gender• Age• Mental model/expectations• Interpupilary distance• Not knowing• Sense of balance• Flicker fusion frequency

threshold• Real-world task experience• Migraine history

29

Jason Jerald, PhD @TheVRBook

Adverse Health Effects

Cables and Safety– Sit in a Chair– Safe audio levels– Use a human spotter– Constrain/limit haptics– Provide harnesses, railing, and/or padding– Spend the time to arrange cables nicely. Cable tie them to

desk, etc. And then leave them.

30

Jason Jerald, PhD @TheVRBook

Adverse Health Effects

Warning Grids

31

Jason Jerald, PhD @TheVRBook

Motion SicknessThe Basics• The biggest problem is motion sickness

– Varies greatly from person to person

• As users:– Stop at the first sign of sickness– Be well-hydrated– Not hungry– Not hung over

• As demoers– Remind users not to “tough it out”– Choose comfortable applications

32

Jason Jerald, PhD @TheVRBook

Motion Sickness

• Sensory Conflict• Evolution/Poison Theory• Postural Instability Theory• Rest Frame Hypothesis• Eye Movement Theory

33

Jason Jerald, PhD @TheVRBook

Locomotion

• Physical walking• Teleportation• Dynamic field of view• Dynamic rest frames

34

Jason Jerald, PhD @TheVRBook

Physical Walking

• Real-world one-to-one walking• Treadmill walking• Redirected walking• Walking in place

35

Jason Jerald, PhD @TheVRBook

Teleportation

• Popularized byCloudHead Games

• Zero motion sickness

• Results in disorientationBowman & Hodges 199

Trainexus by

36

Jason Jerald, PhD @TheVRBook

Dynamic Field of View

Image Courtesy of

Fernandes & Feiner 2016

37

Jason Jerald, PhD @TheVRBook

Rest Frames

• Stabilized cues relative to real world Prothero & Parker (2003)

• Reduces sensory conflict between what you are seeing and what you are feeling

• Example: Cockpit

EVE Valkyrie by CCP Games

38

Jason Jerald, PhD @TheVRBook

Rest Frames

39

Jason Jerald, PhD @TheVRBook

Dynamic Rest Frames

Looking ahead with no DRF Looking ahead with DRF Looking to Right with DRF

by

40

Jason Jerald, PhD @TheVRBook

Head-Mounted Displays

41

Jason Jerald, PhD @TheVRBook

Desks

The Nanomanipulator

42

Jason Jerald, PhD @TheVRBook

DDRIVE by and

CAVEs

43

Jason Jerald, PhD @TheVRBook

CAVEs

44

Jason Jerald, PhD @TheVRBook

Phones & Tablets

Zoo-AR by

45

Jason Jerald, PhD @TheVRBook

VR Input Devices

46

Jason Jerald, PhD @TheVRBook

1_Q&A

47

Jason Jerald, PhD @TheVRBook 48

Jason Jerald, PhD @TheVRBook

1_Q&A

49

Jason Jerald, PhD @TheVRBook

1_Q&A

50

Jason Jerald, PhD @TheVRBook 51

Jason Jerald, PhD @TheVRBook

Try the Merge Things for Yourself!

Go toBit.ly/MThings

52

Jason Jerald, PhD @TheVRBook

Today’s Five VR Applications

• Training• Medical Visualization• Computer-Aided Design• Retail• Education

53

Jason Jerald, PhD @TheVRBook

Computer-Aided Design

• Immersive modeling challenges– Not just polygons & special effects– Large number of options– Precision

54

Jason Jerald, PhD @TheVRBook

by , , &

Computer-Aided Design

55

Jason Jerald, PhD @TheVRBook

by , , &

Computer-Aided Design(video)

56

Jason Jerald, PhD @TheVRBook

Computer-Aided Design

by , , &

57

Jason Jerald, PhD @TheVRBook

Where is Technology Going?The Past

• Expensive• Dedicated hardware• Train key jobs• Formal• Defense dominates• Experts create• Sequential learning• Accidental engagement

The Future

• Inexpensive• Multiuse (e.g., phones)• Train many jobs• Informal• Commercial dominates• Users create• Free-form learning• Intentional Fun

58

Jason Jerald, PhD @TheVRBook

The Future

“The best way to predict the future is to invent it.”

—Alan Kay

59

Recommended