NETRA on SIGGRAPH 2010

MIT media lab camera culture EyeNetra.com

NETRA: Interactive Display for Estimating Refractive

Errors and Focal RangeVitor Pamplona Ankit Mohan Manuel M. Oliveira Ramesh Raskar

NETRA: Near Eye Tool for Refractive Assessment

Vitor Pamplona Ankit Mohan Manuel M. Oliveira Ramesh Raskar

Challenge

6.5 Billion people

4.5B have a cell phone

2B haverefractive errors

0.6B have URE

NETRA at LVP Eye Institute

Computational Photography

Optometry/Opthalmalogy

Measure .. Overcome Limitations .. Extend Abilities

Phoropter

Snellen chart

Trial lenses

Reading Charts• Accuracy

– Sharpness Estimation is subjective– Brightness affects results– Pupil size variation and DoF

• Cost– Trial Lens Set > $150– Bulky

Retino scope w/

Lenses

Auto-refracto-

Chart with

Lenses

In-Focus: Focometer Optiopia

Solo-health: EyeSite

Technology Shining Light plus lenses

Fundus Camera

Moving lenses + target

Reading chart on monitor

Cellphone + eyepiece

Cost to buy $2,000* ~$10,000 ~$100 ~$495 ~$200 -- $30

Cost per test ~$36 ~$36 ~$5 -- -- -- ~$1

Data capture No Comp. No No No Comp. Phone

Mobility <500g >10Kg 2kg 1kg <5kg >10Kg <100g

Speed Fast Fast Medium Medium -- Fast Fast

Scalability No No No Yes Probably No Yes

Accuracy 0.15 0.15 0.5 0.75 -- -- <0.5

Self evaluation No No Yes Yes Yes Yes Yes

Electricity Req No Yes No No -- Yes No

Astigmatism Yes Yes Yes/No No -- Yes Yes

Network No Yes No No No Yes Yes

Training High High High Medium Medium Low Low

* Phoropter-based: $5,000.00

Needs expert, Moving parts, Shining lasers

Shack-Hartmann Wavefront Sensor

Expensive; Bulky, Requires trained professionals

Wavefront aberrometer

Shack-Hartmann ~ Lightfields

Levoy et al 2009 Zhang and Levoy 2009: Observable Light Field

Oh, Raskar, Barbastathis 2009: Augmented Light Field

Sensor Microlens Array

Planar Wavefront

Shack & Platt 1971Liang et al 1994

David Williams et al, Rochester

Spot Diagram

Sensor

Displacement = Local Slope

of the Wavefront

Spot Diagram

NETRA = Inverse of Shack-Hartmann

Spot Diagram on LCD

Cell Phone Display

Eye Piece

Spot Diagram on LCD

Inverse of Shack-HartmannUser interactively creates the Spot Diagram

Displace 25 points but 3 parameters

Infinity

Optometry

Human Eye

Infinity

Subject can focusat infinity

Normal Vision

Accommodation Range

Myopia (nearsightedness)

Infinity

Subject cannot focusat far distances

Normal Vision

Myopia

Accommodation Range

Infinity

Shifted Accommodation Range

Myopia Correction

Infinity

Subject can focusat infinity

Normal Vision

Myopia

Accommodation Range

Infinity

Human Eye

Shifted Accommodation Range

Hyperopia (farsightedness)

Infinity 10cm

Normal Vision

Myopia

Hyperopia

Wrong focal point

Accommodation Range

Infinity

Human Eye

17Infinity

Accommodation Range

Normal Vision

Myopia

Hyperopia

‘Beyond’Infinity

Human Eye

Hyperopia (farsightedness)

Refractive Errors and Shifted Range

Perfect vision

Myopia

Hyperopia

10cmInfinity

Need to measure

1m 33cm Distance

Refractive Errors and Shifted Range

Perfect vision

Myopia

Hyperopia

10cmInfinity

Diopter = 1/Distance

1m 33cm

-1D-3D

Distance

Diopter

Relaxed Eye with Myopia

Blurred point

Red pointat infinity

perfect vision

myopia

hyperopia

~10cminfinity

Focusing Range

Distinctimage points

perfect vision

myopia

hyperopia

~10cminfinity

Focusing Range

Pinholes

Red pointat infinity

Scheiner’s Principle

Virtual red pointat infinity

perfect vision

myopia

hyperopia

~10cminfinity

Focusing Range

Display

perfect vision

myopia

hyperopia

~10cminfinity

Focusing Range

Virtual red pointat finite distance

Move spots towards each

Display

Points overlap

Display

perfect vision

myopia

hyperopia

~10cminfinity

Focusing Range

Points overlap

Display

perfect vision

myopia

hyperopia

~10cminfinity

Focusing Range

Points overlap

perfect vision

myopia

hyperopia

~10cminfinity

Focusing Range

Point at infinity

Relaxed Eye with Hyperopia

perfect vision

myopia

hyperopia

~10cminfinity

Focusing Range

Display

Virtual red pointat infinity

Points overlap

Virtual point“beyond” infinity

Move spots away from each other

perfect vision

myopia

hyperopia

~10cminfinity

Focusing Range

Display

Points overlap

Virtual point“beyond” infinity

Move spots away from each other

perfect vision

myopia

hyperopia

~10cminfinity

Focusing Range

NETRA: Using pinholes

Patterns on an LCD

Pinhole array

Patterns on an LCD

Microlens array

NETRA: Using Lens to Increase Light

Pixel Pitch

Virtual Depth

Interactive Method

Farthest Focal Point(myopia, hyperopia)

Interactive Method

Overview• Inverse of Shack Hartmann Wavefront Sensor

• Hi-res displays + interaction• Measuring Spherical Error

• No moving parts, lasers• Blur -> Alignment problem• ~ Lightfield Display for Single Eye

• Astigmatism• Novel Patterns• Focal Range• User Study

MIT media lab camera culture UFRGS EyeNetra.com

Astigmatism: angle-dependent refractive error

http://www.elizabethpope.co.uk/eyeinfo/astigmatism.html

Refractive Power as a Function of Angle

Cylinder SphereAxis Cyl.Unknowns:

SCP )(sin( 2

Astigmatism

Cross or points may never meet with a 1d search !

Astigmatism

Lines reduce the problem to a 1d search

Interactive Method

Farthest Focal Point(myopia, hyperopia, astigmatism)

Interactive Method

Evaluation Prototype

LCD Display

Minification

Camera simulatesthe perfect eye

Trial lenses simulate lens

aberration

Subjective Validation: User Study

Measuring the Accommodation Range

Perfect vision

~10cmInfinity

Myopia

Hyperopia

Step 1: Far limit Step 2: Near limit

Perfect vision

~10cmInfinity

Myopia

Hyperopia

Perfect vision

~10cmInfinity

Myopia

Hyperopia

Points overlap

Display

Virtual Point at the far limit

Relaxed Eye

Points overlap

Display

Accommodated Eye

Virtual pointgetting closer

Move points towards each other

Subject Accommodates to fix the “blur”

Points overlap

Display

Accommodated Eye

Subject Accommodates to fix the “blur”

Points overlap

Display

Accommodated Eye

Subject cannot accommodate more than the previous point

Patterns for Alignment Task

Displayed

Subject view

Displayed

Subject view

Visual Cryptography

A B A B A B A B A B

[NaorShamir94]

Patterns for Alignment Task

Displayed

Subject view

Displayed

Subject view

Visual Cryptography

A B A B A B A B

A B A B A B A B A B

[NaorShamir94]

Subject View as Convolution

Subject’ s View

Display

Viewmaster prototype

+3D to -5D with accommodation61

Subject View

h - Jittered Pinholes

G(-5D) G(0D) G(+5D)

Scaled Patterns

Summary of Interaction

Farthest Point(myopia, hyperopia, astigmatism)

Nearest Point(presbyopia)

Accommodation Range

Limitations

• Children• Ability to align lines

• Single Eye test– Other eye for convergence-forced accommodation

• Resolution is a function of the display DPI– Samsung Behold II – 160 DPI – 0.35D– Google Nexus One – 250 DPI – 0.2D– Apple iPhone 4G – 326 DPI – 0.14D

Future Work• Clinical research for an optometry device

– Side-by-side validation tests– Field trials – Tests for cataract, lazy eye, etc

• Opportunity to monitor one’s eyesight– Diabetes/Glucose non-invasive meter– Unstable lens prescriptions

• Distribution in Developing Countries– Software app for free– Eyepiece blueprint to NGOs for <$1– More at EyeNetra.com

Future Work• Multi-focus display without moving parts

– [Akeley04][Rolland00][Hua09] [Barsky04]

• Personalized devices (clear without glasses) – Alarm Clock – Cell phones– eReaders

Inju Fernando Meyer

Acknowledgements

• Volunteers• Dr. Joseph Ciolino (MGH Mass Eye and Ear Inst.)• Dr. Fuentanta Vera Diaz (Schepens Eye Research Inst.)• Dr. James Kobler (MGH Mass Eye and Ear Inst.)• Dr. Shrikant Bhardwaj, (LV Prasad Eye Institute, India)

Sponsors• CNPq-Brazil• Alfred P. Sloan Research Fellowship• Google • Samsung

NETRA: Display for Eye Refraction Tests

• Inverse of Shack-Hartmann wavefront aberrometer– High-resolution displays and user interaction

• Focal Parameters– Myopia, Hyperopia, Astigmatism– Focal range

• Thermometer for the eye– Measurement not prescription– Promote Self Awareness

• Impact in Developing Countries– 600 Million without corrective glasses– $1 cost, easy to deploy

NETRA: Interactive Display for Estimating Refractive Errors and Focal Range

Vitor Pamplona Ankit Mohan Manuel M. Oliveira Ramesh Raskar

NETRA on SIGGRAPH 2010

Technology

Netra Intro

SigGraph 2010 - Collada BOF - 2 - Extensions Process

Shiv Netra

Netra p. osti

PENERIMAAN PENYANDANG DISABILITAS SENSORIK NETRA … · PENERIMAAN PENYANDANG DISABILITAS SENSORIK NETRA RUMAH PELAYANAN SOSIAL DISABILITAS SENSORIK NETRA BHAKTI CANDRASA SURAKARTA

Ppt Usada Netra

NVIDIA GPU Technology Siggraph Asia 2010kr.nvidia.com/.../siggraph-asia-2010/presos/Gateau_Intro_to_CUDA_C.pdf · y h 0 CUDA C Prerequisites You (probably) need experience with C

NetRA Resources Assessment (NetRA) - National …sites.nationalacademies.org/cs/groups/pgasite/documents/webpage/... · NetRA Resources Assessment (NetRA) 1 Dadhi Ram Adhikari –Economist2

Peter Barnum Srinivasa Narasimhan Takeo Kanade Robotics Institute, Carnegie Mellon University SIGGRAPH 2010 July 27, 2010

SIGGRAPH 2010 Course: Physically Based Shading Models in Film and Game Production SIGGRAPH 2010 Physically Based Shading Models in Film and Game Production

Guide d’administration système du serveur Netra CT 900 · 2010. 12. 22. · vi Guide d’administration système du serveur Netra CT 900 • Janvier 2007 Programmation du CPLD

Netra T4 AC100/DC100 Installation and User's Guide · 2010. 12. 14. · Netra T4 DC100 System 30 Powering Off the System 32 Netra T4 AC100 System 32 Netra T4 DC100 System 33 4. External

Netra Lisa Sinew

Netra X4200

netra seminar 2pokušaj

TUNA NETRA - staffnew.uny.ac.idstaffnew.uny.ac.id/upload/198304222009122008/pendidikan/TUNA+NETRA... · KLASIFIKASI TUNA NETRA A. Berdasarkan Tingkat Ketajaman Pengelihatan ... pembesaran

NETRA - dspim.com

Netra ct Server Product Overview - zh€¦ · Netra ct 8 ö-CompactPCIˆﬂ NEBS 3 ß üu rs ETSI ý} ˚þNC ˛Ž Netra ct ÌL ª˚Žıt ‘ Netra ctC ˚˝ • Netra ct 800 A •

SIGGRAPH 2007 - Course Notes - Interaction Tomorrowmi-lab.org/files/publications/p75-haller.pdf · · 2010-01-28• MAX 6DOF stylus from Terminal ... Microsoft Word - SIGGRAPH 2007

(SIGGRAPH 2010) Street Slide: Browsing Street Level Imagery