1

Computer Assisted Surgeryand

Medical Image Analysis

Computer Vision GroupA tifi i l I t lli L b tArtificial Intelligence Laboratory

Massachusetts Institute of TechnologySurgical Planning Lab

Brigham and Women’s HospitalHarvard Medical School

Computer assisted surgery

• Goal:• Goal:– Use computer vision techniques to plan and guide

surgical interventions, by giving the surgeon the ability to sense critical information that is not normally visible to her

• How?– Capture models of patient anatomy and function– Use to guide surgeon’s actions

2

Conventional Surgery: See the surface

Provided by Nakajima, Atsumi et al.

Image Guided Surgery: See under the surface

Provided by Leventon et al.

3

Intelligently aiding the surgeon

• Convert medical images into models of• Convert medical images into models of patient’s:– Structural anatomy– Functional anatomy

4

brachio h li

subclavian artery

common carotidartery

brachio cephalic

Central Vessels

cephalic trunc

brachio cephalictrunc

pulmonary trunk pulmonary veins

aorta

Courtesy of Lorigo

Cartilage Thickness MappingMapping

Courtesy Warfield, Winalski

5

Functional information

Visualizing the surgical site• Augmented g

reality visualizations

• Surgical guidance

• Simulation of surgical navigation

6

Visualizing the surgical site

• AugmentedAugmented reality visualizations

• Surgical guidance

• Simulation of surgical navigation

Surgical navigation

7

Visualizing the surgical site

• Augmented• Augmented reality visualizations

• Surgical guidance

• Simulation of• Simulation of surgical navigation

Medical Imaging at Medical Imaging at LEMS

Benjamin Kimia, Joseph Mundy

8

Carpal Bone SegmentationSegmentation of carpal bones from CT images, to be used in the study of carpal dynamics

9

Image Guided TherapyEstimation of Spine Vertebrate position for needle procedures

Fine Resolution Visualization of Surfaces Brain surface visualization

10

Computational AtlasesStudying the notion of an “Average Shape” and quantifying deviations from that, to study diseased vs healthy population, fMRI, etc

Averaging Metacarpals and Corpus Collosi

Comparison before and after normalization