35
The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualization Rob MacLeod, Dana Brooks, Mike Steffen, Burak Erem, Darrell Swenson and Jeroen Stinstra, Ross Whitaker, and Chris Johnson. University of Utah, SCI Institute, Bioengineering Department Northeastern University

The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

The Utah Integrated Environment for Image Based

Modeling, Simulation, and Visualization

Rob MacLeod, Dana Brooks, Mike Steffen, Burak Erem, Darrell Swenson and Jeroen Stinstra, Ross Whitaker, and Chris Johnson.

University of Utah, SCI Institute, Bioengineering DepartmentNortheastern University

Page 2: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Tell a Simple Story....

“Pie in the Sky” Bridges

Page 3: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Pies in the Sky

CinC2009

Page 4: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Pies in the Sky

Page 5: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

History (1998)

The Problem Solverʼs Toolbox for Bioelectricity and Biomagnetism

or the“This Old House Approach to

Maxwellʼs Equations”

Page 6: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Software Structure

Model

Sim VisCore

BioPSE

Page 7: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Models

Utah Torso Weinstein Head Model

Page 8: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Forward/Inverse Problem

Forward problem

Body Surface Potentials

GeometricModel

EpicardialActivation/Potentials

Inverse problem T. Oostendorp

Page 9: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Pie Based Inverse Problem

Model

Sim VisCore

BioPSE

Page 10: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

The PresentCenter for Integrative Biomedical Computing

(CIBC)

Page 11: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

CIBC Vision

Image ProcessingImage & Data Acquisition

Intervention

Visualization

Mathematical Modeling & Simulation

Geometry Processing

Integrated Software Tools

Page 12: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

The Pipeline

Generation of volume model

Discrete pointse.g., sensors

Boundaryconditions

MeasuredData

(meshing)

Application of tissue parameters/boundary conditions and computation

Verification & evaluation of results(simulation, error visualization)

(simulation, estimation)

Image aquisition & processing

(image processing)

Identification of structures

Visualization

(image processing and segmentation)

Fitting of geometric surfaces(geometric modeling)

Meshless approaches

Surface based approaches

!

Page 13: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Image Visualization

Page 14: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Image Based Shape Analysis

Average Hand

Page 15: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Left Atrial Shape Analysis

First Mode

+σ+σ +2σ-2σ Mean

Page 16: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Segmentation with Seg3D

Page 17: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

The Pipeline

Generation of volume model

Discrete pointse.g., sensors

Boundaryconditions

MeasuredData

(meshing)

Application of tissue parameters/boundary conditions and computation

Verification & evaluation of results(simulation, error visualization)

(simulation, estimation)

Image aquisition & processing

(image processing)

Identification of structures

Visualization

(image processing and segmentation)

Fitting of geometric surfaces(geometric modeling)

Meshless approaches

Surface based approaches

!

Page 18: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

BioMesh3D

Output Tetrahedral Mesh(Scaled Jacobian Coloring)

Input Labelmap(e.g. from Seg3D

Stage 2:Material Interface

Stage 3:Medial Axis

Stage 6:Distribute Particles

Stage 4:Sizing Field

Stage 8:Volume Mesh

Page 19: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Geometric Mesh Construction

Multisurface Conformal Meshing

TalkJosh Levine

Page 20: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Versatile Modeling

Includes: vasculature, recording needle electrodes, fiber structure.

Page 21: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

The Pipeline

Generation of volume model

Discrete pointse.g., sensors

Boundaryconditions

MeasuredData

(meshing)

Application of tissue parameters/boundary conditions and computation

Verification & evaluation of results(simulation, error visualization)

(simulation, estimation)

Image aquisition & processing

(image processing)

Identification of structures

Visualization

(image processing and segmentation)

Fitting of geometric surfaces(geometric modeling)

Meshless approaches

Surface based approaches

!

Page 22: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Interactive Visualization

The Toolkit• EP Experiments• ECGSim• Clinical EP - BSPM - EAM

• Body surface• Epicardium• Torso volume - (In)homogenous• Heart volume

Data Sources

GeometricModels

SourceFormulation

• Epicardial potentials• Activation times• Discrete sources• ...

Forward solution method

• Boundary element• Finite element

Inverse solution method

• Tikhonov, TSVD• Isotropy• WBPR• Activation based Gauss-Newton• Variational form regularizer• ...

Page 23: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

SCIRun Platform

Page 24: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Example: Forward Solutions

Page 25: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Example: Inverse Solution

Activation-based inverse solution with ECGSim heart geometry

Page 26: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Phantom Validation Data

Utah torso tank with isolated heart

Page 27: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Defibrillation Computational Pipeline

Solve Laplace’sequations

Project the ElectricField onto Myocardial Volume

Estimate Effectiveness

Poster

Wed 12:00

Page 28: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Evaluation of Defibrillation

!

Page 29: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Validation Through Experiments

Defibrillation simulation and validation

Page 30: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Validation Through Experiments

Defibrillation simulation and validation

Page 31: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Clinical Inverse Solutions

Early Activation

Stovicek, et al

Page 32: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Status/Timeline

Page 33: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Be Part of the PlanPost Doctoral Fellowship:

The NIH Center for Integrative Biomedical Computing (CIBC, www.sci.utah.edu/cibc) at the Scientific Computing and Imaging (SCI) Institute, University of Utah, invites applications for a post-doctoral researcher for interdisciplinary research at the intersection of biomedical image analysis, geometric modeling, simulation, numerical methods, and scientific visualization.

Page 34: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

Join the Utah SCI/CIBC Team

Page 35: The Utah Integrated Environment for Image Based Modeling, Simulation, and Visualizationmacleod/talks/VPH2010-MacLeod.pdf · 2011-06-19 · the Scientific Computing and Imaging (SCI)

More Information

www.sci.utah.edu/cibc