50
What does compressive sensing mean for X-ray CT and comparisons with its MRI application Emil Sidky University of Chicago- Dept. of Radiology work supported by the NIH

What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

What does compressive sensing mean for X-ray CTand comparisons with its MRI application

Emil Sidky University of Chicago- Dept. of Radiology

work supported by the NIH

Page 2: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Outline

* CT and image reconstruction background

* Application: mammography

* Compressive sensing in CT versus MRI

* Some results with real CT data

* Ongoing studies: - extremely small objects real data - sparsity-based sampling sufficiency theoretical study

Page 3: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Outline

* CT and image reconstruction background

* Application: mammography

* Compressive sensing in CT versus MRI

* Some results with real CT data

* Ongoing studies: - extremely small objects real data - sparsity-based sampling sufficiency theoretical study

Page 4: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Standard introduction to CT

X-ray source

LI0

I∫

Lµ(~r)dℓ = − ln(I/I0)

Radon transformX-ray transform

Page 5: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Reality of CT

* object function is simplified:

* data model also simplified: - X-ray scatter - X-ray source beam-spectrum - detector physics - random processes ....

* CT is a digital instrument: finite number of samples

µ(~r) → µ(~r, E, t)

Page 6: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Overview of image reconstruction algorithms

* An algorithm consists only of a number of data processing steps

* Data/imaging models and their methods of solution help guide their design

* Trade-off (see Foundations of Image Science by Barrett and Myers)

simple model complex model easy to solve hard to solve model error is large model error is small

* Practical I.R. algorithms evaluated on imaging task Theoretical I.R. research based on model solution

Page 7: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Implicit v. Explicit image reconstruction

g = X(f) f = X−1(g)

(example: compressive sensing)solved iterativelynon-linearcomplex models can be devisedzoology of data modelsneed to reconstruct whole image

(example: FBP)one-shot processingusually linearmodeling limitedmodels more uniformcan reconstruct point-by-point

Page 8: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Model zoology

Implicit / Iterative / CS

type of expansion elements: pixels, blobs, waveletsnumber of expansion elementsray samplingmeasurement model line integration Siddon’s method, ray-tracing area-weighted integration

~g = X ~fg(θi, ξi) =

L(θi,ξi)dℓf(~r)

Explicit / FBP/ FDK

continuous object function

---continuous data functionmeasurement model line integration

Radon/X-ray

Page 9: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Full solution v. point-by-point

implicit explicit

Page 10: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Outline

* CT and image reconstruction background

* Application: mammography

* Compressive sensing in CT versus MRI

* Some results with real CT data

* Ongoing studies: - extremely small objects real data - sparsity-based sampling sufficiency theoretical study

Page 11: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

X-ray Imaging for Breast Cancer Screening

Goal: Early detection

Task: image asymptomatic women and decide to recall or not

Imaging: suspicious mass (tumor) or micro-calcification cluster (DCIS)

Page 12: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

X-ray Imaging for Breast Cancer Screening

Digital mammography

resolutiondepth: 6.0 cmin-plane: 0.1 mm

Page 13: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

X-ray Imaging for Breast Cancer Screening

Digital mammography Digital breast tomosynthesis

resolutiondepth: 6.0 cmin-plane: 0.1 mm

resolutiondepth: 1.0 mmin-plane: 0.1 mm

Page 14: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

X-ray Imaging for Breast Cancer Screening

Digital mammography Digital breast tomosynthesis Computed Tomography

resolutiondepth: 6.0 cmin-plane: 0.1 mm

resolutiondepth: 1.0 mmin-plane: 0.1 mm

resolutiondepth: 0.3 mmin-plane: 0.3 mm

Page 15: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

X-ray Imaging for Breast Cancer Screening

Digital mammography Digital breast tomosynthesis Computed Tomography

resolutiondepth: 6.0 cmin-plane: 0.1 mm

resolutiondepth: 1.0 mmin-plane: 0.1 mm

resolutiondepth: 0.3 mmin-plane: 0.3 mm

design constraint: Equal X-ray dose

Page 16: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Projection image Digital breast tomosynthesis

in-plane depth

Courtesy: Massachusetts General HospitalGE prototype DBT scanner

Mass imaging

Page 17: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Projection image Digital breast tomosynthesis

Courtesy: Massachusetts General HospitalGE prototype DBT scanner

Microcalcification imaging

2 cm

Page 18: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Breast computed tomography (bCT)

512-view, bCT simulationFBP reconstruction

unregularized Gaussian filtered

Page 19: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Breast computed tomography (bCT)

512-view, bCT simulationFBP reconstruction

unregularized Gaussian filtered

Can CS help?

Page 20: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Outline

* CT and image reconstruction background

* Application: mammography

* Compressive sensing in CT versus MRI

* Some results with real CT data

* Ongoing studies: - extremely small objects real data - sparsity-based sampling sufficiency theoretical study

Page 21: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Compressive sensing for CT withgradient magnitude sparseness

~f ∗ = argmin‖~f‖TV such that X ~f = ~g

‖~f‖TV =∑

i

|~∇fi|

dete

ctor

specifying XSiddon’s methodsquare pixelsdifferent array sizes

Page 22: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Compressive sensing for CT withgradient magnitude sparseness(comparison with FT/MRI image model)

discrete Cartesian FT discrete X-ray transformconsistent may be inconsistentdiscrete inverse no known direct discrete inverseneed NxN samples need 2Nx2N samples?incoherence partial incoherence

~g = X ~f

Page 23: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Inverse of the discrete X-ray transform?

1024x1024 discrete phantom FBP applied to 2048x2048 data set

Page 24: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Incoherence

Page 25: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

image gradient CS for CT

~f ∗ = argmin‖~f‖TV | |X ~f − ~g|2 ≤ ǫ2 and fmax > ~f > 0

‖~f‖TV =∑

i

|~∇fi|

* data inconsistency --> ε>0* no discrete inverse --> challenge for algorithm development* partial incoherence --> no exact recovery theorems, RIP, NSP (we have performed extensive tests...)

Algorithm alternates POCS with TV-steepest descentPMB 2008 - Sidky and Pan

Page 26: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Outline

* CT and image reconstruction background

* Application: mammography

* Compressive sensing in CT versus MRI

* Some results with real CT data

* Ongoing studies: - extremely small objects real data - sparsity-based sampling sufficiency theoretical study

Page 27: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

PMB 2010CSalgorithm

960-views

Page 28: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

PMB 2010

Robustness to model error

Page 29: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

TMI 2011

CS60-views

FDK360-views

FDK60-views

POCS60-views

Page 30: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Is CS really new?

* Edge-preserving TV regularization used since early 1990s Constrained, TV-minimization equivalent to TV-penalized unconstrained optimization

* Sparsity and L1-relaxation exploited for contrast-enhanced vessel imaging

Page 31: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

PMB 2002

4-views!

L1-relaxation

Page 32: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Contributions of CS

* Expanded thinking on optimization based image reconstruction Traditional iterative: minimize data fidelity + γ roughness penalty CS: Use penalty to break degeneracy of the solution space

* Novel rules for determining data sufficiency-based object sparsity

*Beating Nyquist Frequency?? No. Nyquist is only one form of interpolation Use of interpolation, followed by FBP yields the continuous image CS yields only discrete representation of the image

Page 33: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Outline

* CT and image reconstruction background

* Application: mammography

* Compressive sensing in CT versus MRI

* Some results with real CT data

* Ongoing studies: - extremely small objects real data - sparsity-based sampling sufficiency theoretical study

Page 34: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Focus on bCT:tradeoff between view-number and noise-per-view

1878-projections, 100 micron detector bins, low-intensity X-ray illumination

Courtesy XCounter

Page 35: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

constrained, TV-minimizationFirst attempt: 100 micron pixel array

Page 36: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Second attempt: 25 micron pixel array

image array: 4096 x 4096data samples: 1878 views x 1200 bins undersampled!!

Page 37: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

CS-algorithm modifications

detector-coordinateFourier upsampling

constrain imagespatial frequencies

Sidky et al. 2011- arxiv.org/abs/1104.0909

Page 38: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Outline

* CT and image reconstruction background

* Application: mammography

* Compressive sensing in CT versus MRI

* Some results with real CT data

* Ongoing studies: - extremely small objects real data - sparsity-based sampling sufficiency theoretical study

Page 39: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Preliminary investigation on sparsity-baseddata sufficiency

* Aiming for an empirical Donoho-Tanner type study

* Accurate, first order TV-minimization solver Jakob Joergensen - Danish Technical University T. Jensen et al. ( arxiv.org/abs/1105.3723 )

* Computer-generated breast phantom

Page 40: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Phantom

256x256 pixelized array65536 unknowns ~10000 non-zero pixels

gradient magnitude

Page 41: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Sampling sufficiency study

|~g − X ~f |2 + α|~f |2

|~g − X ~f |2 + α|~∇f |2

|~g − X ~f |2 + α‖~f‖TV

objectives

Tikhonov

CS

α extremely small -> data RMSE=10-5

32 64 128 256 512number of views

0.00

0.04

0.08

image R

MSE

L2 -magnitude

L2 -roughness

L2 -total variation

data: 32-512 views x 512 bins

32 64 128 256 512number of views

0.00

0.05

0.10

0.15

image R

MSE

L2 -magnitude

L2 -roughness

L2 -total variation

32 64 128 256number of views

�3�2�1

log10 im

age R

MSE

L2 -magnitude

L2 -roughness

L2 -total variation

whole image error

ROI error

necessary samples/sparsity ~ 2.5 ??? What is fully sampled?

Page 42: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

the group working on CS in CT

Xiaochuan Pan Emil Sidky

Students:Junguo BianXiao HanEric PearsonZheng ZhangAdrian Sanchez

Rick ChartrandLANL

Jakob Joergensenstudent at the Danish Technical Univ.

University of Chicagoapplied math experts:

Page 43: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Fourier sampling problems

νx

νyν2

ν1

νy

νx

ν2

ν1

interpolation extrapolation

"standard" CSChartrand, Sidky and Panmath.lanl.gov/~rick/Publications/chartrand-2011-frequency.shtml

CS approach to an old problem

Page 44: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Papoulis-Gerchberg

time

samplinginterval

frequency

band-limited signal

Page 45: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Papoulis-Gerchberg reversed

spatial frequency

samplinginterval

space coordinate

compact support

Page 46: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Frequency extrapolation experiment

continuous object model4Kx4K samplesof continuous FT

scaled FT samples

Problem: recover 4Kx4K FT sample grid from central set of 512x512 samples.

Page 47: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Frequency extrapolation method

ϕp(t) =

{

γ|t|2 if |t| ≤ α

γ|t|p/p − δ if |t| > α

x∗ = argmin∑

i=1

ϕp(|∇x|i) + λ‖Ax − b‖22

Chartrand ISBI 2009 for details*efficient solver

Page 48: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Results: no frequency extrapolation

inverse DFT zero pad zero pad and filter

Page 49: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Results: non-convex frequency extrapolation

p=1 p=0.25 p=-0.5

Page 50: What does compressive sensing mean for X-ray CT and ... › programs › scientific › 10-11 › ... · X-ray Imaging for Breast Cancer Screening Digital mammography Digital breast

Results: non-convex frequency extrapolation

p=1 p=0.25 p=-0.5