Jason Holloway Aswin Sankaranarayanan Ashok Veeraraghavan Salil
Tambe April 28, 2012
Slide 2
Low-speed images work for static scenes
Slide 3
open shut 33 ms
Slide 4
Blurring in dynamic areas High spatial resolution in static
areas
Slide 5
30 million voxel budget Increasing fps decreases light
throughput 1 Megapixel x 30 fps175 x 175 x 1000 fps
Slide 6
Optical coding
Slide 7
-LCOS -Per pixel coded exposure P2C2 [Reddy et al. 2011] Per
pixel shutter control Flexible Voxels Gupta et al. 2011] CPEV
[Hitomi et al. 2010, -Implement on CMOS -Single bump per pixel per
frame Per pixel sensor control FSVC Global shutter control Global
shutter control y t x Exposure Single Pixel Camera [Wakin et al.
2006] Spatial-muliplexing y t x y t x
Slide 8
Slide 9
Video Removed General motion Linear with known velocity
PeriodicityLinear dynamical systems Coded Strobing [Veeraraghavan
et al. 2011] CD-LDS [Sankaranarayanan et al. 2010] Flutter Shutter
[Raskar et al. 2006] P2C2 [Reddy et al. 2011] Flexible Voxels
[Gupta et al. 2010] CPEV [Hitomi et al. 2011] FSVC 80x20x-50x
6x-16x
Slide 10
Locally linear motion model Union of subspaces (UoS) General
motion TV minimization
Slide 11
High-speed PCA subspace approx. A 18x18x24 patch can be
expressed using 324 dimensional subspace y t x 521 velocities, 40
angles and 13 speeds y t
Slide 12
High-speed subspace Low-speed subspace Patch based
reconstruction
Slide 13
Speed = 1.38 pixels/high-speed frame Direction = 61 Speed
(pixels/frame)
Slide 14
Video Removed PSNR: 35.5 dB
Slide 15
Slide 16
Video Removed Hairnets advertisement placard moving right PSNR:
40.6 dB
Slide 17
Video Removed Dancer clapping causes a chalk cloud to form
PSNR: 28.7 dB
Slide 18
PointGrey Machine Vision cameras were used to simulate FSVC
Flea3 grayscale camera operating at 8 fps
Slide 19
Video Removed Observed framesRecovered video (6x) Video
Removed
Slide 20
Hardware complexity Reconstruction quality FSVC CPEV P2C2
Global shutter control suffices for high speed video recovery