Upload
others
View
4
Download
0
Embed Size (px)
Citation preview
3D Video services
Marco Cagnazzo
Part III: Advanced servicesOverviewOverview
3D Vid t3D Video systems• History• Acquisition• Transmission (coding)• RenderingFuture services• Super Hi Vision systems• High speed cameras• High sensibility cameras
page 1 Marco Cagnazzo 27.05.2010 3D Video
3D imaging a very old story!3D imaging… a very old story!
The weighing of the heart scene from
Masaccio, Trinità (1425-1427), S t M i N ll Fi
P. Picasso, Les Demoiselles d'Avignon, 1907, MOMA, NYC
The weighing of the heart scene from the Papyrus of Ani, ca. 1200 B.C.
Flat imagesPerspective and
distance fogSanta Maria Novella, Firenze
g
Perspective
gMultiple views
Piero della Francesca? Leon Battista Alberti? Città ideale (1470 1475 circa)
page 2 Marco Cagnazzo 27.05.2010 3D Video
Piero della Francesca?, Leon Battista Alberti?, Città ideale (1470-1475 circa), Galleria Nazionale delle Marche, Urbino.
Depth perceptionDepth perception
Bi lBinocular cues• Stereoscopic imaging: stereopsis
Monocular cues• Perspective• Motion parallax• Depth from motion• Distance fog and texture degradation• Object sizes
page 3 Marco Cagnazzo 27.05.2010 3D Video
Stereoscopic imagingStereoscopic imaging
As soon as photography was born, stereoscopic devices were createddevices were created
1844 St b D id B t d i th t1844: Stereoscope by David Brewster, a device that could take photographic pictures in 3D.
1851: Improvement by Louis Jules Duboscq (picture of Queen Victoria displayed at The Great Exhibition)of Queen Victoria displayed at The Great Exhibition)
page 4 Marco Cagnazzo 27.05.2010 3D Video
ExampleExample
Stereoscopic view of Manhattan, 1909
page 5 Marco Cagnazzo 27.05.2010 3D Video
3D Movies3D Movies
1855 th Ki t i t d i th St1855: the Kinematoscope was invented, i.e. the Stereo Animation Camera
1915: The first anaglyph movie was produced
1922: the first public 3D movie was displayed - The Power of LovePower of Love
1935: the first 3D color movie was produced1935: the first 3D color movie was produced
page 6 Marco Cagnazzo 27.05.2010 3D Video
Anaglyph imageAnaglyph image
page 7 Marco Cagnazzo 27.05.2010 3D Video
3D Television3D Television
1947: Soviet Union developed 3D films: Robinson CrusoeCrusoe
’50 3D i d d B D il’50: many 3D movies were produced: Bwana Devil, House of Wax, Alfred Hitchcock’s Dial M for Murder (the movie was released in 2D because not all(the movie was released in 2D because not all cinemas were able to display 3D films)
page 8 Marco Cagnazzo 27.05.2010 3D Video
3D Television3D Television“Quality of Experience”: Very good 2D movies vs objectionable 3D (bad color annoying glasses )(bad color, annoying glasses…)
90s-2000s: New technologies in acquisition, compression, and 90s 000s e tec o og es acqu s t o , co p ess o , a drendering
A f 2008 3D i i b d J bl h lAs of 2008, 3D programming is broadcast on Japanese cable channel BS 11 approximately four times per day.
Sky 3D channel in April 2010. The system will require a special "3D ready" television and Sky+HD DVR box
Starting on June 11th, 2010 ESPN will launch a new channel dedicated to 3D sports with up to 85 live events a year in 3Dp p y
page 9 Marco Cagnazzo 27.05.2010 3D Video
3D TV Systems3D TV Systems
S
tion
g Decod
er
BR
Stereo camera
Multi user 3D TV
nt Produ
ct
eo Cod
ing
3D Video
D+D
IB
…
… …
Depthcamera
Single user 3D TV
3D Con
ten
3D Vide 3
er
Multi-camera setup
2D TV3
DVB
Decod
2D/3D conversion
2D TV
Video Depth Meta data
page 10 Marco Cagnazzo 27.05.2010 3D Video
Video Depth Meta data
3D Video acquisition3D Video acquisition
StStereoscopy • 2 cameras mounted side by side, separated by the same distance as
between a person's pupils.
Multi-view capture uses arrays of many cameras to capture a 3D scene through multiple independent video streams.
Color+depth camera: capture normal video and a depth map estimatedColor+depth camera: capture normal video and a depth map, estimated with radar-like techniques (uses infrared)
M lti i d th N C l d thMultiview+depth: N Color+depth cameras
page 11 Marco Cagnazzo 27.05.2010 3D Video
3D Video Acquisition: stereo camera3D Video Acquisition: stereo camera
page 12 Marco Cagnazzo 27.05.2010 3D Video
3D Video Acquisition: color + depth3D Video Acquisition: color + depth
page 13 Marco Cagnazzo 27.05.2010 3D Video
3D Video Acquisition: MVD3D Video Acquisition: MVD
page 14 Marco Cagnazzo 27.05.2010 3D Video
Coding of 3D videoCoding of 3D videoEncode separately each view
Encode jointly view• Use other views to perform• Use other views to perform
prediction of current image
Encode a view and a depth map• Joint or separate coding of view
and depth• Scalable coding?Scalable coding?
page 15 Marco Cagnazzo 27.05.2010 3D Video
3D Rendering:Anaglyph MethodAnaglyph Method
page 16 Marco Cagnazzo 27.05.2010 3D Video
3D Rendering: Polarized MethodPolarized Method
page 17 Marco Cagnazzo 27.05.2010 3D Video
3D Rendering:Alternate-frame sequencingAlternate-frame sequencing
E d f i f th l ft [ i ht] iEvery second frame is from the left [right] viewVideo is projected at twice the frame rateViewers wears glasses that shutter alternatively the left or the right eye
page 18 Marco Cagnazzo 27.05.2010 3D Video
3D Rendering:Auto stereoscopic displayAuto stereoscopic display
page 19 Marco Cagnazzo 27.05.2010 3D Video
Non-stereoscopic rendering methodsNon-stereoscopic rendering methodsMotion parallax Head tracking
No special screen nor glasses!No special screen nor glasses!
page 20 Marco Cagnazzo 27.05.2010 3D Video
THANKS FOR YOUR ATTENTION!ATTENTION!
?? || \\ (1)?? || \\
______________ (1)Questions or comments
® Dario Rossi, Télécom-ParisTech
Contacts:Marco CAGNAZZO
Institut Télécom – Télécom ParisTech
Dép. Traitement Signal et Imagep g g
e‐mail: [email protected]