TV-RING & ImmersiaTV
TV-RING & ImmersiaTV:
Present and future of TVSergi Fernández
15/10/2015
TV-RING & ImmersiaTV
2
-Introduction to the TV-RING project-Main results gathered in the last 24 months-Main outcomes: products going to market-Introduction to ImmersiaTV
WHAT IS THIS PRESENTATION ABOUT?
TV-RING & ImmersiaTV
WHAT IS TV-RING ABOUT?
ICT PSP EU funded projectStarted in Sept’13Finishes in Feb’16Budget ~2.8 M€Coordinated by: i2CAT
TV-RING & ImmersiaTV
WHAT IS TV-RING ABOUT?The Consortium:
TV-RING & ImmersiaTV
WHAT IS TV-RING ABOUT?
TV-RING
3 pilots
Open Connected TV Forum
User validation
Inform and exploit results
7
WHAT IS TV-RING ABOUT?
@tv_ring
Professional and End-Users
Gather requirements
Improve apps/features
Evaluate and validate services
User validation
8
WHAT IS TV-RING ABOUT?
@tv_ring
Living Labs Approach
User validation
Users panels in the pilots
Co-creation workshop
9
WHAT IS TV-RING ABOUT?
@tv_ring
3 pilots
10
WHAT IS TV-RING ABOUT?
@tv_ring
The Netherlands
Digital Right Management (DRM)
Recommendation systems
2nd Screen App
Germany (Berlin-
Brandenburg)HbbTV App with UHD
contents / MPEG-DASH
New interactive formats
TV App Gallery
Spain (Catalonia)
Multicamera Service
MPEG-DASH: Live and On-demand
3 pilots
11
WHAT IS TV-RING ABOUT?
@tv_ring
DRM
12
WHAT IS TV-RING ABOUT?
@tv_ring
Recommender
13
WHAT IS TV-RING ABOUT?
@tv_ring
2nd Screen Game
14
WHAT IS TV-RING ABOUT?
@tv_ring
Verknallt & abgedreht
15
WHAT IS TV-RING ABOUT?
@tv_ring
SandMänchen
16
WHAT IS TV-RING ABOUT?
@tv_ring
Multicamera
17
WHAT IS TV-RING ABOUT?
@tv_ring
Multicamera
18
WHAT IS TV-RING ABOUT?
@tv_ring
OfflineInternational &
Regional Workshops
Third parties engagement > use of
test-beds
Open Connected TV Forum
19
WHAT IS TV-RING ABOUT?
@tv_ring
OnlineFor stakeholders: Information and
discussions
For developers: HbbTV development tools and
resources
Open Connected TV Forum
20
www.hbbtv-developer.com
@tv_ring
21
HbbTV Developer WebsiteThe Reference website for developersThe website consists of 3 different parts:
• Wiki – Providing tutorials, requirements, guidelines, code snippets, …
• Forum – Providing a place for discussions
• Blog – Providing news around HbbTV, project results
@tv_ring
22
TV-RING from idea to market
@tv_ring
23
Other figures:
@tv_ring
_More than 1 year of testing with users_70 households distributed in 2 regular user panels (almost 200 people)
_+8000 users enjoyed our Apps in The Netherlands, Germany and Spain
_6 new apps/services have been deployed and 4 went into production
_TV-RING has been the first in demonstrating the UHDTV streaming is possible over HbbTV _TV-RING has been present in more than
30 events and organised 7 workshops
TV-RING & ImmersiaTV
We invite you to try our demos!
...and tomorrow dedicated session on See2Gather (by NPO)
If you want further information, please contact us: [email protected] (TV-RING & ImmersiaTV project coordinator) or visit www.tvring.eu
25
Start January 201630 Months
Budget 3.8M€
Tooling companies• IP-Based production
pipeline• Omnidirectional
production tools
Research institutes• Stitching• Innovative Codecs• User Evaluation
Production• Omnidirectional video
production• Broadcasting
27
TV-RING & ImmersiaTV
28
ImmersiaTV. General objective
Offer an integrated experience across devices,enhancing the traditional broadcast with immersive content and second and third screen functionalities.
TV-RING & ImmersiaTV
29
ImmersiaTV. General objective
A novel form of Broadcast content that matches the demands of immersive displays, and can be shared with tablets and traditional TV consumers.
TV-RING & ImmersiaTV
30
ImmersiaTV. Why?
TV-RING & ImmersiaTV
31
ImmersiaTV. Why?
TV-RING & ImmersiaTV
32
ImmersiaTV. Why?
33
ImmersiaTV. Why?
TV-RING & ImmersiaTV
34
• OBJ1. Create a new cinematographic language where the specificities of immersive displays are taken into account
• OBJ2. Extend the production pipeline to create omnidirectional content for a multi-platform environment.
ImmersiaTV. Objective
TV-RING & ImmersiaTV
35
• OBJ3. Re-design the distribution chain for omnidirectional content (capture, compression, distribution, reception, and rendering)
• OBJ4. Maximize the quality of the end-user experience, across devices
• OBJ5. Maximize the impact of the ImmersiaTV solutions.
ImmersiaTV. Objective
36
Platform
specific
Delivery
Stream
Combination
Time Mana
ger
Receptio
n
Reception & Decoding of video streams
Time synchronization
Immersive
User Info
Integration
(head and
body positions and rotatio
ns)
Head Mounted Display(Smart
composition of
audiovisual portals)
Selection of video
stream and
production-
selected
viewpoint
Traditional TV set (fixed
viewpoint)
Second screen
(viewpoint can be
extended with tablet movements
)
VideoStorage
Head and/or tablet movements
Change Field of view
Trigger events
Region Of Interest
Multimedia Server as Home Receptor
Capture Stitching + Geometric
Transformations
Encoding & compression Distribution (CDN)
Decoding/Storage
Geometric conversions
Display(s) adaptation Rendering
Capture Stitching + Geometric
Transformations
Encoding & compression Distribution (CDN) Decoding Geometric
conversionsDisplay(s)
adaptationRendering
1st IterationOffline creation+ on demand streaming
2nd IterationLive production & off the shelf (near) realtime streaming3rd IterationLive production & smart(near) realtime streaming
Capture Stitching + Geometric
TransformationsEncoding &
compression Distribution (CDN) Decoding Geometric conversions
Display(s)adaptation
Rendering
offline Video on demand
Offline encoding (ex. HEVC/H.265) without restrictions on bit rate, delay and quality parameters
Real-time encoder (ex. HEVC/H.265) with restrictions on bit rate, delay and quality parameters
viewpoint
Multimedia Server as Home Receptor
Multimedia Server as Home Receptor
Low latency & ROI encoder
Real-time decoder
Low latency &ROI decoder
Non real-timeDecoding + storage
viewpoint
viewpointROI estimation
39
40
TV-RING & ImmersiaTV
Thank you for you attention!
[email protected] TV-RING & ImmersiaTV project coordinator