Embed Size (px)
DESCRIPTION
Presentation for the FutureTV session at EuroITV 2013. See http://www.linkedtv.eu/event/futuretv2013/. Paper presented by Lotte Belice Baltussen of the Netherlands Institute for Sound and Vision. Lotte Belice Baltussen, Roeland Ordelman, Jaap Blom. VideoHypE: An Editor Tool for Supervised Automatic Video Hyperlinking. In 11th European Interactive TV Conference (EuroITV 2013), June 2013, Como, Italy.
Citation preview
Television Linked To The Web
www.linkedtv.eu
Lotte Belice Baltussen, Roeland Ordelman, Jaap BlomNetherlands Institute for Sound and Vision
VideoHypE: An Editor Tool for Supervised Automatic Video Hyperlinking
EuroITV | Como, Italy – 24 June 2013
2
www.linkedtv.eu
LinkedTV: interweaving Web and TV into a single experience
Mixing lean back and lean forward Want to maintain immersion while removing fourth
wall illusion Works only for certain genres and audiences Does second screen help or hinder?
The LinkedTV vision
linkedtv.eu
3
www.linkedtv.eu
Scenarios and content
Enriched News
Professional news content produced by RBB for general audience
local news show rbb Aktuell People, locations and events
can be linked to previous events.
Antiques Interactive
Program watched predominantly by 50+ers
AVRO:Tussen Kunst en Kitsch (TKK)
Objects, locations and experts provide anchors to related materials (targets).
linkedtv.eu
4
www.linkedtv.eu
Antiques Interactive: Enriched link demo
linkedtv.eu
5
www.linkedtv.eu
dbpedia.org/resource/Jan_Sluyters
Workflow
linkedtv.eu
Paintings by Jan Sluijters
“...painting of Jan Sluijters....”
Hypervideo analysis
Presentation engine
Named Entity Recognition
Enriching NEs with web content
Generation of media fragments
6
www.linkedtv.eu
dbpedia.org/resource/Jan_Sluyters
Workflow
linkedtv.eu
Paintings by Jan Sluijters
“...painting of Jan Sluijters....”
Hypervideo analysis
Presentation engine
Named Entity Recognition
Enriching NEs with web content
Generation of media fragments
VideoHypE
7
www.linkedtv.eu
Why do we need VideoHypE?
, Roeland Ordelman1
Broadcasters want to have some control. Editors have the expertise to determine relevance + The user interface can only show a limited amount of links, and there are many
Research: sample 805 videos, average 55 NEs per video. 55 NEs = many, many
possible links depending on the size of the white list [Li et al., 2013]
NE - person: Jan Sluijters
NE – art syle: Fauvism
NE - person: Emiel Aardewerk
Link white list 1
Link white list 2
Link white list 3
Link white list 6
Link white list 7
Link white list etc etc
Link white list 4
Link white list 5
8
www.linkedtv.eu
VideoHypE requirements
, Roeland Ordelman1
Requirements session with 5 AVRO editorial members + digital staff of TKK. Main outcomes:
1. Selecting from list of available episodes2. Create and edit chapters3. Timeline with chapters4. See annotations per chapters, distinction between entity types5. Select annotations + related hyperlinks6. Add selected, approved hyperlinks7. Timeline with enities and hyperlinks8. Add new hyperlinks to media fragments (e.g. shots/chapters/spatial)9. Remove hyperlinks and/or entities (per media fragment or episode)10. Separate user environment for each end user partner11. Adding to white list12. Sorting on entity types13. Collaborative space14. Delete annotations forever15. Level of completion per chapter / episode16. Variable # suggested links depending on time pressure
MAX 20-30 minutes per episode!!!
9
www.linkedtv.eu
Demo overview – choose your video
, Roeland Ordelman1
10
www.linkedtv.eu
Demo overview – shot overview
, Roeland Ordelman1
11
www.linkedtv.eu
Demo overview - chapters
, Roeland Ordelman1
12
www.linkedtv.eu
Demo overview – selecting entities
, Roeland Ordelman1
13
www.linkedtv.eu
Demo overview – selecting links per entity
, Roeland Ordelman1
14
www.linkedtv.eu
Demo overview – editor‘s choices overview
, Roeland Ordelman1
15
www.linkedtv.eu
Demo overview – adding links
, Roeland Ordelman1
17
www.linkedtv.eu
1. Implementing remaining requirements.2. How to make the editor tool scalable?
• Different programmes, different requirements• How to deal with live content?• There is not just one front-end => one-screen solutions, 2nd screens, multiple
screens, etc.3. Personalisation: what ‘bandwith’ is left personalisation?4. Relevance is a crucial issue – how can the system ‘learn’?5. User testing with real editors
VideoHypE – discussion & future work
18
www.linkedtv.eu
Thanks!
, Roeland Ordelman1
Find me here:@lottebelice | [email protected]
Credits:Again: other authors are Roeland Ordelman and Jaap BlomSlides partly by: Lynda Hardman (CWI)Heaps of thanks to AVRO for so generously letting LinkedTV use their content.
Links:www.linkedtv.eutwitter.com/BenGlabs www.avro.nl
