7
IBM - CVUT Student Research Projects Video anotation for IBM TalkingHead Jiří Hronek ([email protected]) Vojtěch Sázel ([email protected]) Project coordinator: Ing. Ladislav Kunc

IBM - CVUT Student Research Projects Video anotation for IBM TalkingHead Jiří Hronek ([email protected]) Vojtěch Sázel ([email protected]) Project

Embed Size (px)

Citation preview

Page 1: IBM - CVUT Student Research Projects Video anotation for IBM TalkingHead Jiří Hronek (hronej2@fel.cvut.cz) Vojtěch Sázel (sazelv1@fel.cvut.cz) Project

IBM - CVUT Student Research Projects

Video anotation forIBM TalkingHead

Jiří Hronek ([email protected])Vojtěch Sázel ([email protected])

Project coordinator: Ing. Ladislav Kunc

Page 2: IBM - CVUT Student Research Projects Video anotation for IBM TalkingHead Jiří Hronek (hronej2@fel.cvut.cz) Vojtěch Sázel (sazelv1@fel.cvut.cz) Project

IBM - CVUT Student Research Projects

2

Video anotation forIBM TalkingHead

TalkingHead description The TalkingHead framework is system for

visual interaction with computer users via animated 3D head and sound

Animated head is capable of moves and mimics

voice synthesizer is included in the framework TalkingHead uses XML scenarios, that

describe head movements and contain spoken text

Page 3: IBM - CVUT Student Research Projects Video anotation for IBM TalkingHead Jiří Hronek (hronej2@fel.cvut.cz) Vojtěch Sázel (sazelv1@fel.cvut.cz) Project

IBM - CVUT Student Research Projects

3

Video anotation forIBM TalkingHead

Our goals Choose short videosequences from English

TV programs – news Create a transcript from videos Add some marks into the transcript, according

to the movements of the TV reporter's head Rewrite the transcript to XML file in format of

TalkingHead

Page 4: IBM - CVUT Student Research Projects Video anotation for IBM TalkingHead Jiří Hronek (hronej2@fel.cvut.cz) Vojtěch Sázel (sazelv1@fel.cvut.cz) Project

IBM - CVUT Student Research Projects

4

Video anotation forIBM TalkingHead

Our goals – cont. Compare movement of the animated head

with movement of the real head of TV reporter Form a small group of english speaking

people Run “usability test“ Answers for questions on correspondence TalkingHead's

movement with real head movement Aswers for questions on movement realism Answers for question: „Is it possible to use TalkingHead to read

the news?“

Page 5: IBM - CVUT Student Research Projects Video anotation for IBM TalkingHead Jiří Hronek (hronej2@fel.cvut.cz) Vojtěch Sázel (sazelv1@fel.cvut.cz) Project

IBM - CVUT Student Research Projects

5

Comparsion between the TalkingHead and reporter's head

Page 6: IBM - CVUT Student Research Projects Video anotation for IBM TalkingHead Jiří Hronek (hronej2@fel.cvut.cz) Vojtěch Sázel (sazelv1@fel.cvut.cz) Project

IBM - CVUT Student Research Projects

6

Video anotation forIBM TalkingHead

Conclusion Results of this project will be used in the

development of automatic 3D TalkingHead movements

What's acomplished TV videos have been chosen Anotations have been made for them

To do usability test

Page 7: IBM - CVUT Student Research Projects Video anotation for IBM TalkingHead Jiří Hronek (hronej2@fel.cvut.cz) Vojtěch Sázel (sazelv1@fel.cvut.cz) Project

IBM - CVUT Student Research Projects

7

Video anotation forIBM TalkingHead

Any questions? ...