11
ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org Juris Zubkans, RIDEMO Andreas Walter, FZI Gabor Nagypal. disy 19.03.2009 – final review meeting ImageNotion beta

The ImageNotion Beta version

Embed Size (px)

DESCRIPTION

The ImageNotion application is the outcome of the EU funded project IMAGINATION.This presentation shows the innovative approach for the combination of semantic technologies and automated processes for image annotation

Citation preview

Page 1: The ImageNotion Beta version

ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org

Juris Zubkans, RIDEMOAndreas Walter, FZIGabor Nagypal. disy

19.03.2009 – final review meeting

ImageNotion beta

Page 2: The ImageNotion Beta version

2ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org

From prototype version to beta version

ImageNotion prototype•Released: October 2007

•Main goal: development of a prototype to show potential of ImageNotion

•Prototype used for evaluations• Online evaluation Nov/Dec 2007, > 100 participants• Formative evaluation workshop

Page 3: The ImageNotion Beta version

3ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org

Features of the prototype

Automated processes•First version of person detection (NTUA)•Simple approach for text mining (JSI)•Face detection (IIS)•Face recognition with static training (IIS)•No combination of services so far

ImageNotion methodology•Visual representation of semantic elements•Only basic relations like in thesauri (broader, narrower, is-a)

Web based frontend• using many new Web 2.0 features(Autocomplete, refresh of site parts) using AJAX

Page 4: The ImageNotion Beta version

4ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org

Feedback for prototype (in a brief)

General approach very promising for • Semantic image annotation , e.g. in image agencies• Semantic image search, e.g. editors, students

Visual approach for showing semantic elements • ImageNotion methodology easily understandable• Allows collaborative and work integrated ontology development

Combination of services• Saves time (and so money) for creating annotations on images

Frontend• „Desktop application feeling“

=> High motivation for making prototype a beta version…

Page 5: The ImageNotion Beta version

5ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org

The new ImageNotion version (1)

Automated processes (short overview)• Improved person detection, NTUA also developed similarity search• Improved version of text mining from JSI, also text recognition (FZI),

Integration of SearchPoint (visual search refinment)• Improved version of IIS for face detection, also gender and mood

detection• Dynamic training of face recognition based on imagenotions developed

by IIS together with FZI• Combination of services, e.g. higher score of face if person is nearby,

automatic mapping of names recognized in text recognition with newly detected faces

Page 6: The ImageNotion Beta version

6ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org

The new ImageNotion version (2)

ImageNotion methodology (short overview)• Extension with named relations, e.g. „has gender“, „works as“• Implemented own reasoning functions with named relations (e.g.

isImageNotionAPerson true, if has relations is-a person or has-gender male / female)

• Import of ontologies, Export of ontologies to OWL• Merging of imagenotions describing the same semantic element

Backend• Creation of service based architecture to make complete application more

flexible and extensible

Frontend• Integration of feedback from evaluations, now it is even more „desktop

application“

Page 7: The ImageNotion Beta version

7ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org

ImageNotion webpage

Page 8: The ImageNotion Beta version

8ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org

ImageNotion webpage

References• www.imagenotion.com as main page of the ImageNotion company• References shows customizable ImageNotion installation, currently

o Photo12: photo agencyo Deniz Saylan: German photographero BSMC: library

Try ImageNotion• Public installation, everyone may upload images• Initial images delivered by photo12 (cinema)• Version will be used for second online evaluation in April

Publications• Shows the (in the meantime) big list of publications• Gabor and I am proud about the publication of two journal paper publications

and also indepently from us a four page article published by the ix magazine

Page 9: The ImageNotion Beta version

9ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org

ImageNotion beta

Page 10: The ImageNotion Beta version

10ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org

ImageNotion beta

Customizable…

Demo photo12.imagenotion.com(images from photo12)

Page 11: The ImageNotion Beta version

11ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org

Thank you!

Do you have questions

Please visit www.imagenotion.com