Upload
andreas-walter
View
579
Download
4
Embed Size (px)
DESCRIPTION
The ImageNotion application is the outcome of the EU funded project IMAGINATION.This presentation shows the innovative approach for the combination of semantic technologies and automated processes for image annotation
Citation preview
ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org
Juris Zubkans, RIDEMOAndreas Walter, FZIGabor Nagypal. disy
19.03.2009 – final review meeting
ImageNotion beta
2ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org
From prototype version to beta version
ImageNotion prototype•Released: October 2007
•Main goal: development of a prototype to show potential of ImageNotion
•Prototype used for evaluations• Online evaluation Nov/Dec 2007, > 100 participants• Formative evaluation workshop
3ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org
Features of the prototype
Automated processes•First version of person detection (NTUA)•Simple approach for text mining (JSI)•Face detection (IIS)•Face recognition with static training (IIS)•No combination of services so far
ImageNotion methodology•Visual representation of semantic elements•Only basic relations like in thesauri (broader, narrower, is-a)
Web based frontend• using many new Web 2.0 features(Autocomplete, refresh of site parts) using AJAX
4ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org
Feedback for prototype (in a brief)
General approach very promising for • Semantic image annotation , e.g. in image agencies• Semantic image search, e.g. editors, students
Visual approach for showing semantic elements • ImageNotion methodology easily understandable• Allows collaborative and work integrated ontology development
Combination of services• Saves time (and so money) for creating annotations on images
Frontend• „Desktop application feeling“
=> High motivation for making prototype a beta version…
5ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org
The new ImageNotion version (1)
Automated processes (short overview)• Improved person detection, NTUA also developed similarity search• Improved version of text mining from JSI, also text recognition (FZI),
Integration of SearchPoint (visual search refinment)• Improved version of IIS for face detection, also gender and mood
detection• Dynamic training of face recognition based on imagenotions developed
by IIS together with FZI• Combination of services, e.g. higher score of face if person is nearby,
automatic mapping of names recognized in text recognition with newly detected faces
6ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org
The new ImageNotion version (2)
ImageNotion methodology (short overview)• Extension with named relations, e.g. „has gender“, „works as“• Implemented own reasoning functions with named relations (e.g.
isImageNotionAPerson true, if has relations is-a person or has-gender male / female)
• Import of ontologies, Export of ontologies to OWL• Merging of imagenotions describing the same semantic element
Backend• Creation of service based architecture to make complete application more
flexible and extensible
Frontend• Integration of feedback from evaluations, now it is even more „desktop
application“
7ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org
ImageNotion webpage
8ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org
ImageNotion webpage
References• www.imagenotion.com as main page of the ImageNotion company• References shows customizable ImageNotion installation, currently
o Photo12: photo agencyo Deniz Saylan: German photographero BSMC: library
Try ImageNotion• Public installation, everyone may upload images• Initial images delivered by photo12 (cinema)• Version will be used for second online evaluation in April
Publications• Shows the (in the meantime) big list of publications• Gabor and I am proud about the publication of two journal paper publications
and also indepently from us a four page article published by the ix magazine
9ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org
ImageNotion beta
10ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org
ImageNotion beta
Customizable…
Demo photo12.imagenotion.com(images from photo12)
11ImageNotion: www.imagenotion.com IMAGINATION : www.imagination-project.org
Thank you!
Do you have questions
Please visit www.imagenotion.com