Interoperable and Unified Multimedia Retrieval]{Interoperable and Unified Multimedia Retrieval in Distributed and Heterogeneous Environments

Embed Size (px)

DESCRIPTION

In this abstract, the research topics of my doctoral thesis will be introduced. These emerged within THESEUS, in which I work as a third-party funded researcher. The overall aim of my work is to provide unified and interoperable multimedia retrieval in distributed and highly heterogeneous environments. In this case, I am focusing on multimedia databases, multimedia metadata formats, semantic web technologies as well as international standardization (MPEG/JPEG and W3C).

Text of Interoperable and Unified Multimedia Retrieval]{Interoperable and Unified Multimedia Retrieval in...

  • 1. Motivation Research topics Conclusion Interoperable and Unied Multimedia Retrieval in Distributed and Heterogeneous Environments Florian Stegmaier Supervisor: Harald Kosch Co-Supervisor: Mario Dller o Chair of Distributed Information Systems University of Passau, Germany October 26th, 2010 Presenter: Florian Stegmaier, University of Passau ACMMM10 Interoperable and Unied Multimedia Retrieval
  • 2. Motivation Research topics Conclusion Outline of this talk 1 Motivation Multimedia retrieval in todays world Distributed and heterogeneous retrieval use cases 2 Central research question How to provide an unied access to distributed and heterogeneous environments? How can query semantic be maintained during metadata and query language transformation? Can query classication and backend benchmarking establish an ecient / intelligent data fusion process? 3 Conclusion Presenter: Florian Stegmaier, University of Passau ACMMM10 Interoperable and Unied Multimedia Retrieval
  • 3. Motivation Multimedia retrieval in todays world Research topics Distributed and heterogeneous retrieval use cases Conclusion Multimedia retrieval in todays world Multimedia data can be produced, published and consumed by everybody everywhere at any time Petabytes of multimedia data and metadata stored and oered in popular systems Central research topics i am facing in my PhD thesis Unied multimedia retrieval, metadata interoperability, query expansion and data fusion Presenter: Florian Stegmaier, University of Passau ACMMM10 Interoperable and Unied Multimedia Retrieval
  • 4. Motivation Multimedia retrieval in todays world Research topics Distributed and heterogeneous retrieval use cases Conclusion Use cases for distributed and heterogeneous retrieval Local query processing Distributed query processing Medical examination system query query query Image RDF triple Retrieval DICOM store(diseases System (patient data) and anatomy) (CT Scans) Find images which are similar to Select CT scan, where disease is aGivenImage.jpg and lesion, anatomy near liver annotated with vacation and and the CT scan is similar to taken at Lake Garda! aGivenCTScan.jpg! Presenter: Florian Stegmaier, University of Passau ACMMM10 Interoperable and Unied Multimedia Retrieval
  • 5. Motivation Unied access to distributed environments Research topics Metadata interoperability and query transformation Conclusion Ecient / intelligent data fusion process Unied access to distributed, heterogeneous environments Two fundamental decisions: supported query language: MPEG Query Format (query language & management capabilities), JPSearch compliant for still images architecture: external metasearch engine Presenter: Florian Stegmaier, University of Passau ACMMM10 Interoperable and Unied Multimedia Retrieval
  • 6. Motivation Unied access to distributed environments Research topics Metadata interoperability and query transformation Conclusion Ecient / intelligent data fusion process Syntactic metadata transformation JPSearch transformation rules1 : XML based JPSearch Core Schema as pivot metadata schema registration, identication and management of metadata schemas and transformation rules 1 Presented at SAC2010 (Track ASIIS). Presenter: Florian Stegmaier, University of Passau ACMMM10 Interoperable and Unied Multimedia Retrieval
  • 7. Motivation Unied access to distributed environments Research topics Metadata interoperability and query transformation Conclusion Ecient / intelligent data fusion process Semantic and syntactical metadata transformation W3C Ontology and API for Media Ressource 2 : Ontology based Media Ontology as pivot metadata schema syntactic mappings by the use of rules, semantic mapping expressed by e.g. SKOS 2 Reference implementation will be presented as Demo at SAMT2011 online at: http://mawg.joanneum.at/ Presenter: Florian Stegmaier, University of Passau ACMMM10 Interoperable and Unied Multimedia Retrieval
  • 8. Motivation Unied access to distributed environments Research topics Metadata interoperability and query transformation Conclusion Ecient / intelligent data fusion process Query reformulation and expansion Issue during metadata transformation: maintain query semantic Dynamic query expansion Google-like search inserting new data sources while query execution (e.g., extracting metadata of a Query-By-Example and forward this to a metadata based retrieval service or use of the linked data cloud) Presenter: Florian Stegmaier, University of Passau ACMMM10 Interoperable and Unied Multimedia Retrieval
  • 9. Motivation Unied access to distributed environments Research topics Metadata interoperability and query transformation Conclusion Ecient / intelligent data fusion process Knowledge based data fusion process Knowledge based on: Benchmarking content based multimedia retrieval Classication of MPEG query format requests estimating retrieval quality of connected data sources to choose appropriate algrithms3 3 Presented at AMR2010. Presenter: Florian Stegmaier, University of Passau ACMMM10 Interoperable and Unied Multimedia Retrieval
  • 10. Motivation State of research Research topics Discussion Conclusion State of research Presenter: Florian Stegmaier, University of Passau ACMMM10 Interoperable and Unied Multimedia Retrieval
  • 11. Motivation State of research Research topics Discussion Conclusion Discussion Thank you for your attention . . . . . . any questions? Contact informations: Email: florian.stegmaier@uni-passau.de Twitter: http://www.twitter.com/fstegmai Presenter: Florian Stegmaier, University of Passau ACMMM10 Interoperable and Unied Multimedia Retrieval