17
Semantics Visualizations on Mobile Devices Wolfgang Jochum [email protected] Spectralmind OG Phorusgasse 8/9 1040 Vienna, Austria www.spectralmind.com 22. März 2011 2. Potsdamer I-Science Tag

Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation

  • Upload
    others

  • View
    11

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation

Semantics Visualizations on Mobile Devices Wolfgang Jochum

[email protected]

Spectralmind OG Phorusgasse 8/9 1040 Vienna, Austria

www.spectralmind.com 22. März 2011

2. Potsdamer I­Science Tag

Page 2: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation

Finding music?

10 Mill. titles – overview?

– finding desired music quickly?

– finding new music? – usability?

Page 3: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation

Our Vision

making the wealth of music

accessible by everyone

Page 4: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation

Spectralmind

•  TU Vienna spin-off, founded 2008

•  backed by ~10 years of research

•  intelligent semantic audio solutions

•  audio analysis & indexing technology

Page 5: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation

Spectralmind

•  independent high-technology company

•  supported by inits, AWS preseed, FFG

•  located in Vienna, Austria

•  research link with TU Vienna

Page 6: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation

Spectralmind Team

Johann Waldherr Bizdev & Sales – [email protected]

Thomas Lidy Managing Director – [email protected]

Wolfgang Jochum Head of Technology – [email protected]

Ewald Peiszer Head of R&D– [email protected]

Page 7: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation

Overview genre clusters

Music Browsing by Sound Similarity

Visual Music Discovery Product

Detail view titles with cover art

www.sonarflow.com

Page 8: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation

Underlying Technology

Audio Search Engine

Automatic Labeling

Spectralmind Products

Music Recommendation

Audio files Semantic

Audio analysis

Audio Feature Extraction

Page 9: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation

•  basic approach

•  sonarflow @ mobile

•  predefined & simple placement

iPhone Launch

late March!

Mobile Visual Music Discovery sonarflow mobile – „music at your fingertips“

www.sonarflow.com

Page 10: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation

About the Project

• media management and retrieval through mobile devices considering usability and visualization

•  started August 2010

•  3 national partners

•  funded by the FFG COIN program

Page 11: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation

Overview

Page 12: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation

•  multimedia mgmt.

•  semantic search on text, audio, video

•  social annotation

•  crowd sourcing

•  semantic audio analysis

•  search & annotation

•  recommendation

•  media visualization

•  interactive interfaces

•  mobile app

•  mobile development

•  multi-platform solutions

Partners

Page 13: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation

Goals

Advanced and integrated multimedia search over interlinked networks of information by applying semantic technology.

Page 14: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation

Goals

Novel visualization methods for usable and comprehensive search on multimedia.

Page 15: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation

Goals

Flexible development framework for mobile application development and the provision of semantic multimedia search and visualization through mobile devices.

Page 16: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation

Keep in Touch

•  [email protected]

•  http://mouviz.playence.com/

Page 17: Semantics Visualizations on Mobile Devices · • semantic search on text, audio, video • social annotation • crowd sourcing • semantic audio analysis • search & annotation

www.spectralmind.com

Thank you!