Mobile Access to MPEG-7 Based Multimedia Services

Lehrstuhl Informatik 5(Informationssysteme)

Prof. Dr. M. JarkeI5-CJK*-0509-1

MDM 2009

Yiwei CaoMatthias JarkeRalf Klamma

Oscar MendozaSatish Srirama

Mobile Access to MPEG-7 Based Multimedia Services

Yiwei Cao 曹怡蔚, Matthias Jarke, Ralf Klamma, Oscar Mendoza, and Satish Srirama

Informatik 5 (Information Systems), RWTH Aachen University

May 19, 2009Taipei, Taiwan

International Conference on Mobile Data Management (MDM ‘09)



MDM 2009



Agenda Introduction

– The German Excellence Research Cluster UMIC– Requirements from the LAS multimedia services– Research questions

Methodologies and technologies Mobile access to multimedia services

– Mobile access with mobile web servers and via ESB– Implementation on iPhones and smartphones– Evaluation by service monitoring on MobSOS

Conclusions and outlook



MDM 2009



Introduction to UMIC Ultra High-Speed Mobile Information and Communication

– A research cluster established at RWTH Aachen University under the excellence initiative of the German Government, 2006-2011 with an average funding of 6.5 million Euro per year

– Concepts and demonstrators for smart, mobile, broadband, low-cost systems

– Interdisciplinary design with four researchareas among over 20 research groups

Mobile Application & Services– Demanding applications of the

next-generation mobile Internet – Quality of mobile services

Virtual Campfire – mobile social software



MDM 2009



Affordable communication technologies

SoftwareArchitecture

Requirements for UMIC in Scenario Virtual Campfire

A load balancing distribution of multimedia services to enhance quality of service

Better access to multimedia services on the mobile client side for scalability

Mobile service sharing among different mobile device holders

Virtual Campfire

Mesh networks, WiMax, etc.

Web services

Mobile web services

Mobile social software

LAS ??

MobSOS

...



MDM 2009



The LAS Server

Lightweight Application Server(Spaniol et al., 2006)

The community engine MPEG-7 based multimedia services Web Services orchestration Easy configuration and rapid prototyping

Mobile access?Distributed?



MDM 2009



Research Questions How can performance of mobile multimedia applications

be enhanced?– Reduction of large data volumes– Reduction of high cost of wireless data communication– Dealing with overload of rich semantic information– Data interoperability among different mobile platforms

Does mobile middleware provide good solutions?– What kind of mobile middleware solutions exist on those

handheld devices with limited resource capacity? – Is additional data communication overhead resulted

by middleware?– What about the portability and scalability of mobile access

on various mobile platforms?



MDM 2009



Methodologies and Technologies Service Oriented Architecture

(Burberk, 2000; Hasan and Duran, 2006)– Web Services – Cloud Computing (Chappell, 2008)

Mobile Web Services (Srirama et al., 2006)– Mobile devices are Web Service

consumers and providers– Standards based, e.g. SOAP, XML,

WSDL, HTTP– Use of kSOAP and kXML

Enterprise Integration (Keen et al., 2004)– Enterprise Service Bus (ESB)



MDM 2009



MPEG-7 Based Multimedia Services MPEG-7 Multimedia Content Description Interface (Martinez et al., 2002)

Multimedia annotation services (Spaniol et al., 2006)– Automatic extraction of technical and context-aware information– Multiple tagging methods: free text, image, semantic based, commsonomy

Multimedia search services (Cao et al., 2008)– Semantic search– Keyword search– Context-aware search etc.

Multimedia sharing services (Klamma et al., 08)– Storytelling service– Image services etc.

The basic multimedia MPEG-7 services (Klamma et al., 2006)– Creation and modification of MPEG-7 metadata– XML binding

MPEG-7 services

LAS servicesMultimedia

sharingservices

Multimediaannotationservices

Multimediasearch

services

LAS core services



MDM 2009



Alternative System Architecture

LAS access with Mobile Web Services

LAS access via Enterprise ServiceBus (ESB)



MDM 2009



Implementation Mobile middleware

– Mobile Web Services on the Mobile Host

– OpenESB The prototype on the client side

– Mobile access to LAS– Nokia N95: J2ME CLDC – iPhone: Objective C

– Mobile multimedia annotation: free text tagging and MPEG-7 standard based semantic tagging

– Mobile multimedia search and retrieval



MDM 2009



Evaluation via MobSOS MobSOS is a test bed for multimedia community services

(Renzel et al., 2008) Theoretically conceptualized on the D&M IS Success Model

(Delone and McLean, 1992) Easy in use via the MobSOS HTTP connector Each LAS service call is monitored and stored in the

monitoring data repository The survey data repository to enhance system and

information quality via users’ satisfaction measure Data analysis with SPSS



MDM 2009



Evaluation Results Multimedia files are retrieved on search request on mobile devices MPEG-7 based multimedia services are monitored by MobSOS



MDM 2009



Conclusions Design and implementation of alternative architecture

Interoperability and scalability are crucial for mobile multimedia services across various mobile platforms

Load balancing can reduce wireless data communication cost and improve mobile multimedia service quality

Quality of services can be traced by service monitoring

Factors Mobile Web Services ESB as middlewarePerformance Response time is proportional to multi-

media file size and increases exponentiallyResponse time increases linearly at a low rate

Scalability Not scalable, only one LAS server is connected

Scalable, distributed access to LAS services

Developmentcost

Details must be known by clients WSDL is used to publish and find Web services on the ESB

Reliability Long response time by Web Services overload

Short response time



MDM 2009



Outlook A complete mobile multimedia service chain for

mobile multimedia management Interoperable mobile multimedia management Further enhancement of multimedia service

quality with MobSOS monitoring Multimedia services sharing

via the XMPP protocol Context-aware and semantic

mobile multimedia services Mobile services as nodes in the

vision of Cloud Computing

Multimedia creation with 3D scanners

Multimedia services

monitoring

Multimedia sharing by

storytelling etc.

MPEG-7 based multimedia annotation

Multimedia search and adaptation



MDM 2009



Questions? http://www.umic.rwth-aachen.de

The 8th International Conference on Web-based Learning (ICWL‘09), August 19-21, 2009, Aachen, Germany– Call for participation– Call for papers to Workshops

http://www.umic.rwth-aachen.de/�

Technology

Mobile Access to MPEG-7 Based Multimedia Services