MeMoML Master project MeMoML for the MeModules project 23.12.2005 Seminar: tangible user interfaces University of Fribourg David Bächler [email protected]

MeMoML

Master project MeMoML

for the MeModules project

23.12.2005

Seminar: tangible user interfacesUniversity of Fribourg

David Bächler

[email protected]

23.12.2005 MeMoML: [email protected] 2

Content

MeModules project Description Goals

State of the art Markup languages for TUIs

MeMoML project MeMoML MeMoEngine MeMoML-GUI Schema


MeModules project

MeModules tangible links between the human memory

and reachable information

Collaboration EIA (www.eif.ch) - UniFr Co-financed by the Hasler foundation

2 + 1 years from January 1st on


Lost in the “InfoSpace” effect: Information overload in our daily life


Lost in the “InfoSpace” effect: Information overload in our daily life


MeModules project

Designing and implementing a system for creating and managing tangible shortcuts to multimedia information

Change the traditional way of communication with computers GUI TUI

associativememory

physicalreminder

realassociation


MeModules project

Two main goals Easy interaction with devices in the everyday life Information categorization in order to improve

information access and retrieval

Secondary goal Collaboration of academic university (UniFr) and

university of applied sciences (EIA)


State of the art of TUI MLs

Markup languages for tangible user interfaces

Why MLs? Heterogeneous environment

All devices must be formally described Multitude of particular accesses to devices

Standardized access to devices



Not a lot of existing work in the field of meta- or markup-languages for tangible user interfaces

Very new area



TUIML high-level description language for TUIs Small part of the TUIMS project

TUIMS Laying the Foundations for a Tangible User

Interface Management System http://www.eecs.tufts.edu/~oshaer/TUIMS.pdf http://www.cs.tufts.edu/tech_reports/reports/2005-

2/report.pdf (2004-2005 ongoing work)



UserML User Modeling Markup Language (UserML)

for Ubiquitous Computing Based on XML A User Model Editor transforms UserML

into XForms with XSLT http://www.dfki.de/~krueger/PDF/UM2003.

pdf (published 2003)


UserML Example

partial user model which uses categories from the ontology ”UserOL”

<UserModel><UserData id="231">

<category>userproperty.timepressure</category><range>low-medium-high</range><value>high</value><ontology>"http://www.u2m.org/UserOL/"</ontology>

</UserData>

<UserData id="224">...

</UserData</UserModel>



MRIML Mixed Reality Interface Markup Language Interface markup language for defining cross-

platform user interfaces Contained in the VR and AR framework

A Framework for Realizing Multi-ModalVR and AR User Interfaces Frauenhofer Institut http://www.fit.fraunhofer.de/gebiete/mixed-reality/pu

blications/broll05.pdf (published 2005)


MRIML Example

Description of a button

<part class=”Button” id=”numericalValues”><style>

<property name=”type”>pushButton</property><property name=”position”>0.0 0.0 0.0</property><property name=”orientation”>0.0 0.0 0.0</property><property name=”isVisible”>false</property>

</style>

<part class=”FocusListener” id=”numericalValuesFocusListener”>…

</part></part>



PML Physical Markup Language

« for communicating a description of physical environments and the objects within them, their relationships to you, each other and the space »

Philips http://www.research.philips.com/technologies/syst

_softw/pml/downloads/pml.pdf

http://www.research.philips.com/technologies/syst_softw/pml/



TouchMe Diploma project of Andy Gonzalez at EIA (2005) Communication with RFID tags

Causes actions at computer (e.g. Open browser, show photos, play music)

Started work towards categorization of objects and actions

But the main goal was to have a running application

MeMoML will continue the categrozation and formalization


MeMoML

MeModules Markup Language

Every tangible link described via a predefined scenario physical objects communication processes targeted actions

flexible, device-independent and easy-to-use language for describing scenarios


MeMoML

Objects Source with Attributes (simple, complex) Target with Attributes (simple, complex)

Communications Cable, Wireless

Actions Send, Read, Play


MeMoML

Example

<OBJECT A = Seashell, …..> <COMMUNICATION = MonoTag reader> <ACTION = Play> <OBJECT B = CD>


MeMoEngine

identify objects ensure communication processes execute actions, described in the

scenario (with MeMoML)


MeMoEngine

Physical level PC with several devices attached

Configuration file for all devices formal description of the device location information (path) communication capabilities

CD player, beamer, video player, …


MeMoEngine

Example

<DEVICE = CDPlayer PATH= /Path/… COMMUNICATION= WiFi>

<DEVICE = Beamer PATH = /Path/… COMMUNICATION= wire>


MeMoEngine

Functioning of the MeMoEngine1. Configuration

2. Use of MeMoML

3. Create scenario

+ + = slideshow

holiday musicpictures


MeMoML-GUI

facilitate the interaction with the MeMoML language The MeMoML code is created “behind the

scene”

Result: the person receives the pictures of the slideshow

send Business cardSeashell + Pictures


Schema


Schema






Further information

Omar Abou Khaled (Supervisor EIA) [email protected]

Elena Mugellini (Assistant EIA) [email protected]

Denis Lalanne (Unifr) [email protected]

Questions?

Website:

MeModules homepage (coming soon)

Documents

MeMoML Master project MeMoML for the MeModules project 23.12.2005 Seminar: tangible user interfaces University of Fribourg David Bächler [email protected]