Alexis Clay – Sino-French Seminar on Graphics and Image 1/45 Sino-French Seminar on Graphics and Image

Alexis Clay – Sino-French Seminar on Graphics and Image 1/45

Sino-French Seminar on Graphics and Image


ToC

• ESTIA:– The Engineer School– ESTIA’s role in local development

• LIPSI : ESTIA research– Research axis– The people / National andInternational collaborations– Projects

• Computer Science team– Human Machine Interaction using TUI– Emotion recognition

• Conferences

The ESTIA – The LIPSI – The Computer Science Team - Conferences


The ESTIA

CampusCampus

ESTIAEngineer school

Master degree

LIPSI &GRAPHOS

Research Centres

Research

ESTIA ENTREPRENDREYoung companies & projects incubator

Spin off creation

ESTIA-INNOVATION

Centre of technological transfer

ConsultingThe ESTIA – The LIPSI – The Computer Science Team - Conferences


The Engineer School

• Mecatronic Engineer & Project manager

• International (EI Bilbao, UT Cranfield, ESA…)

• Double degree and 3 languages


• 50 students in Master degree


ESTIA’s role in local development

• ESTIA is involved in the regional economical development

• Supported by the Chamber of Commerce and Industry

• In order to play a role: Technology-oriented young companies support; Centre of Technological Transfer.

ESTIA entreprendre, ESTIA innovation



Research in ESTIA: LIPSI

• Director: Jean-Roch Guiresse• Scientific director: P. Weil, CNRS

Director of research (member of LaBRI - Bordeaux)

• 14 Assistant Professors, 16 Ph.D students, 1 engineer.

The ESTIA – The LIPSI – The Computer Science Team – Conferences


How does LIPSI work?

• For Each project:

– A few people from LIPSI

– Collaboration with other laboratories

– Collaboration with Companies



How does LIPSI work?

Fundamental research…

… always with an industrial partnership linked to an application case.



The LIPSI

Conception engineering

Collaborative Design ProcessesProduct design

Industrial Task oriented Interaction

Robotics, electronics, microtechnologies

Electrical Engineering, Renewable Energies


A pluridisciplinar Laboratory


LIPSI: The scientific Network


CLIPSGrenoble

CLIPSGrenoble

NTHU(Taiwan)

NTHU(Taiwan)

Univ. Le HavreUniv. Le Havre

Univ. Mondragon (Spain)

Univ. Mondragon (Spain)

L2EPCentrale Lille

L2EPCentrale Lille

GILCOGrenoble

GILCOGrenoble

ERPI-ENSGSINancy

ERPI-ENSGSINancy LAPS

Bordeaux 1

LAPSBordeaux 1

TIMAGrenoble

TIMAGrenoble

IXL BordeauxIXL Bordeaux

Military School Bruxelles (Belgium)

Military School Bruxelles (Belgium)

ENSAM Eng. SchoolParis

ENSAM Eng. SchoolParis

Centrale IRCCyNNantes

Centrale IRCCyNNantes

Tec. De Monterey,Ciateq (Mexico)

Tec. De Monterey,Ciateq (Mexico)

LIUPPA PauLIUPPA Pau

LaBRI BordeauxLaBRI Bordeaux

LIPSI


Interactive Conception – Reversed integrated

conception• Cut down the product conception cycle• Automation of technical choices in an engineering

and design department


Characterization – classification – reduction of a space of solutions


Numerical Engineering – Meshless methods

• Build meshless approximation functions that allow the reproduction of C0 functions

• Plane structure calculus• Energy network calculus

Interdisciplinary laboratory gives unexpected applications:

Use of those methods (designed for mechanics) by a Computer scientist to create discontinuities.



Robotics and Embedded Systems

Micro Unmanned Aerial Vehicle

Virtual reality simulator– Control law testing- System behaviour analysis- Virtual Image processing- Real-time acquisition of

theUAV’s absolute position



Intelligent sensors, image processing and

microelectronics

Minicameras, miniaturisation of acquisition circuits and electronic controls (on drones and robots)



Organisational Transform – Cooperative project

conduction

• Product Data Management• Product Life Cycle Management• Collaborative conception• Customer support



Renewable Energies

• EneR-GEA: Renewable Energies – Electrical Engineering and Automatics

• Study of the impact of clean energy systems on an isolated network



The Computer Science Team

IFP (French Petrol

Institute)

University ofPau

LaTEP

ENSAMTrèfle

Bordeaux

AlgoTechUniversity ofBordeaux 1

IXL

Compagnie des Signaux

Ballets de Biarritz (Dance)

University Joseph Fourier

GrenobleCLIPS-IMAG

National Tsing Hua University

IBRLabTaiwan

University of Bordeaux 1

LaBRI

LIPSI

CS Team Collaboration



Simulators

• Garbage Incinerating Factory Simulator

• Fishing and Sailing training Simulator


Human-Machine Interaction for Computer Graphics

Human Machine Interfaces (HMI): – Extend interfaces possibilities– Reduce the cognitive process due to the

interface to manipulate an application

Interface

Physical Software

Functionnalities of the

Application




TUI: Tangible User InterfacePhysical object designed to reduce the interaction

metaphorFor a given task, in a given environment, a specific

TUI must be designed, tested, evaluated.

Interface

Functionnalities

Interface

Functionnalities

Keyboard and Mouse TUI




I/O brush: Tangible Media Lab, MIT, 2003.




HMI for Computer Graphics – Manipulation of visual data

• Complex data (heavy computing) (CAD models, Geological models)

• Large displays• Mobile devices (Tactile

Augmentation)

– Augmented Reality• Capture of real world (body

movement)• Projection of images in inadapted

environment (augmentation of a stage)

(Only Interaction)



Manipulation of 3D CAD models

Tangible User Interface

“The hand” in Euskara

Expérimentation d'un Système Kinésique Utilisable pour l'Assemblage

Tangible User Interface








• Task: Assembly in CAD• Problem: GUI hide difficulties to designers relative positioning of two parts accessibility

• Solution: Use props instead of mouse and keyboard to manipulate CAD parts




• Specific Tools: context-dependent, task-dependent

• 3D model control– Working environnement– desk/table setting– single/collaborative work– Non-intrusive

Passive TUIs captured by camera




ESKUA: results

Interactors for mechanical CAD parts

Plateform for manipulation, acquisition and tracking of

interactors.






• ESKUA: evaluating the interactors

• Result: functional surfaces

New set of interactors

[ESKUA video]


Manipulation of 3D geological models

GeoTUI

• Task: Validate a model of subsoil• Problem: Complex task because

– Needs geophysicians and geologists collaboration– Pure mental representation

• Tested Solutions by French Petrol Institute (IFP) for first problem :– GUI: inadapted– Immersive Room: too big, expensive, planning problems



• A complex geoscience task– Understand a subsoil you have never seen

• From perpendicular and parallel cuts

From a mapof the place



Extracted cutCut after study



tableComputer

Video-projector Video-camera



Tactile Augmentation of a Mobile Device

TactiMoD

Task: Guide a visitor in a museum tour.Problem: Map requires attention and diverts visitors

from the exhibitionA solution: use of tactile vibration on a mobile

device

• Mobile device: small• As little cognitively demanding as possible• Must not « blind » the user from its environment• User should not have to focus on the device• Must be intuitive: no instructions needed




Hypothesis: “it is possible to lead and to guide someone towards a point of interest by using vibrations coming from a mobile device”

Mobile device augmented by left and right vibration systems; basketball-like grip stripe.



Evaluation of the system:

• guiding people over 2 different paths

• Survey and interview

Hypothesis validated through testing« TactiMod: Dirige et oriente un pieton » 2006. Nadine Couture, Stephanie Minel,

Ubimob’06, September 5-8, Conservatoire National des Arts et Metiers, Paris.

Escalier

Escalier

Terminé

Escalier

Escalier

Terminé

Pathway used for testing

.

Subjects MoyE-

type

Correct Orientation over 13 10.7 1.4

Long Hesitation 2.7 1.4

Short Hesitation 3.3 0.8

Subject re-orientation by tester 2.3 1.3



Ubiquitous Computing

Ubiquitous computing: « Computers » everywhere in the whole environment. Embedded systems.

Communication between all the devices

Wearable Computing

(shoes, fabric, glasses)

Mobile Computing

(Cell phones, PDA)

Personal Computer (laptops, PC)

Ubiquitous Computing (onboard systems: cars, planes, domestic appliance, walls…)



Ubiquitous Computing

TUIs: usable in ubiquitous computing Interest in the crossroad between HMI and ubiquitous

computing

« Emotional computers » (Picard, 95)

HMI Ubiquitous Computing

TUIs Emotion recognition and Synthesis



Emotion Recognition through Gesture Analysis

emotion

• Task: Augmenting a dance show experience by analysing the dancer’s emotion and adding virtual elements onto the stage

• Problem: Recognizing a user’s (dancer’s) emotion

• Solution: Study emotion using user’s (dancer’s) body position and movement




• The emotion Project: use position and gesture to determine a user’s emotion (Dance).


Etc

…E

tc…

Etc

…E

tc…

Col

labo

rativ

e m

eetin

g co

ntex

tC

olla

bora

tive

mee

ting

cont

ext

Col

labo

rativ

e m

eetin

g co

ntex

tC

olla

bora

tive

mee

ting

cont

ext

pilo

t str

ess

(IT

EC

HS

-

pôle

aér

osp

ace)

pilo

t str

ess

(IT

EC

HS

-

pôle

aér

osp

ace)

pilo

t str

ess

(IT

EC

HS

-

pôle

aér

osp

ace)

pilo

t str

ess

(IT

EC

HS

-

pôle

aér

osp

ace)

Sha

dow

Dan

ceS

hado

wD

ance

Sha

dow

Dan

ceS

hado

wD

ance

emotion


System reactivity

Emotion wise Reactivity

Goal : We consider a system S to which we will add an emotional ability through an emotion system. This will act as a bridge between the user and the system S. The emotional system must:

•Manage to recognize a general emotion through the gesture and body position of the user

•Translate this emotion in order to generate a context wise reaction of the system

Recognition

(sadness)

(joy)





• Application: Augment a dance show– Changing auras according to the emotion expressed by

the dancer

– Large displays on stage– Stereoscopy to make virtual objects/persons appear to the public

– Ballet “The Shadow”– NTHU (Taiwan) Collaboration



Conferences: Virtual Concept

• International meeting on Interactive Design and Manufacturing Methodologies, Tools and Processes

• This year: Meeting in Cancun, Mexico, from November 26th to December 1st

http://www.virtualconcept.estia.fr/2006/



Conferences: ErgoIA

• Ergonomics, human engineering, Artificial Intelligence and HMI

• From October 10th to october 13th in Biarritz, Basque Country, France.

http://www.ergoia.estia.fr/



Conclusion

• Scientific collaboration on projects: Share the knowledge and know-how on projects that require several skills, joint Ph.D supervision, exchange students

• Coupling Computer graphics and HMI (Tangible Interfaces): navigation using large displays, interaction with 3D objects, images…


Questions?


Thank You!

http://www.virtualconcept.estia.fr/2006/

http://www.ergoia.estia.fr/

Documents

Alexis Clay – Sino-French Seminar on Graphics and Image 1/45 Sino-French Seminar on Graphics and Image