11/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

Marc Parenthoën, Jacques Tisseau,

Thierry Morineau

Autonomy and Proactive Perception for Virtual Actors

Laboratory of Software IngeneeringLi2, EA 2215 UBO/ENIB, BREST, FRANCE

Research Group in Informatics and CognitionGRESICO, UBS/IUP, VANNES, FRANCE

22/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

virus

interaction

immersion

3D-movie

flight simulator

presence

video-game

0 1

1

autonomy

1

VR : History

virtual theatre

interactive fiction

in virtuo virtual reality

33/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

Plan Autonomy by Conviction

Affordance-Based FCM

Virtual Proactive Perception

Principle of autonomy for behovioral model

Behavior specification and control

Simulation, active perception and prediction

Implementation of a Virtual Skipper

44/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

Animation

what IS the model

Simulation

what doesthe model DO

ModellingWhat BECOMES of the model

Model

sense action

language

real time interactive

on line

Exploitation of Models

55/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

model

Numerical Simulation

model

Interactive Simulation

model

Participative Simulation

avatarequal/equalslave/master master/slave

actor

spectator

cre-actor

interactive simulationaction

real time animationsense

on line modellinglanguage

interactivity

0

1

2

User Status

66/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

Deficiencies sensorial motor mental

loss of autonomy

Abilities of perception of action of decision

Autonomy of execution

Towards Intrinsic Autonomous Models

77/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

Multi-Agent Systems

perception

action

decision

Numerical model descriptive causal behavioral

88/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002 VOWELS

Agent Environment Interaction Organisation

“extended” VOWELS User

model

model

A E I O

avatar

avatar

U

Participative Multi-Agent Systems

99/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

FCMs [Kosko86]

specify control

Behavioral Modelling

closeenemy

farenemy

wish toescape

fear

+ +

-

-

+

+

AGENT FCMeffectors actions

defuzzyfication

sensors perceptions

fuzzyfication

Dec

isio

n

Dyn

amic

s

1 ;,,1for , )1(),()( tNiNitatfGS

Nita t

Tt L

model perception

1010/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

Plan Autonomy by Conviction

Affordance-Based FCM

Virtual Proactive Perception

Implementation of a Virtual Skipper

1111/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

Psychological Model of Activity

Affordances [Gibson77]

environment-tool-agent

absolute value

relative value accessibility level (perceptual/motor)

selection via FCM

sensation=Fuzzyfication(sensors)

attractive or repulsive effect

perception=Dynamics(FCM)

1212/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

Affordance-Based FCM Construction

concepts=affordances

extern activation=absolute value

selection via FCM perception=dynamics(FCM)

strategy of trajectory

virtual sensors + fuzzy rules

given by expert

associated with selected affordance

1313/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

Plan Autonomy by Conviction

Affordance-Based FCM

Virtual Proactive Perception

Implementation of a Virtual Skipper

1414/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

Active Perception [Berthoz 88]

comparisonreal/simulated

behaviormodification

sensorimotor inputs

effector command

operators on state

variables

inner maps operations

input switch

output switch

} proj

ectiv

e

}

con

serv

ativ

e

1515/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

projection

modification

simulation and adaptationsensors

effectors

FCM selectsaffordance

comparison/anticipation

sequence of postures

HF

LF

Virtual Proactive Perception

simulation in the simulation

active perception, anticipation, simulation and learning

selection

sensors

effectors

comparison/anticipation

FCM learnsaffordances

sequence of postures

HF

hebb

1616/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

Plan Autonomy by Conviction

Affordance-Based FCM

Virtual Proactive Perception

Implementation of a Virtual Skipper

1717/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

Affordance-Based FCMs Construction

ObstacleJibe-Luff

GatewayVMG

GatewayRestart

ObstacleLuff

SpecificNo Surf

SpecificSurf

LandmarkGyroscope Landmark

Trim

+1

+1 -1

-1

-1

-1 -1-1

-1

-1-1

-1 -1

-1

-1

-1

compasscrollrrollrtrimtcompasschelmboatv2

1818/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

Human and Virtual Helmsmans

compasscrollrrollrtrimtcompasschelmboatv

2

•associated to each affordance,•part of strategy

1919/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

European Center of Virtual Reality(CERV)

CERV

… Brest, september 2003

2020/20/20

{par

enth

oen

,tis

seau

}@en

ib.f

r m

orin

eau

@u

niv

-ub

s.fr

Syst

emic

s, C

yber

neti

cs a

nd I

nfor

mat

ics

Orl

ando

, Flo

rid

a, J

uly

14-1

8, 2

002

Marc Parenthoën, Jacques Tisseau,

Thierry Morineau

Autonomy and Proactive Perception for Virtual Actors

Laboratory of Software IngeneeringLi2, EA 2215 UBO/ENIB, BREST, FRANCE

Research Group in Informatics and CognitionGRESICO, UBS/IUP, VANNES, FRANCE