Upload
others
View
2
Download
0
Embed Size (px)
Citation preview
© M. Rauterberg, TU/e 2016 1/31
Serious Games for Health
- lessons learned -
Matthias RAUTERBERG
Department of Industrial Design
Eindhoven University of Technology
The Netherlands
Eindhoven University of Technology
© M. Rauterberg, TU/e 2016 2/31 Eindhoven University of Technology
Full Professors of the DI Group
Loe FEIJS, full professor, full time
Bachelor & Master in Electrical Engineering
PhD in Computer Science/Mathematics
Sidarto BAMBANG-OETOMO, full professor, part time
Bachelor & Master in Medicine
PhD in Medicine, specialist in Neonatology
Matthias RAUTERBERG, full professor, full time
Bachelor in Philosophy
Bachelor & Master in Psychology
Bachelor & Master in Computer Science
PhD in Computer Science/Mathematics
© M. Rauterberg, TU/e 2016 3/31 Eindhoven University of Technology
Rene AHN
Master in Physics
PhD in Computer Science
[until 2014]
Assistant & Associate Professors of the DI Group
Christoph BARTNECK
Master in Technological Design
PhD in Industrial Design
[until 2010]
Emilia BARAKOVA
Master in Electronics and Automation
PhD in Mathematics and Physics
Wei CHEN
Master in Electronics
PhD in Electrical Engineering
[until 2015]
Frank DELBRESSINE
Master in Mechanical Engineering
PhD in Mechanical Engineering
Jun HU
Master in Computer Science
PhD in Computer Science
Erik van der SPEK
Bachelor in Psychology
PhD in Computer Science
Mathias FUNK
Master in Computer Science
PhD in Electrical Engineering
© M. Rauterberg, TU/e 2016 4/31 Eindhoven University of Technology
Rauterberg M. (2006). HCI as an engineering discipline: to be or not to be!?. African Journal of Information and Communication Technology,
vol. 2, no. 4, pp. 163-184.
© M. Rauterberg, TU/e 2016 5/31 Eindhoven University of Technology
Hao LIU (PhD)
Chee Fai TAN (PhD)
© M. Rauterberg, TU/e 2016 6/31 Eindhoven University of Technology
How to get economy class passengers moved?
Westelaken R. van de, Hu J., Liu H., Rauterberg M. (2011). Embedding gesture recognition into airplane seats for in-flight entertainment.
Journal of Ambient Intelligence and Humanized Computing, vol. 2, no. 2, pp. 103-112
© M. Rauterberg, TU/e 2016 7/31 Eindhoven University of Technology
Heart rate as an indicator of the stress level
Liu H., Hu J., Rauterberg M. (2015). Follow your heart: Heart rate controlled music recommendation for low stress air travel.
Interaction Studies, vol. 16, no. 2, pp. 303-339
© M. Rauterberg, TU/e 2016 8/31 Eindhoven University of Technology
Adaptive music system for stress free air travel
© M. Rauterberg, TU/e 2016 9/31 Eindhoven University of Technology
Architecture of our Inflight-Entertainment (IFE) system
© M. Rauterberg, TU/e 2016 10/31 Eindhoven University of Technology
Test bed for simulating a long haul flight to Shanghai (KLM)
Tan CF., Chen W., Rauterberg M. (2009). Design of aircraft cabin test bed for stress free air travel experiment. In: Proceedings of 5th International
Conference on Planning and Design - ICPD (pp. 157-167), Tainan City, Taiwan.
© M. Rauterberg, TU/e 2016 11/31 Eindhoven University of Technology
Liu H., Salem B., Rauterberg M. (2009). A survey on user profile modeling for personalized service delivery systems. In: Proceeding of IADIS
International Conference on Interfaces and Human Computer Interaction 2009 (pp.45-51), Lisbon: IADIS Press.
Liu H., Hu J., Rauterberg M. (2010). LsM: A new location and emotion aware web-based interactive music system. In: IEEE International Conference
on Consumer Electronics - ICCE 2010 (Digest of Technical Papers; pp.253-254), Piscataway: IEEE.
Liu H., Hu J., Rauterberg M. (2010). iHeartrate: A heart rate controlled in-flight music recommendation system. In: E. Barakova, B. de Ruyter, and A.
Spink (eds.) Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research - MB 2010. (Article 26 , 4 pages,
online), New York: ACM.
© M. Rauterberg, TU/e 2016 12/31 Eindhoven University of Technology
© M. Rauterberg, TU/e 2016 13/31 Eindhoven University of Technology
© M. Rauterberg, TU/e 2016 14/31 Eindhoven University of Technology
Examples of the bio-signal heart rate reactions
© M. Rauterberg, TU/e 2016 15/31 Eindhoven University of Technology
Results of the bio-signal heart rate are significant in the
hypothesized direction
© M. Rauterberg, TU/e 2016 16/31 Eindhoven University of Technology
Expertise Center for Epileptology, Sleep Medicine and Neurocognition
TIMO:
a diagnostic game
for ADHD Pongpanote GONGSOOK (PhD)
© M. Rauterberg, TU/e 2016 17/31 Eindhoven University of Technology
Sallustro C. (2013). Timo & Friends: A diagnostic tool on the time perception of children with ADHD. USI Final Report No 978-90-444-1220-8,
Department of Industrial Design, Eindhoven University of Technology (32 pages).
© M. Rauterberg, TU/e 2016 18/31 Eindhoven University of Technology
Gongsook P., Peijnenborgh J., Sallustro C., Van der Spek E., Hu J., Bellotti F., Rauterberg M., Hendriksen J. (2014). A diagnostic tool on time perception of children
with ADHD. In: A. De Gloria (ed.), Games and Learning Alliance (Lecture Notes in Computer Science, vol. 8605, pp. 400–405), Berlin Heidelberg: Springer.
© M. Rauterberg, TU/e 2016 19/31 Eindhoven University of Technology
Mini game 1:
Dressing up
GOAL: Executive function.
REASON: Executive functions,
which include planning and
organization, are deficient in
children with ADHD.
Mini game 2:
Making sandwiches
GOAL: Remember set of items.
REASON: The working memory
in children with ADHD is
remarkably low.
© M. Rauterberg, TU/e 2016 20/31 Eindhoven University of Technology
Mini game 3:
Cross a river with a balloon
GOAL: The child has to estimate how
long 10 seconds last.
REASON: Temporal durations are
deficient in children with ADHD.
Mini game 4:
Defeat a naughty monkey
GOAL: Response inhibition.
REASON: Withhold response with
Go/No-Go signals.
© M. Rauterberg, TU/e 2016 21/31 Eindhoven University of Technology
Mini game 5:
Catch stars in the magic land
GOAL: Motor reaction after warned
signals.
REASON: Slower and more
variable reaction times have been
found for ADHD children.
Mini game 6:
Waiting for the rocket
GOAL: Waiting behavior. The
influence of high rewards valued
for delaying decisions.
REASON: Based on the
hypothesis that attention deficits
are related to an ineffectiveness
of delayed reinforcement.
© M. Rauterberg, TU/e 2016 22/31 Eindhoven University of Technology
30 minutes
User Interaction Logging
Mini game 1 Transition Mini game 2 Transition Mini game 6
Main Title
Data
Configuration
Main
Ending
Introduction / Demonstration
Game Plays
Ending / Wrapping up
Idle Checker
End-of-time Checker
4 minutes (240 seconds)
Game structure and interaction flow
© M. Rauterberg, TU/e 2016 23/31 Eindhoven University of Technology
startstart
Game Updates
(fps)
Game started
Write to AllTouches
endendGame ends
User intervention Game relateWrite to
Game Play
Write to Specific Objects
Distractors relate(touched)
Game Events logging
Non-User interventionGame relate
Distractors relate(played)
Data logging structure
© M. Rauterberg, TU/e 2016 24/31 Eindhoven University of Technology
© M. Rauterberg, TU/e 2016 25/31 Eindhoven University of Technology
ADHD
Predicted Group Membership
Total
No Yes
Count No 84 2 86
Yes 11 10 21
% No 97.7 2.3 100.0
Yes 52.4 47.6 100.0
87.9% of original grouped cases correctly classified.
97,70%
2,30%
Control
No-ADHD ADHD
52,40%
47,60%
ADHD
No-ADHD ADHD
Results of the behavior based parameters
© M. Rauterberg, TU/e 2016 26/31 Eindhoven University of Technology
General Hospital
Simulation for Team Training
Van de Ven J., Houterman S., Steinweg R. A., Scherpbier A. J., Wijers W., Mol B. W. J., & Oei S.G. (2010). Reducing errors in health care: cost-
effectiveness of multidisciplinary team training in obstetric emergencies (TOSTI study); a randomised controlled trial. BMC Pregnancy and
Childbirth, 10, 59 (online).
Fransen A., van de Ven J., Merie´n A., de Wit-Zuurendonk L., Houterman S., Mol B., Oei S.G. (2012). Effect of obstetric team training on team
performance and medical technical skills: a randomised controlled trial. BJOG An International Journal of Obstetrics and Gynaecology, vol.119, no.
11, pp. 1387–1393.
Han J., de With P.H.N., Merien A., Oei S.G. (2012). Intelligent trainee behavior assessment system for medical training employing video analysis.
Pattern Recognition Letters, vol. 33, no. 4, pp. 453-461.
© M. Rauterberg, TU/e 2016 27/31 Eindhoven University of Technology
Hu J., Peters P., Delbressine F. and Feijs L. (2010). Distributed architecture for delivery simulators. In: Proceedings of International Conference
on E-Health Networking, Digital Ecosystems and Technologies (EDT) (Shenzhen, pp. 109-112) IEEE.
© M. Rauterberg, TU/e 2016 28/31 Eindhoven University of Technology
© M. Rauterberg, TU/e 2016 29/31 Eindhoven University of Technology
Work in progress
Mark TIELEN (PhD candidat)
© M. Rauterberg, TU/e 2016 30/31 Eindhoven University of Technology
What are the lessons learned?
1. Mixed design teams with all required expertise are essential.
2. Full circle of design-prototyping-validation works.
3. The domain problem becomes the END, and the technology
a MEAN.
4. Collaboration, cooperation, communication.
5. Public attention helps to secure funding.
6. And finally: success has many fathers/mothers …
© M. Rauterberg, TU/e 2016 31/31 Eindhoven University of Technology
Thank you for your attention.
TC
14 o
n E
nte
rtain
men
t C
om
pu
tin
g