Exploring the semantics of caress

results

current work

Timothy Chen, Dr. Sidney Fels, Thecla SchiphorstTimothy Chen, Dr. Sidney Fels, Thecla Schiphorsttichen@ece.ubc.ca ssfels@ece.ubc.ca schiphorst@techbc.ca

goal

New Media Innovation Centre

http://www.newmic.com

University of British Columbia

Electrical & Computer Engineering

motivation• To develop an To develop an

interaction framework interaction framework based on whole-hand based on whole-hand interaction with surfacesinteraction with surfaces

• Users find system intuitive to controlUsers find system intuitive to control

• Whole-hand interaction very suited for taskWhole-hand interaction very suited for task

• Physical surface facilitates repeatable actions Physical surface facilitates repeatable actions (spatial location)(spatial location)

• Coarse obstruction representation not a big issueCoarse obstruction representation not a big issue

contributions• Demonstrates an application of whole-hand Demonstrates an application of whole-hand

interaction with a surfaceinteraction with a surface

• Touch-interactive system using multiple-point inputTouch-interactive system using multiple-point input

• Investigation of semantics of gestural inputInvestigation of semantics of gestural input

• Interactive art piece in virtual reality settingInteractive art piece in virtual reality setting

• New interface for musical expressionNew interface for musical expression

• Linux driver for MTC ExpressLinux driver for MTC Express

• Interpolation of raw data (5)Interpolation of raw data (5)

• Curve fitting to delineate contact area on touchpadCurve fitting to delineate contact area on touchpad

• Finger motion tracking (moving obstacles)Finger motion tracking (moving obstacles)

future work• Study real-world tasks that involve whole-hand Study real-world tasks that involve whole-hand

interactioninteraction

• Develop useful application conceptsDevelop useful application concepts

• Provide a formalization of whole-hand input for Provide a formalization of whole-hand input for interactive systemsinteractive systems

mtc express• Tactex Controls, Inc.Tactex Controls, Inc.

• Multiple-point sensing Multiple-point sensing (72)(72)

• Pressure-sensitivePressure-sensitive

• Up to 200Hz sampling Up to 200Hz sampling rate (compressed data)rate (compressed data)

Technical University of British Columbia

Interactive Arts

system• Dynamic particle fieldDynamic particle field

• Metaphor: hands in Metaphor: hands in running streamrunning stream

• Deployed in CAVE—Deployed in CAVE—cylindrical flow field cylindrical flow field envelops user (1)envelops user (1)

• Input from MTC Express Input from MTC Express (2) controls shape and (2) controls shape and size of obstructions (3)size of obstructions (3)

• Obstructions disrupt Obstructions disrupt particle flow (4)particle flow (4)

• Music feedbackMusic feedback

• The sense of touch, like The sense of touch, like sight and hearing, can sight and hearing, can convey a tremendous convey a tremendous amount of informationamount of information

• There are many There are many techniques to deliver and techniques to deliver and record audio and record audio and imagery, but not much imagery, but not much for touchfor touch

Human Communication Technologies Lab

http://hct.ece.ubc.ca