Spatial Manipulation

8/9/2019 Spatial Manipulation

1/22

New Interaction Techniques

Department of Computer SciencesUniversity of Tampere, FinlandDepartment of Computer SciencesUniversity of Tampere, Finland

September December, 2003

Grigori Evreinov

www.cs.uta.fi/~grse/

Screen Space &Spatial manipulation


2/22

TAUCHI MMIG G. Evreinov 01_21 14.11.2003

Spatial Manipulation

Samsung GPRS wristwatch phone

http://www.fossil.com


3/22



[1, 2] TiltType:Accelerometer-Supported Text Entry for Very Small

Devices (UIST2002), http://portolano.cs.washington.edu/projects/tilttype/


4/22



[3] TiltText: Using Tilt forText Input to Mobile Phones (UIST2003)


5/22


[4] Dasher, http://www.inference.phy.cam.ac.uk/djw30/dasher/p0.html

demo1


if cursor is moving into the t, rectangles corresponding to ta, tb,tc, ...,tz

appear in a vertical line like the first line

the heights of the rectangles correspond to the probabilities of these strings

according to the language model


6/22



the left picture shows the

EdgeWrite recognition

algorithm before thestylus is detected inside

one of the corners

once the stylus enters a

corner area, the corners

deflate for the duration of

the stroke (the right pict.)

[5] EdgeWrite:A Stylus-Based Text Entry Method Designed

forHighAccuracy and Stability of Motion

onscreen keyboards are small and require the user to fix

attention on the keyboard rather than on the output

text entry (recognition) on a handheld device is difficult forpeople with motor impairments (tremor, Cerebral Palsy

and fatigue)


7/22



marking menus and other forms of

gesture input are being used in

commercial desktop systems and inmobile devices

by analyzing mouse and pen flick

gestures (5200 gestures), the high

levels of angular error were revealed

when using a pen-based input device togenerate rightwards and leftwards

gestures

the relatively long time taken to

generate downwards gestures using

the mouse

[9]Analysing Mouse and Pen Flick

Gestures


8/22



Keuning-Van Oirschot [10] investigated

cursor movements with an amplitude of 250

pixels, in eight different directions and with

three control devices: a mechanical mouse,

an optical mouse and an optical trackball,

to find characteristics of the cursor path

which could be used to create a prediction

algorithm on directionthe focus was on the mean curvature of

and the variability between the paths in

each direction

it can be concluded that on average cursor

paths are rather straight in all eightdirections and with all three devices

the variability of the paths depends on

direction, friction of the control device and

user


9/22



the method for rapid evaluation of new graphic templates for text input

the method does not require learning of the new graphics, any layout or rules

before testing, and is intended to evaluate the users capabilities regarding to

the pen-based text entry technique

testing takes no more than two minutes per graphic template


10/22



the average performance (left scale),

standard deviation and the amount of

copied images per second (right

scale)

the total times of the drawing (s),

the total length of tracks (mm) and

the number of copied images


11/22


Spatial Manipulation7 segments


12/22



Segm1 - 7

txtText1

Clear

lblCodec

SegmActivate

SymbDec

SetSegmentsCtrl+K=>movesegments

Ctrl+G=>color

imaging

Form_KeyDown()

Form_MouseMove()

7 segments

Form_MouseUp()


13/22


Spatial ManipulationStylus flicks on touchscreen

MouseT


14/22


Spatial ManipulationMouseT

Bs NH RDJ

L

Cl NH RDJ

L

Sp NH RDJ

L

K NH RD

J

L

Space

ClearBackSp

K

K

K

J

L

H ND R

speed vectors

abs. position

abs. position

abs. position


15/22



K

MouseT

Timer1

txtText1

BackSpace

ChgSymbol

SetSymbol

SetHelp

Timer1.Enabled = False

Timer1.Interval = 0

XtmpE = Xtmp: YtmpE = Ytmp

ChgSymbol

ChgSymbol

(YtmpE - YtmpS) > M1x tChar + 1

(XtmpE - XtmpS) > M2x tChar + 7

(XtmpE - XtmpS) > M1xAnd

(XtmpE - XtmpS) < M2x tChar + 3

ChgSymbol(YtmpE - YtmpS) < -M1x tChar - 1

(XtmpE - XtmpS) < -M2x tChar - 7

(XtmpE - XtmpS) < -M1xAnd

(XtmpE - XtmpS) > -M2x tChar - 3

Timer1.Enabled = True

Timer1.Interval = Rtime

XtmpE = XtmpS: YtmpE = YtmpS

XtmpS = Xtmp: YtmpS = Ytmp

Form_MouseMove()


16/22


Spatial ManipulationMouseT

1 2

150

Finish

Instruction

Timer1

Form_MouseMove()

t1=GetTickCountt2 = GetTickCount

If t1 > 0 Thenk = CInt(t2 - t1)

VPerformance

DurationSlow

DurationMiddle1

DurationMiddle2

DurationFast

Error

lblSave

Calibration: to find the path length of cursor in 150 ms

2 1


17/22


Spatial ManipulationDrag & Drop


18/22



Timer1

txtText1

Drag & Drop

KeyPos(0) (10)

lblNKey

fraData

GridData1:

order No (1-100)

entered number

time per symbol, ms

GridData1_Click()to save column

lblTimeS

lblTimeR

lblTestTime

lblError

lblCapt

lblClrSpot

Clear

EditTools

Statistics

EditKeys

Error

Form_MouseMove()

SpotPointer

Shadow(0) (10)

Pointer


19/22


Spatial ManipulationtxtEntry_3Btn

1

2

3


20/22



lblString1

txtText1

lblString2 lblString3

String1 - 3

lbl1 - 3

Form_DblClick() Cancel

Form_MouseMove()

SelButton3

SelButton2

SelButton1

Form_MouseUp()

Form_KeyDown()

Form_KeyUp()

Form_MouseDown()

BackSpace

ChangeString

EditCaption


21/22

TAUCHI MMIG G. Evreinov p 20_21 14.11.2003

References

[1] Partridge, K., Chatterjee, S., Sazawal, V., Borriello, G. and Want, R. TiltType:Accelerometer-Supported

Text Entry for Very Small Devices. http://www.cs.washington.edu/homes/kepart/papers/uist2002.pdf

[2] Sazawal, V., Want, R. and Borriello, G. The UnigestureApproach One-Handed Text Entry for Small

Devices. http://www.speakeasy.org/~roywant/papers/lncs_unigesture.pdf

[3] Wigdor, D., Balakrishnan, R. TiltText: Using Tilt forText Input to Mobile Phones.

http://www.dgp.toronto.edu/papers/dwigdor_UIST2003.pdf

[4] Ward, D.J.Adaptive ComputerInterafces. Ph.D. Thesis, University ofCambridge, 2001.Available at:

http://www.inference.phy.cam.ac.uk/djw30/papers/thesis.pdf

[5] Wobbrock, J.O., Myers, B.A., Kembel, J.A. EdgeWrite:A Stylus-Based Text Entry Method Designed for

HighAccuracy and Stability of Motion. http://www.cs.cmu.edu/~jrock/pubs/uist-03.pdf

[6] J. Himberg, J. Hkkil, P. Kangas, and J. Mntyjrvi. On-line personalization of a touch screen based

keyboard. In Proceedings of the 2003 International Conference on Intelligent UserInterfaces (IUI 2003),

pp. 77-84, Miami, Florida, USA, 2003.ACM Press.

[7] G. W. Lesher, B. J. Moulton and D. J. Higginbotham, Optimal CharacterArrangements forAmbiguous

Keyboards. IEEE Transactions on Rehabilitation Engineering, pp. 415423, 1998.

http://www.enkidu.net/downloads/papers/LeMoHi98b.pdf

[8] Lyons, K., Patel, N.J. and Starner, T. KeyMenu:A Keyboard Based Hierarchical Menu

http://www.gvu.gatech.edu/ccg/publications/keymenu/



22/22

TAUCHI MMIG G. Evreinov p 21_21 14.11.2003

[9] Moyle, M., Cockburn,A.Analysing Mouse and Pen Flick Gestures.

http://www.cosc.canterbury.ac.nz/~andy/papers/sigchinz.pdf

[10] Keuning-Van Oirschot, H., Houtsma,A.J.M. CursorTrajectoryAnalysis. IPOAnnual Progress Report

No 35, 2000, pp. 128-139.

[11] Kamba, T, Elson, SA, Harpold, T, Stamper, T & Sukariya, P (1996) "Using Small Screen space more

efficiently," Proc.ACMCHI96, 383-390.

[12] Hinckley, K. Design Issues in Spatial Input. Ch. 4.,

http://research.microsoft.com/Users/kenh/thesis/design_issues.htm

http://research.microsoft.com/users/kenh/papers/Survey.pdf

[13]Albinsson, P-A, Zhai, S., High Precision Touch Screen Interaction, in Proceedings ofCHI 2003,ACM

Conference on Human Factors in Computing Systems, Fort Lauderdale, Florida,April 5-10, 2003. pp

105-112, http://www.almaden.ibm.com/u/zhai/papers/TouchScreen.pdf

[14] Zhai, S., Kristensson, P-O., Shorthand Writing on Stylus Keyboard, in Proceedings ofCHI 2003,ACM

Conference on Human Factors in Computing Systems, Fort Lauderdale, Florida,April 5-10, 2003. pp 97-104, http://www.almaden.ibm.com/u/zhai/papers/SharkFinal.pdf

WAAAwrite always, anything, anywhere


Documents

Spatial Manipulation