45
Kill the Search Button II The Handheld Devices Are Coming

Kill the Search Button II - Mobile Gestures

Embed Size (px)

DESCRIPTION

Code4Lib presentation about smartphone gestures. I talk about an alternative gesture based paradigm for mobile devices and show an example of how to augment an iPhone library search app with gestures.

Citation preview

Page 1: Kill the Search Button II - Mobile Gestures

Kill the Search Button II

The Handheld Devices Are Coming

Page 2: Kill the Search Button II - Mobile Gestures

Gestures for a Mobile Search App

Michael Poltorak Nielsen

Page 3: Kill the Search Button II - Mobile Gestures

Today's agenda

● Current Mobile Interaction Paradigm

● An Alternative

● Smartphone Gestures

● Demo: A Library Search App with Touch and Gestures

Page 4: Kill the Search Button II - Mobile Gestures
Page 5: Kill the Search Button II - Mobile Gestures

But, the Current Handheld Interaction Paradigm is based on:

Page 6: Kill the Search Button II - Mobile Gestures

Glass

Page 7: Kill the Search Button II - Mobile Gestures
Page 8: Kill the Search Button II - Mobile Gestures
Page 9: Kill the Search Button II - Mobile Gestures

The future is sliding, toomicrosoft.com/office/vision

Page 10: Kill the Search Button II - Mobile Gestures
Page 11: Kill the Search Button II - Mobile Gestures
Page 12: Kill the Search Button II - Mobile Gestures
Page 13: Kill the Search Button II - Mobile Gestures
Page 14: Kill the Search Button II - Mobile Gestures

Pictures Under GlassTransitional paradigm dictated by technology, not human capabilities Bret Victorworrydream.com/ABriefRantOnTheFutureOfInteractionDesign

Page 15: Kill the Search Button II - Mobile Gestures

Alternative Paradigm

Direct Manipulation Gesture Driven Palpable Tactile

Page 16: Kill the Search Button II - Mobile Gestures
Page 17: Kill the Search Button II - Mobile Gestures
Page 18: Kill the Search Button II - Mobile Gestures
Page 19: Kill the Search Button II - Mobile Gestures

Harrison, C. and Hudson, S. E. 2009. Providing Dynamically Changeable Physical Buttons on a Visual

Display

Page 20: Kill the Search Button II - Mobile Gestures

Not bad, huh?

Page 21: Kill the Search Button II - Mobile Gestures

Near Future?

+

Page 22: Kill the Search Button II - Mobile Gestures

Have a Moment

Page 23: Kill the Search Button II - Mobile Gestures

Our Mobile Projects

Page 24: Kill the Search Button II - Mobile Gestures

Mobile Search App(s)

HTML5 + iPhone app, Android?● search library data (10M + 800M)● request stuff, favourites● view own items● renew In beta, to be published really soon

Page 25: Kill the Search Button II - Mobile Gestures

Barcode to Map Location AppWith Silkeborg Public Library

Page 26: Kill the Search Button II - Mobile Gestures

● Augment search app with gestures

● Can gestures be combined with multi-touch interactions?

● Goals: ○ Produce alpha app○ Test usability

Now: Gestures

Page 27: Kill the Search Button II - Mobile Gestures

Smart Phone Interactions and Inputs

Keyboard typingMicrophone speechScreen touch, visualsCamera pattern, movementAccelerometer accelerationGyroscope rotationCompass directionGPS movement, position

Page 28: Kill the Search Button II - Mobile Gestures

Focus on

Keyboard typingMicrophone speechScreen touch, visualsCamera pattern, movementAccelerometer accelerationGyroscope rotationCompass directionGPS movement, position

Page 29: Kill the Search Button II - Mobile Gestures

Gestures

AdvancedCircle, cross, up-down, etcMovement hard to measure Can't reliably calculate movement from acceleration

SimpleTilt, flip, turn, rotate, shake, throwAccelerometer data

Page 30: Kill the Search Button II - Mobile Gestures

What Can Browsers do Accelerometer-wise?

Page 31: Kill the Search Button II - Mobile Gestures

So: Going Native iPhone app with gestures

HTML5 web app without gestures

Android?

Page 32: Kill the Search Button II - Mobile Gestures

Search App Interactions

Do search query, toggle search boxSwitch views compact, normal, expandendNext/previous page switch search results Show full record full info about itemRequest get the materialFavourites save material

Page 33: Kill the Search Button II - Mobile Gestures
Page 34: Kill the Search Button II - Mobile Gestures
Page 35: Kill the Search Button II - Mobile Gestures
Page 36: Kill the Search Button II - Mobile Gestures
Page 37: Kill the Search Button II - Mobile Gestures
Page 38: Kill the Search Button II - Mobile Gestures
Page 39: Kill the Search Button II - Mobile Gestures

Demo Time

Page 40: Kill the Search Button II - Mobile Gestures

What's next?

From Nokia

Page 41: Kill the Search Button II - Mobile Gestures

Challenges

No standard mobile gestures Gestures may be individualGestures may not be appropiate at allSophisticated gestures hard to codeObjective-C Argh!

Page 42: Kill the Search Button II - Mobile Gestures

Thank you!

Michael Poltorak [email protected]

twitter:@michaelpoltorak

Page 43: Kill the Search Button II - Mobile Gestures
Page 44: Kill the Search Button II - Mobile Gestures
Page 45: Kill the Search Button II - Mobile Gestures