1. THIRD HAND ENHANCING SINGLE-HANDED AND HAPTIC INTERACTIONS ON MOBILE DEVICES THROUGH A ROBOTIC ARM CHICHI LIAO, SHUN-YAO YANG 3/13 2015, @ADVANCED HCI 2. OUTLINE Motivation Device Implementation Application Study Issues 3. OUTLINE Motivation Device Implementation Application Study Issues 4. PHYSICAL SUPPORT FOR HANDHELD DEVICE 5. LIMITATION 6. IF THERES ANOTHER PHYSICAL FORCE GRASP PHONE FOR YOU? 7. BUT HOW? 8. WE WANT TO INTRODECE A concept, that is a solution to allow the device an additional physical support through grasping its user with an Robot Arm. 9. EXPLORE THE CONCEPT Opens up new opportunities for novel single-handed interaction and haptic feedback on mobile devices. 10. USE CASE I Single-handed interactions: Andy in-air gestures 11. USE CASE II Haptic feedback: AndyThird Hand force feedback 12. OUTLINE Motivation Device Implementation Application Study Issues 13. DEVICE 14. DEVICE 15. DEVICE 16. DEVICE 17. OUTLINE Motivation Device Implementation Application Study Issues 18. IMPLEMENTATION Fix position and rotation relative to head. Implementation: Camera on phone AR tag on face Using Forward Kinematics decide position and rotation relative to wrist Decide every motor by Inverse Kinematics 19. OUTLINE Motivation Device Implementation Application Study 20. APPLICATION Single-handed gestures Haptic feedback 21. OFF-SCREEN SINGLE HAND GESTURES In-air gestures Back-device-touch Others 22. HAPTIC FEEDBACK Racing car game Photo taking tutorial 23. OUTLINE Motivation Device Implementation Application Study Issues 24. STUDY Force Different by voltage Different by Angle (?) Comfortable The conflict between two force, on fingers and on the wrist. Experience 25. ISSUES How to study? The relation between wrist, robot arm, phone itself. 26. SUMMARY Third hand is a novel concept, explore new possibilities of mobile device in single-handed gestures and haptic feedback. 27. Thank You