1. +INTERACTIVESURFACESInstructor: LE Khanh-DuyLE Anh-DungDr. Benoit Huet

2. +AGENDA1. INTRODUCTION2. APPROACH3. DEMONSTRATION4. CONCLUSION 3. +AGENDA1. INTRODUCTION2. APPROACH3. DEMONSTRATION4. CONCLUSION 4. +USER INTERFACE AT A GLANCE 5. +MOTIVATION We want Draw/touch/interact freely Artistically Collaboration Enhancement in education 6. +LIKE THIS ?[1] [3][2] 7. +AGENDA1. INTRODUCTION2. APPROACH3. DEMONSTRATION4. CONCLUSION 8. +Surface Setup Methods Infrared-illumination-based method Depth-sensing-camera-based method Using digital pen 9. + Infrared-illumination-based method[8] Two most popular approaches Frustrated total internal reflection (FTIR)Rear diffuse illumination (Rear DI) Captured image 10. +Infrared-illumination-based methodRear DI setup in reality 11. +Infrared-illumination-based method Preprocess the captured image by following steps Background subtraction Binarization Spot size filtering Dilation Detect and track the blobs to identify users interactions 12. + Infrared-illumination-based method Captured image Background subtraction Binarization TrackingDilationSpot size filtering 13. +Depth-sensing-camera-basedmethod[4] Depth-sensing camera: combinationof infrared and regular camera Example: Microsoft Kinect Extract 3D skeletons of users and 3Dposition of display surface 14. +Depth-sensing-camera-based method Map 3D positions of users hands in space to 2D position ofthem on the surfaceSymbolic representation of the projection surface as seen by theKinect (left); Desirable target representation of a hand hovering over theprojection surface (right) 15. +Using Digital Pen [5] Interactive surface covered by a specially printed paper withpattern of tiny dots Digital pen is a pen with embedded IR camera to track themovementPrinted paper with pattern of tiny dotsDigital pen with IR camera 16. +Authentication problem incollaborative works Problem: who is interacting with a region or an object on thesurface? 17. +Authentication problem incollaborative works Some solutions Attaching RFID tags to users Tracking digital pen by ID 18. + Attaching RFID tags to users [4] Applied in depth-sensing camera-based system Each user in the system has a tag Assigning a tag to a skeleton Tracking tagged skeletons to monitorinteractions of users. Users need to register with system byinteracting with area of RFID reader 19. +Tracking digital pen by ID Applied in system using digital pen and pattern-printedsurface Each digital pen is identified by an ID. Movement of each digital pen will be recorded 20. +AGENDA1. INTRODUCTION2. APPROACH3. DEMONSTRATION4. CONCLUSION 21. +MEDUSA [7] 22. +SHARED DESIGN SPACE [5] 23. +AGENDA1. INTRODUCTION2. APPROACH3. DEMONSTRATION4. CONCLUSION 24. +CONCLUSION Detect not only the touch, but also the hover action, theappearance of the user Track each person by using RFID Still some limitations: Design Responsiveness Cost 25. +ADDITIONAL DEMOS 26. +References[1] MIT Sketching: http://www.youtube.com/watch?v=NZNTgglPbUA[2] SandCanvas: http://sandcanvas.com/[3] MemTable: http://fluid.media.mit.edu/projects/memtable-integrated-system-capture-and-recall-shared-histories-group-workspaces[4] F. Klompmaker, H. Fischer and H. Jung, "Authenticated Tangible Interaction using RFID and Depth-SensingCamera Supporting Collaboration on Interactive Tabletops," 2012.[5] M. Haller, P. Brandl, D. Leithinger, J. Leitner, T. Seifried and M. Billinghust, "Shared Design Space: Sketchingideas using digital pens and a large augmented tabletop setup".[6] E. Larson, G. Cohn, S. Gupta, X. Ren, B. Harrison, D. Fox and S. N.Patel, "HeatWave: Thermal Imaging forSurface User Interaction".[7] M. Annett, T. Grossman, D. Wigdor and G. Fitzmaurice, "Medusa: A Proximity-Aware Multi-touch Tabletop.[8] L.-w. Chan, Y.-f. Chuang, Y.-f. Chia, Y.-p. Hung and H. Jane, "A New Method for Multi-Finger Detection Using aRegular Diffuser". 27. THANK YOU FOR YOURLISTENING