Interactive surfaces for collaborative works

  • View

  • Download

Embed Size (px)


This is the final presentation about our research in interactive surfaces that use for collaborative works. This is the presentation for the ATMM (Advanced Topics in MultiMedia) course which is instructed by Dr. Benoit Huet. This course has given me a wide scale of many interesting topics that multimedia can involve in.

Text of Interactive surfaces for collaborative works

  • 1. +INTERACTIVESURFACESInstructor: LE Khanh-DuyLE Anh-DungDr. Benoit Huet

2. +AGENDA1. INTRODUCTION2. APPROACH3. DEMONSTRATION4. CONCLUSION 3. +AGENDA1. INTRODUCTION2. APPROACH3. DEMONSTRATION4. CONCLUSION 4. +USER INTERFACE AT A GLANCE 5. +MOTIVATION We want Draw/touch/interact freely Artistically Collaboration Enhancement in education 6. +LIKE THIS ?[1] [3][2] 7. +AGENDA1. INTRODUCTION2. APPROACH3. DEMONSTRATION4. CONCLUSION 8. +Surface Setup Methods Infrared-illumination-based method Depth-sensing-camera-based method Using digital pen 9. + Infrared-illumination-based method[8] Two most popular approaches Frustrated total internal reflection (FTIR)Rear diffuse illumination (Rear DI) Captured image 10. +Infrared-illumination-based methodRear DI setup in reality 11. +Infrared-illumination-based method Preprocess the captured image by following steps Background subtraction Binarization Spot size filtering Dilation Detect and track the blobs to identify users interactions 12. + Infrared-illumination-based method Captured image Background subtraction Binarization TrackingDilationSpot size filtering 13. +Depth-sensing-camera-basedmethod[4] Depth-sensing camera: combinationof infrared and regular camera Example: Microsoft Kinect Extract 3D skeletons of users and 3Dposition of display surface 14. +Depth-sensing-camera-based method Map 3D positions of users hands in space to 2D position ofthem on the surfaceSymbolic representation of the projection surface as seen by theKinect (left); Desirable target representation of a hand hovering over theprojection surface (right) 15. +Using Digital Pen [5] Interactive surface covered by a specially printed paper withpattern of tiny dots Digital pen is a pen with embedded IR camera to track themovementPrinted paper with pattern of tiny dotsDigital pen with IR camera 16. +Authentication problem incollaborative works Problem: who is interacting with a region or an object on thesurface? 17. +Authentication problem incollaborative works Some solutions Attaching RFID tags to users Tracking digital pen by ID 18. + Attaching RFID tags to users [4] Applied in depth-sensing camera-based system Each user in the system has a tag Assigning a tag to a skeleton Tracking tagged skeletons to monitorinteractions of users. Users need to register with system byinteracting with area of RFID reader 19. +Tracking digital pen by ID Applied in system using digital pen and pattern-printedsurface Each digital pen is identified by an ID. Movement of each digital pen will be recorded 20. +AGENDA1. INTRODUCTION2. APPROACH3. DEMONSTRATION4. CONCLUSION 21. +MEDUSA [7] 22. +SHARED DESIGN SPACE [5] 23. +AGENDA1. INTRODUCTION2. APPROACH3. DEMONSTRATION4. CONCLUSION 24. +CONCLUSION Detect not only the touch, but also the hover action, theappearance of the user Track each person by using RFID Still some limitations: Design Responsiveness Cost 25. +ADDITIONAL DEMOS 26. +References[1] MIT Sketching:[2] SandCanvas:[3] MemTable:[4] F. Klompmaker, H. Fischer and H. Jung, "Authenticated Tangible Interaction using RFID and Depth-SensingCamera Supporting Collaboration on Interactive Tabletops," 2012.[5] M. Haller, P. Brandl, D. Leithinger, J. Leitner, T. Seifried and M. Billinghust, "Shared Design Space: Sketchingideas using digital pens and a large augmented tabletop setup".[6] E. Larson, G. Cohn, S. Gupta, X. Ren, B. Harrison, D. Fox and S. N.Patel, "HeatWave: Thermal Imaging forSurface User Interaction".[7] M. Annett, T. Grossman, D. Wigdor and G. Fitzmaurice, "Medusa: A Proximity-Aware Multi-touch Tabletop.[8] L.-w. Chan, Y.-f. Chuang, Y.-f. Chia, Y.-p. Hung and H. Jane, "A New Method for Multi-Finger Detection Using aRegular Diffuser". 27. THANK YOU FOR YOURLISTENING