Upload
mayurpa
View
118
Download
3
Tags:
Embed Size (px)
Citation preview
Sixth Sense Technology based Virtual mouse and
Virtual drawing
Presented by:-Ms.Priyanka JainMr.Sudhir RautMr.Harshal RingeMr.Mayur Patil
Guided by:-Prof Deepali Gothawal
D.Y Patil College of Engineering, Akurdi (Pune), India
Contents
What is Virtual Reality? Introduction Features Requirements How camera captures work? Processing and Overall Execution Sequence Proposed System Applications Future Scope Conclusion Reference
What is virtual reality
Removing the standard input and output and building wearable computer system to create realistic environment for user software interaction.
Many input devices like camera, mic, sensors to make it easy to handle and make tough enough to develop
Introduction
Developing a advance human interaction system using computer vision.
Where, System will look for human behavior Process the action and convert to input Last perform a user defined action
Where we can provide a vision to industrial robots.
Features
Virtual paint brush using Red laser pointer Where user draw any thing on plane white surface
and it get drawn on computer
Finger motion based mouse control User move finger in air and system detect it
Hand gesture based photo snap shots Human hand position to grab image
Requirements
Development tools Microsoft Visual Basic
Operating System Microsoft Windows 98 or higher
Hardware Web camera, Laser Pointer
How Capture Work?
Camera Driver
Capture Window
Start Capturing
Show In Picture
Box
Fig 1: Interface of camera with computer
Processing
Capturing Camera View
Getting Current Frame out of it
Creating Memory Image
Finding Pixel RGB
Comparing Pixel color
Decision making
Overall Execution Sequence
Fig 2: Processing and Overall execution
Pixel Properties
.Y=50
X=75
A = GetPixel ( x , y )
255 255 255 = white
ExtractRGBFromColor(A, red, green, blue)
Laser Drawing
Fig 3: Virtual Drawing
How Drawing
VB Provides a picture box control to work as Drawing Pad
Using Function and property PictureBox.Line (x1,y1)-(x2,y2) PicuteBox.BackColor = ? PictureBox.ForeColor = ? PictureBox.DrawWidth + ?
Image Grabbing
Fig 4: Auto Image Grabbing
Grabbing Image
Once system process image and get Left , Top , Height , Width
Copy Image in to temporary picture boxUsing Function
SavePicture(FileName)
Save Image on diskCalled Auto Image Grabbing
Mouse Motion
Fig 5: Virtual Mouse
Mouse Control
In this module system will continuously track for finger
Finger has red color spot Image processing part will get the X, YPass these X, Y to the function
SetCursorPos()
It will control mouse motion
Application
Gaming is one of the major application which can avoid unnecessary wiring problems.
Defense Robots is also one of the application that can have wide scope in military applications.
Future Scope
Face based retailing systemsReading live news papersZooming features for Image grabbingShutdown
Conclusion
Sixth Sense technology is next generation
method to virtually communicate with the
systems now by implementing this proposed
system we are trying to give vision to
computer system for better and easy
interaction
References
S. Sadhana Rao “Sixth Sense Technology” Proceedings of the International Conference on Communication and Computational Intelligence – 2010, Kongu Engineering College, Perundurai, Erode, T.N., India.27 – 29 December, 2010.pp.336-339.
Sixth Sense- A Wearable Gestural Interface by P.Mistry, P. Maes.
http://blog.ted.com/2009/03/sixth_sense_pranav.php
http://en.wikipedia.org/wiki/
http://www.media.mit.edu/research/highlights/sixthsense-wearable-gestureal-interface augment-our-eorld
Thank - you