Sixth Sense Technology: Exotic Applications

Abstract:A new system named Sixth-Sense is proposed for obtaining physical world information in smart space. Our view is object-centered and sensors are attached to several objects in the space. What we focus is to use the smart sensor attached objects to obtain in-formation from no sensor attached objects, i.e., the so called potential objects detection problem. The Sixth-Sense resolves this problem by Sixth-Sense Skeleton and inference rules. Everyone is aware of their five basic senses, seeing, feeling, smelling, hearing and tasting. What everyone is not so well aware of is their sixth sense, that sense of otherworldliness, a connection to something more and greater than their physical senses are able to perceive.This is the entrance to the world of the unseen en-counter, the unheard communication, the unfelt touch of someone from the spiritual world trying to make a connection with someone in the physical body.

INTRODUCTION:‘Sixth Sense’s a wearable gesturer interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information. Sixth sense comprises a pocket projector, a camera and smart phone. The hardware components are coupled in a pendent like mobile wearable device. By using a camera and a tiny projector mounted in a pendant like wearable device, ‘Sixth Sense’sees what you see and visually augments any surfaces or objects we are interacting with. It projects information onto surfaces, walls, and physical objects around us, and lets us interact with the projected information through natural hand gestures, arm movements, or our interaction with the object itself. ‘Sixth Sense’attempts to free information from its confines by seamlessly integrating it with reality, and thus making the entire world your computer. We've evolved over millions of years to sense the world around us. When we encounter something, someone or some place, we use our five natural senses to perceive information about it; that information helps us make decisions and chose the right actions to take. But arguably the most useful information that can help us make the right decision is not naturally perceivable with our five senses, namely the data, information and knowledge that mankind has accumulated about everything and which is increasingly all available online. Although the miniaturization of computing devices allows us to carry computers in our pockets, keeping us continually connected to the digital world, there is no link between our digital devices and our interactions with the physical world. Information is confined traditionally on paper or digitally on a screen. Sixth Sense bridges this gap, bringing intangible, digital information out into the tangible world, and allowing us to interact with this information via natural hand gestures. ‘Sixth Sense’ frees information from its confines by seamlessly integrating it with reality, and thus making the entire world your computer.Since it is next to five senses which sense our gestures. Information is traditionally confined to paper or digitally to a screen. There is no link between our digital devices and our interaction with the physical world.

1

SIXTH SENSE TECHNOLOGY:The Sixth Sense prototype is comprised of a pocket projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks user's hand gestures and physical objects using computer-vision based techniques [1]. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducially) at the tip of the user’s fingers using simple computer-vision techniques. The movements and arrangements of these fiducially are interpreted into gestures that act as interaction instructions for the projected application interfaces. The maximum number of tracked fingers is only constrained by the number of unique fiducially, thus Sixth Sense also supports multi-touch and multi-user interaction

.COMPONENTS USED IN SIXTH SENSE :

i)Camera: A webcam captures an object in view and tracks the user hand gestures. It sends the data to the smart phone. It acts as a digital eye, connecting you to be world of digital information. Fig.1

Fig. 1 camera

ii)Colored markers: It is at the tip of the user’s fingers. Making the user’s fingers with red, yellow, and blue tape helps the webcam recognize gestures [2]. The movements and arrangements of these markers are interpreted into gestures that act as interaction instructions for the projected application interfaces. Fig.2

2

Fig.2 color markers

iii)Projector: The projector projects visual information enabling surfaces and physical objects to be used as interfaces. The projector itself contains a battery inside, with 3 hours of a battery life. A tiny LED projectors display data sent from the smart phone on any surface in view object, wall, or person.fig.3

Fig.3 projector

iv)Mirror: The usage of mirror is significant us the projector dangles pointing downwards from the neck.

v)Smart phone: A webcam enabled smart phone in the user’s pocket processes the video data, using vision to identify the object other software searches the web and interprets the hand gestures.fig.4

3

Fig.4 smartphone

WORKING OF SIXTH SENSE :The hardware that makes sixth sense work is a pendent like mobile wearable interface. It has a camera, a mirror and a projector and is connected wirelessly to a Bluetooth smart phone that can slip comfortably into one’s pocket. The camera recognizes individuals, images, pictures, gestures one makes with their hands. Information is sent to the smart phone for processing [3]. The downward facing projector projects the output image on to the mirror. Mirror reflects image on to the desired surface. Thus digital information is freed from its confines and placed in the physical worldfig.5

Fig 5. Using colour markers making gestures

4

. Fig 6.After the arrangement the actual picture of thedevice

Fig 7. Block Diagram

HOW TO USE SIXTH SENSE TECHNOLOGY:

1.Take picture: If you fashion your index fingers and thumbs into a square (“framing” gesture), the system will snap a photo. Fig.8

5

Fig.8. person using gestures to take a

Virtual calculator :: You can use the sixth sense to project a keyboard onto your hand, and then use that virtual keyboard to make a call.fig.9Check the time: Draw a circle on your wrist to get a virtual watch that gives you the correct time. Fig 10

Fig9 virtual keypad

Fig.10 virtual watch

Drawing:The drawing application lets the user draw on any surface by tracking the fingertip movements of the user’s index finger. Fig 11

6

Fig 11. drawing

Watch videos: It searches the most appropriate video from the web by seeing the headlines or the caption of the new report.Check your flight status: you can check the status of the flight while you are on taxi, just place the ticket in front of the projector and it checks its status from the internet. Fig.11

Fig.12 Ticket status

Check the brand of the product: It helps you to choose the best product from the super market.Check your mail: Drawing a magnifying glass symbol takes the user to the map application while a ‘@’ symbol lets the users check his mail.Gaming: We can play motion games via piece of paper and digital information about a product can be known instantaneously.In editing: Here we pinch out the data from book and put on a board then modify the data accordingly. Now we can take a printout of the modified data.Zooming features: The user can zoom in or zoom out using hand movements. The user navigates a map displayed on a nearby surface using hand gestures to zoom and pan. fig.12

7

Fig 12 zooming

Feed information on people: The system will project relevant information about a person such as what they do, where they work and so on.Moving news paper: News paper is the movie Harry potter, it is quit similar to it . It searches the most appropriate video from the web by seeing headlines.fig.13

Fig.13 news paper

Advantages of sixth sense technology: 1. Connectionless between physical world and digital information.2. Data access directly from machine in real time.3. Mind map the data any where 4. Portable5. It is a open source6. Cost effective7. Support multi-touch and multi-user interface

CONCLUSION:

8

Sixth sense recognizes the objects around us, displaying information automatically and letting us to access it in any we need. Allowing us to interact with this information via natural hand gestures. We can carry your digital world with you, where ever you go. You can use any surface around you as an interface. It is the potential of becoming the ultimate “transparent” user interface for accessing information about everything around us conclusion. If they can get rid of the colored finger caps and it ever goes beyond the initial development phase, that is. But as it is now, it may change the way we interact with the real world and truly give everyone complete awareness of the environment around us.

REFERENCES:[1] Intuition Technology, John M. Living[2] Sixth Sense, Pranav Mistry.[3] Speculations in science and technology, Western Australian Institute of technology.

9