kinectpresentation-121214093502-phpapp02

8/12/2019 kinectpresentation-121214093502-phpapp02

1/22

Technology should intuitively understand us.It should work for us, not the other way around


2/22

1. Introduction

2. Kinect Hardware3. Kinect for Windows Architecture

4. Skeleton, Audio and Sensor data

5. Applications6. Demo and Questions


3/22

Kinect portmanteau of kinetic and connect),originally known by the code name Project atal, isa motion sensing input device by MicrosoftfortheXbox 360video game console.

The technology behind Kinect was invented in2005 by Zeev Zalevsky, Alexander Shpunt, AviadMaizels,Javier Garcia and Alex Kipman headed thekinect project for microsoft.

Kinect launched for the Xbox 360 on 11/4/2010.


4/22

Kinect builds on software technology developedinternally by Rare, a subsidiary of Microsoft GameStudios owned by Microsoft

Range camera technology by Israeli developerPrimeSense, which developed a system that caninterpret specific gestures, making completelyhands-free control of electronic devices possibleby using an infrared projector and camera and aspecial microchip to track the movement of objects

and individuals in three dimension


5/22

RGB CAMERA

MULTI-ARRAY MIC MOTORIZED TILT

3D DEPTH SENSORS


6/22


7/22


8/22

Kinect has FOUR microphones to retrieve spatial sound and attenuate noise,interferences and compensate for room acoustics.

Kinect has small color camera with 640x480 resolution.

The camera can track upto six people including two acitve people for motionanalysis and tracking

However PrimeSense states that it can see but not process as players as manypeople as present in the field-of-view of the camera.


9/22

Four microphone array

with hardware-based

audio processing

Multichannel Echo Cancellation (MEC)

Sound position tracking

Other digital signal processing (noise suppression and

reduction)

Kinect sensor's microphone array enables the Xbox 360 to

conduct acoustic source localizationand ambient noise

suppression, allowing for things such as headset-free party

chat over Xbox Live.


10/22

Kinect eyes

Eyes of Kinect are made by an INFRARED MEASUREMENT SYSTEM-Laser beam is send from the objective and received by sensor as can be seenabove.

These sensors can move to adjust for the distance and height. This deviceproduces MAP OF DEPTH to objects in a room.

The device can thus see in bad light or in darkness. Before the use it isTRAINED with movements of persons in the room. You can see on the right thatin infrared the beam makes lots of measurement dots

The area required to play Kinect is roughly 6ms


11/22

Kinect recognizes voice IN ROOMS and can be used for voice control ofapplications.

Kinect recognizes persons and body movements which is used in applications.But before this Kinect is TRAINED interactively like shown in pictures.

After the training person and body movements will be recognized.More than one person can be identified in a scene


12/22

Kinect uses a motion sensor that tracks your entire body. Sowhen you play, its not only about your hands and wrists.

Its about all of you. Arms, legs, knees, waist, hips and soon.


13/22

As you play, Kinect creates a digital skeleton of youbased on depth data. So when you move left or

right or jump around, the sensor will capture it andput you in the game.


14/22

Kinect ID remembers who you are by collecting physicaldata thats stored in your profile. So when you want to play

again, Kinect will know its you, making it easy to jump inwhenever you want.


15/22


16/22


17/22


18/22


19/22

Numerous developers are researching possible applicationsof Kinect that go beyond the system's intended purpose ofplaying games.

Another recent application of Kinect is for multi-touchdisplays. A Seattle-based company that graduated fromMicrosoft's Kinect Accelerator, Ubi Interactive, hasdeveloped software for the Kinect intended to work with

projectors to allow touchscreen-like capabilities on varioussurfaces


20/22

It is the first practical natural user interface formachines communicating with people

It is combining acoustical and visual sense

It is recognizing full body movements, even

complicated ones

It finds application not only in games but also inthe field of medical sciences and robotics.

After selling a total of 8 million units in its first 60

days, the Kinect holds the Guinness WorldRecord of being the "fastest selling consumerelectronics device".


21/22

Requires Space

Relatively new: limited

gamesFamily play: cant supportmore than 2 people

Cost: $150 for the sensor

and Xbox is $200


22/22

Documents

kinectpresentation-121214093502-phpapp02