Ronnie SaurenmannPrincipal ArchitectMicrosoft Switzerlandronnies@microsoft.com

Kinect SDK

Kinect

A technology marvel that cost less than 150 CHF

Kinect Architecture

Kinect Architecture

Kinect SDK

Drivers, for using a Kinect sensor device with a Windows-based PC.API and device interfaces, together with technical documentation for developers.Source code samples.Documentation for creatively exploring natural user interface (NUI) possibilities for non-commercial use.

What you get

Highly performant and robust skeletal tracking capabilities

determining the body positions of one or two persons moving within the Kinect field of view

The latest advances in audio processing, with sophisticated acoustic noise and echo cancellationDepth data, which provides the distance of an object from the Kinect camera

raw audio and image data

RequirementsHardware

Kinect for Xbox 360 sensorComputer with a dual-core, 2.66-GHz or faster processorWindows 7–compatible graphics card that supports DirectX® 9.0c capabilities2-GB RAM (4-GB RAM recommended)

SoftwareWindows 7 (x86 or x64)Visual Studio 2010 Express (or other 2010 edition)Microsoft .NET Framework 4.0

C++, C# or VB

Power Supply for Kinect/XBox Bundle

Developing with the SDK

Raw sensor streams

Access to raw data streams from the depth sensor, color camera sensor, and four-element microphone array enables developers to build upon the low-level streams that are generated by the Kinect sensor.

Demo

Advanced audio capabilities

Audio processing capabilities include sophisticated acoustic noise suppression and echo cancellation, beam formation to identify the current sound source, and integration with the Windows speech recognition API.

Demo

Skeletal tracking

The capability to track the skeleton image of one or two people moving within the Kinect field of view make it easy to create gesture-driven applications.

Demo

Skeletal tracking

Joints data

Every joint gives you:X – horizontal position between -1 and 1Y – vertical position between -1 and 1Z – dinstance from Kinect in meters

PlusTrackedNot TrackedInferred (calculated)

Demo

What kinds of non-commercial activities are allowed?Scholarly research, including research funded by research

grants from government agencies or non-profit institutions. Classroom teaching (even if you are paid for that teaching) and investigative student projects. Professional research and personal experimentation to understand the capabilities and possibilities for the Kinect device in the Windows environment, and for general exploration of natural user interface (NUI) concepts.Exhibits and demonstrations (even if you are paid for exhibiting or producing the exhibit/demo).We envisage this restriction as temporary while the beta SDK is in its pre-commercial state. Stay tuned!

Resources

Microsoft KinectSDKCoding For Fun – Kinect ToolkitKinect GesturesSpeech Recognition / Text To Speech – Other languages

© 2011 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.

The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after

the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.