Markerless real-time motion capture in Blender mate at Blender... · Performance capture • Rather...

Preview:

Citation preview

Markerless real-time motion capture in Blender

www.ni-mate.com

In this talk

• Background & state of the art

• What is NI mate (V2)?

• Demo time: NI mate with BGE for games/adds, NI mate with Intel RealSense

www.ni-mate.com

Delicode Ltd

Julius Tuomisto Janne Karhu Jesse Kaukonen

www.ni-mate.com

Delicode Ltd

• A tiny three-man studio in Helsinki

• Develops applications that make use of computer vision and 3D cameras

• Revenue from licensing software and doing custom development for clients

www.ni-mate.com

Performance capture

• Rather than using motion capture as a generic animation replacement, performance capture aims at capturing an actors full input in recognisable form

• Most of today’s performance capture systems are expensive and time consuming to setup

www.ni-mate.com

Markerless systems

• Faster take up time, but traditionally less accurate than marker based solutions (equals more cleaning)

• Examples of markerless capture systems are IPISoft and Captury

Natural Interaction Mate or [animate]

www.ni-mate.com

NI mate• NI mate doesn’t aim to compete with

professional solutions, but rather offers an easy to use, entry level real-time solution for markerless motion capture

• Different sensors have different strong points, while the number of supported simultaneous devices is limited only by SDK or hardware (USB bandwidth) limitations

www.ni-mate.com

NI mate (cont’d)• Use cases are numerous and range from

animation to installations to digital signage (advertisement) to game development to VR

• Already supports a wide range of 3D cameras on the market today

• A range of official plugins, such as the one for Blender, makes integrating NI mate to varied work flows simple

www.ni-mate.com

Official plugins

www.ni-mate.com

Introducing Intel RealSense

• First RealSense capabilities in NI mate include hand and finger tracking and facial motion capture, more on the way

• Release available for download starting today!

Demo time!

www.ni-mate.com

Thank you! Questions?

• Download at NI-mate.com and get started with your existing device in Blender today!

• Don’t forget to take part in tomorrow’s workshop titled “Unleash your 3D camera”, where we’ll also be handing out a few RealSense cameras!

Recommended