15
Markerless real-time motion capture in Blender

Markerless real-time motion capture in Blender mate at Blender... · Performance capture • Rather than using motion capture as a generic animation replacement, performance capture

  • Upload
    others

  • View
    12

  • Download
    1

Embed Size (px)

Citation preview

Page 1: Markerless real-time motion capture in Blender mate at Blender... · Performance capture • Rather than using motion capture as a generic animation replacement, performance capture

Markerless real-time motion capture in Blender

Page 2: Markerless real-time motion capture in Blender mate at Blender... · Performance capture • Rather than using motion capture as a generic animation replacement, performance capture

www.ni-mate.com

In this talk

• Background & state of the art

• What is NI mate (V2)?

• Demo time: NI mate with BGE for games/adds, NI mate with Intel RealSense

Page 3: Markerless real-time motion capture in Blender mate at Blender... · Performance capture • Rather than using motion capture as a generic animation replacement, performance capture

www.ni-mate.com

Delicode Ltd

Julius Tuomisto Janne Karhu Jesse Kaukonen

Page 4: Markerless real-time motion capture in Blender mate at Blender... · Performance capture • Rather than using motion capture as a generic animation replacement, performance capture

www.ni-mate.com

Delicode Ltd

• A tiny three-man studio in Helsinki

• Develops applications that make use of computer vision and 3D cameras

• Revenue from licensing software and doing custom development for clients

Page 5: Markerless real-time motion capture in Blender mate at Blender... · Performance capture • Rather than using motion capture as a generic animation replacement, performance capture

www.ni-mate.com

Performance capture

• Rather than using motion capture as a generic animation replacement, performance capture aims at capturing an actors full input in recognisable form

• Most of today’s performance capture systems are expensive and time consuming to setup

Page 6: Markerless real-time motion capture in Blender mate at Blender... · Performance capture • Rather than using motion capture as a generic animation replacement, performance capture

www.ni-mate.com

Markerless systems

• Faster take up time, but traditionally less accurate than marker based solutions (equals more cleaning)

• Examples of markerless capture systems are IPISoft and Captury

Page 7: Markerless real-time motion capture in Blender mate at Blender... · Performance capture • Rather than using motion capture as a generic animation replacement, performance capture
Page 8: Markerless real-time motion capture in Blender mate at Blender... · Performance capture • Rather than using motion capture as a generic animation replacement, performance capture

Natural Interaction Mate or [animate]

Page 9: Markerless real-time motion capture in Blender mate at Blender... · Performance capture • Rather than using motion capture as a generic animation replacement, performance capture

www.ni-mate.com

NI mate• NI mate doesn’t aim to compete with

professional solutions, but rather offers an easy to use, entry level real-time solution for markerless motion capture

• Different sensors have different strong points, while the number of supported simultaneous devices is limited only by SDK or hardware (USB bandwidth) limitations

Page 10: Markerless real-time motion capture in Blender mate at Blender... · Performance capture • Rather than using motion capture as a generic animation replacement, performance capture

www.ni-mate.com

NI mate (cont’d)• Use cases are numerous and range from

animation to installations to digital signage (advertisement) to game development to VR

• Already supports a wide range of 3D cameras on the market today

• A range of official plugins, such as the one for Blender, makes integrating NI mate to varied work flows simple

Page 11: Markerless real-time motion capture in Blender mate at Blender... · Performance capture • Rather than using motion capture as a generic animation replacement, performance capture

www.ni-mate.com

Official plugins

Page 12: Markerless real-time motion capture in Blender mate at Blender... · Performance capture • Rather than using motion capture as a generic animation replacement, performance capture
Page 13: Markerless real-time motion capture in Blender mate at Blender... · Performance capture • Rather than using motion capture as a generic animation replacement, performance capture

www.ni-mate.com

Introducing Intel RealSense

• First RealSense capabilities in NI mate include hand and finger tracking and facial motion capture, more on the way

• Release available for download starting today!

Page 14: Markerless real-time motion capture in Blender mate at Blender... · Performance capture • Rather than using motion capture as a generic animation replacement, performance capture

Demo time!

Page 15: Markerless real-time motion capture in Blender mate at Blender... · Performance capture • Rather than using motion capture as a generic animation replacement, performance capture

www.ni-mate.com

Thank you! Questions?

• Download at NI-mate.com and get started with your existing device in Blender today!

• Don’t forget to take part in tomorrow’s workshop titled “Unleash your 3D camera”, where we’ll also be handing out a few RealSense cameras!