22
Virtual Reality, Rendering of Music Performance TÓTH RICHARD

Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

  • Upload
    others

  • View
    21

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

Virtual Reality,

Rendering of Music

PerformanceTÓTH RICHARD

Page 2: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

Similar applications – Rock Band VR

Page 3: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

Similar applications – Rock Band VR

Page 4: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

Unity Engine

Page 5: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

VS

Page 6: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

Unreal Engine 4

Page 7: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

VS

Page 8: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

Unity scene – Resources

Page 9: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

Unity scene – People

Page 10: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

Custom models

Page 11: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

Assets made by community

Page 12: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

VR Integration

Unity + VR headset

Camera control C# scripts

Camera animation

Rendering efficiency – Lighting

and polygon count – Missing

Profiler

Page 13: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

GUI ans Controls

• Gesture Based Controls with MS Kinect OR Leap motion

Page 14: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

Animation

• Search OR record motion capture data in format .bvh (walk, dance, drink, play)

• Import .bvh files

• Animate persons

• Add camera to every person

• Navigation between persons ?

• Hidden interaction with people according to user actions

Page 15: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

About .bvh

Page 16: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

Online datasets

Page 17: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

Convert files

.bvh -> (script) -> .fbx -> Unity -> Humanoid

Page 18: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

In Unity

Page 19: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

Document

• With: https://www.sharelatex.com/

Page 20: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

Future Problems:

• Missing .bvh files or models

• Point cloud animation

• Optimalization

Page 21: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms
Page 22: Virtual Reality Rendering of Music Performancedavinci.fmph.uniba.sk/~toth145/bc/files/VRRMP.pdf · Tutorials Virtual Reality Virtual Reality Get started developing for VR platforms

Thank [email protected]