16
NY Magic Leap Meetup Building 3D Interfaces with Magic Leap July 24, 2019

NY Magic Leap Meetup - Evolving Technologies …NY Magic Leap Meetup Building 3D Interfaces with Magic Leap July 24, 2019 Magic Leap 3D Interfaces Magic Leap Deployment Magic Leap

  • Upload
    others

  • View
    15

  • Download
    0

Embed Size (px)

Citation preview

Page 1: NY Magic Leap Meetup - Evolving Technologies …NY Magic Leap Meetup Building 3D Interfaces with Magic Leap July 24, 2019 Magic Leap 3D Interfaces Magic Leap Deployment Magic Leap

NY Magic Leap Meetup

Building 3D Interfaceswith Magic Leap

July 24, 2019

Page 2: NY Magic Leap Meetup - Evolving Technologies …NY Magic Leap Meetup Building 3D Interfaces with Magic Leap July 24, 2019 Magic Leap 3D Interfaces Magic Leap Deployment Magic Leap

Magic Leap 3D Interfaces

Page 3: NY Magic Leap Meetup - Evolving Technologies …NY Magic Leap Meetup Building 3D Interfaces with Magic Leap July 24, 2019 Magic Leap 3D Interfaces Magic Leap Deployment Magic Leap

Magic Leap Deployment

Page 4: NY Magic Leap Meetup - Evolving Technologies …NY Magic Leap Meetup Building 3D Interfaces with Magic Leap July 24, 2019 Magic Leap 3D Interfaces Magic Leap Deployment Magic Leap

Magic Leap Zero Iteration

Page 5: NY Magic Leap Meetup - Evolving Technologies …NY Magic Leap Meetup Building 3D Interfaces with Magic Leap July 24, 2019 Magic Leap 3D Interfaces Magic Leap Deployment Magic Leap

ML Input

Page 6: NY Magic Leap Meetup - Evolving Technologies …NY Magic Leap Meetup Building 3D Interfaces with Magic Leap July 24, 2019 Magic Leap 3D Interfaces Magic Leap Deployment Magic Leap

Magic Leap ControlController.cs

MLInputController _controller;bool _homeButtonUp;

void Start() {MLInput.Start();_controller = MLInput.GetController(MLInput.Hand.Left);MLInput.OnControllerButtonUp += OnButtonUp;}

void OnDestroy() {MLInput.OnControllerButtonUp -= OnButtonUp; MLInput.Stop(); }

void OnButtonUp(byte controller_id, MLInputControllerButton button) {if (button == MLInputControllerButton.HomeTap) {

_homeButtonUp = true;}

Page 7: NY Magic Leap Meetup - Evolving Technologies …NY Magic Leap Meetup Building 3D Interfaces with Magic Leap July 24, 2019 Magic Leap 3D Interfaces Magic Leap Deployment Magic Leap

Interacting with UI Elements

• Sliders

• Can readily resize and reorient slider

• Buttons

• Toggle switches

Page 8: NY Magic Leap Meetup - Evolving Technologies …NY Magic Leap Meetup Building 3D Interfaces with Magic Leap July 24, 2019 Magic Leap 3D Interfaces Magic Leap Deployment Magic Leap

Toggle Buttons

• System Icons:

• Eliminate individual draw calls by using one Atlas

• Enable haptic feedback and sound

Page 9: NY Magic Leap Meetup - Evolving Technologies …NY Magic Leap Meetup Building 3D Interfaces with Magic Leap July 24, 2019 Magic Leap 3D Interfaces Magic Leap Deployment Magic Leap

General Hand Gestures

• Collection of standard hand gestures

• Left/Right Hand recognition

• Confidence metrics

Page 10: NY Magic Leap Meetup - Evolving Technologies …NY Magic Leap Meetup Building 3D Interfaces with Magic Leap July 24, 2019 Magic Leap 3D Interfaces Magic Leap Deployment Magic Leap

Drone Flight using Hand Gestures

Page 11: NY Magic Leap Meetup - Evolving Technologies …NY Magic Leap Meetup Building 3D Interfaces with Magic Leap July 24, 2019 Magic Leap 3D Interfaces Magic Leap Deployment Magic Leap

Drone Flight Lexicon

• 14 Basic Commands

• Two command types:

• Discrete

• Continuous

• Developed framework based on Gaze Activation

Page 12: NY Magic Leap Meetup - Evolving Technologies …NY Magic Leap Meetup Building 3D Interfaces with Magic Leap July 24, 2019 Magic Leap 3D Interfaces Magic Leap Deployment Magic Leap

Interacting with Holograms

• Make active use of LWRP facilities in Unity

• Touch interaction

• Smoothing movement

Page 13: NY Magic Leap Meetup - Evolving Technologies …NY Magic Leap Meetup Building 3D Interfaces with Magic Leap July 24, 2019 Magic Leap 3D Interfaces Magic Leap Deployment Magic Leap

Lightweight Render Pipeline Example

Page 14: NY Magic Leap Meetup - Evolving Technologies …NY Magic Leap Meetup Building 3D Interfaces with Magic Leap July 24, 2019 Magic Leap 3D Interfaces Magic Leap Deployment Magic Leap

Magic Mover

• HOD: “Hands-On Display”

• Haptic feedback

• Pick and move objects with near effortless motion

Page 15: NY Magic Leap Meetup - Evolving Technologies …NY Magic Leap Meetup Building 3D Interfaces with Magic Leap July 24, 2019 Magic Leap 3D Interfaces Magic Leap Deployment Magic Leap

Thank You!!

Loren Abdulezer – [email protected]

Evolving Technologies Corporation

www.evolvingtech.com

©2019 Evolving Technologies Corporation

Page 16: NY Magic Leap Meetup - Evolving Technologies …NY Magic Leap Meetup Building 3D Interfaces with Magic Leap July 24, 2019 Magic Leap 3D Interfaces Magic Leap Deployment Magic Leap