Taking a Leap Forward With JavaFX

Taking A Leap Forward With JavaFXSimon Ritter, Oracle CorporationGerrit Grunwald, Canoo Engineering AGJohan Vos, LodgonJosé Pereda, Universidad de Valladolid

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Program Agenda

The Man Machine Interface

Leap Motion Controller

JavaFX Basics and 3D

Leap Motion Java API

The Man Machine Interface

How It All Started

Progress was made…

Multi-touch has become popular

Gaming Has Driven Several Interfaces

Now It’s About Gestures

The Leap Motion Controller

The Basics

Small device (80 x 30 x 12mm) USB connection

– No external power required

Multiple OS support– Windows

– Mac OSX

– Linux

Low cost: $80

The Technology

Array of infra-red sensors– Can be susceptible to bright light

Proprietary motion detection algorithm– Tracks to 0.01mm resolution

– The secret sauce

1-2% CPU load No GPU requirement

The Details

The Leap Motion sensor detects hands, fingers and tools Data captured as frames continuously Listener handles events from frames Controller is the connection between device and application Gesture recognition must be enabled through the controller

Leap Motion Java APICo-ordinate System

Right hand Cartesian co-ordinate system

60cm range 150° view angle (left/right) 120° view angle (front/back)

Field Of View

Gestures

Predefined gestures– Circle

– Swipe

– Key tap (downward movement: y-axis)

– Screen tap (forward movement: z-axis)

Turn, twist, tilt, make a fist– Use motion factors from frame

Translation, rotation axis, rotation angle, scale factor

JavaFX Basics and 3D

JavaFX: The New Way To Build Java UIs

Scene Graph

Directed Acyclic Graph Parents and children Representation of the GUI components

Binding

Creates a dependency between a property and a changeable value

High level API– Easy to use

– Covers most common situations

Low level API– Allows for more complex interactions

– Optimised for fast execution and small footprint

Properties

Basis for high level binding API Concrete types for all primitives, String and Object

– DoubleProperty, StringProperty, etc

Simple API– bind / unbind– bindBidirectional / unbindBidirectional– isBound

Timeline Based Animations

Timeline– Modifies values of variables specified in KeyFrames

KeyFrame: specifies that a variable should have– A particular value at a particular time

KeyValue: Value to be interpolated for an interval

Animated Transitions

Pre-defined, single-purpose animations– Fade, Path, Pause, Rotate, Scale, Translate

– Can specify to, from and by values

Container transitions– Parallel, sequential

– Can be nested arbitarily

Transitions and Timelines share ancestary– A Timeline can be added to a Parallel / Sequential transition

JavaFX And The Third Dimension

Basic collection of 3D shapes– Box

– Cylinder

– Sphere

– MeshView (everything else)

javafx.scene.shape

Shapes

PhongMaterial– Way to cover a 3D object in a colour or image

– Uses interpolation to smooth polygon effects

Surfaces

How to illuminate the scene javafx.scene.effect.LightBase AmbientLight

– A light source that seems to come from all directions

PointLight– An attenuated light source that has a fixed point in space and radiates light

equally away from itself in all directions

Lighting

Where the scene is viewed from PerspectiveCamera

– Field of view is configurable (default is 30°)

ParallelCamera– Renders a scene without perspective correction

Cameras

Leap Motion Java API

Interaction Principles

Application Code

Listener

GUI Node

Controller

LeapMotion

Basic Approach

Create Controller Register Listener

– Subclass to implement specific functionality

onFrame callback method in Listener called by Controller Or you can use polling Frame contains all data

– Hand position, orientation

– Fingers

– Pointer position, orientation

Frame By Frame

Set of hand and finger tracking data detected at a point in time Hand provides:

– Direction of palm

– List of visible Fingers

Finger (which is a subclass of Pointable) provides:– Direction

– Tip position and velocity

– Length, width

– Time visible

Handling Gestures

Enable the gestures you want to use Recognised gesture data is added to the Frame

GestureList gl = frame.gestures();

for (int i = 0; i < gl.count(); i++) { Gesture g = gl.get(i); if (g.type == TYPE_SWIPE) SwipeGesture sw = new SwipeGesture(g);

Conclusions and More Information

Conclusions

Leap Motion adds a great new way to interact with applications Java support makes integration with existing applications simple

– Clean, straightforward API

– Simple gesture recognition

Use your imagination!

Further Information

www.leapmotion.com www.oracle.com/javafx jperedadnr.blogspot.co.uk blogs.oracle.com/speakjava

Graphic Section Divider

Taking a Leap Forward With JavaFX

Technology

Banks taking a quantum leap through digital - PwC

Taking a “Leap of Faith” with Public Lands Friends of Snodgrass Mountain, LLC

A quantum of possibilities: The business advantages of taking the quantum leap

Taking a Leap of Faith on Captives - sipconline.net a Leap of Faith on Captives by Bruce... · Taking a Leap of Faith on Captives Written by Bruce Shutan Editor’s Note: This is

Taking a Leap: Technical Role to Management Role

Taking the Leap: Real-Talk about Real-Time Marketing

Stepping Up – Taking the leap into technical leadership : DevLink 2014

Taking the Leap - Using ODS Statistical Graphics for Data Visualization

Taking the Leap Presentation

Taking Your Big Leap - coachtothebest.comcoachtothebest.com/.../10/EO-Nepal-Taking-the-Big-Leap-November-2017.pdf · Taking Your Big Leap What does it take to take my big leap? Roles

nothing to disclose Taking the Leap Radical System ...app.ihi.org/.../Presentation_M22_Taking_the_Leap_Kerscher.pdf · Taking the Leap – Radical System Transformation to Advanced

01 - JavaFX. Введение в JavaFX

Taking the Leap and Sustaining the Journey

Taking the Leap

Taking The Quantum Leap To Measure Your Social Media Recruitment ROI

Making the Leap Taking Your Company to the Next Level Business Mentors

Banks taking a quantum leap through digital 21 April 2015

The 2D to 3D Transition Taking the Leap

Taking a Quantum Leap with Html 5 WebSocket

Taking a Leap with Sharia in the World of Options · Taking a Leap with Shariah in the World of Options 8 SHARIYAH REVIEW BUREAU The Parties to an Option’s Contract An option’s