NEXT

GENERATION

USER INTERFACES

HARSHAD K T

S5 MCA

Roll NO: DOALMCA013

NIELIT CALICUT

Contents

Introduction

Technologies

Gesture Interfaces

Augmented Reality (AR)

Voice User Interface (VUI)

Tangible User Interface (TUI)

Conclusion

References

INTRODUCTION

•User Interface

•Graphical User Interface (GUI)

User interfaces provide a means of

Input, allowing the users to manipulate a system

Output, allowing the system to indicate the effects of the

users' manipulation

Here are some key features of

1.Gesture Interfaces

2.Augmented Reality (AR)

3.Voice User Interface (VUI)

4.Tangible User Interface

(TUI)

Gesture Interfaces

Gesture recognition is a topic in computer

science interpreting human gestures via

mathematical algorithms.

Gestures can originate from any bodily motion

(commonly originate from the face or hand )

It enables humans to communicate with the machine

Gestures enabled applications provide interface to

interact with the system

Gesture types

•Offline gestures : Those gestures that are processed

after the user interaction with the object. An example is

the gesture to activate a menu.

•Online gestures : Direct manipulation gestures. They

are used to scale or rotate a tangible object.

Uses of gestures interfaces

1. Sign language recognition

2. Control through facial

gestures

3. Alternative computer

interfaces

4. Immersive game technology

5. Affective computing

6. Remote control

Input devices

1. Wired gloves

2. Depth-aware cameras

3. Controller-based

gestures

4. Single camera

Data glove

Depth aware camera

Sixth Sense Technology (Example system )

'Sixth Sense' is a wearable gestural interface that augments the

physical world around us with digital information and lets us

use natural hand gestures to interact with that information

Pranav mistry , inventor of the SixthSense

•prototype is comprised of a Pocket Projector, a Mirror and

a Camera

•connected with the mobile computing device in the user’s

pocket.

•The software program processes the video stream data

captured by the camera and tracks the locations of

the colored markers

•Sixth Sense also supports multi-touch and multi-user

interaction

Applications

Navigate a map

Multi-touch based systems

Zoom in, zoom out

Drawing application

Takes photos using “framing”

gestures

It augments the physical objects 

Taking photos with gestures

Augmented reality using 6th sense technologyNavigation, Zoom in / zoom

out

Devices used

Augmented Reality (AR)

Augmented reality (AR) is a live, copy view of real-world

environment whose elements are augmented by computer-

generated sensory input such as sound, video, graphics

or GPS data

Gaming Application

NavigationLive AU

AR enabled camera

Devices Used

Hardware

Display

Head-mounted Display

Eyeglasses

Contact lenses

EyeTap

Handheld

Spatial Augmented

reality

Input devices

HMD

Contact lenses

EyeTap

Applications

Architecture

Commerce

Education

Gaming

Medical

Military

NavigationEducation

Google Glass view

Commerce

Navigation

Voice User Interface (VUI)

A voice–user interface (VUI) makes human

interaction with computers possible through a voice/speech

platform in order to initiate an automated service or process.

Future Uses

1.Smart phone and PDA`s working

2.Helps the people who are slow in typing, (avoids straining

and Injuries )

3.Helps the handicapped people

4.Facilitate to create portable devices (with no keyboard, no

separation between content and keyboard on the touch

screen )

5.Reduce the devices half in size ( laptop computers ,

desktop, sliding mobile devices)

1. The VUI must be sophisticated enough to distinguish

between the input commands, and background

conversation

2. It need highly sophisticated software in order to

accurately process and find or retrieve as per the

particular user's preferences

Example gadget : Google glass

Samsung S-voice

Understanding Speech Technology

Barge-In

Grammar

Tuning

Voice User Interface

VXML

The Voice XML Specification

The Voice XML Advantage

Tangible User Interface

A tangible user interface (TUI) is a user interface in which

a person interacts with digital information through the

physical environment.

Characteristics TUI

Physical representations are computationally coupled to

underlying digital information.

Physical representations with visible/ tangible interfaces for

interactive control.

Aware of physical objects through sensors and coupled to digital

representation

Properties of tangible user interfaces

•space-multiplex both input and output

•concurrent access

•spatially aware (position, area, size… etc)

Object recognition in TUI

Surface computing

Surface computing  enables user to interact directly with

the system

Without using keyboard and mouse

Features Direct interaction

Multi user experience

Multi touch

Object recognition

Application

•Used in hotel, restaurants and retails stores

•In casinos (watch video , games,

navigation, ..etc)

•Digital image painting Advantages

Wireless communication

Time saving

New and improved learning

experience

Disadvantages

Not portable

Very Expansive

Surface commuting systemsMicrosoft pixelsense

CONCLUSION

Next Generation user interfaces are focused on real world

objects

The future electronic gadgets will be working on the above

discussed concepts

Many of these technologies are implemented now and some

of them are in developing stage

The trend changes in Electronics and IT will make effect

on future user interfaces also

REFERENCES1. www.hongkiat.com/blog/next-gen-user-interface

2. www.hongkiat.com/blog/cool-futuristicconcept-gadgets-that-really-

inspires

3. en.wikipedia.org/wiki/Gesture_recognition

4. www.ted.com/talks/john_underkoffler_drive_3d_data_with_a_gesture

5. www.ted.com/talks/

pranav_mistry_the_thrilling_potential_of_sixthsense_technology

6. en.wikipedia.org/wiki/Voice_user_interface

7. mashable.com/category/augmented-reality

8. www.google.com/glass/start

TED talks References

John Underkoffler Pranav Mistry Tomi Ahonen(Gestures interfaces) (Sixth sense technology) (Augmented

reality)

TED is a global set of conferences owned by the private non-profit Sapling

Foundation

( www.ted.com )

Thank you