The Last Stop before Autonomous...

The Last Stop before Autonomous Navigation:

Augmented Reality using Microsoft HoloLens

bySamuel R. Pecota

eNavigation Underway North America 2017

The coming extinction of the merchant mariner

eNavigation Underway North America 2017

• Merchant sailors have been plying the oceans for over 3000 years

• The job wasn’t all that romantic though

• The work was, and still is, generally hard, dirty, and dangerous

• Autonomous cargo vessels of the future

• Rolls Royce• Kongsberg

But perhaps for not much longer…

eNavigation Underway North America 2017

• People will still be going to sea, but only for fun

• Not for the purpose of moving cargo from Point A to Point B

Unless you are a paying passenger of course…

eNavigation Underway North America 2017

• Which could still be set up for autonomous navigation too!

…or you have your own boat

eNavigation Underway North America 2017

• On the surface, underwater and in the air

The world’s navies are also going autonomous

eNavigation Underway North America 2017

• No one can say how long it will last…

• Or exactly what problems will need to be overcome

But there will be a transition period

eNavigation Underway North America 2017

• Super VTS• Direct, daily

fleet operational control

• A human always still on duty

Remotely controlled vessels may be a first step toward full autonomy

eNavigation Underway North America 2017

• Wire splicing?• Knot tying?• Line handling?• Sight reduction?

• All becoming obsolete skills

What does this mean for the future of Maritime Education and Training (MET)?

eNavigation Underway North America 2017

• Modern merchant bridge

• Modern warship bridge

Evolution not Revolution

eNavigation Underway North America 2017

• eNavigation lecture 2010

• Docking in Honolulu

MET is not accomplished overnight

eNavigation Underway North America 2017

• Paper chart navigation• ECDIS and radar

navigation• What is next?

One way might be to simplify the navigational task

eNavigation Underway North America 2017

• Cosco Busan (2007)• USS Fitzgerald (2017)

Navigational skills are in a state of slow decline

eNavigation Underway North America 2017

• Better electronics perhaps?

• Immersion without distraction

• Eyes out the window!

What can be done to fix this problem?

eNavigation Underway North America 2017

Microsoft HoloLens

eNavigation Underway North America 2016

• First announced Jan 2015

• We turned it into a navigational tool

HUD Holo (Oct 2016)

eNavigation Underway North America 2016

HoloLens HUD for Maritime (2017)

eNavigation Underway North America 2017

• Eyes out the window!

• Easy to learn and use

• Immediate and constant position information

• Enhanced situational awareness

Advantages of HoloLens HUD

eNavigation Underway North America 2017

• ECDIS interface• Display AIS targets in

proper location and orientation

• Provide collision avoidance advice

• Direct communication with autonomous vessels

More advantages (still to be developed)

eNavigation Underway North America 2017

Come to starboardyou idiot human!

I told himbut he’s notlistening!

• Full autonomy is the end game

• How we get there safely is critical

• HoloLens for HUD Maritime could help

Conclusion

eNavigation Underway North America 2017

Thank you!

eNavigation Underway North America 2017

eNavigation Underway North America 2017