Laser World of Photonics, Munich 29 June 2017 Photonics ...respice-sme.eu/fileadmin/cms/downloads/EPIC_Presentation_Photonics... · Laser World of Photonics, Munich 29 June 2017 Photonics

Jose Pozo Director of Technology and Innovation

EPIC [email protected]

Mobile: +31 626978312

Laser World of Photonics, Munich 29 June 2017

Photonics for the Automotive Industry: focus on ADAS

EPIC European Photonics Industry Consortium

EPIC is the industry association that promotes the sustainable

development of organisations working in the field of photonics

in Europe. EPIC fosters a vibrant photonics ecosystem by

maintaining a strong network of 260+ members and acting as

a catalyst and facilitator for technological and commercial

advancement. EPIC publishes market and technology

reports, organizes technology workshops and B2B

roundtables, coordinates EU funding proposals, advocacy

and lobbying, education and training activities, standards

and roadmaps, pavilions at exhibitions.

www.epic-assoc.com

Our members and activities encompass the entire value chain from:

• Biophotonics

• Displays

• Imaging

• Lasers (for industrial, military, medical applications)

• LED, OLED, and Smart Lighting

• Optic fiber

• Optical components

• Photonic Integrated Circuits: III-V, Silicon Photonics, and TriPleX

• Projectors

• PV solar energy including CPV and OPV, and Batteries

• Sensors (for automotive, defense, medical, … applications)

• and all other photonic related technologies

http://www.epic-assoc.com/







EPIC members have free access to professional technology and market reports

199 SLIDES

Helping EPIC

members

analyse new

markets!

20-30 events per year but….

We are not an event organizer We build knowledge, value and supply

chains

Upcoming events

The trend toward innovation is a huge opportunity for the

Photonics industry. It allowed and will continue to allow new

photonic technology to enter the car.

Evolution of Photonics in Automotive

2005

2010

2020

Entertainment

Comfort

Security

Transmitter for MOST

networks, Hamamatsu

LIDAR, Velodyne

LEDs for ambient

interior lighting, Hella

Technologies: MOST (Media Oriented System

Transport), LCD display for passengers

Technologies: Basic optical components

(photodiodes, thermopiles),

LEDs for interior lighting

Technologies: LIDARs, stereovision camera

systems, Head-up Displays, LEDs

headlamps, laser headlamps, …

Automation vs driver

Currently connectivity and autonomous driving are optional

features in automotive but safety is not

Architecture of Systems for ADAS

Observation Perception Planning &

Decision Action

Information provided by external

source

Simulation and

data processing

Control Unit /

Intelligence

Actuators

Communication systems

Outside:

Radar, LIDAR,

Cameras, Ultrasounds

Inside:

Cameras, Speed

monitoring systems

Data collection and

analysis

Scene description: ego

positioning, objects

trajectory, lane

boundaries, …

Trajectory planning

Emergency brake assist

Emergency steering

assist

Active: Brake, motor,

steering gear

Passive: Airbags,

headlamps

Warnings : sound,

light alarm, displays

Li-Fi, Wi-Fi, Radio-

wave, Micro-wave

Sensors

In red: where Photonics can provide

performant functions and technologies

Road infrastructure,

other vehicles, …

Ca

r

Technology description System composed of an image sensor, packaging and software. Used for imaging applications.

Cameras for ADAS - Synthesis

10

Main sensors providers

Applications in ADAS

Current

• Parking assistance, Lane Keeping Assist, Blind Spot Detection, Traffic Sign Recognition,

Adaptive Cruise Control, Automatic Emergency Braking

Future

• 360° mapping of the car surroundings in 3D

Camera for Lane Keeping Assist, Valeo

Advantages

- Very low cost safety system

- Highly compact

- Easy hardware implementation

Limitations

- Low performance in bad weather conditions and at night

- Requires complex software

Stereovision camera system, Bosch

Photonics, an enabler of ADAS > Current and future photonic technologies > Imaging & sensing outside the car

11

Future camera detectors in cars

Reducing size of components while keeping great accuracy and fast processing are major requirements of automotive manufacturers

Integrating the image processing core directly with the sensor is a promising solution

Example:

The Fraunhofer Institute for Reliability and Microintegration IZM and CogniVue co-developed a microcamera module

CogniVue is a Canadian company that provide a new kind of image processing core for embedded vision, the APEX Image Cognition Processor (ICP)

Combining this technology with the assembly and

interconnection skills of the Fraunhofer IZM allowed the

release a reduced size camera of 1,2 cm3 (without the

optics) offering fast and reliable image processing.

First applications in automotive is Traffic Sign Recognition

but algorithm are under development to allow Lane

Keeping Assist or pedestrian and animals detection. The

camera could also be used for driver drowsiness monitoring Cross-section of the microcamera

(source: Fraunhofer IZM)


12

Future camera systems in cars – Multiple camera systems

On the way toward automated driving, mapping in 3D the complete surrounding of the vehicle will be necessary

One way of achieving this goal is to use several camera systems (generally stereovision) to monitor the environment of the car in real-time and in 3D

Example:

The Italian laboratory VisLab (Artificial Vision and Intelligent Systems Laboratory) in Parma has developed several driverless vehicles prototypes over the last 15 years.

Most of their autonomous driving systems are a combination of several sensors (LIDArs, RADARs, cameras, …)

• In 2010, they ran a real conditions test from Parma to

Shangaï with a system based on 4 laser scanners, 4

stereovision systems, a large field-of-view camera and

a GPS

Their latest goal is to provide a system mainly based

on cameras to replace expensive 3D mapping LIDARs

• The Deeva prototype vehicle holds around 20 cameras

and 4 laser scanners and looks like a normal vehicle Deeva, the new autonomous vehicle of VisLab


13

Main Players

Detector Tier One Suppliers OEMs


Technology description LIDAR (Light Detection and Ranging) uses light to detect objects and measure distances.

LIDARs for ADAS - Synthesis

14

Main LIDAR Players


Current

• Adaptive Cruise Control

• Forward collision avoidance and warning

Future

• 360° mapping of the car’s surrounding for autonomous driving

Small size 3D mapping LIDAR, Velodyne Advantages

- High resolution and field of view

- High measurement range

Limitations

- Poor performance in bad weather conditions

- High cost of 360° mapping systems


Principle of LIDARs

A pulsed laser beam illuminates an object to detect

The light backscattered by the object is then collected and sent onto a photodetector

The distance to the object is deduced from the measurement of the time between the pulse emission and the reception of the reflected pulse

By using mirrors or prisms, the laser scans the environment in 2D over a certain field of view (FOV), it is then possible to obtain a depth map

15

LIDAR - Presentation

Laser

Object to

detect

Backscattered

light

Photodetecto

r Reception

optics

Signal

processing

Emission

Reception

For applications in automotive,

there are 2 types of LIDAR:

The ‘‘laser range finder’’

type: object detection in

front of the car

The ‘‘3D mapping’’ type:

360° scanning of the

environment of the car in

3D

Operating principle of a LIDAR


Comparison with RADAR sensors:

16

Competing technology of LIDARs

Laser RADAR from Denso

Short range LIDAR from

Continental

LIDAR RADAR (long range)

905 nm (eye-safe) Operating band 77 GHz

+ Speed, distance,

angle, object width

Measured parameters Speed, distance

Up to 200 m Detection range Up to 200 m

Relative speed range - 100 km/h…+250 km/h

+ Resolution

+ (~30-40° horizontal)

Field of view (~10-20° horizontal)

Bad weather condition ++

Low reflectance objects (dirt vehicle, pedestrians,…)

+

+ (400 – 600 €)

Sub-system cost (800 – 2 000 €)

The main drawback that limits the adoption of LIDAR in cars is its poor

performance in bad weather conditions (rain, fog, snow, …)


Velodyne (USA)

Started LIDAR activity in 2005

1st product based on 64 lasers and a

spinning head to provide 360° FOV

Integrated on the roof-top of the self-

driving car of Google in 2012

Latest product from Velodyne is based

on 16 lasers, holds in a hand and cost

less than 10 000 €

17

Future LIDAR in cars – Early players of 3D mapping LIDAR

Ibeo Automotive Systems (Germany)

Founded in 2010 (product

development started in 2007)

Partnership with Valeo since 2010 for

co-development

Ibeo LIDAR product offer:

• Sensor fusion: up to 6 LIDARs can be

combined to enable 360° sensing with

special algorithm for data

synchronization

• Object tracking: based on contour

matching, for better object recognition

Ibeo Lux, Ibeo

Velodyne’s LIDAR on top of the Google Car


18

Future LIDAR systems in cars – Flash LIDAR cameras

In 3D mapping LIDAR, one of the major technical challenge lies in the

mechanical scanning that is necessary to provide 360° information

A way of increasing reliability and robustness – and reducing maintenance

requirements - of LIDAR would be to remove scanning : it is what flash LIDAR

cameras do

Flash LIDAR cameras are a type of time-of-flight (TOF) cameras for long range

3D imaging

Flash LIDAR cameras look like a 2D digital camera but have the additional

ability of providing depth information


Comparison of 3D imaging methods principle

Source: Vision Systems

Adoption of LIDAR will remain below 1% until 2020

The adoption of laser range finder will be faster than laser 3D mapping thanks to a lower cost but will remain low because of high competition with RADAR

Cost of 3D mapping LIDAR is dramatically decreasing but their wide adoption should happen after 2025 when complex autonomous driving in city will begin to be implemented into cars

19

Cost and Adoption Rate of LIDAR over Years

1

10

100

1000

10000

100000

0,00%

0,10%

0,20%

0,30%

0,40%

0,50%

0,60%

2013 2014 2015 2016 2017 2018 2019 2020

ASP

(€

)

Ad

op

tio

n r

ate

LIDAR adoption rate and cost over year

LIDAR 3D mapping

LIDAR range finder

Laser range finder ASP

Laser 3D mapping ASP


©

20

Main players of LIDARs in Automotive

LIDAR

manufacturers Tier One Suppliers OEMs

LIDAR range finder

3D mapping LIDAR


Technology description Camera systems using infrared wavelengths to image at night.

Night Vision - Synthesis

21

Main Technology Players


Improving night driving safety:

• Detect animals, pedestrians or other objects on the road

• Warn the driver about potential collisions

Detection of pedestrians thanks to night vision Source: thecarexpert.co.uk

Advantages

- Good imaging resolution

- Good measurement range

Limitations

- Expensive

- Poor performance in bad weather conditions


22

Future systems for night vision in cars

Emerging product: Fusion of active and passive systems

Principle:

• Both an NIR imaging system and a thermal imaging system are integrated into the car

• The NIR system provides high resolution images displayed on an in-dash display

• The FIR system, that has a lower resolution, provides reliable detection and identification of objects on the road through thermal signatures

Future technology : competition with LIDAR 3D mapping

With the development of automated driving, LIDAR for 3D mapping of the car environment

are expected to be widely adopted for day and night driving

Combination of NIR and FIR imaging to enhance night vision

(source: ADOSE FP7 project)

Advantages

- Increased detection sensitivity and range compared to NIR imaging

- Increased resolution compared to FIR imaging

Limitations - Increased complexity

of data processing due to NIR and FIR data fusion

- Very expensive


23

Current IR detectors in cars - Comparison

Parameters CCD – CMOS

(Active IR imaging)

Microbolometers

(Passive IR imaging)

Wavelength 800-900 nm 7.5 - 14 µm (7 500 - 14 000 nm)

Detection range up to 100 m up to 400 m

Resolution Higher Lower

Sensor size Smaller Larger

Limitations for

applications in automotive

Poor performance in adverse

conditions

Dazzled by opposing vehicle’s

headlamps

Poor performance in adverse

conditions

Do not work behind windshield and so

are exposed to dirt, dust, humidity,

heat

Advantages for

applications in automotive

Lower cost

High resolution

High detection distance range


24

Main Players

Camera Tier One Suppliers Automakers

Active IR imaging

Passive IR imaging

Aftermarkets

Stopped option

in 2014

Other chineese

companies Chineese

companies

Valeo and Sagem signed a partnership in 2010 for the co-development of camera

systems for night vision and bad weather conditions driving in military and civil

automotive applications

Active + passive


Technology description Advanced headlamps that adapt mechanically or electronically the light beam to the driving situation. Situation information are provided by sensors.

Adaptive Frontlighting - Synthesis

25



Adapt the shape of the headlamp beam to the situation:

• Town or highway

• Straight or bended road

• Wet or dry roads

• Presence or absence of other vehicles

Audi matrix LED adaptive front lighting Source: automoto.ba ; autoevolution.com

Advantages

- Improve visibility at night

- Detect potential danger earlier

Limitations

- More expensive and bulky than classic headlamps

- Can be disturbing for the driver

Photonics, an enabler of ADAS > Current and future photonic technologies > Lighting in ADAS

26

Illustration of the principle of LED matrices

Parameters to monitor:

Speed

Outside brightness

Presence of other

vehicles by detecting

head or rear lights

Distance to other vehicles

Opel LED matrix headlamps


27

Lighting

components Tier One Suppliers Automakers

AFS based on HID

LED Matrices


Main players

Technology description Systems using light sources and optical receiver to transmit information.

Optical communication for ADAS - Synthesis

28



Current:

• Vehicle-to-infrastructure communication for electronic toll payment and

parking access control

Future

• Vehicle-to-infrastructure and vehicle-to-vehicle communication to share

traffic and safety data

Principle of car-to-X communication, Mercedes-

Benz

Image

Advantages

- High speed

- Secure network as data are directed from one device to another (difficult to hack)

Limitations

- More expensive than Wi-Fi

- Can be impaired by obstacles on the optical path

Photonics, an enabler of ADAS > Current and future photonic technologies > Communication

Visible Light Communication

Applications of car-to-car or of car-to-infrastructure communication include:

Cooperative Adaptive Cruise Control

Cooperative Forward Collision Warning

Intersection collision avoidance

Approaching emergency vehicle warning (Blue Waves)

Transit or emergency vehicle signal priority

Electronic parking payments

Rollover warning

Highway-rail intersection warning

Electronic toll collection

In the first place, the system would only alert the driver with a warning sound or light, but future developments will allow braking automatically, adapting speed or changing the direction of the car.

Technology description Human-machine interface allowing the display of driving information directly in the line of sight of the driver.

Head-Up Display - Synthesis

30

Examples of Players


Current

• Display basic information: vehicle’s speed, fuel level, directions

Future

• Display critical safety information provided by ADAS sensors

Head-Up Display, Bosch Advantages

- Driver’s eyes remain on the road

- Reduce driver’s fatigue

- Enhance driving in low visibility conditions

Limitations

- Bulky system

- Brightness performance are not always good enough

Photonics, an enabler of ADAS > Current and future photonic technologies > Head-up Displays

More and more photonic technologies are going to be adopted for a wide range of

ADAS functions in the car.

In 2020, we can imagine a driver assistance package based only on photonic

technologies:

31

Cost of a Photonic driver assistance package in 2020

3D mapping

LIDAR

13 cameras (4 stereovision

systems to back-up LIDAR, 1

camera for TSR and LKA, 1 for

driver monitoring, 3 for

passenger monitoring)

Head-up display Adaptive front-lighting

system

Basic sensors (photodiodes for rain

and luminosity

detection)

600 € 130 € < 10’s € 160 € 100 €

2020 total ADAS Photonics package cost:

~1 000€

Option price : ~ 4 - 5 000€

i.e. ~10-15% of the car’s cost Source: Tematys

Photonics, an enabler of ADAS > Conclusion

320 members as of 29 June 2017

Documents

Laser World of Photonics, Munich 29 June 2017 Photonics ...respice-sme.eu/fileadmin/cms/downloads/EPIC_Presentation_Photonics... · Laser World of Photonics, Munich 29 June 2017 Photonics