Embed Size (px)
Citation preview
Image and vision sensors, systems & applications for Smart Cities
Thierry Ligozat
Chief Innovation Officer, Professional Imaging
Teledyne e2v
APAC Innovation Summit
8th September 2017
Page 1
Teledyne e2v – AnaFocus at a glance
Vision system
Overview of image sensor technology
Example of applications
Page 2
Outline
1600
employees
1. Teledyne e2v - at a glance
NINE
engineering and manufacturing locations globally
VALUES
customer focus, innovation and excellence throughout, with agility, courage and integrity
500+
engineers and scientists
Page 3
Professional Imaging
Imaging
+ CCD & CMOS sensors, focal plane arrays, cameras & sub-systems
RF Power
+ Electron devices and sub-systems generating, amplifying & precision controlling RF power
Semiconductors
+ Hi-rel semiconductors for space, aerospace, defence & industrial applications
Page 4
1. Professional Imaging appl icat ions
Healthcare
Drug discovery
Life science
X-ray radiography
Ophthalmology
Pathology diagnostics
Automation
Optical inspection
Food sorting
Machine vision
Factory automation
Barcode reading
Safety
Low light surveillance
Night vision
Bad weather conditions
Traffic surveillance
Page 5
2. Sensors & systems in Smart Cit ies
Page 6
“Instrumented, Interconnected, and Intelligent”
Smart cities involve the use of sensors and systems to generate data that can be analysed to provide services.
What is a vision system?
A vision system is composed of a camera with an optic, a sensor, electronic control, and processing.
The lighting could also be an important part of the vision system.
Page 7
4. What are image & vision sensors?
Pixel matrix
CDS/PGAOne ADC per column
Shift register or memory
Digital
output
Lin
e d
eco
der
Dig
ital
tim
ing
, p
roce
ssin
g
Page 8
Colo
rF
ilter
Pixel
Array
Analog
Signal
chain
Control
Digital
Signal
ProcessorA/D
Op
tics
Amplification
Zoom
Windowing
Frame rate
Digital
Output
Color processing
Image enhancement
Data compression
101100..
Light
Data
Technology and design: silicon die and package
CMOS Image sensor technologyPixel sensitivity
Our imaging solutions operate across the spectrum coveringfrom near infrared, visible, ultraviolet, and X-rays
Direct
detection
Indirect
detection
Teledyne e2v CMOS capability
Page 9
CMOS image sensor technology
• The direct sensing capabilities of CMOS go beyond Visible from UV to Near Infrared (NIR) for night vision or medicalapplications.
• Multispectral or Hyperspectral capability is possible using specific filters for sorting or agriculture applications.
• CMOS technology is widely used and CMOS image sensor Integration is easier compared to other technologies.
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
400 600 800 1000
QE EV76C660 (%)
QE EV76C560 (%)
Wavelength(nm)
CMOS Front Side Quantum EfficiencyNight Sky PhotonicRadiance
CMOS technology is based on silicon material
Page 10
5. Image sensor technologyCMOS sensors: design and features
Page 11
Speed enables : capture objects in motion, freeze an image for further analysis
Sensitivity enables :
Low light vision, day/night mode, High Dynamic Range
Resolution enables :
Field of view and details
5. Image sensor technologyCMOS sensors: design and features
Page 12
3D visions advantages : Add depth data, avoid false detection, improve robustness
Multi spectral :
spectral filters added for identification, sorting, or health monitoring
Advanced processing on chip. Can eliminate the need for separate analysis, processing, and storage
Page 13
CMOS sensors technology enables smart sensors
Imaging Roadmap
2D/3D Vision
Multi Spectral
Smart Sensor
Resolution
Sensitivity
Vis/NIR
Speed: pixel and readout
Pixel matrix
CDS/PGAOne ADC per column
Shift register or memory
Digital
outputs
Lin
e d
eco
der
Dig
ital
tim
ing,
pro
cess
ing
Image sensor technology
Almost all these features can be combined in a CMOS Sensor.
Services in a
Smart City
Data flow
Page 14
Services in a Smart City
*Transportation services
*Emergency services
*etc…
Platform for service
allocation
Data storage & analysis
Data transmission
Data collection
Smart sensors
6. Focus on smart sensors
Services in a
Smart City
Data flow
Eye-RIS™
6. Focus on smart sensors
• 176 x 144 resolution with 6µm pixel
• Fully-programmable sensor with an ALTERA 32bit microprocessor
• Autonomous vision system capable of acquiring and processing images, and support decision-making
Applications
• Event and movement detection, counting people etc.
• Home surveillance, elderly care (privacypreserved – no image transfer)
Page 15
7. Examples of applications
Page 16
Example 1: Smart public l ighting
Goals:
• Manage the power of public lighting in real time
• Adapt LED power when a pedestrian is detected
• Avoid false detection (moth, spider web etc.)
• Functional in all weather conditions (fog, rain, snow)
Other possible add-ons: smart parking, security
Application
Page 17
Example 1: Smart public l ighting
Technology:
• Low light and NIR sensitivity for night vision: thick susbtrate
• Movement detection by processing at sensor or system level
• 3D vision - Range gating to improve robustness (all weather, no false detection)
Technology: thick substrate and range gating
Test conditions using ProxOnyx 1.3MP
Laser power=4W, divergence=10°, full range=600m, Ti=40ms, Gating
=100KHz,PHFOV=14°
Control
Camera
Light
@T0
@T1
Δt
@T2
@T3 = T0 + 2t
@T0
@T1
Δt
@T2
@T3 = T0 + 2tGlobal shutter
Pulsed light
Page 18
Example 2: Intel l igent Traff ic System
Applications
Traffic control
Automatic Number Plate Recognition
Speed cameras
Roadside worker safety cameras
Needs
See several roads: Large Field of View
Image of moving object: image with no distortion
Sunny day and night capabilities: High Dynamic
Traffic and transportation are increasingly assisted by Intelligent Traffic Systems (ITS)
Page 19
Example 2: Intel l igent Traff ic System
Global shutter pixel: no distorsion for identification
High resolution and Region of Interest
Pixel Technology : global shutter, resolution, High Dynamic Range (HDR), Region of Interest (RoI)
High Dynamic Range mode: 70dB -> 100 to 120dB
Example of sensors for ITS: Emerald
• 8M, 12M, 16Mpixels
• 2.8µm pixel with global shutter
Page 20
Example 3: Robotics and safety
Page 21
Time of Flight (ToF) Technology
Application and requirements:
• Area monitoring for industrial safety
• Measure distance and angular position of objects in regard to the hazardous area (example of a robot)
• Parameters monitored in real time with a very high level of confidence in any ambient conditions: 3D information is required
3D sensors: Time of Flight
• Measuring the delay between the emitted pulse and the received one, you can calculate the distance to the object
In ToF sensors
Page 22
Example of Advanced Driver Assistance Systems based on ToF
Driving assistance and autonomous cars
Page 23
Example 4: Transport safety
Page 24
Train inspection system
• Quality inspections: detect worn or broken parts
• Inspection in motion
• High speed and high resolution required
Laser Triangulation technology
Laser triangulation system:
• Laser line projector
• High speed camera with an angle
• Peak intensity acquisition of line modified by the object shape
• 3D reconstruction
For train inspection system
Page 25
Example 5: Medical appl icat ion - OCT
Optical Coherence Tomography (OCT) for Ophthalmology
• OCT is a non-invasive imaging test which uses light waves to take cross-section pictures of your retina
• With OCT, ophthalmologist provide treatment guidance for glaucomaand diseases of the retina. These retinal diseases include age-related macula degeneration (AMD) and diabetic eye disease
The vision system needs:
• A high speed acquisition to avoid eye movement
• To see in depth of the retina using Near Infrared wavelength
Page 26
The analysis only takes a few minutes.
Systems for hospitals
Example 5: Medical appl icat ion-OCT
The vision system is composed of:
• An infrared light source to see in-depth
• An optical system
• A high speed line scan camera
• Processing
Systems for hospitals - technology
Page 27The same type of technology is developed for skin cancer
diagnosis.
Conclusions
• Smart cities involve the use of sensors – whether stand alone or added to physical devices called systems
• Image and vision sensors enable the collection of visual data and smart sensors can help interpret data and make decisions
• CMOS Image sensors have high performances and provide features like high resolution, high speed, low noise, 2D/3D data, spectral data, and more.
• We have seen how the technology is used in some examples of applications for Smart Cities like
• Smart public lighting
• Intelligent Traffic System
• Industrial safety
• Transport safety
• Medical applications
Page 28
Thank you
Page 29
