Vision and Image Sensors, systems & applications for Smart ... ?· Image and vision sensors, systems…

  • Published on
    28-Jul-2018

  • View
    212

  • Download
    0

Embed Size (px)

Transcript

  • Image and vision sensors, systems & applications for Smart Cities

    Thierry Ligozat

    Chief Innovation Officer, Professional Imaging

    Teledyne e2v

    APAC Innovation Summit

    8th September 2017

    Page 1

  • Teledyne e2v AnaFocus at a glance

    Vision system

    Overview of image sensor technology

    Example of applications

    Page 2

    Outline

  • 1600

    employees

    1. Teledyne e2v - at a glance

    NINE

    engineering and manufacturing locations globally

    VALUES

    customer focus, innovation and excellence throughout, with agility, courage and integrity

    500+

    engineers and scientists

    Page 3

  • Professional Imaging

    Imaging

    + CCD & CMOS sensors, focal plane arrays, cameras & sub-systems

    RF Power

    + Electron devices and sub-systems generating, amplifying & precision controlling RF power

    Semiconductors

    + Hi-rel semiconductors for space, aerospace, defence & industrial applications

    Page 4

  • 1. Professional Imaging appl icat ions

    Healthcare

    Drug discovery

    Life science

    X-ray radiography

    Ophthalmology

    Pathology diagnostics

    Automation

    Optical inspection

    Food sorting

    Machine vision

    Factory automation

    Barcode reading

    Safety

    Low light surveillance

    Night vision

    Bad weather conditions

    Traffic surveillance

    Page 5

  • 2. Sensors & systems in Smart Cit ies

    Page 6

    Instrumented, Interconnected, and Intelligent

    Smart cities involve the use of sensors and systems to generate data that can be analysed to provide services.

  • What is a vision system?

    A vision system is composed of a camera with an optic, a sensor, electronic control, and processing.

    The lighting could also be an important part of the vision system.

    Page 7

  • 4. What are image & vision sensors?

    Pixel matrix

    CDS/PGAOne ADC per column

    Shift register or memory

    Digital

    output

    Lin

    e d

    eco

    der

    Dig

    ital

    tim

    ing

    , p

    roce

    ssin

    g

    Page 8

    Colo

    rF

    ilter

    Pixel

    Array

    Analog

    Signal

    chain

    Control

    Digital

    Signal

    ProcessorA/D

    Op

    tics

    Amplification

    Zoom

    Windowing

    Frame rate

    Digital

    Output

    Color processing

    Image enhancement

    Data compression

    101100..

    Light

    Data

    Technology and design: silicon die and package

  • CMOS Image sensor technologyPixel sensitivity

    Our imaging solutions operate across the spectrum coveringfrom near infrared, visible, ultraviolet, and X-rays

    Direct

    detection

    Indirect

    detection

    Teledyne e2v CMOS capability

    Page 9

  • CMOS image sensor technology

    The direct sensing capabilities of CMOS go beyond Visible from UV to Near Infrared (NIR) for night vision or medicalapplications.

    Multispectral or Hyperspectral capability is possible using specific filters for sorting or agriculture applications.

    CMOS technology is widely used and CMOS image sensor Integration is easier compared to other technologies.

    0%

    10%

    20%

    30%

    40%

    50%

    60%

    70%

    80%

    90%

    400 600 800 1000

    QE EV76C660 (%)

    QE EV76C560 (%)

    Wavelength(nm)

    CMOS Front Side Quantum EfficiencyNight Sky PhotonicRadiance

    CMOS technology is based on silicon material

    Page 10

  • 5. Image sensor technologyCMOS sensors: design and features

    Page 11

    Speed enables : capture objects in motion, freeze an image for further analysis

    Sensitivity enables :

    Low light vision, day/night mode, High Dynamic Range

    Resolution enables :

    Field of view and details

  • 5. Image sensor technologyCMOS sensors: design and features

    Page 12

    3D visions advantages : Add depth data, avoid false detection, improve robustness

    Multi spectral :

    spectral filters added for identification, sorting, or health monitoring

    Advanced processing on chip. Can eliminate the need for separate analysis, processing, and storage

  • Page 13

    CMOS sensors technology enables smart sensors

    Imaging Roadmap

    2D/3D Vision

    Multi Spectral

    Smart Sensor

    Resolution

    Sensitivity

    Vis/NIR

    Speed: pixel and readout

    Pixel matrix

    CDS/PGAOne ADC per column

    Shift register or memory

    Digital

    outputs

    Lin

    e d

    eco

    der

    Dig

    ital

    tim

    ing,

    pro

    cess

    ing

    Image sensor technology

    Almost all these features can be combined in a CMOS Sensor.

  • Services in a

    Smart City

    Data flow

    Page 14

    Services in a Smart City

    *Transportation services

    *Emergency services

    *etc

    Platform for service

    allocation

    Data storage & analysis

    Data transmission

    Data collection

    Smart sensors

    6. Focus on smart sensors

  • Services in a

    Smart City

    Data flow

    Eye-RIS

    6. Focus on smart sensors

    176 x 144 resolution with 6m pixel

    Fully-programmable sensor with an ALTERA 32bit microprocessor

    Autonomous vision system capable of acquiring and processing images, and support decision-making

    Applications

    Event and movement detection, counting people etc.

    Home surveillance, elderly care (privacypreserved no image transfer)

    Page 15

  • 7. Examples of applications

    Page 16

  • Example 1: Smart public l ighting

    Goals:

    Manage the power of public lighting in real time

    Adapt LED power when a pedestrian is detected

    Avoid false detection (moth, spider web etc.)

    Functional in all weather conditions (fog, rain, snow)

    Other possible add-ons: smart parking, security

    Application

    Page 17

  • Example 1: Smart public l ighting

    Technology:

    Low light and NIR sensitivity for night vision: thick susbtrate

    Movement detection by processing at sensor or system level

    3D vision - Range gating to improve robustness (all weather, no false detection)

    Technology: thick substrate and range gating

    Test conditions using ProxOnyx 1.3MP

    Laser power=4W, divergence=10, full range=600m, Ti=40ms, Gating

    =100KHz,PHFOV=14

    Control

    Camera

    Light

    @T0

    @T1

    t

    @T2

    @T3 = T0 + 2t

    @T0

    @T1

    t

    @T2

    @T3 = T0 + 2tGlobal shutter

    Pulsed light

    Page 18

  • Example 2: Intel l igent Traff ic System

    Applications

    Traffic control

    Automatic Number Plate Recognition

    Speed cameras

    Roadside worker safety cameras

    Needs

    See several roads: Large Field of View

    Image of moving object: image with no distortion

    Sunny day and night capabilities: High Dynamic

    Traffic and transportation are increasingly assisted by Intelligent Traffic Systems (ITS)

    Page 19

  • Example 2: Intel l igent Traff ic System

    Global shutter pixel: no distorsion for identification

    High resolution and Region of Interest

    Pixel Technology : global shutter, resolution, High Dynamic Range (HDR), Region of Interest (RoI)

    High Dynamic Range mode: 70dB -> 100 to 120dB

    Example of sensors for ITS: Emerald

    8M, 12M, 16Mpixels

    2.8m pixel with global shutter

    Page 20

  • Example 3: Robotics and safety

    Page 21

    Time of Flight (ToF) Technology

    Application and requirements:

    Area monitoring for industrial safety

    Measure distance and angular position of objects in regard to the hazardous area (example of a robot)

    Parameters monitored in real time with a very high level of confidence in any ambient conditions: 3D information is required

  • 3D sensors: Time of Flight

    Measuring the delay between the emitted pulse and the received one, you can calculate the distance to the object

    In ToF sensors

    Page 22

  • Example of Advanced Driver Assistance Systems based on ToF

    Driving assistance and autonomous cars

    Page 23

  • Example 4: Transport safety

    Page 24

    Train inspection system

    Quality inspections: detect worn or broken parts

    Inspection in motion

    High speed and high resolution required

  • Laser Triangulation technology

    Laser triangulation system:

    Laser line projector

    High speed camera with an angle

    Peak intensity acquisition of line modified by the object shape

    3D reconstruction

    For train inspection system

    Page 25

  • Example 5: Medical appl icat ion - OCT

    Optical Coherence Tomography (OCT) for Ophthalmology

    OCT is a non-invasive imaging test which uses light waves to take cross-section pictures of your retina

    With OCT, ophthalmologist provide treatment guidance for glaucomaand diseases of the retina. These retinal diseases include age-related macula degeneration (AMD) and diabetic eye disease

    The vision system needs:

    A high speed acquisition to avoid eye movement

    To see in depth of the retina using Near Infrared wavelength

    Page 26

    The analysis only takes a few minutes.

    Systems for hospitals

  • Example 5: Medical appl icat ion-OCT

    The vision system is composed of:

    An infrared light source to see in-depth

    An optical system

    A high speed line scan camera

    Processing

    Systems for hospitals - technology

    Page 27The same type of technology is developed for skin cancer

    diagnosis.

  • Conclusions

    Smart cities involve the use of sensors whether stand alone or added to physical devices called systems

    Image and vision sensors enable the collection of visual data and smart sensors can help interpret data and make decisions

    CMOS Image sensors have high performances and provide features like high resolution, high speed, low noise, 2D/3D data, spectral data, and more.

    We have seen how the technology is used in some examples of applications for Smart Cities like

    Smart public lighting

    Intelligent Traffic System

    Industrial safety

    Transport safety

    Medical applications

    Page 28

  • Thank you

    Page 29

Recommended

View more >