1

HMI 2015 – Forum Industrial Automation

Vision Sensor APS3D Für das nächste Qualitätslevel der

hochgenauen 3D Fertigungsautomatisierung

Tolga Sarraf Sales Manager 3D Machine Vision

tsarraf@isravision.com

2

ISRA VISION – Short Overview

INDUSTRIAL AUTOMATION SURFACE INSPECTION

The global market and technology leader in MACHINE VISION Customized systems, innovative production solutions and software intelligence for…

3

Continuous growth and stable financials 30 years of experience in Industrial Automation and Surface Inspection

Established 1985 Legal form AG, public company Sales (13/14) 102,5 mill. € R&D – Invest 16 mill. € p.a. Equity 57%

Employees > 600 (> 100 R&D)

ISRA VISION – Short Overview

4

Herten, GER

Shanghai, CN Atlanta, USA

Aachen, GER

Germany Darmstadt (HQ) – Aachen – Berlin – Bielefeld – Erlangen – Herten – Karlsruhe – Mainz USA Atlanta – Detroit China Shanghai – Tianjin Korea Seoul Japan Tokyo Russia Moscow Taiwan Taiyuan India Mumbai – Calcutta Brazil Sao Paulo Turkey Istanbul UK Hampshire - London Finland Helsinki France Paris Italy Rovereto Spain Barcelona

LOCATIONS

Berlin, GER

25 offices worldwide - Close to the customer

ISRA VISION: a globalized company

5

Market strategy ISRA VISION focuses on high level applications & generic products

Components (e.g. cameras) Basic hardware and software modules

Application- specific

standard products

Generic standard products

Sensor products

End Users

Key Account Management

Sales

Distribution

Sales OEMs Integrators Line Builders

6

Contour Matching MONO21/2D

Photogrammetry MONO3D

Shape Matching SHAPEMATCH3D

Stereo Vision and 3D Point Cloud

SHAPESCAN3D

… for 3D Robot Guidance

What’s coming next ?

Plug & Automate 3D Machine Vision Product Line

7

Double View Shape Matching for Gap & Flush on-the-fly

GFS3D

GGS3D High Accuracy Shape Matching stationary

SGS3D High accuracy Shape Matching on robots

… for 3D In-Line Gauging

What’s coming next ?

Plug & Automate 3D Machine Vision Product Line

8

3-in-1 innovation Stereometry Triangulation Phase-Shift illumination

APS3D

The next step in the evolution of 3D Robot Guidance and 3D In-Line Gauging

The first Smart In-Line 3D Point Cloud Sensor

APS3D Area Profile Scanner

Plug & Automate 3D Machine Vision Product Line

9

The technology behind: Stereometry / Triangulation Two cameras observe the same object area

Camera positions in respect to each other are known by calibration

3D object points can be determined by ray intersection

The technology behind: Phase-Shift Fringe Projection Projection of multiple patterns on the object surface by a programmable projector

Variation and shifting of the pattern (“Phase-Shift”) leads to stereo image collection

Determination of a 3D position for every camera pixel leads to a extremely dense 3D point cloud

Sine Pattern

3D Point Cloud Technology with APS3D

10

Stereometry / Triangulation

Dense Point Clouds by Phase-Shift projection

Object analysis based on Point Cloud

Dedicated features (edges, holes, etc.)

Complete shape of object

Form analysis: Compare to CAD model

Form reconstruction: Generate CAD model

etc.

Established technology Triangulation

Shape Matching with 6 stripes

Dedicated feature determination

edges

holes

planes

single surface points

etc.

New technology

NEW

Improved measurement of free-form surfaces

3D Point Cloud Technology with APS3D

11

Advanced data processing

< 0,3 sec with fast fringe projection

3D Data Generation

Fast and accurate for 3D Machine Vision

On-board Evaluation

Precise 3D dataset for reliable inspection

Point Cloud & Meshing

3D Point Cloud Technology with APS3D

12

Complex form Slot / Immersion

Hole / Immersion Complex Edge

Measurement of complex geometries for 3D Robot Guidance and 3D In-Line Gauging

3D Point Cloud Technology with APS3D

13

Application: 3D Robot Vision / 3D Assembly with 6 DOF determination Roof Insertion

Windshield Insertion

Wheel Mounting

Hemflange Application 3D Best-Fit Door Assembly Automated fueling

Use of 3D sensors, typically used in a sensor network

Interfaces to PLC and robots with standard fieldbus like Profinet, Ethernet/IP, …

All applications are directly integrated into the production process and are “mission critical”

3D Point Cloud Technology with APS3D

14

Application: 3D Inline Gauging

APS3D Sensor (designed for use on robot, temperature compensated)

Robot Temperature Compensation (RTC) with temperature stable artifacts and special software

IQ-VIS Client-Server Reporting Software Production Decision Intelligence

3D Position of hole 3D Position of hole Gap & Flush

4 Robot cell 3D Reporting

Sensor on robot

Statistical reports

3D Point Cloud Technology with APS3D

15

Application: Automated gripping of wheel rims

Shape based 6-DOF pose determination for Robot Vision application

3D Point Cloud Technology with APS3D

16

Application: Quality Control with dimensional measurement Inline 100% dimensional part control (tool and mold wear control)

Distance measurement based on features detected in 3D point cloud

3D Point Cloud Technology with APS3D

17

Application: Quality Control by fast 3D CAD Comparison Compare 3D Point Cloud with given CAD model to detect form deviations and defects

3D Point Clouds 3D Deviations CAD Model

3D Point Cloud Technology with APS3D

18

Application: Quality Control with dimensional measurement Inline 100% dimensional part control

Quality control of incoming parts or produced parts

Part Point Cloud

Cross section for diameter control

Scan

Measure

3D Point Cloud Technology with APS3D

19

Application: Recognition of stamped marks / characters

Use point cloud techniques with better contrast to increase robustness

3D Point Cloud Technology with APS3D

20

Application: Character recognition on wires Fully automated shape sampling on rubber and conversion to depth image

Original

Scanned surface

Characters are hard to detect in gray level image

After conversion of 3D point cloud into depth image

the characters can be recognized easily

3D Point Cloud Technology with APS3D

21

Application: Shape control of wiper rubber 3D Defect detection based on 3D point cloud

Original Scanned Surface

3D Point Cloud Technology with APS3D

22

Application: Shape control of bike saddles Fully automated shape control and comparison with CAD model

3D Point Cloud Technology with APS3D

23

Application: Shape Sampling of foot models Fully automated shape measurement of models for reverse engineering

Meshed Surface

3D Point Cloud Technology with APS3D

24

Application: Shape Control of shoe soles Automated 3D quality control

Original

Scanned Surface

3D Point Cloud Technology with APS3D

25

Application: Shape Control of food

Automated crack control of cookies based on 3D point clouds

3D Point Cloud Technology with APS3D

26

Newest Hardware Components

High resolution stereo camera setup

Fringe projection with high power LED projector

RGB (Red/Green/Blue) pattern projection

Integrated processing power (CPU)

APS3D Area Profile Scanner The new excellence class for 3D applications

Industrial Design

Small ruggedized housing

Protection class IP65

Ready for integration into a production line

Made for use on robots

Best Performance

Pre-calibrated for highest precision

High accuracy down to 3 µm

Dense 3D Point cloud > 1 Mio. Points

Fast Scanning time < 0.3 second

Intelligence on-board

Integrated point cloud generation and feature evaluation

3D Point Cloud Technology with APS3D

27

Product family APS3D Starting with four different models

Different stand-offs, measurement volumes, accuracies

APS3D-40 APS3D-120 APS3D-300 APS3D-460

Stand-off 91 mm 192 mm 480 mm 1040 mm

Field of view 40 x 34 mm² 120 x 100 mm² 300 x 250 mm² 460 x 380 mm²

Z-Range 13 mm 80 mm 100 mm 150 mm

Accuracy 3 µm 10 µm 25 µm 40 µm

Best suited for 3D Robot Guidance and 3D In-Line Gauging Area Profile Scanner APS3D

3D Point Cloud Technology with APS3D

28

Advanced Software Point cloud generation and evaluation integrated in sensor

Remote setup via Ethernet / Internet

Touch optimized following the new ISRA standard

Several data interfaces to standard point cloud software products

3D Point Cloud Technology with APS3D

29

Multi Sensor Setup

Larger objects can be determined by a sensor net of multiple APS3D

CONact APS3D

3D Point Cloud Technology with APS3D

30

Innovation • Three technologies combined in one sensor

Precise capture of 3D object • High density point clouds

Usage without PC • Integrated CPU power

Best performance • Newest technologies

Applicable in challenging conditions • Designed for industry

Suitable for several applications • 3D Robot Guidance • 3D In-Line Gauging • 3D Quality Control

Fast. Accurate. Compact.

APS3D Area Profile Scanner

The new star of ISRA VISIONs 3D Machine Vision Product Line

Leading the way to new 3D Robot Automation Applications

3D Point Cloud Technology with APS3D

31