Embed Size (px)
Citation preview
MotionCam-3DThe highest resolution and highest accuracyarea based 3D camera in the world
Jan Zizka, CEO
AWARD 2018
3D Scanning
Intel D435 Active stereoCorrelation
Primesense / Kinect 1
Structured dotsRecognition
MS Kinect 2 Time-of-Flight
PMD Time-of-Flight
Basler/Panasonic Time-of-Flight
Sony(Softkinetic)
Time-of-Flight
Photoneo3D Camera
Parallel structured light
Scanning in motion3D Cameras
Ensenso Active stereoCorrelation
Sick Profilometry
Zivid Labs Structured lightSequential
Canon Structured lightSequential
PhotoneoPhoXi 3D Scanner
Laser structured lightSequential
Scanning of static scenes3D Scanners
...
3D Scanning in motion
Intel D435 Active stereoCorrelation
Primesense / Kinect 1
Structured dotsRecognition
MS Kinect 2 Time-of-Flight
PMD Time-of-Flight
Basler/Panasonic Time-of-Flight
Sony(Softkinetic)
Time-of-Flight
Photoneo3D Camera
Parallel structured light
Scanning in motion3D Cameras
Ensenso(with FlexView)
Active stereoCorrelation, Sequential
Sick / LMI / ...Profilometry
(also in motion, but only 1 profile in time)
Zivid Labs Structured lightSequential
Canon Structured lightSequential
Cognex(Enshape)
Structured lightSequential
PhotoneoPhoXi 3D Scanner
Laser structured lightSequential
Scanning of static scenes3D Scanners
4 major 3D scanning technologiesarea scan & close/mid-range & in motion
Time-of-Flight
MicrosoftSonyPMD
AMS/HeptagonPanasonic
Odos/RockwellEspros
Structured Patterns
AppleQualcomm/Himax
Mantis VisionOrbbec
Stereo
IntelZED
Ensenso/IDS
Parallel Structured Light
Photoneo
We parallelize sequential structured light
Computational Image Sensor● Photoneo developed and patented a novel, ultimate IS for Computational Photography● It's not just another image sensor with "epsilon improvement" (like lower noise or higher
resolution). It fundamentally changes the way how the image is captured and thus reveals a novel valuable information.
● Broad applicability:3D Scanning, HDR video, Motion Tracking, Image Deblurring, Compressive sensing
Rolling Shutter Global Shutter Mosaic/Matrix Shutter
Overview - 3D scanning in motion3D Scanning
in motion
Triangulation
Time-of-flight
Passive stereo
Passive systems Active systems
Illumination?
Active stereo Structured patterns / dots
Parallelstructured light
Unreliable method
Camera unit Processing unit
Projection unit
Parallel Structured Light is proprietary, patented technology developed by Photoneo
World’s best 3D Camera
● Scanning in motion● Novel technology - Parallel Structured Light
○ Custom CMOS image sensor○ Rolling => Global => Mosaic Shutter
● 10x Higher Resolution & Accuracy● No Motion Blur● Works Outdoors● Multiple Devices Simultaneously● Optimal Light Efficiency● Rapid Acquisition - up to 60 FPS● Patented
Photoneo CMOS image sensor
Photoneo 3D Camerais superset of Photoneo 3D Scanner
One shot mode (default)
● Resolution: 500K points● 1 frame
○ In motion
High resolution mode
● Resolution: 2M points● 4 frames
○ Static scene
Software on-the-flyswitch
Every bit of every pixel contributes to the final quality of 3D data. Each 3D point is independent measurement.
Output / Sensor resolution True resolution Z noise
@ 1m, 50% albedo
Consumer ??? Active stereoCorrelation 1280 × 800 ~5 000 projector dots
(+features from passive stereo) 3mm
Industrial ??? Active stereoCorrelation 1280 x 1024 512 x 410 = ~210 000
(Nyquist-Shannon sampling theorem) 3mm
Consumer ??? Structured dotsRecognition 640 × 480 ~70 000 projector dots 3mm
Consumer ??? Time-of-Flight 512 × 424 256 × 212 = ~54 000(0.5x penalty - heavy spatial smoothing) 3mm
Consumer ??? Time-of-Flight 160 × 120 160 × 120 = ~19 000 3mm
Industrial ??? Time-of-Flight 640 × 480 320 × 240 = ~77 000(0.5x penalty - heavy spatial smoothing) 6mm
Consumer ??? Time-of-Flight 640 × 480 640 × 480 = ~300 000 6mm
Industrial ??? Time-of-Flight 640 x 480 640 × 480 = ~300 000 10mm
Photoneo Parallel Structured Light 1068 × 800(One shot mode) ~500 000 0.5mm
3D/DepthMap Texture Normals
Bin Picking / Belt Picking
Automotive, general manufacturing, Logistics, e-Commerce
Palletizing, de-palletizing, machine tending
Online Quality Control and Metrology
People counting, behaviour monitoringVR, AR and ergonomics
www.channelfutures.com
Food processing / handling
Picking, Sorting,
Harvesting
Festo
Thank you
● Effective resolution is limited because:○ Surface is sampled by a projected pattern○ Projected pattern is sampled by camera
=> A surface detail should be at least ~7 camera pixels wide to be resolved by the camera
● Structured dots case● “no dot” area = no information
● Stereo case● “no dot” area = passive stereo
(= poor performance)
Active Stereo / Kinect like devices
Projector dots Camerapixel
No dot means no 3D information
