25
Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 5 Messen optischer Größen, Messen aus Bildern Übersicht Optische Strahlung, Sensorik Geometrie, Photogrammetrie Kamerakalibrierung Stereo Menschliche Wahrnehmung Neurophysiologie Kognitive Psychologie Digitale Bildanalyse Digitales Rasterbild, Kenngrößen Bildverarbeitungsoperationen, Segmentation Salient point detection + description

Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

  • Upload
    others

  • View
    16

  • Download
    1

Embed Size (px)

Citation preview

Page 1: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

1

Axel Pinz SS 2017 Messtechnik 2 – 5

Messen optischer Größen, Messen aus Bildern

ÜbersichtOptische Strahlung, Sensorik

Geometrie, Photogrammetrie– Kamerakalibrierung

– Stereo

Menschliche Wahrnehmung Neurophysiologie

Kognitive Psychologie

Digitale Bildanalyse– Digitales Rasterbild, Kenngrößen

– Bildverarbeitungsoperationen, Segmentation

– Salient point detection + description

Page 2: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

2

Axel Pinz SS 2017 Messtechnik 2 – 5

Das Digitale Rasterbild

2D Matrix Bildkoordinaten (x,y)

“picture element” – pixel

Raster x, y

“square pixels”: x = y

Monochrom: Grauwert / pixel Farbe: (r,g,b) / pixel

x

y

Page 3: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

3

Axel Pinz SS 2017 Messtechnik 2 – 5

Kenngrößen eines Digitalen Rasterbildes

• Räumliche Auflösung: Bezug x Szene

• Radiometrische Auflösung: Bit / pixel

• Farbe: diverse Farbmodelle: RGB, IHS, CIE, …

• Nachbarschaft 4-, 6-, 8-Nachbarschaft

Page 4: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

4

Axel Pinz SS 2017 Messtechnik 2 – 5

Räumliche Auflösung (1)

Bezug zur Szene herstellen! Z.B.: x ~ 1mm

Page 5: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

5

Axel Pinz SS 2017 Messtechnik 2 – 5

Räumliche Auflösung (2)

Abtasttheorem beachten!

Bezug zwischen kleinstem Detail in der Szene und

Abtastung der Szene im Raster x

„kleinstes Detail“ „maximale Ortsfrequenz“ 0

Shannon: ∆𝑥 <1

2𝜇0

Page 6: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

6

Axel Pinz SS 2017 Messtechnik 2 – 5

Räumliche Auflösung – Beispiel

x ~ 0.5mm

Page 7: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

7

Axel Pinz SS 2017 Messtechnik 2 – 5

Räumliche Auflösung – Beispiel

x ~ 1mm

Page 8: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

8

Axel Pinz SS 2017 Messtechnik 2 – 5

Räumliche Auflösung – Beispiel

x ~ 2mm

Page 9: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

9

Axel Pinz SS 2017 Messtechnik 2 – 5

Räumliche Auflösung – Beispiel

x ~ 4mm

Page 10: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

10

Axel Pinz SS 2017 Messtechnik 2 – 5

Räumliche Auflösung – Beispiel

x ~ 8mm

Page 11: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

11

Axel Pinz SS 2017 Messtechnik 2 – 5

Räumliche Auflösung – Beispiel

x ~ 16mm

Page 12: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

12

Axel Pinz SS 2017 Messtechnik 2 – 5

Radiometrische Auflösung (1)

Bit/pixel, typisch: 8 bit/pixel 256 Grauwerte

8 bit/Farbe 2563 Farben

1 bit/pixel Binärbild

8bit/pixel 4 bit/pixel

Page 13: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

13

Axel Pinz SS 2017 Messtechnik 2 – 5

Radiometrische Auflösung (2)

Bit/pixel, typisch: 8 bit/pixel 256 Grauwerte

8 bit/Farbe 2653 Farben

1 bit/pixel Binärbild

2bit/pixel 1 bit/pixel

Page 14: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

14

Axel Pinz SS 2017 Messtechnik 2 – 5

Farbe (1): RGB

Additives (Monitor) / subtraktives (Buchdruck) RGB-Modell:

Farbwürfel, lineares Modell

Page 15: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

15

Axel Pinz SS 2017 Messtechnik 2 – 5

Farbe (1): HSV

Hue, Saturation, Value – “HSV hexcone” – 6-seitige Pyramide

Nichtlineares Modell

Page 16: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

16

Axel Pinz SS 2017 Messtechnik 2 – 5

Farbe – Beispiel

RGB:

HSV:

r g b

h s v

Page 17: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

17

Axel Pinz SS 2017 Messtechnik 2 – 5

Farbe – Beispiel

Matlab:>> RGB=imread('peppers.jpg');

>> imwrite(RGB(:,:,1),'peppers_red.jpg');

>> imwrite(RGB(:,:,2),'peppers_green.jpg');

>> imwrite(RGB(:,:,3),'peppers_blue.jpg');

>> HSV=rgb2hsv(RGB);

>> imwrite(HSV(:,:,1),'peppers_hue.jpg');

>> imwrite(HSV(:,:,2),'peppers_sat.jpg');

>> imwrite(HSV(:,:,3),'peppers_val.jpg');

Visit Earl F. Glynn‘s Computerlab:http://www.efg2.com/Lab/

Page 18: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

18

Axel Pinz SS 2017 Messtechnik 2 – 5

Direkte Nachbarn eines Pixels

im quadratischen Raster im hexagonalen Raster

Nachbarschaft definiert Zusammenhang (von Linien/Regionen)

Vordergrund/Hintergrund! z.B: Linie trennt den Hintergrund

… 8-Nachbarschaft

, … 4-Nachbarschaft

Nachbarschaft

Pixel

4-Nachbarschaft 8-Nachbarschaft 6-Nachbarschaft Vgl.: Fovea!

Page 19: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

19

Axel Pinz SS 2017 Messtechnik 2 – 5

Erster Schritt der Bildanalyse: das Histogramm

Grauwertstatistik: Grauwert/Häufigkeit, z.B.:

Grauwert

# p

ixel

>> IM=imread(8bpp.jpg');

>> imhist(IM);

Page 20: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

20

Axel Pinz SS 2017 Messtechnik 2 – 5

Histogramm-Analyse: Belichtung

unterbelichtet korrekt belichtet überbelichtet

HSV value v [0,1]

Page 21: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

21

Axel Pinz SS 2017 Messtechnik 2 – 5

Histogramm-Analyse: Kontrast

kontrastreich kontrastarm

Page 22: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

22

Axel Pinz SS 2017 Messtechnik 2 – 5

Histogramm-Analyse: Modi

Bimodales Histogramm Multimodales Histogramm

Vordergrund?

Hintergrund?

Page 23: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

23

Axel Pinz SS 2017 Messtechnik 2 – 5

Modi Normalverteilungen Schwellwert

Originalbild Histogramm-Analyse

VordergrundHintergrund

Schwellwert

Page 24: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

24

Axel Pinz SS 2017 Messtechnik 2 – 5

Modi Normalverteilungen Schwellwert

Histogramm-Analyse Binärbild

Fehler!

Page 25: Institute of Electrical Measurement and Measurement Signal ... · Institute of Electrical Measurement and Measurement Signal Processing 1 Axel Pinz SS 2017 Messtechnik 2 –5 Messen

Institute of Electrical Measurement and Measurement Signal Processing

25

Axel Pinz SS 2017 Messtechnik 2 – 5

Messen optischer Größen, Messen aus Bildern

ÜbersichtOptische Strahlung, Sensorik

Geometrie, Photogrammetrie– Kamerakalibrierung

– Stereo

Menschliche Wahrnehmung Neurophysiologie

Kognitive Psychologie

Digitale Bildanalyse– Digitales Rasterbild, Kenngrößen

– Bildverarbeitungsoperationen, Segmentation

– Salient point detection + description