37
1 Computer Vision - Introduction Computer Vision Introduction Andrea Torsello [email protected]

Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

1 Computer Vision - Introduction

Computer Vision

Introduction

Andrea [email protected]

Page 2: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

2 Computer Vision - Introduction

Getting in contact Student -> Teacher

[email protected]

Teacher -> Strudents course web site

http://www.dsi.unive.it/~atorsell/Visione

Page 3: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

3 Computer Vision - Introduction

Texts

R. C. Gonzalesz and R. E. Woods. Digital Image Processing. Prentice-Hall, 2002

D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall, 2002

E. Trucco and A. Verri. Introductory Techniques for 3D Computer Vision. Prentice-Hall, 1998

R. Szeliski. Computer Vision. Springer 2011.

Page 4: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

4 Computer Vision - Introduction

Goals

What does it mean to see?

Computer vision:Build a system that “sees”

Page 5: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

5 Computer Vision - Introduction

Page 6: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

6 Computer Vision - Introduction

Page 7: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

7 Computer Vision - Introduction

Related Fields

Image processing Pattern recognition (Machine learning/Data mining) Scene analysis

Page 8: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

8 Computer Vision - Introduction

Image Processing

Page 9: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

9 Computer Vision - Introduction

Pattern recognition

Page 10: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

10 Computer Vision - Introduction

Scene Analysis

Page 11: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

11 Computer Vision - Introduction

Taxonomy

High/Medium/Low level vision

Low (image restopration, contrast enhancement, …):

input=image, output=image Medium (segmentaion, shape recogntition, …):

input=images, output=attributes/features High (Image analisys, scene understanding, …):

input=images, output=concepts

Page 12: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

12 Computer Vision - Introduction

Some applications ofComputer Vision

Page 13: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

13 Computer Vision - Introduction

Image search

Page 14: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

14 Computer Vision - Introduction

Face Detection

Page 15: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

15 Computer Vision - Introduction

Face Recognition

Page 16: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

16 Computer Vision - Introduction

Robotics

Page 17: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

17 Computer Vision - Introduction

Surveilance

Page 18: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

18 Computer Vision - Introduction

Driving Assistance

Page 19: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

19 Computer Vision - Introduction

Autonomous Vehicles

Tartan racing (Carnegie Mellon University, General Motors Corporation, Caterpillar, Continental e altri)

vinctori DARPA Urban Challenge 2007

Page 20: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

20 Computer Vision - Introduction

Satelite surveys

Stereo reconstruction of the surace of Venus from a pair of satelite images

(Institute for Computer Graphics and Vision, Technical University of Graz, Austria)

Page 21: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

21 Computer Vision - Introduction

Medical Image Analysis

Page 22: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

22 Computer Vision - Introduction

Digitalization

Page 23: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

23 Computer Vision - Introduction

Digital Photography

Page 24: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

24 Computer Vision - Introduction

Cinema & TV

Page 25: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

25 Computer Vision - Introduction

Some Hystory Emissionist theory (tactile vision)

The eye emits rays that travel through space and hit objects. The contact of the ray and the objects causes the visual sensation.

Pythagoras, Empedocles, Euclid Intromissionist theory

Object continuously emit to the surounding space imaeges of them selves. This images (eidola) enter the eye throught the pupil, thus revealign themselves.

Democritus, Epicurus, Lucretius Persistence of retinal images (“after-image”)

Ibn al-Haytham (Alhazen) (965-1039 AD)

Page 26: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

26 Computer Vision - Introduction

Keplero and the theory of retinal images

1604 Kepler develops the modern theory of retinal images.

Page 27: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

27 Computer Vision - Introduction

Perception as unconscious conclusions Helmholtz

Page 28: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

28 Computer Vision - Introduction

Recent models... James J. Gibson (1904-1979)

and the ecologic approach

“The belief of the empiricists that the perceived meanings and values of things are supplied from past the experience of the observer will not do. But even worse is the belief of nativists that meanings and values are supplied from the past experience of the race by innate ideas.” (Gibson, 1979)

David Marr and the computational approach

Three levels: Computational Algorithmic Implementative

(hardware)

Page 29: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

29 Computer Vision - Introduction

Illusions

Page 30: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

30 Computer Vision - Introduction

Ames' room

Page 31: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

31 Computer Vision - Introduction

Necker Cube

Page 32: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

32 Computer Vision - Introduction

Bistable images

Jastrow duck/rabbit

Page 33: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

33 Computer Vision - Introduction

Contextual perception of length

Mueller-Lyer illusion Ponzo illusion

Page 34: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

34 Computer Vision - Introduction

Fraser Spiral

Page 35: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

35 Computer Vision - Introduction

Escher's impossible images

Page 36: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

36 Computer Vision - Introduction

Bottom-up or Top-down?

Page 37: Computer Vision Introductionatorsell/Visione/01-Intro.pdf · Digital Image Processing. Prentice-Hall, 2002 D. Forsyth and J. Ponce. Computer Vision. A Modern Approach. Prentice-Hall,

37 Computer Vision - Introduction

Bottom-up or Top-down?