8/16/2019 2015-16 EE412-5

1/40

EE412/CS455

Principles of Digital Audio andVideo

Lecture 5

8/16/2019 2015-16 EE412-5

2/40

Video Scanner and Cameras

8/16/2019 2015-16 EE412-5

3/40

Single Sensor Imaging

8/16/2019 2015-16 EE412-5

4/40

Line Sensor Imaging

8/16/2019 2015-16 EE412-5

5/40

 Array Sensor Imaging: Imaging Optics

8/16/2019 2015-16 EE412-5

6/40

Today’s digital cameras/scanners either

have CCD (Charge-Coupled Devices) or

CMOS cells /sensors Both technologies competing for Market

Camera Sensors

8/16/2019 2015-16 EE412-5

7/40

CMOS Sensor

8/16/2019 2015-16 EE412-5

8/40

CMOS Architecture Basics

Ref: Dave LitWiller: CCD Vs. CMOS: Fact and Friction

8/16/2019 2015-16 EE412-5

9/40

CCD Architecture Basics

Ref: Dave LitWiller: CCD Vs. CMOS: Fact and Friction

8/16/2019 2015-16 EE412-5

10/40

Progressive scan types:

Frame Transfer Architecture

Interline Transfer Architecture Frame Interline Transfer Architecture

Imaging & Readout

 Arrangements in CCD sensors

8/16/2019 2015-16 EE412-5

11/40

Frame Transfer Architecture

8/16/2019 2015-16 EE412-5

12/40

Interline Transfer Architecture

8/16/2019 2015-16 EE412-5

13/40

Frame-Interline Transfer Architectur 

8/16/2019 2015-16 EE412-5

14/40

Interlaced scan types based on FIT

architecture:

transfer only odd or even lines at field rate with

frame rate exposure time for each cell

operate and image at field rate and drop alternate

lines at signal processing level

operate and image at field rate and average twoconsecutive lines to get fields

Interlaced Scanning in CCDs (slidefor reference only)

8/16/2019 2015-16 EE412-5

15/40

 – Reading Package

 – Page 495-497 (Luther: Section 10.2.3.1,10.2.3.2)

 – Page 498-505 (Luther: Chapter 10)

 – Page485-489 (Luther: Section6.4,6.4.1,6.4.2,6.4.3,6.4.3.1-3) – Page492-493 (Luther: Section 6.4.7,6.4.8)

 –  CCD vs. CMOS: Facts and Fiction (uploadedarticle on LMS)

Necessary Readings

8/16/2019 2015-16 EE412-5

16/40

EE412/CS455

Principles of Digital Audio andVideo

Lecture 6

8/16/2019 2015-16 EE412-5

17/40

Color Video Capturing Principles

8/16/2019 2015-16 EE412-5

18/40

Digital Video Camera: Block

Diagram

8/16/2019 2015-16 EE412-5

19/40

Color Cameras

8/16/2019 2015-16 EE412-5

20/40

Dichroic Reflective Filter

8/16/2019 2015-16 EE412-5

21/40

Color Splitters (with Dichroic fi lters)

8/16/2019 2015-16 EE412-5

22/40

Digital Camera Processing

Image Processing (Color

Correction, White Balancing etc.

8/16/2019 2015-16 EE412-5

23/40

Video Signal and System

Specification and Performance

Measurement (/ Test Patterns)

8/16/2019 2015-16 EE412-5

24/40

Signal bandwidth and the required

aperture response are dependent on the

resolution also

 Aperture Response and Signal

Bandwidth

8/16/2019 2015-16 EE412-5

25/40

 Aperture Response in Scanning

8/16/2019 2015-16 EE412-5

26/40

Display Characteristics Display Size

 Aspect ratio Brightness/Contrast

 Angle of View

Color  Resolution

Gamma

Linearity

Persistence

Interlace/Non-interlace

8/16/2019 2015-16 EE412-5

27/40

 – Standard: 4:3

 – Others: 16:9, 2:1

 Aspect Ratio

8/16/2019 2015-16 EE412-5

28/40

Color Testing

8/16/2019 2015-16 EE412-5

29/40

Resolution

Resolution in terms of pixels (for digital displays) (Effective) resolution is specified in TVL and

is Kell factor times the active lines

Kell factor range = 0.5-0.9, typical: 0.7

(CRT), 0.9 (CCD, CMOS, LCD, Plasma)

Line patterns and zone plate patterns are

used for testing the resolution

8/16/2019 2015-16 EE412-5

30/40

Resolution / Frequency

Response Testing

8/16/2019 2015-16 EE412-5

31/40

Video Frequency response

Multiburst chart; pulse-bar chart;wedge test pattern

Resolution / Frequency

Response Testing

8/16/2019 2015-16 EE412-5

32/40

Zone Plate Pattern

8/16/2019 2015-16 EE412-5

33/40

Gray Scale

Stairstep pattern

Gray Scale/Gamma Testing

8/16/2019 2015-16 EE412-5

34/40

Grating pattern and ball chart

Display Linearity Testing

8/16/2019 2015-16 EE412-5

35/40

Universal Test Pattern

8/16/2019 2015-16 EE412-5

36/40

Video Artifacts (for reference only)

• Pixel Defects

• Compression Artifacts

• Smearing and streaking (either because of

unwanted display retention or bad analog video

signal)

and more……….

8/16/2019 2015-16 EE412-5

37/40

Compression Artifacts

MPEG 4 - 47.8 Kbytes

sequence

H.261 - 47.7 Kbytes

sequence

8/16/2019 2015-16 EE412-5

38/40

Compression Artifacts: Blocking

Image Size: 352 x 288

From: http://www.compression.ru/video/deblocking/index_en.html

8/16/2019 2015-16 EE412-5

39/40

Compression Artifacts: Corrupted

Blocks

Image Size: 250x250

http://www.doc.ic.ac.uk/~nd/surprise_96/journal/vol4/sab/report.html

8/16/2019 2015-16 EE412-5

40/40

 – Reading Package

 – Page 473-477(Luther: Section 6.1,6.2,6.2.1,6.2.1.1,6.2.1.2)

 – Page 481 (Luther: Section6.2.3,6.2.3.1,6.2.3.2,6.2.4)

 – Page119-120(Luther: Section 2.3.3)

 – Page122-123 (Luther: Section 2.3.5-2.3.6)

 – Page494-498 (Luther: Section10.1,10.2,10.2.1,10.2.2,10.2.3,10.2.3.1,10.2.3.2,10.2.4-10.2.8)

Necessary Readings