37
Color Fidelity Color Fidelity in in Multimedia Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 [email protected]

Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 [email protected]

  • View
    220

  • Download
    5

Embed Size (px)

Citation preview

Page 1: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

Color FidelityColor Fidelityinin

MultimediaMultimedia

H. J. Trussell

Dept. of Electrical and Computer Engineering

North Carolina State University

Raleigh, NC 27695-7911

[email protected]

Page 2: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

Basic Color Problems describe color measure color coordinates color matching, profiling, calibration design filters for instruments & cameras image reproduction image correction

Page 3: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

Multimedia Aspects

Rendering accurate color on various soft displays

Rendering hardcopy of softcopy Alternatives to hardcopy - journals Watermarking – calibration,

validation, breaking(?)

Page 4: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu
Page 5: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

L

r

S

c = ST L r

Page 6: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

Color Science Basics

Equation for eye c = STLr

Where S is the sensitivity of the eyeL is diagonal illuminant matrixr is vector of reflectances of object

Color Matching Functions defined by CIE

A is defined as a linear transformation of STristimulus values are defined by t = ATLr

Note: from any non-singular, linear transformation of A, the tristimulus values can be found

Page 7: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

350 400 450 500 550 600 650 700 7500

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

Wavelength (nm)

Cone Sensitivities

Page 8: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu
Page 9: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

350 400 450 500 550 600 650 700 750-0.1

-0.05

0

0.05

0.1

0.15

0.2

0.25

0.3

0.35

Wavelength (nm)

CIE RGB Color M atching Functions

Page 10: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu
Page 11: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

350 400 450 500 550 600 650 700 7500

0.2

0.4

0.6

0.8

1

1.2

1.4

1.6

1.8

Wavelength (nm)

CIE XYZ Color M atching Functions

Page 12: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu
Page 13: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

CIEXYZCIELab

JND Thresholds

Color Space Uniformity

Page 14: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

CIE Lab*Uniform Color Space

)]/()/([200*

)]/()/([500*

16)/(116*

nn

nn

n

ZZfYYfb

YYfXXfa

YYfL

where nnn ZYX ,, define the white point

008856.0,116/16787.7

008856.0, )(

3/1

xx

xxxf

Page 15: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

Difference image may not relate toperceived difference

Difference image will relate toperceived difference

Page 16: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

gamut

Record Device

Gamut Mapping

Display Device

I x, y,

ˆ I x,y,

Frecord

D Fdisplay 1

DICS

DICS

DDCS(1)

DDCS(2)

RGB L

a*

b*

Color Management

Page 17: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

CIEDICS

One-to-one mapping onto CIE space

Device Independent Color Space

Page 18: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

Device Dependent Color Space

Gamut of Display

CIE

gamut

DDCS

Page 19: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

PrinterDyesub

An ExampleFdisplay

H .Fdisplay 1 Frecord .

Frecord 1

Desktop Scanner

Digital Lena

Printed Lena

Scanned Lena

Corrected Lena

H .

Page 20: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu
Page 21: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

Color Camera/Scanner Modelc M HLrT

where M represents the scanner filter set

H represents optics and sensor functions

Goal:

Estimate tristimulus values from the recorded data

t Bc

Page 22: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

Characterized for oneIlluminant.

Data gathered underanother illuminant.

1 2

Digital Camera

Digital Camera

Page 23: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

To determine the appearance of an image under many different lighting conditions

You must record more than 3 channels!

Problems:

Time to record

Space to store

Page 24: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

Input Device Design

c1, .. .,cp P-chan. Scanner

F1

FJ

L1

LJ

Page 25: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

De-mosaic Problem

Page 26: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

Color Image Communication

• Compression in luminance-chrominance space.

• RGB, CMYK, sRGB, CIEXYZ, CIELab.

Page 27: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

Heat, Humidity, Paper Changes, Ink Changes

Digital DataDigital Color Printer

time=0 time=T

Output Control

Page 28: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

RGB CIE

Output Device

Fdisplay-1

Output Device Characterization

Page 29: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

PDDCS

DICSPDDCS

G1

G2

Page 30: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

sRGB Approach

•Map printer DD values to DICS.

•Map DI values into sRGB gamut.

•Transform to sRGB values.

DICSsRGB Gamut

Printer Gamut

Page 31: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

RGB Display SpaceCIE Color Space

Gamut

Output Device Gamut

Page 32: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

RGB Display SpaceCIE Color Space

Gamut

Gamut Mapping

Page 33: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

Gamut

Region B

Point A

Point CCIE Space

Page 34: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu
Page 35: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

If viewing conditions the same, CIE works well to indicate color sample matching.

Cost functions must consider color space uniformity. (all CIE spaces are not the same)

Pixel to pixel differences in CIELab for pictorial images may not relate to appearance.

Need usable color appearance models.

Appearance Concerns

Page 36: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

1 2

Monitor

CIEXYZ CIEXYZCIEXYZ

Page 37: Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC 27695-7911 hjt@eos.ncsu.edu

Summary

Color is complicated to get right There are some really neat math

problems in color Multimedia depends on color for its glitz Who is willing to pay for accurate color?