B44 Lecture 16: Light and Shadow
1
1
Lecture 6Light
Science B44
Ted Adelson
Dan
Ker
sten
2
1. Contrast and cell response2. Estimate the light intensity3. Discovering light and paint together4. Is it a shadow or a dark stain5. Is it a reflection or a light spot
Light
3
We see surfaces as defined by their reflectanceindependently of the amount of light falling on it.
They are white (reflect a lot), grey (medium) orblack (hardly at all) whether we see them insunlight or dim room light.
But photometers, photographs, and photoreceptorsregister the light reflected from the surface.This can be million times more in sunlight thanroom light.
How do we recover the constant “paint” value??
First pass: Contrast
1. Contrast and cell response
4
Bright light
1000 1000
600 200
600 - 200600 + 200
= ……%Contrast=Contrast = 60 - 2060 + 20
= 50%
20
Medium light
100 100
60
for two adjacent areasContrast (difference/sum) is independent of light level
5
Cells do respond to edge contrastAnd not much to the mean light level (they adapt)Nice, but isn’t there a problemCells only respond to contrast at edgesIt is not a point by point record of image intensityThis distorts the representation of light and darkHere are some examples
Hermann GridSimultaneous contrastCraik Cornsweet Illusion
6
Hermann Grid
B44 Lecture 16: Light and Shadow
2
7
Simultaneous contrast
8
Craik Cornsweet Illusion
Centers of each square are equiluminant
9
physical properties of stimulus
luminance (a) = luminance (b)
luminanceprofilea b
10
just to be sure that the centers are really equiluminant
11
Centers are equal, why do they look different?Hint from response to real disc of uniform brightness
ON center cells
luminance
cell responses12
Contrast at border is the only available signalMust “fill in” brightness from edge to central regionFilling in process fooled by an edge that looks like the
cell response profile to a real edge--> fills in inappropriately
B44 Lecture 16: Light and Shadow
3
13
First Pass: Cells estimate contrast
Properties of receptive fields correctly suggest thatperception of light and dark depends strongly oncontrast from edges
Responses independent of light level, to some degreeBut importance of edges leads to some errorsSuppressed image data must be reconstructed or “filled
in”But this “filling in” cannot reconstruct the exact
original: the edge-based description is not invertibleIt fails on corners, intersections, shallow gradients
14
Reflected light is the product of the lightfalling on the surface
And the reflectance (paint) of the surfaceHow do we find the reflectance or “paint”when we only have the light arriving at our
eyes?--> Estimate the light
2. Second Pass: Estimate the light
15
Judging the intensity of the illuminationCorrect for that intensity to recover the
reflectance of each surface1. Take the average illumination from all surfaces
as half of the light intensity. The averagesurface will be gray, reflect half of the light
2. Take the maximum intensity in the scene as anestimate of the light, probably reflected by awhite surface
Simple if there are many surfaces, all at the sameangle to one light
Real scenes much more complex
Lightness constancy
16
Gilchrist and apparent illuminantLight inferred based on apparent location in space
Hidden lights
Viewingpeep-hole
17
By removing a corner of the target square, the targetis made to appear to be in either the brightly lit frontroom or the dimly lit far room
18
By removing a corner of the target square, the targetis made to appear to be in either the brightly lit frontroom or the dimly lit far room
B44 Lecture 16: Light and Shadow
4
19
Although the target and the light coming from it neverchange, observers see it as white when it is apparentlyin the front room but dark gray when it appears to bein the back room
20
A visible shadow also changesthe apparent light falling ona surface
The light in the illuminatedarea is taken as muchstronger
21
The light in the shadowed areais taken as dimmer
Correcting for the illuminantcan make two areas thatsend equal amount of lightlook very different
22
SecondExample
23
We "see" a light source and what it covers based oncues in the image (illumination edges, shadowedges, spatial layout of scene and lights)
24
But the model of the light is simpleHas no memoryAnd is independent of our conscious knowledge
B44 Lecture 16: Light and Shadow
5
25
Sometimes it is not possible to determine whatthe light is without at the same time makinga choice about the reflectance (paint)
Sometimes the choice of what is light andwhat is paint follows a rule of simplicity
Chose the solution with the fewest elements
3. Choosing light and paint together
26
ProblemHow many ways can this pattern be explained?
27
Paint solutionCould be 9 differentpatches of paint
28
Light solutionCould be 9 lights
29
Bent object9 different surfacesbent at odd angles andone light. But you canonly look at it fromone special position
30
Simplest solution1 light,2 bends,2 paints
B44 Lecture 16: Light and Shadow
6
31
Highlight: a reflectionon a shiny surface
Shading: the variation inreflected light due tothe change in theorientation of thesurface
Shadow: an area wherelight is blocked by anintervening object
Highlight
Shadow
Shading
4. Is it a shadow or a dark spot of paint?
32
In addition to estimating the light (illuminant), italso helps to identify shadows and highlights(illumination effects, not paint)
Shadows are extremely complex shapes in thescene determined by the direction of thelight, the shape of the object casting theshadow and the surface on which it falls
Computer graphics can control and solve all ofthese variables
Vision does not have the time"Simple" rules to infer shadows
33
Is this a shadow here?What are the cues?Darker but same colorNo thickness, substance of its
ownSimilar texture inside and
outsideX junctions of shadow and
surface contoursMany possible cues could be
usedBut few are
34
Shadows must:1. Be darker than the
surface they are seen on2. Make X junctions with
surface contours3. Lie flat on the surface
(no volume)
Shadow Rules
35
Just like a shadow, areflection does notbelong to the surface onwhich it is seen
It is not paintIt changes if the observer
moves, or the scenechanges, or the objectmoves
5. Is it a reflection or light spot of paint
Sphere examples from Roland W. Fleming36
Reflections are not likepaint
When the object moves,the reflections are notstuck on like paint
They change in complexways
5. Is it a reflection or light spot of paint
Teapot example from Dan Kersten
B44 Lecture 16: Light and Shadow
7
37
A small highlight at one spot on a surface makes the wholesurface look glossy.
Remove the highlight or cover it with your finger and thewhole surface now looks matte (not glossy)
38What is wrong here?Verticality rule: an object’s reflections in a horizontalsurface are always vertically aligned with the object
39What is wrong here?Verticality rule: an object’s reflections in a horizontalsurface are always vertically aligned with the object 40
Verticality rule: an object’s reflections in a horizontalsurface are always vertically aligned with the object
41
Reflections must be:1. Lighter than the surface they are seen on2. Vertically aligned with reflected objects if
reflection is on a horizontal surface (water)
Reflection Rules
42
How do we see surface reflectance(lightness constancy)?
Contrast response in cells is a startAlso estimate the lightSometimes, solve for light and paint
together, choose simplest pairingShadows need to be darker, lie on surfaceReflections need to be lighter
1 Minute QuizNo lecture MondayReadings for Wednesday BV 12: 365-373Electronic Article: EA 7 on web site.
Summary
B44 Lecture 16: Light and Shadow
8
43
Surface reflectance: the proportion ofthe incident light that is reflected. Asurface with high reflectance is white,low reflectance is black
Lightness constancy: the ability to see thesurface reflectance independently ofthe intensity of the incident light
X-junction: two contours that cross overto form an X and serve as a cue totransparency or shadow
Glossary