Embed Size (px)
Citation preview
Arithmetic and Geometric Transformations (Chapter 2)
CS474/674 – Prof. Bebis
Addition
• Useful for combining information between two images:
0 <= α <= 1
Averaging (see Example 2.5 on page 75)
• Image quality can be improved by averaging a number of images together (very useful in astronomy applications).
5 10
20 50 100
Note: images must be registered!
Subtraction
• Useful for “change” detection.
Subtraction (cont’d)
• Medical application
(iodine medium injectedinto the bloodstream)
difference enhanced
Geometric Transformations
• Transformation applied on the coordinates of the pixels (i.e., relocate pixels).
• A geometric transformation has the general form
(x,y) = T{(v,w)}
where (v,w) are the original pixel coordinates and
(x,y) are the transformed pixel coordinates.
Geometric Transformations
1
0
0
]1[]1[
3231
2221
1211
tt
tt
tt
wvyx
affine transformation
y=v sinθ + w cosθ
Forward mapping
• Transformed pixel coordinates might not lie within the bounds of the image.
• Transformed pixel coordinates can be non-integer.
• There might be no pixels in the input image that map to certain pixel locations in the transformed image
No one-to-one
correspondence!
Forward mapping (cont’)
• An example of holes due to image rotation, implemented using the forward transformation.
Inverse Mapping
• To guarantee that a value is generated for every pixel in the output image, we must consider each output pixel in turn and use the inverse mapping to determine the position in the input image.
• To assign intensity values to these locations, we need to use some form of intensity interpolation.
• Interpolation — process of using known data to estimate unknown values.
• Interpolation can be used to increase (or decrease) the number of pixels in a digital image.
e.g., some digital cameras use interpolation to produce a larger image than the sensor captured or to create digital zoom
http://www.dpreview.com/learn/?/key=interpolation
Interpolation
Interpolation (cont’d)
Zero-order interpolation: nearest-neighbor
Interpolation (cont’d)
First-order interpolation: average
Interpolation (cont’d)
Bilinear interpolation
I(x,y) = ax + by + cxy + d
The 4 unknowns (a,b,c,d) can be determined from 4 equations formed by the 4 nearest neighbors.
Interpolation (cont’d)
Bilinear interpolation
http://en.wikipedia.org/wiki/Bilinear_interpolation
Interpolation (cont’d)
Bicubic interpolation
• It involves the sixteen nearest neighbors of a point (i.e., 4x4 window).
• The 16 unknowns aij can be determined from sixteen equations formed by the 16 nearest neighbors.
j
i j
iij yxayxI
3
0
3
0
),(
Examples: Interpolation
Examples: Interpolation
Examples: Interpolation
Examples: Interpolation
Image Registration
• Goal: align two or more images of the same scene.
• How: estimate a transformation that aligns the two images.
Image Registration (cont’d)
• Under certain assumptions, an affine transformation can be used to align two images.
• There are 6 unknowns (i.e., t11, t12, t21, t22, t31, t32)
• We need at least 6 equations.
• Three correspondences are enough, more are better.
1
0
0
]1[]1[
3231
2221
1211
tt
tt
tt
wvyxUnknowns?Equations?Correspondences?
Image Registration Example
apply affinetransformation
Error when comparing the transformed and originalimages.
