45
A. I. P 9512514 郭郭郭 922014 郭郭郭 922508 郭郭郭 Term Project

A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

  • View
    249

  • Download
    0

Embed Size (px)

Citation preview

Page 1: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

A. I. P

9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒

Term Project

Page 2: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

• Implement this paper :“Two-scale Tone Management

for photographic Look,” Bae, Paris, and Durand.

• Apply the method to different kind of pictures.

• Add HDR technique.

Subject Review

Page 3: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Algorithm Review

model

input

base

detail

bilateral filter

high pass and local averaging textureness

texturenesstransfer

large-scaletransfer

Page 4: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Algorithm Reviewmodified base

modified detail

final output

constrained combination

postprocess

black-and-whiteoutput

Page 5: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Our works

Our input

Our model

Page 6: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Our works

Our detail

Our base

Page 7: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Our works

With edge preserving

Without edgepreserving

Page 8: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Our works

Our result

Author’s result

Page 9: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

HDR

Page 10: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

HDR

Page 11: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

• Uncertainty.• Poisson equation.• Histogram matching.• Textureness.• Color channel.

Problems

Page 12: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

• An old problem while using fast bilateral filter.

Uncertainty

Page 13: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Uncertainty

Page 14: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

• Cost most time in our pipeline.

• Use Discrete Sine Transform to reduce time complexity.

• Easy to implement.

Poisson

Page 15: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

• General Poisson Equation:– Ixx + Iyy = f

• For discrete version, we can rewrite the equation to matrix form:– TI + IT = F ,where T is a N*N triagonal matrix of

{1,-2,1}.

Poisson

Page 16: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

• We define

SXS I

I2

1NS SS

SDTS

),...,diag( D

],...ss,[s S 2

1Nss

22N

j4sin where,s Ts

] 1N

N,...sin

1N

2sin,

1N[sins

2T

N21

N21

jkkTj

2jjjj

Tj

Poisson

Page 17: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Poisson

BSFS1N

2XDDX

SFSDXSSDXSS

SFSXSTSSSTSXS

FSXSTTSXS

FITTI

2

2222

22

Page 18: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

• DX+XD=B is easy to solve

• Then we use I=SXS to get final answer.

Poisson

)/(bx

bxx

kjjkjk

jkkjkjkj

Page 19: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

• In fact, SXS performs 2-D DST on X

• Implementation steps:– Perform 2-D DST on F– Divide the sum of the correspondin

g eigenvalue and a constant.– Perform 2-D DST again

Poisson

Page 20: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

• The gray-value in log domain are always negative or zero.

• The range could be even wider if HDR added.

• The function implemented by MATLAB can only handle the interval from 0 to 1……

Hist-matching

Page 21: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Hist-matching

Inputdistribution

histogram

Page 22: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Hist-matching

Mask

distribution

histogram

Page 23: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Hist-matching

Outputdistribution

histogram

Page 24: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Hist-matching

Input

Output

Mask

Page 25: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Textureness

ρp = max( 0, ( T’p – T(B’)p ) / T(D)p )

T( I )p = 1/k * ∑ gσs( |p – q| ) gσr( |Ip - Iq| )|H|q

q∈|H|

k = ∑ gσs( |p – q| ) gσr( |Ip - Iq| ) q∈I

O = B’ + ρD

H is the high-pass version of the image.

Page 26: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Textureness

Input

Page 27: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Textureness

High frequency of H

Page 28: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Textureness

Absolute value of H

Page 29: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Textureness

T

Page 30: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Textureness

0 +

Page 31: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Textureness

Page 32: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

• Which color channel could work best?

– RGB channel.• Process separately.• Process intensity only and then

interpolate the three channel.

– YUV channel.

Color Channel

Page 33: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Color Channel

Page 34: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Color Channel

Page 35: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Color Channel

Page 36: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

Color Channel

Page 37: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

More Images

Input Model

Page 38: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

More Images

Input Output

Page 39: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

More Images

Input

Model

Page 40: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

More Images

Input Output

Page 41: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

More Images

Input

Model

Page 42: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

More Images

Input

Output

Page 43: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

More Images

Input

Model

Page 44: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

More Images

Input

Output

Page 45: A. I. P 9512514 郭瓊蓮 922014 柯瑋明 922508 吳榮軒 Term Project

QuestionsThanks for your attention.