37
Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1 1 National Taiwan University 2 The University of Tokyo Shape-Preserving Half- Projective Warps for Image Stitching

Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

  • Upload
    senwe

  • View
    110

  • Download
    0

Embed Size (px)

DESCRIPTION

Shape-Preserving Half-Projective Warps for Image Stitching. Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1 1 National Taiwan University 2 The University of Tokyo. Image stitching. Geometric transformation. Projective transformation (Homography). Projective warp. Image compositing. - PowerPoint PPT Presentation

Citation preview

Page 1: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

Che-Han Chang1, Yoichi Sato2, Yung-Yu Chuang1

1National Taiwan University 2The University of Tokyo

Shape-Preserving Half-Projective Warps for Image Stitching

Page 2: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

2

Image stitching

Page 3: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

3

Page 4: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

4

Page 5: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

5

Geometric transformation

Page 6: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

6

Projective transformation(Homography)

Page 7: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

7

Projective warp

Page 8: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

8

Imagecompositing

Page 9: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

9

• Misalignment (overlapping regions)• Geometric distortion (non-overlapping regions)– Stretched shapes shape distortion– Non-uniform scaling area distortion

Projective Warp

Misalignment

Page 10: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

10

• Misalignment (overlapping regions)• Geometric distortion (non-overlapping regions)– Stretched shapes shape distortion– Non-uniform scaling area distortion

Projective Warp

Distortion

Page 11: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

11

As-Projective-As-Possible Warp

Projective Warp

Locally aligned

Distortion

Globally aligned

Distortion

Page 12: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

12

Key idea: Replacing it bya similarity transformation.

As-Projective-As-Possible Warp

(scaling, rotation, translation)

Page 13: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

13

Source

Projective warpSimilarity warp Our warp

We propose shape-preserving half-projective warp, a spatial combination of a projective transformation and a similarity transformation.

Page 14: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

14

Projective warp Our warp

APAP warp APAP + Our warp

Page 15: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

15

GoalGiven a projective transformation, construct a warp that gradually changes from projective to similarity.

Page 16: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

16

Linear mapping

H

Scaleup Scale

down

Construction

+

Analysis

Page 17: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

17

Change of coordinates

Page 18: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

18

H

Scaleup Scale

down

As , area distortion

Page 19: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

19

H

H becomes linear if u is a constant

Page 20: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

20

similarity transformation

H

H becomes linear if u is a constant

Page 21: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

21

H

S

Page 22: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

22

H

S

Page 23: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

23

C0 continuity C1 continuity

Page 24: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

24

Given H, l1 and l2, determine S and T such that the resulting warp is C1 continuous.

Page 25: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

25

C1C1

Given H, l1 and l2, determine S and T such that the resulting warp is C1 continuous.

C1 continuity on l1 Boundary constraints

C1 continuity on l2

Page 26: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

26

Given H, l1 and l2, determine S and T such that the resulting warp is C1 continuous.

C1 continuity on l1 Boundary constraints

C1 continuity on l2

Page 27: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

27

Given H, l1 and l2, determine S and T such that the resulting warp is C1 continuous.

C1 continuity on l1 Boundary constraints

C1 continuity on l2

Page 28: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

28

Two-view stitching

Page 29: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

29

Two-view stitching

Projective warp

Our warp

Page 30: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

30

Given H, l1 and l2, determine S and T such that the total warp is C1 continuous.

Parameters

Page 31: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

31

Optimizing parametersWe want that each image undergoes a similarity transformation as much as possible.

Page 32: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

32

Multiple image stitching

Page 33: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

33

Projective Refinedwarp

Refinedwarp

APAP

Combined warp

Our warp

Combining with the APAP warp

Page 34: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

34

OriginalAutoStitch

Our warpProjective warp

Results

Page 35: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

35

AutoStitch

Projective warp

Our warp

Results

Page 36: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

36

• A novel parametric warp for image stitching• Parameter selection could be improved

Conclusion

Projective warpSimilarity warp Our warp

Page 37: Che-Han Chang 1 , Yoichi Sato 2 , Yung-Yu Chuang 1

37

Thank you!Any questions?