28
Stereo Matching Low-Textured Survey 1. Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2. A Robust Stereo Matching Method for Low Texture Stereo Images 1

Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

Embed Size (px)

Citation preview

Page 1: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

1

Stereo Matching Low-Textured Survey

1. Stereo Matching-Based Low-Textured Scene Reconstruction

for Autonomous Land Vehicles (ALV) Navigation

2. A Robust Stereo Matching Method for Low Texture Stereo

Images

Page 2: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

2

Outline

• Introduction• Proposed Paper 1 • Proposed Paper 2• Conclusion • Result

Page 3: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

3

Introduction

• Low-textured–Matching costs of the stereo pairs are almost

similar.

• In low-textured regions– Local algorithms are guaranteed to fail.– Global algorithms are too time-consuming.

Page 4: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

4

Introduction

• Solution of Local Approach– Bigger window size.

• Low-textured regions are larger than the size of the aggregation window.

Page 5: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

5

Introduction

• The size of aggregation windows should be – large enough to include intensity variation.– small enough to avoid disparity variation.

• An adaptive method for selecting the optimal aggregation window for stereo pairs.

Page 6: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

6

Introduction

• Low computation time and high quality of disparity map.

• Different strategies are applied in the well-textured and low-textured regions.

Page 7: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

7

Introduction

Page 8: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

8

Outline

• Introduction• Proposed Paper 1– Proposed Method– Texture Detection– Approaches

• Proposed Paper 2• Conclusion• Result

Page 9: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

9

Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles

(ALV) Navigation

Image Analysis and Signal Processing (IASP), 2011 International Conference on

Mechatronics & Automation School, National University of Defense Technology, Changsha, Hunan, China

Tingbo Hu

Tao Wu

Hangen He

Page 10: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

10

Proposed Method

• Local algorithms are used to matching the pixels in well-textured regions.

• A new matching algorithm combining plane priors and pixel dissimilarity is designed for the low-textured regions.

Page 11: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

11

Proposed Method

• In low-textured regions, the intensities of the pixels are almost identical.–Material and the Normal Vectors are consistent.

Page 12: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

12

Proposed Method

• A low-textured region is likely to correspond to a 3D plane.

Page 13: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

13

Texture Detection

• .

• .

Page 14: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

14

Approach - Local

• In the well-textured regions–Moravec Normalized Cross Correlation (MNCC)

Page 15: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

15

Approach - Plane

• In the low-textured regions

Page 16: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

16

Approaches

• .Low textured

Well textured

Page 17: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

17

Disparity Map

Page 18: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

18

Outline

• Introduction• Proposed Paper 1• Proposed Paper 2– Proposed Method– Edge Detection– Aggregation

• Conclusion• Result

Page 19: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

19

A Robust Stereo Matching Method for Low Texture Stereo Images

Computing and Communication Technologies, 2009. RIVF '09. International Conference on

Department of Information Media Technology Faculty of Information Science and Technology, Tokai University

Le Thanh SACH

Kiyoaki ATSUTA

Kazuhiko HAMAMOTO

Shozo KONDO

Page 20: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

20

Proposed Method

• Utilizes the edge maps computed from the stereo pairs to guide the cost aggregation.

Page 21: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

21

Proposed Method

Page 22: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

22

Edge Detection

Page 23: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

23

Edge Map

Page 24: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

24

Edge Detection

Page 25: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

25

Aggregation

• Horizontal Aggregation

Page 26: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

26

Aggregation

• Vertical Aggregation

Page 27: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

27

Conclusion

• Different strategies are applied in different kinds of regions.

• The computational complexity of Paper 2 cost aggregation method is independent of the window size.

Page 28: Stereo Matching Low-Textured Survey 1.Stereo Matching-Based Low-Textured Scene Reconstruction for Autonomous Land Vehicles (ALV) Navigation 2.A Robust

28

Result