1
1. Introduction SUB-PIXEL PRECISION IMAGE MATCHING FOR DISPLACEMENT MEASUREMENT OF MASS MOVEMENTS USING NORMALISED CROSS- CORRELATION Misganu Debella-Gilo 1 and Andreas Kääb 1 1 Department of Geosciences, University of Oslo, 0316 Oslo, Norway The Normalised cross-correlation is the most widely used area-based image matching method for measuring displacements of earth surface masses such as glacier flow, rockglacier creep and landslide. One of the drawbacks of NCC is that its precision is limited to a pixel, thus varying with the size of the pixel. A number of techniques have been used to achieve sub-pixel precision in matching of mass movements using the normalised cross- correlation algorithms (e.g. Crippen and Blom, 1991; Scambos et al., 1992; Yamaguchi et al. ,2003), although without rigorous comparison of their performances. This study (Debella- Gilo and Kääb, 2010) compares the performances of two fundamentally different approaches to reaching sub-pixel precision in mass movement detection and measurement from repeat remotely sensed images, namely interpolation of image intensities to sub-pixel precision prior to matching and interpolation of the correlation surface after matching to locate the peak at sub-pixel precision. 2. Methods Three pairs of aerial orthoimages over glacier flow, rockglacier creep and rock sliding with temporal baseline of approximately one month, 13 years and 30 years, respectively, were used. These images were downsampled to five different coarser resolutions. One additional resolution pyramid pair was created by manual translation of one image to use it as translation-only control. The original image pairs were matched to measure the displacement magnitude and direction. Using the same matching points the coarser resolution images were matched. In the first approach, the coarse resolution images were interpolated to different sub-pixel precisions using bi-cubic convolution before matching. In the second approach, the coarse resolution images were matched at pixel precision and the correlation surfaces were interpolated using: 1) bi-cubic convolution, 2) parabolic curve fitting and 3) Gaussian curve fitting. 3. Results Table 1. Summary statistics for the displacement magnitudes and average velocity of the mass movements and the translation-only control image as estimated from the matching of the high-resolution original ortho-images Mass movement Temporal gap Mean displacement (m) Maximum displacement (m) Standard deviation of displacement (m) Maximum velocity (ma -1 ) Aletsch Rock slide 30 years 1.5 4.2 0.45 0.14 Muragl Rockglacier 13 years 2.4 5.8 1.20 0.45 Ghiacciaio del Belvedere Glacier 1 month 12.22 18.83 5.0 226 Control 7.50 7.50 0 7.50 Figure 4 Accuracy of the different sub-pixel precision approaches expressed as the mean deviation of the matching positions from that of the reference high-resolution original ortho-images (averaged for the three mass movement types) Figure 3 Accuracy of the different sub- pixel precision approaches for the control set expressed as the mean deviation of the matching positions from that of the reference high-resolution original ortho- images Figure 5 Relative performance of the different sub-pixel approaches for the control set expressed as the mean deviation of the matching positions from that of the same resolution original image Figure 6 Relative performance of the different sub-pixel approaches expressed as the mean deviation of the matching positions from that of the same resolution original image (averaged from the three mass movement types investigated) Fig 2. Displacement vectors on the Ghiacciaio del Belvedere (A), Muragl rockglacier (B) and Aletsch rock sliding (C). Images displayed are of time2. 4. Conclusions 5. Acknowledgements 6. References Crippen, R.E., & Blom, R.G. (1991). Measurement of subresolution terrain displacements using Spot panchromatic imagery. In, Geoscience and Remote Sensing Symposium, 1991. IGARSS '91. Remote Sensing: Global Monitoring for Earth Management., International (pp. 1667-1670) Debella-Gilo, M. and Kääb, A., 2010. Sub-pixel precision image matching for displacement measurement of mass movements using normalised cross-correlation. Remote Sensing of Environment, In review. Scambos, T.A., Dutkiewicz, M.J., Wilson, J.C., & Bindschadler, R.A. (1992). Application of image cross-correlation to the measurement of glacier velocity using satellite image data. Remote Sensing of Environment, 42, 177-186 Yamaguchi, Y., Tanaka, S., Odajima, T., Kamai, T., & Tsuchida, S. (2003). Detection of a landslide movement as geometric misregistration in image matching of SPOT HRV data of two different dates. International Journal of Remote Sensing, 24, 3523 – 3534 To achieve sub-pixel precision in displacement measurement of mass movements from repeat spatial domain optical images, interpolating image intensities to a higher resolution using bi-cubic interpolation prior to the actual image correlation performs better than both interpolation of the correlation surface using the same algorithm and peak localisation using curve fitting. Correlation peak localisation using Gaussian and polynomial algorithms are inferior in such applications. Interpolation to sub-pixel precision improves both the accuracy and detectability of earth surface mass movements. Interpolation to sub-pixel precision beyond 1/16 th of a pixel does not improve the accuracy much as the signal-to-noise ratio of the measurement decreases. Fig 1. The correlation surface together with the peak, the bi-cubic mesh (top) and the parabola or Gaussian curve fitting the correlation peak. Fig. 7. Displacement vectors depicting the difference in detected movements when the metric pixel size is decreased through intensity interpolation. Red vectors are made by matching images of pixel size 3.2 m. Blue vectors are made by matching the images after interpolating the images to pixel size of 0.4 m. The research was conducted at the Geosciences department of the University of Oslo and financially supported by the Norwegian Research Council through CORRIA project (no. 185906/V30). The orthoimages are based on airphotos by Swisstopo and CNR-IRPI. The authors are very grateful to all of the institutions. 0,00 0,02 0,04 0,06 0,08 0,10 0,12 0,14 0,16 0,18 0 0,1 0,2 0,3 0,4 0,5 0,6 Mean deviation (pixel) Sub-pixel precision (pixel) Bi-cubic (correlation) Bi-cubic (intensity) Gaussian 0,00 0,10 0,20 0,30 0,40 0,50 0,60 0,0 0,1 0,2 0,3 0,4 0,5 0,6 Mean deviation (pixel) Sub-pixel precision (pixel) Bi-cubic (correlation) Bi-cubic (intensity) Parabolic Gaussian 0,00 0,10 0,20 0,30 0,40 0,50 0,60 0,70 0,0 0,1 0,2 0,3 0,4 0,5 Mean deviation (pixels) Sub-pixel precision (pixel)) No- interpolation Bi-cubic (correlation) Gaussian Parabolic 0,00 0,10 0,20 0,30 0,40 0,50 0,60 0 0,1 0,2 0,3 0,4 0,5 Averaged mean deviation (pixels) Sub-pixel precision (pixel) Bi-cubic (correlation) Gaussian Parabollic Bi-cubic (intensity) No- Interpolation A B C The peak of the correlation coefficient was then relocated at sub-pixel precision. The performances of the algorithms were evaluated as follows: 1) by measuring the deviation of the matching points from that of the original high resolution images and computing their mean, i.e. mean deviation. 2) by measuring the deviation of the matching points from that of the same resolution original images to know how much the sub-pixel algorithms model the resolution they are supposed to model.

SUB-PIXEL PRECISION IMAGE MATCHING FOR …SUB-PIXEL PRECISION IMAGE MATCHING FOR DISPLACEMENT MEASUREMENT OF MASS MOVEMENTS USING NORMALISED CROSS-CORRELATION . Misganu Debella -Gilo

  • Upload
    others

  • View
    25

  • Download
    0

Embed Size (px)

Citation preview

Page 1: SUB-PIXEL PRECISION IMAGE MATCHING FOR …SUB-PIXEL PRECISION IMAGE MATCHING FOR DISPLACEMENT MEASUREMENT OF MASS MOVEMENTS USING NORMALISED CROSS-CORRELATION . Misganu Debella -Gilo

1. Introduction

SUB-PIXEL PRECISION IMAGE MATCHING FOR DISPLACEMENT MEASUREMENT OF MASS MOVEMENTS USING NORMALISED CROSS-

CORRELATION

Misganu Debella-Gilo1 and Andreas Kääb1

1Department of Geosciences, University of Oslo, 0316 Oslo, Norway

The Normalised cross-correlation is the most widely used area-based image matchingmethod for measuring displacements of earth surface masses such as glacier flow,rockglacier creep and landslide. One of the drawbacks of NCC is that its precision is limitedto a pixel, thus varying with the size of the pixel. A number of techniques have been used toachieve sub-pixel precision in matching of mass movements using the normalised cross-correlation algorithms (e.g. Crippen and Blom, 1991; Scambos et al., 1992; Yamaguchi etal. ,2003), although without rigorous comparison of their performances. This study (Debella-Gilo and Kääb, 2010) compares the performances of two fundamentally differentapproaches to reaching sub-pixel precision in mass movement detection and measurementfrom repeat remotely sensed images, namely interpolation of image intensities to sub-pixelprecision prior to matching and interpolation of the correlation surface after matching tolocate the peak at sub-pixel precision.

2. MethodsThree pairs of aerial orthoimages over glacierflow, rockglacier creep and rock sliding withtemporal baseline of approximately onemonth, 13 years and 30 years, respectively,were used. These images weredownsampled to five different coarserresolutions. One additional resolutionpyramid pair was created by manualtranslation of one image to use it astranslation-only control. The original imagepairs were matched to measure thedisplacement magnitude and direction. Usingthe same matching points the coarserresolution images were matched. In the firstapproach, the coarse resolution images wereinterpolated to different sub-pixel precisionsusing bi-cubic convolution beforematching. In the second approach, thecoarse resolution images were matched atpixel precision and the correlation surfaceswere interpolated using: 1) bi-cubicconvolution, 2) parabolic curve fitting and3) Gaussian curve fitting.

3. ResultsTable 1. Summary statistics for the displacement magnitudes and average velocity of the mass movements and the translation-only control image as estimated from the matching of the high-resolution original ortho-imagesMass movement Temporal gap Mean

displacement (m)

Maximum displacement (m)

Standard deviation of displacement (m)

Maximum velocity (ma-1)

Aletsch Rock slide 30 years 1.5 4.2 0.45 0.14MuraglRockglacier

13 years 2.4 5.8 1.20 0.45

Ghiacciaio del Belvedere Glacier

1 month 12.22 18.83 5.0 226

Control 7.50 7.50 0 7.50

Figure 4 Accuracy of the different sub-pixelprecision approaches expressed as themean deviation of the matching positionsfrom that of the reference high-resolutionoriginal ortho-images (averaged for thethree mass movement types)

Figure 3 Accuracy of the different sub-pixel precision approaches for the controlset expressed as the mean deviation ofthe matching positions from that of thereference high-resolution original ortho-images

Figure 5 Relative performanceof the different sub-pixelapproaches for the control setexpressed as the meandeviation of the matchingpositions from that of the sameresolution original image

Figure 6 Relativeperformance of the differentsub-pixel approachesexpressed as the meandeviation of the matchingpositions from that of thesame resolution originalimage (averaged from thethree mass movement typesinvestigated)

Fig 2. Displacement vectors on the Ghiacciaio del Belvedere (A), Muragl rockglacier (B) and Aletsch rock sliding (C). Images displayed are of time2.

4. Conclusions

5. Acknowledgements

6. References

Crippen, R.E., & Blom, R.G. (1991). Measurement ofsubresolution terrain displacements using Spot panchromaticimagery. In, Geoscience and Remote Sensing Symposium,1991. IGARSS '91. Remote Sensing: Global Monitoring for EarthManagement., International (pp. 1667-1670)

Debella-Gilo, M. and Kääb, A., 2010. Sub-pixel precision imagematching for displacement measurement of mass movementsusing normalised cross-correlation. Remote Sensing ofEnvironment, In review.

Scambos, T.A., Dutkiewicz, M.J., Wilson, J.C., & Bindschadler,R.A. (1992). Application of image cross-correlation to themeasurement of glacier velocity using satellite image data.Remote Sensing of Environment, 42, 177-186

Yamaguchi, Y., Tanaka, S., Odajima, T., Kamai, T., & Tsuchida, S.(2003). Detection of a landslide movement as geometricmisregistration in image matching of SPOT HRV data of twodifferent dates. International Journal of Remote Sensing, 24,3523 – 3534

To achieve sub-pixel precision in displacement measurementof mass movements from repeat spatial domain opticalimages, interpolating image intensities to a higher resolutionusing bi-cubic interpolation prior to the actual imagecorrelation performs better than both interpolation of thecorrelation surface using the same algorithm and peaklocalisation using curve fitting. Correlation peak localisationusing Gaussian and polynomial algorithms are inferior insuch applications.

Interpolation to sub-pixel precision improves both theaccuracy and detectability of earth surface massmovements. Interpolation to sub-pixel precision beyond1/16th of a pixel does not improve the accuracy much as thesignal-to-noise ratio of the measurement decreases.

Fig 1. The correlation surface together with the peak, the bi-cubic mesh (top) and the parabola or Gaussian curve fitting the correlation peak.

Fig. 7. Displacement vectors depicting the difference indetected movements when the metric pixel size is decreasedthrough intensity interpolation. Red vectors are made bymatching images of pixel size 3.2 m. Blue vectors are madeby matching the images after interpolating the images to pixelsize of 0.4 m.

The research was conducted at the Geosciencesdepartment of the University of Oslo and financiallysupported by the Norwegian Research Council throughCORRIA project (no. 185906/V30). The orthoimages arebased on airphotos by Swisstopo and CNR-IRPI. Theauthors are very grateful to all of the institutions.

0,000,020,040,060,080,100,120,140,160,18

0 0,1 0,2 0,3 0,4 0,5 0,6

Mea

n de

viat

ion

(pix

el)

Sub-pixel precision (pixel)

Bi-cubic (correlation)Bi-cubic (intensity)Gaussian

0,00

0,10

0,20

0,30

0,40

0,50

0,60

0,0 0,1 0,2 0,3 0,4 0,5 0,6

Mea

n de

viat

ion

(pix

el)

Sub-pixel precision (pixel)

Bi-cubic (correlation)Bi-cubic (intensity)Parabolic

Gaussian

0,000,100,200,300,400,500,600,70

0,0 0,1 0,2 0,3 0,4 0,5

Mea

n de

viat

ion

(pix

els)

Sub-pixel precision (pixel))

No-interpolationBi-cubic (correlation)Gaussian

Parabolic

0,000,100,200,300,400,500,60

0 0,1 0,2 0,3 0,4 0,5Aver

aged

mea

n de

viat

ion

(pix

els)

Sub-pixel precision (pixel)

Bi-cubic (correlation)Gaussian

Parabollic

Bi-cubic (intensity)No-Interpolation

A

B

C

The peak of the correlation coefficient was then relocated at sub-pixel precision. Theperformances of the algorithms were evaluated as follows: 1) by measuring the deviation ofthe matching points from that of the original high resolution images and computing their mean,i.e. mean deviation. 2) by measuring the deviation of the matching points from that of thesame resolution original images to know how much the sub-pixel algorithms model theresolution they are supposed to model.