19
Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan Liu, Jun Fan, Qizi Huangpeng, Jing Feng, Jinlun Zhou, Maojun Zhang 1 College of Information System and Management National University of Defense Technology

Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

  • Upload
    vominh

  • View
    219

  • Download
    2

Embed Size (px)

Citation preview

Page 1: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

Super-resolving a Single Blurry ImageThrough Blind Deblurring Using ADMM

Xiangrong Zeng, Yan Liu, Jun Fan, Qizi Huangpeng, Jing Feng,Jinlun Zhou, Maojun Zhang

1

College of Information System and Management

National University of Defense Technology

Page 2: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

Single image super-resolution (SISR)

2

aims to recover a high-resolution (HR) image

from a low-resolution (LR) input image

The SISR problem is typically severely ill-posed!

Page 3: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

Single image super-resolution (SISR)

3

Gaussian blur [Begin and Ferrie, 2004]

Bicubic interpolation (BI) [Glasner, et al., 2009; Yang, et al., 2010]

Gaussian blur followed by BI [Freeman and Liu, 2011]

Simple pixel averaging [Fattal, 2007]

……

Page 4: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

Two important works

4

An accurate blur model is critical to the success of SISRalgorithms[Efrat et al., 2013]

The PSF of camera is the wrong blur kernel from the LRimage [Michaeli and Irani, 2013]

Both seek accurate blur kernels based on existing SISRalgorithms, thus their complexisties are even morethan those of the SISR ones.

Page 5: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

Single blind image super-resolution (SBISR)

5

Only a few works dedicated to the SBISR problem, haverestrictive assumptions on the blur kernel:

A parametric Gaussian model with unknown width[Begin and Ferrie, 2004; Qiao, et al., 2006; Wang, et al., 2005]

Multiple parametric models [He, et al., 2009]

A nonparametric model assuming the kernel has asingle peak [He, et al., 2009]

Page 6: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

In this paper

6

We address the SBISR problem via a blind image deblurring (BID)

method, bridge the gap between SBISR and BID, benefit from

that some BID methods are arguably faster and easier to

understand, than state-of-the-art SISR/SBISR methods, and

reach competitive speed and restoration quality.

Page 7: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

SBISR and BID

7

recover a HR image from a LR imageSBISR:

BID:recover a sharp image from a blurry image

Page 8: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

SBISR and BID

8

SBISR:

BID:

we can solve the SBISR problem in an easier way via reformulatingit into a BID problem.

Page 9: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

Reformulating SBISR into BID

9

SBISR:

The resulting BID :

Page 10: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

The resulting BID problem

10

The regularization problem

Page 11: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

The algorithmic framework

11

Can be efficientlysolved by alternatingdirection method ofmultipliers (ADMM)

Page 12: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

The alternating direction method of multipliers (ADMM)[Gabay and Mercier, 1976; Boyd et al., 2011; Almeida and Figueiredo, 2013]

12

ADMM has been as a popular tool to solving imaging inverse problems

Page 13: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

13

Page 14: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

14

Page 15: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

15

Page 16: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

16

Page 17: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

17

Page 18: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

18

Page 19: Super-resolving a Single Blurry Image Through Blind Deblurring · PDF file · 2016-12-25Super-resolving a Single Blurry Image Through Blind Deblurring Using ADMM Xiangrong Zeng, Yan

Conclusions

19

• Have proposed a new approach for single blind image super-resolution (SBISR) via a blind image deblurring (BID) method,bridging the gap between SBISR and BID, benefitting from thatsome BID methods are arguably faster and easier to understand,than state-of-the-art SISR/SBISR methods, and reachingcompetitive speed and restoration quality.

• Experiments on synthetic and real images show that theeffectiveness and competitiveness of the proposed method.

Thanks for your attention!