Восстановление сжатого видео

Моисейцев Алексей

Video GroupCS MSU Graphics & Media Lab

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

222

Содержание

Введение

SWAT

Adaptive Fuzzy Filtering

Заключение

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

3

Введение

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

444

Содержание

Введение

SWAT

Adaptive Fuzzy Filtering

Заключение

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

5

SWAT

Fast super-resolution reconstructions of mobile video using warped transforms and adaptive thresholding, Sandeep Kanumuri, Onur G. Guleryuz, M. Reha Civanlar,SPIE Conf. on Applications of Digital Image Processing XXX, 2007

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

6

SWAT

Fast super-resolution reconstructions of mobile video using warped transforms and adaptive thresholding, Sandeep Kanumuri, Onur G. Guleryuz, M. Reha Civanlar,SPIE Conf. on Applications of Digital Image Processing XXX, 2007

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

7

SWAT

Fast super-resolution reconstructions of mobile video using warped transforms and adaptive thresholding, Sandeep Kanumuri, Onur G. Guleryuz, M. Reha Civanlar,SPIE Conf. on Applications of Digital Image Processing XXX, 2007

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

8

SWAT

Изображение разбивается на блоки 4x4

Для каждого блока выбирается подходящая маска

Fast super-resolution reconstructions of mobile video using warped transforms and adaptive thresholding, Sandeep Kanumuri, Onur G. Guleryuz, M. Reha Civanlar,SPIE Conf. on Applications of Digital Image Processing XXX, 2007

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

9

SWAT

Fast super-resolution reconstructions of mobile video using warped transforms and adaptive thresholding, Sandeep Kanumuri, Onur G. Guleryuz, M. Reha Civanlar,SPIE Conf. on Applications of Digital Image Processing XXX, 2007

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

10

SWAT

Fast super-resolution reconstructions of mobile video using warped transforms and adaptive thresholding, Sandeep Kanumuri, Onur G. Guleryuz, M. Reha Civanlar,SPIE Conf. on Applications of Digital Image Processing XXX, 2007

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

11

SWATРезультаты

Билинейная интерполяция(несжатое видео)

Fast super-resolution reconstructions of mobile video using warped transforms and adaptive thresholding, Sandeep Kanumuri, Onur G. Guleryuz, M. Reha Civanlar,SPIE Conf. on Applications of Digital Image Processing XXX, 2007

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

12

SWATРезультаты

Результат обработки(несжатое видео)

Fast super-resolution reconstructions of mobile video using warped transforms and adaptive thresholding, Sandeep Kanumuri, Onur G. Guleryuz, M. Reha Civanlar,SPIE Conf. on Applications of Digital Image Processing XXX, 2007

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

13

SWATРезультаты

(несжатое видео)Fast super-resolution reconstructions of mobile video using warped transforms and adaptive thresholding, Sandeep Kanumuri, Onur G. Guleryuz, M. Reha Civanlar,SPIE Conf. on Applications of Digital Image Processing XXX, 2007

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

14

SWATРезультаты

Сжатое видео (H.264, QP=25)Fast super-resolution reconstructions of mobile video using warped transforms and adaptive thresholding, Sandeep Kanumuri, Onur G. Guleryuz, M. Reha Civanlar,SPIE Conf. on Applications of Digital Image Processing XXX, 2007

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

15

SWATРезультаты

H.264 интерполяцияFast super-resolution reconstructions of mobile video using warped transforms and adaptive thresholding, Sandeep Kanumuri, Onur G. Guleryuz, M. Reha Civanlar,SPIE Conf. on Applications of Digital Image Processing XXX, 2007

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

16

SWATРезультаты

Предложенный методFast super-resolution reconstructions of mobile video using warped transforms and adaptive thresholding, Sandeep Kanumuri, Onur G. Guleryuz, M. Reha Civanlar,SPIE Conf. on Applications of Digital Image Processing XXX, 2007

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

17

SWATРезультаты

Fast super-resolution reconstructions of mobile video using warped transforms and adaptive thresholding, Sandeep Kanumuri, Onur G. Guleryuz, M. Reha Civanlar,SPIE Conf. on Applications of Digital Image Processing XXX, 2007

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

18

SWATРезультаты

Fast super-resolution reconstructions of mobile video using warped transforms and adaptive thresholding, Sandeep Kanumuri, Onur G. Guleryuz, M. Reha Civanlar,SPIE Conf. on Applications of Digital Image Processing XXX, 2007

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

191919

Содержание

Введение

SWAT

Adaptive Fuzzy Filtering

Заключение

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

20

Adaptive Fuzzy Filtering

Обычный фильтр:

x — исходное изображение

y — результат

h — весовая функция

Adaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

21

Adaptive Fuzzy Filtering

Свойства

Пример

Adaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

22

Adaptive Fuzzy FilteringГеометрическая зависимость

Adaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

23

Adaptive Fuzzy FilteringПример

исходноеизображение

сжатоеизображение

Adaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

24

Adaptive Fuzzy Filtering

Зависимость от положения:

STD – стандартное отклонение в окрестности

Adaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

25

Adaptive Fuzzy FilteringDirectional Fuzzy Filter

Directional Fuzzy Filter

Adaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

26

Adaptive Fuzzy FilteringDirectional Fuzzy Filter

сжатое видео классификация блоков

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

27

Adaptive Fuzzy FilteringSpatiotemporal Filter

Adaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

28

Adaptive Fuzzy FilteringSpatiotemporal Filter

Adaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

29

Adaptive Fuzzy FilteringSpatiotemporal Filter

Корреляция

Adaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

30

Adaptive Fuzzy FilteringРезультаты

PSNR:

Adaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

31

Adaptive Fuzzy FilteringРезультаты

ОригиналAdaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

32

Adaptive Fuzzy FilteringРезультаты

Сжатое изображениеAdaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

33

Adaptive Fuzzy FilteringРезультаты

Восстановленное изображениеAdaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

34

Adaptive Fuzzy FilteringРезультаты

Adaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

35

Adaptive Fuzzy FilteringРезультаты

ОригиналAdaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

36

Adaptive Fuzzy FilteringРезультаты

Сжатое изображение (30.77 dB)Adaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

37

Adaptive Fuzzy FilteringРезультаты

Восстановленное изображение — Fuzzy Spatial Filter(30.9 dB)

Adaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

38

Adaptive Fuzzy FilteringРезультаты

Восстановленное изображение — предложенный метод (31.09 dB)

Adaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

39

Adaptive Fuzzy FilteringРезультаты

Adaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

404040

Содержание

Введение

SWAT

Adaptive Fuzzy Filtering

Заключение

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

41

Заключение

Были рассмотрены два алгоритма

Алгоритмы рассчитаны на высокую скорость работы

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

42

Литература

Adaptive fuzzy filtering for artifact reduction in compressed images and videos, Dung T. Võ, Truong Q. Nguyen, Sehoon Yea, Anthony Vetro, IEEE Transactions on Image Processing, Volume 18 , Issue 6 (June 2009), pp. 1166-1178

Fast super-resolution reconstructions of mobile video using warped transforms and adaptive thresholding, Sandeep Kanumuri, Onur G. Guleryuz, M. Reha Civanlar,SPIE Conf. on Applications of Digital Image Processing XXX, 2007

CS MSU Graphics & Media Lab (Video Group)

Only for Maxus

4343

Вопросы

?

43