H.264 and DIS
指導教授：楊士萱 老師學生：鄭馥銘
Outline
Introduction of DIS Combine DIS and H.264 Some problem for combination issue Future work
Outline
Introduction of DIS Combine DIS and H.264 Some problem for combination issue Future work
Introduction
Why use DIS in video-footage deviceVideo footage from hand-held camera is typic
ally jerky due to small,unwanted camera movements.
We present a video stabilization algorithm aimed to produce a compensated video sequence so that the camera’s undesirable shake or jiggle can be removed.
Categories of DIS
Mechanical-Optical system Mechanical-Digital system Fully Digital system
Architecture of DIS - 1
Pre-processing
Diadv ： Need additional memory 、 sensor 、 chip
Stabilization Video-Encoder Video-Decoderinput output
Architecture of DIS - 2
Post-processing
Adv ： No motion estimation computation
Disadv ： Coding efficiency can not be increased
Stabilization
Video-Encoder Video-Decoderinput output
Architecture of DIS - 3
Combine-Encoder
Adv ： Save memory 、 sensor 、 chip 、 Coding efficiency can be increased 。
Disdv ：？
Stabilization
Video-Encoder Video-Decoderinput output
Summarize the goal of DIS-system
Combine DIS and H.264 EncoderOur DIS using block-base ME is suited with
encoder so that DIS can immediate get MV form encoder.
Coding efficiency can be increasedJitter can be removed
Outline
Introduction of DIS Combine DIS and H.264 Some problem for combination issue Future work
H.264 Baseline Profile
Free to use Tools
I Slice P SliceCAVLCSlice GroupRedundant Slice
Review of DIS systemBlock-Blased Motion
Estimation
MV Validation
MVs
FMV Generation
Hand – shake Estimation
Motion correction
LMVs
FMV
SMV , HMV , AMV
H.264 Encoder Architecture
Review of DIS systemBlock-Blased Motion
Estimation
MV Validation
MVs
FMV Generation
Hand – shake Estimation
Motion correction
LMVs
FMV
SMV , HMV , AMV
H.264 Encoder Architecture
ME - In DIS system
MB Size
ME - In DIS system
ME - In DIS system
Reference picture management Short termLong term
ME - In DIS system
Pixel ResolutionFull pixelHalf pixelQuarter pixel
ME - In DIS system
H.264 Main profileB Slice
ME - In DIS system
H.264 Main profile Interlaced
ME - In DIS system
Slice groupEx 1 ： interlace
Ex 2 ： foreground &
background
Combine DIS system and H.264
Block-Blased Motion Estimation
MV Validation
MVs
FMV Generation
Hand – shake Estimation
Motion correction
LMVs
FMV
SMV , HMV , AMV
Block-Blased Motion Estimation
Hand – shake Estimation
Motion correction
MVs
SMV , HMV , AMV
H.264 Encoder Architecture
HE
Combine DIS system and H.264
Block-Blased Motion Estimation
Hand – shake Estimation
Motion correction
MVs
SMV , HMV , AMV
H.264 Encoder Architecture
HE
Motion Correction
?
Outline
Introduction of DIS Combine DIS and H.264 Some problem for combination issue Future work
Some problem of combination issue
Where to place Motion Correction module What we need
MV bufferDelay residual coding
DIS-H.264 system architecture-1
HE
Motion Correction
MV Buffer
Some problem of combination issue
DIS-H.264 system architecture-1Maybe jitter can be removed But it does not increase coding efficiency
Remark of combination issue
Shifting frame to stable position （ Motion Correction ） before motion estimation, in order to increase coding efficiency.
Shifting frame to stable position （ Motion Correction ） before motion estimation ,Because the size of reference frame is smaller than current frame.
Zoran DIS-MPEG4 system
Future work
Ability to modify reference software program
To assess the effects of DIS-H.264 system
Recommended
