Embed Size (px)
Citation preview
EIE
415
Mul
timed
ia T
echn
olog
y
Vide
o C
ompr
essi
on
Dr.
Y. H
. Cha
n
2E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Lear
ning
Obj
ectiv
es
Exam
ine
both
the
theo
retic
and
pra
ctic
al a
spec
ts o
f the
vid
eo
com
pres
sion
pro
cess
.D
escr
ibe
the
tem
pora
l red
unda
ncy
that
may
be
expl
oite
d by
vi
deo
com
pres
sion
alg
orith
m.
Add
ress
mot
ion-
com
pens
ated
pre
dict
ion
codi
ngin
the
vide
o co
mpr
essi
on.
Des
crib
e M
PEG
com
pres
sion
stan
dard
s.R
efer
ence
s:“M
ultim
edia
Com
mun
icat
ions
: App
licat
ions
, Net
wor
ks, P
roto
cols
an
d St
anda
rds”
, Fre
d H
alsa
ll, A
ddis
on-W
esle
y, C
hapt
er 4
3E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Con
tent
sFu
ndam
enta
ls o
f vid
eo■
Pict
ure
form
ats
■Fr
ame
rate
s ■
Tem
pora
l red
unda
ncy
■sp
atia
l red
unda
ncy
Mot
ion
com
pens
atio
n pr
edic
tion
■M
otio
n es
timat
ion
■
Mot
ion
com
pens
atio
n ■
Mot
ion
vect
or
■Fu
ll se
arch
alg
orith
m
■3-
step
sear
ch a
lgor
ithm
■
Com
plex
ity v
sper
form
ance
Cod
ec■
Type
s of f
ram
es ■
Tran
smis
sion
ord
er ■
Cod
ing
of d
iffer
ent f
ram
es
Vid
eo st
ream
synt
ax■
Sequ
ence
■G
OP ■
Pict
ure ■
Slic
e ■
Mac
robl
ock■
Blo
ck
4E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Con
tent
s (C
ont.)
Stan
dard
s : B
ackg
roun
d &
His
tory
■M
PEG
-1/-2
/-4/H
-264
/AV
S■
MPE
G-2
: ■
Prof
iles a
nd L
evel
s ■
Scal
abili
ty -
vario
us sc
hem
es a
nd th
eir u
se■
MPE
G-4
: ■
Goa
ls
■
codi
ng o
f vid
eo o
bjec
ts■
H.2
64 :
■
New
feat
ures
Inte
r-m
ode:
■
Sub-
mac
robl
ocks
of v
ario
us si
zes
■
Mul
tiple
refe
renc
e fr
ames
■
B-f
ram
e pr
edic
tion
wei
ghtin
g
■(1
/8)-
pixe
l mot
ion
vect
or p
reci
sion
Intra
-mod
e:
■Sp
atia
l pre
dict
ion
■In
tege
r tra
nsfo
rm
EIE
415
Mul
timed
ia T
echn
olog
y
Fund
amen
tals
of V
ideo
6E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Intr
oduc
tion
The
bit r
ate
requ
irem
ents
resu
lting
from
all
digi
tal
vide
o ar
e su
bsta
ntia
lly la
rger
than
the
bit r
ates
of t
he
trans
mis
sion
cha
nnel
s.C
ompr
essi
on is
nec
essa
ry
NO
Tju
st a
sing
le st
anda
rd a
ssoc
iate
d w
ith v
ideo
H.2
61, H
.263
, …M
PEG
-1, M
PEG
-2 a
nd M
PEG
-4
7E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Pict
ure
Form
at (H
igh
Res
olut
ion)
CC
IR-6
01 4
:2:2
form
atY
: 720×4
80U
V: 3
60×4
80A
pplic
atio
n: O
rigin
al d
igiti
zatio
n fo
rmat
use
d in
CC
IR-6
01
(Tel
evis
ion
Stud
ios)
CC
IR-6
01 4
:2:0
form
atY
: 720×4
80U
V: 3
60×2
40 (A
bsen
ce o
f chr
omin
ance
sam
ples
in a
ltera
tive
lines
)A
pplic
atio
n: D
igita
l vid
eo b
road
cast
app
licat
ions
8E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Pict
ure
Form
at (L
ow R
esol
utio
n)
CIF
(Com
mon
Inte
rmed
iate
For
mat
)4:
2:0
form
atY
: 360×
288
UV
: 180
×14
4A
pplic
atio
ns: A
pic
ture
qua
lity
com
para
ble
with
that
obt
aine
d w
ith
VC
Rs q
ualit
y or
vid
eo c
onfe
renc
ing
QC
IF 4:2:
0 fo
rmat
Y: 1
80×
144
UV
: 90×
72A
pplic
atio
ns: M
obile
mul
timed
ia
9E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Dig
ital V
ideo
Vid
eo (m
ovin
g pi
ctur
es):
a se
quen
ce o
f dig
itize
d pi
ctur
e.
10E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Dig
ital V
ideo
(Fra
me
rate
s)
fram
e ra
tes:
full-
mot
ion
vide
o:24
-30
fram
es/s
or
even
60
fram
es/s
for
HD
TVan
imat
ion:
15-1
9 fr
ames
/svi
deo
tele
phon
y:5-
10 f
ram
es/s
vide
o co
nfer
enci
ng &
inte
ract
ive
med
ia a
pplic
atio
ns:
15-3
0 fr
ames
/s
11E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Vide
o C
ompr
essi
on P
rinci
ples
Vid
eo (m
ovin
g pi
ctur
es):
a se
quen
ce o
f dig
itize
d pi
ctur
e.M
ovin
g JP
EG (1
0:1
to 2
4:1)
: spa
tial r
edun
danc
y
Con
side
r: a
pers
on o
r veh
icle
mov
ing
acro
ss th
e sc
reen
in a
mov
ieLa
st fo
r at l
east
3s
Ass
ume:
fram
e ra
te 6
0 fr
ame
per s
econ
d ⇒
180
fram
esB
y se
ndin
g on
ly in
form
atio
n re
latin
g to
thos
e se
gmen
ts o
f eac
h fr
ame
that
hav
e m
ovem
ent a
ssoc
iate
d w
ith th
emC
onsi
dera
ble
savi
ngs i
n ba
ndw
idth
Tem
pora
l red
unda
ncy
12E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Fram
e D
iffer
ence
C
odin
g
Vide
o -T
empo
ral R
edun
danc
y
Sim
ilarit
ies e
xist
be
twee
n su
cces
sive
fr
ames
Mot
ion
Estim
atio
n
and
Com
pens
atio
n
Proc
essi
ng fo
r re
duci
ng te
mpo
ral
redu
ndan
cies
fram
e t-1
fram
e t
Proc
essi
ng fo
r red
ucin
g sp
atia
l re
dund
anci
es
EIE
415
Mul
timed
ia T
echn
olog
y
Mot
ion-
Com
pens
atio
n Pr
edic
tion
14E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Mot
ion-
Com
pens
atio
n
Mov
ing
Obj
ect
(u,v
)
Dis
plac
edO
bjec
t
time
t
Prev
ious
fram
e
Cur
rent
fram
e
Stat
iona
ryba
ckgr
ound
Mot
ion
com
pens
atio
n•
the
proc
ess
of c
ompe
nsat
ing
for
the
disp
lace
men
t of m
ovin
g ob
ject
s fr
om
one
fram
e to
ano
ther
•Pr
edic
tion
for
lum
inan
ce
sign
al
I(x,y
,t)w
ith th
e m
ovin
g ob
ject
:
)1,
,(
),
,(ˆ
−−
−=
tv
yu
xI
ty
xI
15E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Hyb
rid C
odin
g Sc
hem
e w
ith M
C P
redi
ctio
n
Mot
ion
Estim
atio
n
Mot
ion
Com
pens
atio
n 2
D-D
CT
Cod
ing
I(x,y
,t)
I(x,y
,t-1)
mot
ion
vect
or(u
,v) e(
x,y,
t)
2D
-DC
TD
ecod
ing
Mot
ion
Com
pens
atio
nFr
ame
mem
ory
e(x,
y,t)
I(x,y
,t)
I(x+
u,y+
v,t-1
)
Enco
der
Dec
oder
Mot
ion
estim
atio
n-
the
proc
ess
of f
indi
ng
corr
espo
ndin
g pi
xels
am
ong
fram
es,
i.e.
the
mot
ion
vect
or (u
,v).
Mot
ion
vect
or-
the
rela
tive
disp
lace
men
t of
a ob
ject
from
one
fram
e to
ano
ther
Pr
edic
tion
erro
r:
The
pred
ictio
n er
ror
is e
ncod
ed b
y th
e D
CT
codi
ng m
etho
d
Mot
ion
com
pens
atio
n is
per
form
ed i
n bo
th t
he
enco
der
and
the
deco
der,
but
mot
ion
estim
atio
n is
nee
ded
only
in e
ncod
er
⇒as
ymm
etric
pro
perty
)1,
,(
),
,(
),
,(ˆ
),
,(
),
,(
−−
−−−
=t
vy
ux
It
yx
It
yx
It
yx
It
yx
e
16E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Blo
ck M
atch
ing
Mot
ion
Estim
atio
n
N
N
N
N
Bloc
k
sear
ch w
indow
(-D
, D)
D
D
DD
fram
e t
fram
e t-1
tor
mot
ion
vec
fin
al
the
: ),
(to
rm
otio
n ve
c
cand
idat
e
the
ofpo
sitio
n : )
,(
fram
e
refe
renc
e
in th
ebl
ock
:),(fr
ame
curr
ent
in
the
bloc
k :),(
),
(m
in
arg
),
(
|),
()
,(|
),
(
1
l)(k
,
1 0
1 01
vu
lkII
lk
SAD
vu
lj
ki
Ij
iI
lk
SAD
tt
N i
N jt
t
⋅⋅⋅⋅
=
++
−=
−
− =
− =−
∑∑
Mat
chin
g C
riter
ion:
Su
m A
bsol
ute
Diff
eren
ce
The
bloc
k th
at g
ives
the
best
m
atch
for a
giv
en m
atch
ing
crite
rion
is c
hose
n as
the
mot
ion
vect
or.
Full
sear
chin
gm
ost a
ccur
ate
heav
y co
mpu
tatio
n
Fast
sear
chin
gre
duce
d co
mpu
tatio
n co
mpl
exity
dete
riora
tion
in p
ictu
re q
ualit
y
17E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Curre
nt fra
meRe
feren
ce fr
ame
Sear
ching
wind
owTh
e loc
al co
ordin
ate sy
stem
used
in th
e se
arch
ing w
indow
are u
sed t
o dete
rmine
the
moti
on ve
ctor o
f the m
acro
bloc
k.
Macro
block
of int
eres
t
(0,-6
)
(-6,0)
(6,0)
(0,6)
(0,0)
Cand
idate
macro
block
Full
Sear
ch
18E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Sear
ching
wind
ow
(0,-6
)
(-6,0)
(6,0)
(0,6)
(0,0)
1 -6-5
-4-3
-2-1
01
23
45
6x =-6-5-4-3-2-10123456
y =
MAE
Macro
block
of int
eres
t
MAE
plane
in th
e wind
ow
Curre
nt fra
meRe
feren
ce fr
ame
Full
Sear
ch
19E
IE41
5 M
ultim
edia
Tec
hnol
ogy
12
36
59
78
84
2Se
arch
ing w
indow
(0,-6
)
(-6,0)
(6,0)
(0,6)
(0,0)
11 -6
-5-4
-3-2
-10
12
34
56
x =-6-5-4-3-2-10123456y =
MAE
Macro
block
of int
eres
t
MAE
plane
in th
e wind
ow
Curre
nt fra
meRe
feren
ce fr
ame
Full
Sear
ch
20E
IE41
5 M
ultim
edia
Tec
hnol
ogy
73
87
51
34
83
73
14
36
51
65
24
28
32
51
79
37
54
93
27
38
59
24
66
67
57
39
110
511
102
83
23
84
74
54
93
17
25
37
86
73
87
51
34
83
73
59
52
14
78
54
77
71
14
97
82
55
84
32
28
41
33
73
52
94
63
17
116
86
14
86
35
16
26
311
83
57
56
541
23
65
97
88
42
Sear
ching
wind
ow
MAE
plane
in th
e wind
ow
(0,-6
)
(-6,0)
(6,0)
(0,6)
(0,0)
11 -6
-5-4
-3-2
-10
12
34
56
x =-6-5-4-3-2-10123456y =
MAE
Macro
block
of int
eres
t
MAE
Macro
block
of int
eres
t
Curre
nt fra
meRe
feren
ce fr
ame
Full
Sear
ch
21E
IE41
5 M
ultim
edia
Tec
hnol
ogy
73
87
51
34
83
73
14
36
51
65
24
28
32
51
79
37
54
93
27
38
59
24
66
67
57
39
110
511
102
83
23
84
74
54
93
17
25
37
86
73
87
51
34
83
73
59
52
14
78
54
77
71
14
97
82
55
84
32
28
41
33
73
52
94
63
17
116
86
14
86
35
16
26
311
83
57
56
541
23
65
97
88
42
Sear
ching
wind
ow
MAE
plane
in th
e wind
ow
(0,-6
)
(-6,0)
(6,0)
(0,6)
(0,0)
11 -6
-5-4
-3-2
-10
12
34
56
x =-6-5-4-3-2-10123456y =
Curre
nt fra
meRe
feren
ce fr
ame
Full
Sear
ch
1
•mi
n MAE
=0 ha
ppen
s at (
-5,-2
) ⇒
the m
otion
vecto
r of th
e bloc
k is (
-5,-2
).•
Reali
zatio
n com
plexit
y is h
igh.
Macro
block
of int
eres
t
22E
IE41
5 M
ultim
edia
Tec
hnol
ogy
n-St
ep H
iera
chic
alSe
arch
(n-S
HS)
(Tut
oria
l)
23E
IE41
5 M
ultim
edia
Tec
hnol
ogy
73
87
51
34
83
73
14
36
51
65
24
28
32
51
79
37
54
93
27
38
59
24
66
67
57
39
110
511
102
83
23
84
74
54
93
17
25
37
86
73
87
51
34
83
73
59
52
14
78
54
77
71
14
97
82
55
84
32
28
41
33
73
52
94
63
17
116
86
14
86
35
16
26
311
83
57
56
541
23
65
97
88
42
Sear
ching
wind
ow
MAE
plane
in th
e wind
ow
(0,-6
)
(-6,0)
(6,0)
(0,6)
(0,0)
11 -6
-5-4
-3-2
-10
12
34
56
x =-6-5-4-3-2-10123456y =
Curre
nt fra
meRe
feren
ce fr
ame
Macro
block
of int
eres
t
39 5
2
3-st
ep se
arch
St
ep 1
637
3
3
24E
IE41
5 M
ultim
edia
Tec
hnol
ogy
73
87
51
34
83
73
14
36
51
65
24
28
32
51
79
37
54
93
27
38
59
24
66
67
57
39
110
511
102
83
23
84
74
54
93
17
25
37
86
73
87
51
34
83
73
59
52
14
78
54
77
71
14
97
82
55
84
32
28
41
33
73
52
94
63
17
116
86
14
86
35
16
26
311
83
57
56
541
23
65
97
88
42
Sear
ching
wind
ow
MAE
plane
in th
e wind
ow
(0,-6
)
(-6,0)
(6,0)
(0,6)
(0,0)
11 -6
-5-4
-3-2
-10
12
34
56
x =-6-5-4-3-2-10123456y =
Curre
nt fra
meRe
feren
ce fr
ame
Macro
block
of int
eres
t
39 5
263
7
3
35
1 63
525
9
6
3-st
ep se
arch
St
ep 2
25E
IE41
5 M
ultim
edia
Tec
hnol
ogy
73
87
51
34
83
73
14
36
51
65
24
28
32
51
79
37
54
93
27
38
59
24
66
67
57
39
110
511
102
83
23
84
74
54
93
17
25
37
86
73
87
51
34
83
73
59
52
14
78
54
77
71
14
97
82
55
84
32
28
41
33
73
52
94
63
17
116
86
14
86
35
16
26
311
83
57
56
541
23
65
97
88
42
Sear
ching
wind
ow
MAE
plane
in th
e wind
ow
(0,-6
)
(-6,0)
(6,0)
(0,6)
(0,0)
11 -6
-5-4
-3-2
-10
12
34
56
x =-6-5-4-3-2-10123456y =
Curre
nt fra
meRe
feren
ce fr
ame
Macro
block
of int
eres
t
39 5
263
7
3
35
810
23
17
51 6
352
5
9
6
3
3-st
ep se
arch
St
ep 3
26E
IE41
5 M
ultim
edia
Tec
hnol
ogy
73
87
51
34
83
73
14
36
51
65
24
28
32
51
79
37
54
93
27
38
59
24
66
67
57
39
110
511
102
83
23
84
74
54
93
17
25
37
86
73
87
51
34
83
73
59
52
14
78
54
77
71
14
97
82
55
84
32
28
41
33
73
52
94
63
17
116
86
14
86
35
16
26
311
83
57
56
541
23
65
97
88
42
Sear
ching
wind
ow
MAE
plane
in th
e wind
ow
(0,-6
)
(-6,0)
(6,0)
(0,6)
(0,0)
11 -6
-5-4
-3-2
-10
12
34
56
x =-6-5-4-3-2-10123456y =
Curre
nt fra
meRe
feren
ce fr
ame
Macro
block
of int
eres
t
39 5
263
7
3
35
810
23
17
51 6
352
5
9
6
31 1
•Tw
o in a
ll che
cked
cand
idate
block
s pro
vides
the m
in MA
E.⇒
the m
otion
vecto
r for
the c
once
rned
bloc
k is (
-1,0)
or (-
1,-1)
.•
Low
comp
lexity
but m
ay no
t pro
vide t
he be
st mo
tion v
ector
.
3-st
ep se
arch
St
ep 3
27E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Glo
bal a
nd L
ocal
Min
ima
3-st
ep se
arch
can
be
trapp
ed in
the
loca
l min
ima
Loca
l min
ima
of th
e di
stor
tion
func
tion
givi
ng
pred
ictio
n im
ages
with
hig
her e
rror
than
full
sear
chSo
, man
y re
sear
ch w
orks
hav
e be
en c
arrie
d ou
t to
find
alte
rnat
ive
appr
oach
es fo
r blo
ck m
atch
ing
mot
ion
estim
atio
n.
EIE
415
Mul
timed
ia T
echn
olog
y
Cod
ec
29E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Fram
eM
emor
y2D
-DCT
Qua
ntize
r
Deq
uant
izer
Inve
rse
2D-D
CT
Fram
eM
emor
yM
otio
nC
ompe
nsat
ion
Mot
ion
Estim
atio
n
VLC
code
rBu
ffer
Regu
lato
r
0110
10...
111
Com
pres
sed
bit s
tream
Motion vectors
Predictive frame
Sour
cevi
deo
+
++
-
Vide
o En
code
r
30E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Vide
o D
ecod
er
Buf
fer
Deq
uant
izer
Inve
rse
2D-D
CT
VLC
Dec
oder
Fram
eM
emor
yM
otio
nC
ompe
nsat
ion
++
Qun
atiz
erst
ep si
ze Mot
ion
vect
ors
Rec
ontru
cted
vid
eo01
10..1
1
Com
pres
sed
bit s
tream
31E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Pict
ure
Type
s
II
PP
PP
P
Forw
ard
pred
ictio
n
PP
Intr
a (I
) pic
ture
with
out r
efer
ence
to a
ny o
ther
pic
ture
spr
ovid
e ac
cess
poi
nts t
o th
e co
ded
sequ
ence
whe
re d
ecod
ing
begi
nco
ded
with
onl
y m
oder
ate
com
pres
sion
(10:
1)
Pred
icte
d (P
) pic
ture
refe
renc
e to
the
I-pi
ctur
es o
r P-p
ictu
res
gene
rally
use
d as
a re
fere
nce
for f
urth
er p
redi
ctio
nC
ompr
essi
on ra
tio is
abo
ut 2
0:1
32E
IE41
5 M
ultim
edia
Tec
hnol
ogy
II
BB
BB
P
Forw
ard
pred
ictio
n
Bidi
rect
iona
l pre
dict
ion
BB
With
B-p
ictu
re
Bid
irec
tiona
l (B
) pic
ture
usin
g m
otio
n co
mpe
nsat
ed p
redi
ctio
n fr
om a
pas
t and
a fu
ture
I or
P
pict
ure
neve
r use
d as
a re
fere
nce
or fu
rther
pre
dict
ion
high
est c
ompr
essi
on ra
tio (5
0:1)
33E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Tran
smis
sion
and
Dis
play
Ord
er
I B
B B
P B
B B
I B
B B
P B
B B
I 1
2 3
4 5
6 7
8 9
10 11
12 13
14 15
16 17
Dis
play
Ord
er
I P
B B
B I
B B
B P
B B
B I
B B
B 1
5 2
3 4
9 6
7 8
13 10
11 12
17 14
15 16
Tran
smis
sion
Ord
er
Rul
e:
Bef
ore
you
send
a B
fram
e, m
ake
sure
all
its re
fere
nce
fram
es h
ave
been
sent
.
Send
the
refe
renc
e fr
ame
first
if n
ot.
34E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Exam
ple
An
MPE
G-1
syst
em u
ses t
he fr
ame
sequ
ence
show
n as
be
low
. Der
ive
a su
itabl
e re
orde
red
sequ
ence
that
ens
ures
fir
stly
, onl
y tw
o fr
ames
mus
t be
stor
ed in
the
deco
der,
and
seco
ndly
, the
requ
ired
I and
/or P
-fra
mes
are
ava
ilabl
e to
de
code
eac
h P-
and
B-f
ram
e as
they
are
rece
ived
.
35E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Solu
tion
A s
uita
ble
reor
dere
d fra
me
sequ
ence
that
m
eets
the
defin
ed re
quire
men
ts is
:I,P
,B,B
,P,B
,B,P
, B,B
, I,
B,
B, .
..1,
4,2,
3,7,
5,6,
10,8
,9,1
3,11
,12
36E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Cod
ing
of I-
Pict
ure
2-D
FDC
TQ
VLC
I-Fra
me
Cod
edI-F
ram
e
Intra
fram
e co
ding
8 ×
8D
CT
Any
wei
ghtin
g m
atrix
for D
CT
coef
ficie
nts p
ossi
ble
Diff
eren
tial c
odin
g of
DC
coe
ffic
ient
Uni
form
qun
atiz
atio
nR
un le
ngth
cod
ing
of z
eros
with
zig
-zag
scan
Entro
py c
odin
g
37E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Cod
ing
of P
-Pic
ture
s
Mot
ion
com
pens
ated
pre
dict
ion
from
an
I-or
P-p
ictu
res
One
mot
ion
vect
or p
er m
acro
bloc
kC
odin
g of
pre
dict
ion
erro
r with
8 ×
8 D
CT,
uni
form
qun
atiz
atio
n, z
ig-z
ag
scan
(lik
e I-
pict
ure)
38E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Cod
ing
of M
otio
n Ve
ctor
s
Hig
hly
corr
elat
ed a
mon
g ne
ighb
orin
g m
acro
bloc
ksIn
man
y st
anda
rds,
mac
robl
ock
is th
e un
it fo
r m
otio
n es
timat
ion.
It w
ill b
e fin
e tu
ned
to th
e bl
ock
leve
l if n
eces
sary
Cod
e th
e di
ffer
ence
usi
ng v
aria
ble
leng
th c
ode
(VLC
)
39E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Cod
ing
of B
-Pic
ture
s
2-D
FDC
TQ
VLC
ref f
ram
e 1
Cod
edre
sidu
alsi
gnal
+
Mot
ion
Estim
ator
Inte
rpol
atio
nEn
code
the
mot
ion
vect
ors
Cod
edM
otio
nV
ecto
rsfo
rB
-fra
me
ref f
ram
e 2
Pred
ictio
nEr
ror
Forw
ard
Mot
ion
Vec
tors
Mot
ion
Estim
ator
+
Bac
kwar
d M
otio
n V
ecto
rs
curr
ent f
ram
e
40E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Mot
ion
com
pens
ated
pre
dict
ion
from
two
cons
ecut
ive
P-or
I-pi
ctur
esei
ther on
ly fo
rwar
d pr
edic
tion
(1 v
ecto
r/mac
robl
ock)
oron
ly b
ackw
ard
pred
ictio
n (1
vec
tor/m
acro
bloc
k)or
aver
age
of
forw
ard
and
back
war
d pr
edic
tion
= in
terp
olat
ion
(2
vect
ors/
mac
robl
ock)
Cod
ing
of p
redi
ctio
n er
ror w
ith 8
×8
DC
T, u
nifo
rm q
unat
izat
ion,
zig
-zag
sc
an (l
ike
I-pi
ctur
e)
EIE
415
Mul
timed
ia T
echn
olog
y
Vide
o St
ream
Syn
tax
42E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Vide
o St
ream
Syn
tax
–Si
x La
yers
Sequ
ence
Lay
erG
OP
Laye
rPi
ctur
e La
yer
Slic
e La
yer
Mac
robl
ock
Laye
rB
lock
Lay
er
43E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Vide
o St
ream
Syn
tax
Gro
up o
f Pi
ctur
e
Pict
ure
YY
YY
Cb
Cr
Mac
robl
ock
Blo
ck
IBB
PBB
IBB
PBB
IB...
Gro
up o
f Pic
ture
44E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Supp
lem
enta
ry n
otes
on
Vide
o St
ream
Syn
tax
Y1
Y2
Y3
Y4
Cb
Cr
16 ×
16
Mac
robl
ock
8×8
Blo
ck
Blo
ck la
yer
Y1
Y2
Y3
Y4
Cr
Cb
DC
AC
…..
EOB
DCT
Uni
tD
CT U
nit
Mac
rolo
ckla
yer
Y1
Y2
Y3
Y4
Cr
Cb
Add
ress
Qua
nt.
valu
eM
otio
n ve
ctor
……
.
Mot
ion
Estim
atio
n U
nit
Mot
ion
Estim
atio
n U
nit
MB
Hea
der
45E
IE41
5 M
ultim
edia
Tec
hnol
ogy
MB
Hea
der
Mac
rolo
ckla
yer
Y1
Y2
Y3
Y4
Cr
Cb
MB
1
Slic
e la
yer
Slic
e H
eade
rM
B 1
MB
3M
B 4
…..
MB
NM
B 2
Slic
eSt
art c
ode
Slic
epo
sitio
nQ
uant
.va
lue
Slic
e 1
Slic
e 4
Slic
e 2
Slic
e 3
Slic
e 5
Slic
e 6
Pict
ure
laye
r
Pict
ure
Hea
der
Slic
e 1
Slic
e 2
Slic
e 3
Slic
e 4
Slic
e 5
Slic
e 6
46E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Gro
up o
f Pi
ctur
e
IBB
PBB
IBB
PBB
IB...
Gro
up o
f Pic
ture
Slic
e 1
Slic
e 2
Slic
e 3
Slic
e 4
Slic
e 5
Slic
e 6
Pict
ure
laye
rPi
ctur
e H
eade
r
P2P3
P4P5
P6
Pict
ure
star
t cod
ePi
ctur
ety
pe…
.
P1
GO
P2G
OP3
GO
P4G
OP5
GO
P6Se
quen
ce
Hea
der
Sequ
ence
la
yer
GO
P1
Sequ
ence
st
art c
ode
Vid
eo
para
met
ers
Qua
ntiz
atio
nva
lue
GO
P H
eade
rG
OP
laye
rG
OP
Hea
der
47E
IE41
5 M
ultim
edia
Tec
hnol
ogy
GO
P st
art c
ode:
indi
cate
s the
star
t of a
GO
PTi
me
stam
p:us
ed fo
r syn
chro
niza
tion
purp
oses
Para
met
ers:
defin
es th
e pa
rticu
lar s
eque
nce
of
fram
e ty
pes t
hat a
re u
sed
in e
ach
GO
P (e
.g.
IPPB
PP)
48E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Pict
ure
laye
rSl
ice
1Sl
ice
2Sl
ice
3Sl
ice
4Sl
ice
5Sl
ice
6Pi
ctur
e H
eade
r
Sequ
ence
la
yer
GO
P2G
OP3
GO
P4G
OP5
GO
P6Se
quen
ce
Hea
der
GO
P1
P2P3
P4P5
P6P1
GO
P H
eade
rG
OP
laye
r
Slic
e la
yer
Slic
e H
eade
rM
B 1
MB
3M
B 4
…..
MB
NM
B 2
MB
Hea
der
Y1
Y2
Y3
Y4
Cr
Cb
Y1
Y2
Y3
Y4
Cr
Cb
Mac
robl
ock
laye
r
Blo
ck la
yer
49E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Slic
e La
yer
Each
slic
e is
a c
ontig
uous
se
quen
ce o
f mac
robl
ocks
in ra
ster
sc
an o
rder
, sta
rting
at s
peci
fic
addr
ess o
r pos
ition
in th
e pi
ctur
e sp
ecifi
ed in
the
slic
e or
der
Each
ele
men
t in
the
slic
e is
a
mac
robl
ock
Rea
sons
for S
lice
conc
epts
:(i)
to a
llow
flex
ibili
ty in
sign
al c
hang
es
in so
me
of th
e co
ding
par
amet
ers
(ii) t
o op
timiz
e qu
ality
for a
giv
en b
it ra
te(ii
i) to
con
trol t
he b
it ra
teE
IE41
5 M
ultim
edia
Tec
hnol
ogy
Stan
dard
s: B
ackg
roun
d &
His
tory
51E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Wha
t is
MPE
G?
MPE
G m
eans
Mov
ing
Pict
ure
Expe
rts G
roup
a w
orki
ng g
roup
of I
SO/IE
C
Dev
elop
men
t of i
nter
natio
nal s
tand
ards
for c
ompr
essi
on,
deco
mpr
essi
on, p
roce
ssin
g, a
nd c
oded
repr
esen
tatio
n of
m
ovin
g pi
ctur
es, a
udio
and
thei
r com
bina
tion.
52E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Chr
onol
ogic
al T
able
of V
ideo
Cod
ing
Stan
dard
s
H.2
61(1
990)
MP
EG
-1(1
993)
H.2
63(1
995/
96)
H.2
63+
(199
7/98
)
H.2
63++
(200
0)
H.2
64(
MP
EG
-4P
art
10 )
(200
2)M
PE
G-4
v1
(199
8/99
)M
PE
G-4
v2
(199
9/00
)M
PE
G-4
v3
(200
1)
1990
1992
1
994
1
996
1
998
2
000
2
002
2003
MP
EG
-2(H
.262
)(1
994/
95)
ISO
/IE
CM
PE
G
ITU
-TV
CE
G
53E
IE41
5 M
ultim
edia
Tec
hnol
ogy
MPE
G A
chie
vem
ents
Bui
lt M
PEG
-1, M
PEG
-2W
idel
y ad
opte
d in
aud
iovi
sual
indu
stry
Dig
ital T
V; V
CD
, DV
D, V
ideo
-On-
Dem
and,
arc
hivi
ng, M
usic
on
the
Inte
rnet
MPE
G-4
is st
ill o
n-go
ing
Firs
t ver
sion
read
y at
end
of 1
998
Seco
nd v
ersi
on w
as a
ppro
ved
at th
e en
d of
199
9M
PEG
-7“M
ultim
edia
Con
tent
Des
crip
tion
Inte
rfac
e”W
orki
ng d
raft
was
app
eare
d at
the
end
of y
ear 1
999
IS h
ad b
een
appr
oved
at J
uly
2001
EIE
415
Mul
timed
ia T
echn
olog
y
MPE
G-1
55E
IE41
5 M
ultim
edia
Tec
hnol
ogy
His
tory
: MPE
G-1
Aud
io/V
ideo
on
Dig
ital S
tora
ge M
edia
(1.5
Mbi
t/s,
CIF
)St
art L
ate
1988
Com
mitt
ee D
raft
9/90
(Bits
tream
Synt
ax a
nd
Dec
odin
g)IS
O/IE
C 1
1172
-1…
-5 (S
yste
ms,
Vid
eo, A
udio
, C
ompl
ianc
e, S
oftw
are)
56E
IE41
5 M
ultim
edia
Tec
hnol
ogy
MPE
G-1
Prog
ress
ive
scan
ning
with
a re
fres
h ra
te o
f 30H
z (f
or N
TSC
) an
d 25
Hz
(for
PA
L).
Supp
ort I
-, P-
and
B-f
ram
esI-
fram
es m
ust b
e us
ed fo
r the
var
ious
rand
om-a
cces
s fu
nctio
ns a
ssoc
iate
d w
ith V
CR
s.A
new
laye
r cal
led
slic
e is
add
ed in
the
stru
ctur
e of
the
stre
am su
ch th
at th
e de
code
r can
resy
nchr
oniz
e m
ore
quic
kly
in c
ase
of e
rror
.
NTS
C: Y
= 3
52×2
40 C
b=
Cr
= 1
76 ×
120
PAL:
Y
= 3
52×2
88 C
b=
Cr
= 1
76×1
44
57E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Exam
ple
A d
igiti
zed
vide
o is
to b
e co
mpr
esse
d us
ing
the
MP
EG
-1
stan
dard
. A
ssum
ing
a fra
me
sequ
ence
of:
IBB
PB
BP
BB
PB
BI..
.
and
aver
age
com
pres
sion
ratio
s of
10:
1 (I)
, 20:
1 (P
) an
d 50
:1 (B
), de
rive
the
aver
age
bit r
ate
that
is
gene
rate
d by
the
enco
der f
or b
oth
the
NTS
C a
nd P
AL
digi
tizat
ion
form
ats.
58E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Solu
tion
Fram
e se
quen
ce =
IBB
PB
BP
BB
PB
BI..
.H
ence
: I-f
ram
e: 1
/12
P-fr
ame:
3/1
2B
-fram
e: 8
/12
Ave
rage
CR
= (1
×0.
1 +
3 ×
0.05
+ 8
×0.
02)/1
2=
0.03
42 o
r 29.
24:1
59E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Solu
tion
(Con
t.)
NTS
C fr
ame
size
:W
ithou
t com
pres
sion
=
352
×24
0 ⋅ 8
+ 2
(176
×12
0 ×
8)=
1.01
3760
Mbi
tspe
r fra
me
With
com
pres
sion
=
1.01
376
×1/
29.2
4=
34.6
70 k
bits
per f
ram
e
Hen
ce b
it ra
te g
ener
ated
at 3
0 fp
s =
1.04
0Mbp
s
60E
IE41
5 M
ultim
edia
Tec
hnol
ogy
PA
L fra
me
size
:W
ithou
t com
pres
sion
= 35
2 ×
288
×8
+ 2
(176
×14
4 ×
8)=
1.21
6512
Mbi
tspe
r fra
me
With
com
pres
sion
=
1.21
6512
⋅ 1/
29.2
4=
41.6
04 k
bits
per f
ram
e
Hen
ce b
it ra
te g
ener
ated
at 2
5 fp
s =
1.04
0Mbp
s
Nor
mal
ly, a
llow
ing
for p
acke
tizat
ion
and
mul
tiple
ov
erhe
ads,
a b
andw
idth
of 1
.2 M
bps
is a
lloca
ted
for t
he
vide
o. H
ence
, ass
umin
g a
max
imum
bit
rate
of 1
.5 M
bps,
th
is le
aves
300
kbp
s fo
r the
com
pres
sed
audi
o st
ream
.
Solu
tion
(Con
t.)
EIE
415
Mul
timed
ia T
echn
olog
y
MPE
G-2
62E
IE41
5 M
ultim
edia
Tec
hnol
ogy
His
tory
: MPE
G-2
Aud
io/V
ideo
for b
road
cast
(Dig
ital T
V, H
DTV
, C
able
, Sat
ellit
e)4-
20M
bit/s
for D
igita
l TV
Com
mitt
ee D
raft
11/9
3 (B
itstre
amSy
ntax
and
D
ecod
ing)
Prof
iles@
Leve
ls, s
uppo
rting
inte
rlaci
ngIS
O/IE
C 1
3818
-1…
-6 (S
yste
ms,
Vid
eo, A
udio
, C
ompl
ianc
e, S
oftw
are,
DSM
-CC
)
63E
IE41
5 M
ultim
edia
Tec
hnol
ogy
MPE
G-2
stan
dard
is in
tent
edto
be
gene
ric a
nd to
se
rve
a w
ide
rang
e of
app
licat
ions
. The
con
cept
s of
prof
ile a
nd le
vel h
ave
been
intro
duce
d to
mak
e th
e pr
actic
al im
plem
enta
tions
of t
he sp
ecifi
catio
n ea
sier
.W
hat i
s a p
rofil
e ?
A p
rofil
e is
a "
defin
ed su
bset
of t
he sy
ntax
of t
he
spec
ifica
tion"
.Im
pose
s som
e bo
unds
to th
e fu
ll sy
ntax
D
efin
es w
hich
tool
s or f
unct
iona
litie
smay
be
used
to p
rodu
ce a
bi
tstre
aman
d ho
w.
Wha
t is a
leve
l ?A
leve
l is a
"de
fined
set o
f con
stra
ints
on
the
valu
es w
hich
m
ay b
e ta
ken
by th
e pa
ram
eter
sof t
he sp
ecifi
catio
n w
ithin
a
parti
cula
r pro
file"
.
64E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Leve
lsA
leve
l spe
cifie
s the
rang
e of
the
para
met
ers t
hat a
re
supp
orte
d by
the
impl
emen
tatio
nim
age
size
fram
e ra
tebi
t rat
eFo
ur le
vels
are
def
ined
in M
PEG
-2: e
ach
targ
eted
at a
pa
rticu
lar a
pplic
atio
n do
mai
n.
Lev
elSa
mpl
es/li
nes
Lin
es/f
ram
eF
ram
es/s
ecH
igh
(H)
1920
1152
60H
igh-
1440
(H
-14)
1440
1152
60M
ain
(ML
)72
057
630
Low
(L
)35
228
830
65E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Ther
e ar
e 5
prof
iles a
ssoc
iate
d w
ith e
ach
leve
l: Si
mpl
eM
ain
Spat
ial r
esol
utio
nQ
uant
izat
ion
accu
racy
Hig
h.Th
e di
ffer
ent c
ombi
natio
nsof
leve
ls a
nd p
rofil
es fo
rm a
fr
amew
ork
for a
ll st
anda
rds a
ctiv
ities
ass
ocia
ted
with
MPE
G-
2. One
of t
he m
ost p
opul
ar se
tting
is th
e M
P@M
L st
anda
rd
whi
ch is
for d
igita
l tel
evis
ion
broa
dcas
ting.
adva
nced
tele
visi
on (A
TV) i
n N
orth
Am
eric
a,
digi
tal v
ideo
bro
adca
st (D
VB
) in
Euro
pe, a
nd
mul
tiple
sub-
Nyq
uist
sam
plin
g en
codi
ng (M
USE
) in
Japa
n.
66E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Com
mon
MPE
G-2
Pro
file
and
Leve
ls in
Sim
plifi
ed
Form
Prof
ile
Leve
l
Spat
ial
reso
lutio
nla
yer
Sim
ple
Pict
ures
: I,P
Chr
oma:
4:2:
0
Mai
nPi
ctur
es:
I,P,B
Chr
oma:
4:2:
0
SNR
Pict
ures
:I,P
,BC
hrom
a:4:
2:0
Spat
ial
Pict
ures
:I,P
,BC
hrom
a:4:
2:2
Hig
hPi
ctur
es:
I,P,B
Chr
oma:
4:2:
2H
igh
Enha
ncem
ent
Sam
ples
/line
Line
s/fr
ame
Fram
es/s
ec
1920
1152 60
1920
1152 60
Low
erSa
mpl
es/li
neLi
nes/
fram
eFr
ames
/sec
96
057
630
Hig
h-14
40En
hanc
emen
tSa
mpl
es/li
neLi
nes/
fram
eFr
ames
/sec
1440
1152 60
1440
1152 60
1440
1152 60
Low
erSa
mpl
es/li
neLi
nes/
fram
eFr
ames
/sec
72
057
630
720
576
30M
ain
Enha
ncem
ent
Sam
ples
/line
Line
s/fr
ame
Fram
es/s
ec
720
576
30
720
576
30
720
576
30
720
576
30Lo
wer
Sam
ples
/line
Line
s/fr
ame
Fram
es/s
ec
35
228
830
Low
Enha
ncem
ent
Sam
ples
/line
Line
s/fr
ame
Fram
es/s
ec
352
288
30
352
288
30Lo
wer
Sam
ples
/line
Line
s/fr
ame
Fram
es/s
ec
67E
IE41
5 M
ultim
edia
Tec
hnol
ogy
MPE
G-2
Sca
labl
e C
odin
g C
once
pts
Rea
sons
:to
pro
vide
inte
rope
rabi
lity
betw
een
diff
eren
t ser
vice
sto
giv
e fle
xibl
esu
ppor
t to
rece
iver
s with
diff
eren
t di
spla
y ca
pabi
litie
sto
pro
vide
a la
yere
d vi
deo
bits
tream
that
is a
men
able
fo
r prio
ritize
d tra
nsm
issio
n.to
mad
e it
poss
ible
for t
rans
mis
sion
in th
e pr
esen
ce o
f ch
anne
l err
ors,
such
as i
n A
TM
A n
ew fe
atur
e of
MPE
G-2
is b
it str
eam
scal
abili
ty, w
hich
al
low
s for
a la
yere
d re
pres
enta
tion
of th
e co
ded
bit s
tream
68E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Exam
ple
of u
ses
Scal
ing
betw
een
HD
TV a
nd S
DTV
(Sta
ndar
d D
efin
ition
Tel
evis
ion)
impo
rtant
for H
DTV
to b
e co
mpa
tible
with
SD
TVtra
nsm
issi
on u
sing
HD
TV q
ualit
ybu
t usi
ng sc
alab
le c
odin
g:lo
w re
solu
tion
-ba
se la
yer
high
reso
lutio
n -b
ase
laye
r + e
nhan
cem
ent l
ayer
69E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Scal
able
Enc
oder
and
Dec
oder
two
laye
rs p
rovi
ded
:B
ase
Laye
r :lo
wer
-res
olut
ion
vide
o w
ith re
duce
d bi
t rat
e (d
owns
ampl
ing
spat
ially
or
tem
pora
lly)
upsc
aled
reco
nstru
cted
bas
e-la
yer v
ideo
(ups
ampl
edsp
atia
lly o
r te
mpo
rally
) to
be u
sed
as a
pre
dict
ion
for t
he re
cove
ring
of th
eor
igin
al in
put v
ideo
sign
alEn
hanc
emen
t Lay
er
to c
ode
the
pred
ictio
n er
rors
Rec
onst
ruct
ion
:Lo
w q
ualit
y R
econ
stru
ctio
n :
to m
akes
use
of B
ase
Laye
r onl
y
Hig
h qu
ality
Rec
onst
ruct
ion
:to
mak
es u
se o
f bot
h B
ase
Laye
r and
Enh
ance
men
t Lay
er70
EIE
415
Mul
timed
ia T
echn
olog
y
Scal
able
Cod
ing
Sche
mes
Dat
a Pa
rtitio
ning
whe
n tw
o ch
anne
ls a
re a
vaila
ble,
crit
ical
bits
tream
sfor
bet
ter c
hann
el
and
less
crit
ical
for p
oore
r cha
nnel
SNR
(Qua
lity)
Sca
labi
lity
mul
tiple
-qua
lity
vide
o se
rvic
es
Spat
ial S
cala
bilit
ym
ultip
le-d
imen
sion
dis
play
s
Tem
pora
l Sca
labi
lity
Mul
tiple
fram
e ra
tes
71E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Dat
a pa
rtiti
onin
g
Sing
le-la
yer
enco
der
Dat
a pa
rtitio
ner
Multiplexer
Vid
eoEn
h. L
ayer
B
itstre
am
Bas
e La
yer
Bits
tream
Out
put
Bits
tream
Prio
rity
brea
kpoi
nt
base
laye
r: in
clud
e al
l crit
ical
in
form
atio
n (s
uch
as h
eade
r, m
otio
n ve
ctor
s,…en
hla
yer :
the
rem
aini
ng b
itstre
am
whe
n tw
o ch
anne
ls a
re a
vaila
ble,
crit
ical
bits
tream
sfor
be
tter c
hann
el a
nd le
ss c
ritic
al fo
r poo
rer c
hann
el
1
72E
IE41
5 M
ultim
edia
Tec
hnol
ogy
SNR
Sca
labi
lity
poss
ible
way
for d
egra
datio
n of
the
vide
o qu
ality
in
prio
ritiz
ed tr
ansm
issi
on m
edia
redu
ced
qual
ity v
ideo
: usi
ng b
ase
laye
r, pr
otec
ted
from
tran
smis
sion
err
orit
is b
ased
on
a fr
eque
ncy
(DC
T-do
mai
n) sc
alab
ility
te
chni
que
to o
btai
n hi
gher
qua
lity
vide
o si
gnal
: usi
ng b
oth
low
er a
nd h
ighe
r lay
er b
it st
ream
s
2
73E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Enha
ncem
ent
Enco
der
Bas
e La
yer
Enco
der
Enha
ncem
ent
Dec
oder
Bas
e La
yer
Dec
oder
Enh.
Lay
er
Bits
tream
Bas
e La
yer
Bits
tream
Hig
h qu
ality
vide
o
Low
qua
lity
vide
o
enco
des a
nd tr
ansm
its th
e di
ffer
ence
bet
wee
n th
e no
nqua
ntiz
edD
CT
coef
ficie
nts a
nd th
e qu
antiz
ed c
oeff
icie
nts f
rom
the
base
laye
r w
ith fi
ner q
uant
izat
ion
step
size
At b
ase
Laye
r : D
CT
coef
ficie
nts a
re c
oars
ely
quan
tized
and
tran
smitt
ed (
⇒re
duce
bit
rate
)
Vid
eo
Bas
e La
yer
Dec
oder
+
-+ +
74E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Spat
ial S
cala
bilit
y
It su
ppor
ts d
ispl
ays w
ith d
iffer
ent s
patia
lres
olut
ions
at
the
rece
iver
.B
ase
Lay
er:
the
inpu
t vid
eo is
spat
ially
dec
imat
ed to
low
er sp
atia
l res
olut
ion
sign
al a
nd e
ncod
ed (t
o se
nd m
ore
impo
rtant
dat
a, e
rror
free
if
poss
ible
). lo
wer
spat
ial r
esol
utio
n vi
deo:
to b
e co
nstru
cted
from
the
base
la
yer.
Enh
ance
men
t Lay
er:
the
low
er la
yer d
ecod
er sp
atia
lly in
terp
olat
es th
e si
gnal
to fu
ll sp
atia
l res
olut
ion
for p
redi
ctio
n in
the
enha
ncem
ent l
ayer
.fo
r hi
gh r
esol
utio
n vi
deo:
bit s
tream
s fro
m b
oth
laye
rs a
re
deco
ded.
3
75E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Enha
ncem
ent
Enco
der
Bas
e La
yer
Enco
der
Enha
ncem
ent
Dec
oder
Ups
ampl
ing
Spat
ial
Dow
nsam
plin
g
Spat
ial
Ups
ampl
ing
Spat
ial
Bas
e La
yer
Dec
oder
Enh.
Lay
er
Bits
tream
Bas
e La
yer
Bits
tream
Hig
h re
solu
tion
vide
o
Low
reso
lutio
n vi
deo
to c
ode
the
diff
eren
ce si
gnal
Low
er re
solu
tion
vide
o w
ith re
duce
d bi
t rat
e
Vid
eo
the
inpu
t vid
eo is
sp
atia
lly d
ecim
ated
to
low
er sp
atia
l re
solu
tion
sign
al
the
low
er la
yer d
ecod
er sp
atia
lly in
terp
olat
es th
e si
gnal
to fu
ll sp
atia
l res
olut
ion
for p
redi
ctio
n in
th
e en
hanc
emen
t lay
er
76E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Spat
ial S
cala
bilit
y -D
ecod
er
A si
ngle
-laye
r dec
oder
deco
des o
nly
the
base
laye
r to
pro
duce
a re
duce
d-re
solu
tion
outp
ut se
quen
ce.
A tw
o-la
yer d
ecod
erca
n re
cons
truct
a fu
ll-re
solu
tion
sequ
ence
as f
ollo
ws:
1.D
ecod
e th
e ba
se la
yer a
nd u
p-sa
mpl
e to
the
orig
inal
re
solu
tion.
2.D
ecod
e th
e en
hanc
emen
t lay
er.
3.A
dd th
e de
code
d re
sidu
al fr
om th
e en
hanc
emen
t lay
er to
th
e de
code
d ba
se la
yer t
o fo
rmth
eou
tput
fram
e.
77E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Tem
pora
l Sca
labi
lity
It sh
ares
sim
ilar c
once
pt w
ith th
e sp
atia
l sca
labi
lity
Base
Lay
er:
to p
rovi
de th
e ba
sic te
mpo
ral r
ate
(to se
nd m
ore
impo
rtant
dat
a, e
rror
free
if p
ossi
ble)
. fo
r low
qua
lity
disp
lay
-onl
y th
e lo
wer
laye
r is d
ecod
ed.
Enh
ance
men
t Lay
er:
to b
e co
ded
with
tem
pora
l pre
dict
ion
with
resp
ect t
o th
e lo
wer
laye
r.fo
r hig
h qu
ality
disp
lay
-bit
stre
ams f
rom
bot
h la
yers
are
de
code
d an
d re
com
bine
d fo
r dis
play
.
4
78E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Enha
ncem
ent
Enco
der
Bas
e La
yer
Enco
der
Enha
ncem
ent
Dec
oder
Ups
ampl
ing
Tem
pora
l
Dow
nsam
plin
g
Tem
pora
l
Ups
ampl
ing
Tem
pora
l
Bas
e La
yer
Dec
oder
Enh.
Lay
er
Bits
tream
Bas
e La
yer
Bits
tream
Full
fram
e-ra
te
vide
o
Low
fram
e-ra
te
vide
o
to c
ode
the
diff
eren
ce si
gnal
Low
er fr
ame-
rate
vid
eo w
ith re
duce
d bi
t rat
e
Vid
eo
the
inpu
t vid
eo is
te
mpo
rally
dec
imat
ed
to lo
wer
tem
pora
l re
solu
tion
sign
al
the
low
er la
yer d
ecod
er te
mpo
rally
inte
rpol
ates
th
e si
gnal
to fu
ll te
mpo
ral r
esol
utio
n fo
r pr
edic
tion
in th
e en
hanc
emen
t lay
er
tem
pora
l
79E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Adv
anta
ges
Laye
red
codi
ng fa
cilit
ates
Une
qual
err
or p
rote
ctio
nEf
ficie
nt u
se o
f res
ourc
esC
usto
mer
satis
fact
ion
Mul
tiple
serv
ices
poss
ible
to c
ombi
ne d
iffer
ent s
cala
bilit
y to
ols i
nto
a hy
brid
co
ding
sche
me.
i.e. i
nter
oper
abili
ty b
etw
een
serv
ices
with
diff
eren
t spa
tial r
esol
utio
ns
and
fram
e ra
tes c
an b
e su
ppor
ted
by m
eans
of c
ombi
ning
the
spat
ial
scal
abili
ty a
nd th
e te
mpo
ral s
cala
bilit
y to
ols i
nto
a hy
brid
laye
red
codi
ng sc
hem
e.
80E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Com
paris
on B
etw
een
MPE
G-1
and
MPE
G-2
Cod
ing
Para
met
erM
PEG
-1M
PEG
-2St
anda
rd19
9219
94M
ain
appl
icat
ion
Dig
ital V
ideo
Dig
ital T
V (a
nd H
DTV
)on
CD
-RO
MSp
atia
l res
olut
ion
~288
x360
pix
els
576x
720
pixe
ls(1
152x
1440
pix
els)
Tem
pora
l res
olut
ion
25-3
0 fr
ames
/s50
-60
field
s/s
(100
-120
fiel
ds/s
)Bi
t rat
e1.
5 M
b/s
~4 M
b/s
(~20
Mb/
s)Q
ualit
yC
ompa
rabl
e to
Com
para
ble
toV
HS
NTS
C/P
AL
for T
VC
ompr
essi
on ra
tio~2
0-30
~30-
40ov
er P
CM
(~30
-40)
81E
IE41
5 M
ultim
edia
Tec
hnol
ogy
His
tory
: MPE
G-3
MPE
G-3
exi
sted
onc
e up
on a
tim
e, b
ut it
s goa
l, en
ablin
g H
DTV
, cou
ld b
e ac
com
plis
hed
usin
g th
e to
ols o
f MPE
G-2
, and
he
nce
the
wor
k ite
m w
as a
band
oned
EIE
415
Mul
timed
ia T
echn
olog
y
MPE
G-4
83E
IE41
5 M
ultim
edia
Tec
hnol
ogy
MPE
G-4
: the
Dev
elop
men
ts
Orig
inal
Tar
get:
Adv
ance
d C
odin
g at
Rat
es L
ower
than
64
kbit/
sM
ore
info
rmat
ion
is in
dig
ital f
orm
,…M
ore
info
rmat
ion
is o
n-lin
e,…
Mor
e in
form
atio
n is
aud
io/v
isua
l, …
App
licat
ions
& se
rvic
es b
ecom
e ‘m
ultim
edia
’, .
App
licat
ions
& se
rvic
es b
ecom
e in
tera
ctiv
e, …
Aud
iovi
sual
info
rmat
ion
now
cov
ers a
llbi
trate
s and
all
netw
orks
In sh
ort:
mul
timed
iais
hap
peni
ng
84E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Issu
es th
at u
pcom
ing
MPE
G-4
st
anda
rds
addr
ess
In Ju
ly 1
994,
the
focu
s was
shift
ed fr
om c
ompr
essi
onne
w fu
nctio
nalit
ies +
com
pres
sion
com
pres
sion
no
long
er th
e on
ly re
ason
for d
oing
cod
ing
“low
bitr
ate’
, alth
ough
still
impo
rtant
, is n
ot M
PEG
-4’s
onl
y fo
cus!
Hav
ing
AV
info
rmat
ion
avai
labl
e w
here
ver y
ou a
reR
eusi
ng th
e au
diov
isua
l con
tent
, com
bini
ng e
lem
ents
of
cont
ent i
n ne
w w
ays
Mor
e fr
eedo
m to
inte
ract
with
wha
t is w
ithin
the
cont
ent
85E
IE41
5 M
ultim
edia
Tec
hnol
ogy
MPE
G-4
(C
odin
g of
Aud
io-V
isua
l Obj
ects
)G
ener
ic S
tand
ard
for C
odin
g of
Mul
timed
ia C
onte
nts
1993
-199
8 Fi
rst C
all t
o In
tern
atio
nal S
tand
ard
ISO
/IEC
Pro
ject
# 1
4496
86E
IE41
5 M
ultim
edia
Tec
hnol
ogy
MPE
G-4
: New
Dire
ctio
n (G
oals
)
Con
tent
-Bas
ed
Inte
ract
ivity
Uni
vers
al
Acc
ess
Impr
oved
C
odin
g Ef
ficie
ncy
Vid
eo e
-mai
lM
ultim
edia
aut
horin
gSy
nthe
tic n
atur
al A
V
1. In
tera
ctiv
e co
mpu
ter a
pplic
atio
ns2.
Wire
less
com
mun
icat
ions
3. In
tegr
atio
n of
AV
dat
a in
to a
num
ber o
f app
licat
ions
Wire
less
vid
eoIn
tern
et v
ideo
Vid
eo d
atab
ase
Inte
ract
ive
hom
e sh
oppi
ngV
ideo
gam
es
87E
IE41
5 M
ultim
edia
Tec
hnol
ogy
MPE
G-4
: Cod
ing
of A
V O
bjec
ts
Aud
iovi
sual
scen
e is
com
pose
d of
“O
bjec
ts”.
“Com
posi
tor”
puts
obj
ects
in sc
ene.
Obj
ects
can
be
diff
eren
t in
natu
re.
natu
ral o
r syn
thet
ic A
V, t
ext &
gra
phic
s, an
imat
ed fa
ces,
arbi
trary
shap
e or
rect
angu
lar
Cod
ing
sche
me
can
diff
er fo
r ind
ivid
ual o
bjec
ts.
Prin
cipl
e is
inde
pend
ent o
f bitr
ate.
from
low
bitr
ates
to (v
irtua
lly) l
ossl
ess q
ualit
y.
88E
IE41
5 M
ultim
edia
Tec
hnol
ogy
MPE
G-4
Aud
iovi
sual
Sce
ne
scen
e
2Dba
ckgr
ound
pers
onfu
rnitu
reA
V
pres
enta
tion
voic
evi
deo
glob
ede
sk
89E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Dec
oded
and
Man
ipul
ated
Orig
inal
Dec
oded
Mor
e ab
out t
he g
oals
of M
PEG
-4In
tera
ctiv
ityC
onte
nt b
ased
man
ipul
atio
n an
d bi
tstre
amed
iting
Im
prov
ed te
mpo
ral r
ando
m a
cces
s
90E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Mor
e ab
out t
he g
oals
of M
PEG
-4In
tegr
atio
nof
nat
ural
and
sy
nthe
tic m
ater
ial
Mix
ing
synt
hetic
and
nat
ural
ob
ject
s tog
ethe
r in
the
sam
e sc
ene
Virt
ual e
nviro
nmen
ts
91E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Ove
rvie
w o
f MPE
G-4
Sys
tem
multiplexer
demultiplexer
(Con
vent
iona
l Sys
tem
)
encoder
decoder
92E
IE41
5 M
ultim
edia
Tec
hnol
ogy
VLB
C C
ore
and
the
Gen
eric
MPE
G-4
Cod
er
Mot
ion
(MV
)Te
xtur
e(D
CT)
MPE
G-4
VLB
V C
ore
Cod
er(s
imila
r to
H.2
63/M
PEG
-1)
Mot
ion
(MV
)Te
xtur
e(D
CT)
Gen
eric
MPE
G-4
Cod
er
Shap
e
93E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Bas
ic B
lock
Dia
gram
of M
PEG
-4 V
ideo
Cod
er
+Te
xtur
e C
oder
Shap
e C
oder
Proc
esso
r an
d B
uffe
r
Arb
itrar
y Sh
ape
+
Mot
ion
Estim
ator
Mot
ion
Com
pens
ator
MV
Pre
dict
oran
d C
oder
Prev
ious
/Nex
t R
econ
stru
cted
VO
PsSt
ore
System Multiplexer
Vid
eo O
bjec
tpa
rtial
dat
a
MO
TIO
N C
OD
ER
-
94E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Ove
rvie
w o
f MPE
G-4
Sys
tem
Scen
e se
gmen
tatio
nan
d de
pth
laye
ring
O2
O3
O1
Laye
red
enco
ding
cont
our
mot
ion
text
ure
cont
our
mot
ion
text
ure
cont
our
mot
ion
text
ure
bits
tream
laye
r 1
bits
tream
laye
r 2
bits
tream
laye
r 3
multiplexer
demultiplexer
Sepa
rate
de
codi
ng
compositor
AV
-obj
ects
95E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Proc
essi
ng S
teps
in M
PEG
-4 C
ompo
sito
r
MPE
G-4
term
inal
Network Layer
Elem
enta
ryst
ream
s
Dem
ux
Synt
actic
deco
ded
strea
ms
Synt
actic
deco
ding
Dec
ompr
essi
on
Prim
itive
AV
Obj
ect
Ups
tream
dat
a (u
ser e
vent
s, cl
ass r
eque
st e
tc.)
Com
posit
ion
info
rmat
ion
Scen
e de
scrip
tion
(scr
ipt o
r cla
sses
)B
IFS(
Bin
ary
Form
at fo
r Sce
nes)
•Set
of n
odes
to re
pres
ent t
he p
rimiti
ve sc
ene
obje
cts t
o be
com
pose
d, th
e sc
ene
grap
h co
nstru
cts,
the
beha
vior
and
inte
ract
ivity
•Upd
ate
stre
am: m
odify
the
scen
e in
tim
e•A
nim
Stre
am: a
nim
ate
the
scen
e in
tim
e
EIE
415
Mul
timed
ia T
echn
olog
y
H.2
64
97E
IE41
5 M
ultim
edia
Tec
hnol
ogy
The
H.2
64 V
ideo
Cod
ing
Stan
dard
Mul
ti-m
ode,
mul
ti-re
fere
nce
MC
Mot
ion
vect
or c
an p
oint
out
of i
mag
e bo
rder
1/4-
, 1/8
-pix
el m
otio
n ve
ctor
pre
cisi
onB
-fra
me
pred
ictio
n w
eigh
ting
Inte
ger t
rans
form
Mul
ti-m
ode
intra
-pre
dict
ion
In-lo
op d
e-bl
ocki
ng fi
lter
UV
LC (U
nifo
rm V
aria
ble
Leng
th C
odin
g)N
AL
(Net
wor
k A
bstra
ctio
n La
yer)
SP-s
lices
98E
IE41
5 M
ultim
edia
Tec
hnol
ogy
A N
ote
on T
erm
inol
ogy
of H
.264
The
follo
win
g te
rms a
re u
sed
inte
rcha
ngea
bly:
H.2
6LTh
e W
ork
of th
e JV
T or
“JV
T C
OD
EC”
JM2.
x, JM
3.x,
JM4.
xTh
e Th
ing
Bey
ond
H.2
6LTh
e “A
VC
”or
Adv
ance
d V
ideo
CO
DE
Prop
er T
erm
inol
ogy
goin
g fo
rwar
d:M
PEG
-4 P
art 1
0 (O
ffic
ial M
PEG
Ter
m)
ISO
/IEC
144
96-1
0 A
VC
H.2
64 (O
ffic
ial I
TU T
erm
)
99E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Posi
tion
of H
.264
100
EIE
415
Mul
timed
ia T
echn
olog
y
Bas
ic M
arco
bloc
kC
odin
g St
ruct
ure
Ent
ropy
Cod
ing
Sca
ling
& In
v.
Tran
sfor
m
Mot
ion-
Com
pens
atio
n
Con
trol
Dat
a
Qua
nt.
Tran
sf. c
oeffs
Mot
ion
Dat
a
Intra
/Inte
r
Cod
erC
ontro
l
Dec
oder
Mot
ion
Est
imat
ion
Tran
sfor
m/
Sca
l./Q
uant
.-
Inpu
tV
ideo
Sig
nal
Spl
it in
toM
acro
bloc
ksof
16x
16 p
ixel
sea
ch
Intra
-fram
e P
redi
ctio
n
De-
bloc
king
Filte
r
Out
put
Vid
eoS
igna
l
101
EIE
415
Mul
timed
ia T
echn
olog
y
•Mot
ion
Com
pens
atio
n
Ent
ropy
Cod
ing
Sca
ling
& In
v.
Tran
sfor
m
Mot
ion-
Com
pens
atio
n
Con
trol
Dat
a
Qua
nt.
Tran
sf. c
oeffs
Mot
ion
Dat
a
Intra
/Inte
r
Cod
erC
ontro
l
Dec
oder
Mot
ion
Est
imat
ion
Tran
sfor
m/
Sca
l./Q
uant
.-
Inpu
tV
ideo
Sig
nal
Spl
it in
toM
acro
bloc
ksof
16x
16 p
ixel
sea
ch
Intra
-fram
e P
redi
ctio
n
De-
bloc
king
Filte
r
Out
put
Vid
eoS
igna
l
Vario
us b
lock
siz
es a
nd s
hape
s
8x8 0
4x8
01
01
23
4x4
8x4 10
8x8
Type
s
0
16x1
6
01
8x16
MB
Type
s
8x8
01
23
16x8 10
102
EIE
415
Mul
timed
ia T
echn
olog
y
•M
ultip
le R
efer
ence
Fra
mes
Ent
ropy
Cod
ing
Sca
ling
& In
v.
Tran
sfor
m
Mot
ion-
Com
pens
atio
n
Con
trol
Dat
a
Qua
nt.
Tran
sf. c
oeffs
Mot
ion
Dat
a
Intra
/Inte
r
Cod
erC
ontro
l
Dec
oder
Mot
ion
Est
imat
ion
Tran
sfor
m/
Sca
l./Q
uant
.-
Inpu
tV
ideo
Sig
nal
Spl
it in
toM
acro
bloc
ksof
16x
16 p
ixel
sea
ch
Intra
-fram
e P
redi
ctio
n
De-
bloc
king
Filte
r
Out
put
Vid
eoS
igna
l
Mul
tiple
Ref
eren
ce F
ram
es fo
r M
otio
n C
ompe
nsat
ion
103
EIE
415
Mul
timed
ia T
echn
olog
y
•B
-fram
e Pr
edic
tion
Wei
ghtin
g
Pla
ybac
k or
der:
I0
B1
B2
B
3
P4
B
5
B6
…
…...
Bits
trea
mor
der:
I0
P 4B
1 B
3
B2
P
8
B5
……
...
I 0B
1B
2
B3
P
4
B5
B
6
Tim
e
104
EIE
415
Mul
timed
ia T
echn
olog
y
•In
tege
r Tra
nsfo
rm
Ent
ropy
Cod
ing
Sca
ling
& In
v.
Tran
sfor
m
Mot
ion-
Com
pens
atio
n
Con
trol
Dat
a
Qua
nt.
Tran
sf. c
oeffs
Mot
ion
Dat
a
Intra
/Inte
r
Cod
erC
ontro
l
Dec
oder
Mot
ion
Est
imat
ion
Tran
sfor
m/
Sca
l./Q
uant
.-
Inpu
tV
ideo
Sig
nal
Spl
it in
toM
acro
bloc
ks16
x16
pixe
ls
Intra
-fram
e P
redi
ctio
n
De-
bloc
king
Filte
r
Out
put
Vid
eoS
igna
l
8x8
DC
T is
repl
aced
by
4x4
and
2x2
Inte
ger T
rans
form
s.e.
g. Y
=HX
HT
Adv
anta
ges
of in
tege
r tra
nsfo
rm: N
o m
ultip
lcat
ion
(onl
y sh
ift-a
dd)
No
roun
ding
erro
r
11
11
21
12
11
11
12
21
−−
=
−
−
−
−
H
105
EIE
415
Mul
timed
ia T
echn
olog
y
Exam
ple:
Cod
ing
a 16
x16
resi
dual
mac
robl
ock
All
4x4
lum
aan
d ch
rom
abl
ocks
are
ord
ered
as f
ollo
ws a
nd tr
ansf
orm
ed
with
a 4
x4 in
tege
r tra
nsfo
rm.
DC
coe
ffic
ient
s of b
lock
s 0,1
…15
are
ext
ract
ed to
form
blo
ck -1
, whi
ch is
fu
rther
tran
sfor
med
with
ano
ther
4x4
inte
ger t
rans
form
DC
coe
ffic
ient
s of b
lock
s 18-
21 (2
2-25
) are
ext
ract
ed to
form
blo
ck 1
6 (1
7), w
hich
is fu
rther
tran
sfor
med
with
a 2
x2 in
tege
r tra
nsfo
rmB
lock
s are
enc
oded
and
sent
acc
ordi
ng to
the
sequ
entia
l ord
er.
Not
e al
l DC
coe
ffic
ient
s in
bloc
ks 0
-15,
18-
21 a
nd 2
2-25
are
rem
oved
as
they
are
enc
oded
in b
lock
-1, 1
6 &
17.
10
6E
IE41
5 M
ultim
edia
Tec
hnol
ogy
•In
tra-
pred
ictio
n M
odes
Ent
ropy
Cod
ing
Sca
ling
& In
v.
Tran
sfor
m
Mot
ion-
Com
pens
atio
n
Con
trol
Dat
a
Qua
nt.
Tran
sf. c
oeffs
Mot
ion
Dat
a
Intra
/Inte
r
Cod
erC
ontro
l
Dec
oder
Mot
ion
Est
imat
ion
Tran
sfor
m/
Sca
l./Q
uant
.-
Inpu
tV
ideo
Sig
nal
Spl
it in
toM
acro
bloc
ks16
x16
pixe
ls
Intra
-fram
e P
redi
ctio
n
De-
bloc
king
Filte
r
Out
put
Vid
eoS
igna
l
In o
lder
sta
ndar
ds, b
lock
s ar
e en
code
d in
depe
nden
tly in
intra
mod
ew
ithou
t mak
ing
use
of th
e in
terb
lock
corr
elat
ion
⇒in
effic
ient
H
.264
sup
ports
Dire
ctio
nal s
patia
l pr
edic
tion
in in
tra m
ode
(9 ty
pes
for 4
x4 lu
ma,
1 fo
r 4x4
ch
rom
a, 4
type
s fo
r 16x
16 lu
ma)
•4x
4 lu
ma
case
:
e.g.
, Mod
e 1
(hor
izon
tal):
a=
b=c=
d=I,
e=
f=g=
h=J
i=j=
k=l=
K,
m=n
=o=p
=L
Q A B C D E F G H
I a b c d
J e f g h
K i j k l
L m n o p
1
0 34
56
7 8 2-D
C
107
EIE
415
Mul
timed
ia T
echn
olog
y
If a
blo
ck is
enc
oded
in in
tra m
ode,
a p
redi
ctio
n is
m
ade
base
d on
pre
viou
sly
enco
ded
bloc
ks a
nd th
e pr
edic
tion
resu
lt is
subt
ract
ed fr
om th
e cu
rren
t blo
ck
prio
r to
enco
ding
. M
odes
of p
redi
ctio
n:9
optio
nal p
redi
ctio
n m
odes
to p
redi
ct a
4x4
lum
abl
ock
4 op
tiona
l mod
es to
pre
dict
a 1
6x16
lum
abl
ock
1 m
ode
to e
ach
pred
ict a
4x4
chr
oma
bloc
k.
108
EIE
415
Mul
timed
ia T
echn
olog
y
109
EIE
415
Mul
timed
ia T
echn
olog
y11
0E
IE41
5 M
ultim
edia
Tec
hnol
ogy
Sum
mar
y (H
.264
)V
ideo
cod
ing
is b
ased
on
hybr
id v
ideo
cod
ing
and
sim
ilar i
n sp
irit t
o ot
her s
tand
ards
but
with
impo
rtant
diff
eren
ces
New
key
feat
ures
are
:En
hanc
ed m
otio
n co
mpe
nsat
ion
Smal
l blo
cks f
or tr
ansf
orm
cod
ing
Enha
nced
ent
ropy
cod
ing
Subs
tant
ial b
it-ra
te sa
ving
s (up
to 5
0%)r
elat
ive
to o
ther
st
anda
rds f
or th
e sa
me
qual
ityEn
hanc
emen
t on
perc
eptiv
e qu
ality
seem
s bet
ter t
han
that
on
PSN
RTh
e co
mpl
exity
of t
he e
ncod
er tr
iple
s tha
t of t
he p
rior o
nes
The
com
plex
ity o
f the
dec
oder
dou
bles
that
of t
he p
rior o
nes
111
EIE
415
Mul
timed
ia T
echn
olog
y
Com
paris
on
112
EIE
415
Mul
timed
ia T
echn
olog
y
EIE
415
Mul
timed
ia T
echn
olog
y
AVS
114
EIE
415
Mul
timed
ia T
echn
olog
y
AVS
(Aud
io V
ideo
cod
ing
Stan
dard
)
AV
S ac
tivity
in C
hina
Mak
e a
sim
ple
and
low
-cos
t ind
ustry
stan
dard
Use
as m
ore
as w
e ca
n th
e pa
rts fr
om M
PEG
, av
oid/
arou
nd d
isag
reem
ent f
or IP
R p
olic
y C
o-de
sign
on
both
tech
nolo
gy a
nd IP
One
-sto
p-sh
oppi
ng li
cens
e In
tegr
atio
n of
blo
ckin
g te
chno
logy
from
par
tner
s
115
EIE
415
Mul
timed
ia T
echn
olog
y
Ove
rvie
w o
f AVS
1.0
Vid
eo
Hig
h-ef
ficie
ncy
codi
ngFo
cuse
d ap
plic
atio
n –
initi
ally
HD
TVLo
wer
com
plex
ity, l
ower
cos
tC
ompl
ete
solu
tion:
V
ideo
, aud
io, s
yste
ms,
DR
M
Sim
ple,
com
preh
ensi
ve p
aten
t lic
ensi
ng
116
EIE
415
Mul
timed
ia T
echn
olog
y
Ope
n st
anda
rd Im
pact
to C
hina
Org
aniz
atio
n of
stan
dard
in C
hina
SAC
(Sta
ndar
diza
tion
adm
inis
tratio
n of
Chi
na)
Info
rmat
ion
stan
dard
izat
ion
com
mitt
ees
–A
VS
Wor
king
gro
up–
…
117
EIE
415
Mul
timed
ia T
echn
olog
y
AVS
-Vid
eo T
ools
Maj
or T
ools
Tran
sfor
m –
16bi
t-im
plem
ente
d 8x
8 tra
nsfo
rm (d
iffer
ent
kern
el a
s com
pare
d w
ith H
.264
)Q
uant
izat
ion
and
scal
ing
–sc
alin
g on
ly in
enc
oder
Intra
pre
dict
ion
–5
mod
esM
otio
n co
mpe
nsat
ion
–16
x16/
16x8
/8x1
6/8x
8 m
odes
Qua
rter-
peli
nter
pola
tion
–4-
taps
inte
rpol
atio
n fil
ter
Deb
lock
ing
Entro
py c
odin
g
118
EIE
415
Mul
timed
ia T
echn
olog
y
Wha
t you
hav
e le
arnt
?
Vid
eo c
odin
g ex
ploi
ts th
e te
mpo
ral r
edun
danc
ybe
twee
n su
cces
sive
fram
es in
vid
eo.
Mot
ion-
com
pens
ated
pre
dict
ion:
the
proc
ess o
f com
pens
atin
g fo
r th
e di
spla
cem
ent o
f mov
ing
obje
cts f
rom
one
fram
e to
ano
ther
.V
ideo
com
pres
sion
stan
dard
s: H
261,
H26
3, M
PEG
1,2,
4 an
d H
.264
.M
otio
n-co
mpe
nsat
ed p
redi
ctio
n, D
CT,
diff
eren
tial c
odin
g, ru
n-le
ngth
cod
ing
and
huff
man
codi
ngSc
alab
ility
EIE
415
Mul
timed
ia T
echn
olog
y
END
