Xu Li Tieng Noi - Thay Loan

Embed Size (px)

Citation preview

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    1/63

    1

    x l ting nix l ting nix l ting nix l ting niTrnh Vn LoanTrnh Vn Loan

    FIT-HUTFIT-HUT

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    2/63

    2

    X l ting ni

    Ti liu tham khoTi liu tham kho1.1.La parole et son traitementLa parole et son traitementautomatiqueautomatique

    Calliope, Masson, 1989Calliope, Masson, 198922.. Traitement de la paroleTraitement de la paroleRene Boite et Murat Kunt, PresseRene Boite et Murat Kunt, PressePolytechniques Romandes, 1987Polytechniques Romandes, 1987

    33.. Fundamentals of Speech SignalFundamentals of Speech SignalProcessingProcessing

    Saito S., Nakata K. , Academic Press,Saito S., Nakata K. , Academic Press,

    19851985

    Ti liu tham khoTi liu tham kho1.1.La parole et son traitementLa parole et son traitementautomatiqueautomatique

    Calliope, Masson, 1989Calliope, Masson, 198922.. Traitement de la paroleTraitement de la paroleRene Boite et Murat Kunt, PresseRene Boite et Murat Kunt, PressePolytechniques Romandes, 1987Polytechniques Romandes, 1987

    33.. Fundamentals of Speech SignalFundamentals of Speech SignalProcessingProcessing

    Saito S., Nakata K. , Academic Press,Saito S., Nakata K. , Academic Press,19851985

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    3/63

    3

    X l ting ni

    Ni dungNi dung1.1. Mt s khi nim c bnMt s khi nim c bn

    2.2. X l tin hiu ting niX l tin hiu ting ni

    3.3. M ho ting niM ho ting ni4.4. Tng hp ting niTng hp ting ni

    5.5. Nhn dng ting niNhn dng ting ni

    Ni dungNi dung1.1. Mt s khi nim c bnMt s khi nim c bn

    2.2. X l tin hiu ting niX l tin hiu ting ni

    3.3. M ho ting niM ho ting ni4.4. Tng hp ting niTng hp ting ni

    5.5. Nhn dng ting niNhn dng ting ni

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    4/63

    4

    X l ting ni ?X l ting ni ?

    X l thng tin cha trongX l thng tin cha trongtn hiu ting ni nhmtn hiu ting ni nhmtruyn, lu trtruyn, lu tr tn hiu nytn hiu ny

    hochoc tng hp, nhn dngtng hp, nhn dngting ni.ting ni.

    1.1. Mt s khi nim c bnMt s khi nim c bn

    Cc nghin cu -c tin hnhCc nghin cu -c tin hnh x l ting ni yu cu nhng x l ting ni yu cu nhng

    hiu bit trn nhiu lnh vchiu bit trn nhiu lnh vcngy cng a dng: tngy cng a dng: t ng mng mvv ngn ng hcngn ng hc cho ncho n x lx ltn hiu...tn hiu...

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    5/63

    5

    Mc chMc ch

    M hoM ho mt cch c hiu qumt cch c hiu qutn hiu ting ni truyn vtn hiu ting ni truyn vl-u tr ting ni.l-u tr ting ni.

    1.1. Mt s khi nim c bnMt s khi nim c bn

    Tng hpTng hp vv nhn dngnhn dng ting niting ni

    tin ti giao tip ng-imy bngtin ti giao tip ng-imy bngting ni.ting ni.Tt c cc ng dng ca x lTt c cc ng dng ca x lting ni u cn phi da trnting ni u cn phi da trn

    cc kt qu cacc kt qu ca phn tchphn tch tingtingnini

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    6/63

    6

    11.. Mt s khi nim c bnMt s khi nim c bnPhn bit ting ni vPhn bit ting ni vmm thanh:thanh:

    cc c tnh m hc c nguncc c tnh m hc c ngungc t c ch to ting ni.gc t c ch to ting ni.C 2 loi ngun mC 2 loi ngun m

    tun hon (dy thanh rung)tun hon (dy thanh rung) tp m (dy thanh khngtp m (dy thanh khngrung)rung)

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    7/63

    7

    B my pht mB my pht m1.1. Mt s khi nim c bnMt s khi nim c bn

    Hng

    Thc qun

    Np thanh qun

    Kh qun

    Dy thanh

    Vm ming cng

    Vm ming mm

    Khoang mi

    Li

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    8/63

    8

    S khi b my pht mS khi b my pht m

    1.1. Mt s khi nim c bnMt s khi nim c bn

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    9/63

    9

    Thanh mn (1)Thanh mn (1)11.. Mt s khi nim c bnMt s khi nim c bn

    Thanh mn

    Dy thanh

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    10/63

    10

    Thanh mn (2Thanh mn (2))

    cc v tr ht, th, pht m, cc v tr ht, th, pht m,ni th thoni th tho

    1.1. Mt s khi nim c bnMt s khi nim c bn

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    11/63

    11

    Dy thanh trong mt chu k daoDy thanh trong mt chu k daongng

    1.1. Mt s khi nim c bnMt s khi nim c bn

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    12/63

    12

    Biu din tn hiu tingBiu din tn hiu tingnini

    Dng sng theo thi gianDng sng theo thi gian

    1.1. Mt s khi nim c bnMt s khi nim c bn

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    13/63

    13

    Biu din tn hiu ting niBiu din tn hiu ting ni

    Ph tn hiu ting niPh tn hiu ting ni

    1.1. Mt s khi nim c bnMt s khi nim c bn

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    14/63

    14

    Biu din tn hiu ting niBiu din tn hiu ting ni

    Spectrogram (Sonagram)Spectrogram (Sonagram)

    1.1. Mt s khi nim c bnMt s khi nim c bn

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    15/63

    15

    To m hu thanh . Formant vTo m hu thanh . Formant v

    antiformantantiformant

    1.1. Mt s khi nim c bnMt s khi nim c bn

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    16/63

    16

    To m v thanhTo m v thanh1.1. Mt s khi nim c bnMt s khi nim c bn

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    17/63

    17

    Mt s c im ng mMt s c im ng mting Vitting Vit

    n m titn m tit

    C thanh iu (6), bin iC thanh iu (6), bin i

    thanh iu km theo bin ithanh iu km theo bin i

    nghanghaKhng bin i hnh thiKhng bin i hnh thi

    1.1. Mt s khi nim c bnMt s khi nim c bn

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    18/63

    18

    M hnh to ting ni (FantM hnh to ting ni (Fant1960)1960)

    )z1)(z1(

    A)z(G

    11

    K

    1k

    2

    k2

    1

    k1 )zbzb1(

    B)z(V

    )z1(C)z(R 1

    P

    1.1. Mt s khi nim c bnMt s khi nim c bn

    Lc thngLc thng

    thp G(z)thp G(z)

    Lc thngLc thng

    thp G(z)thp G(z)Tuyn mTuyn m

    V(z)V(z)

    Tuyn mTuyn m

    V(z)V(z)Ti bc xTi bc x

    R(z)R(z)

    Ti bc xTi bc x

    R(z)R(z)

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    19/63

    19

    A(z): Hm truyn t ca b lcA(z): Hm truyn t ca b lcoo

    M hnh ton im ccM hnh ton im cc

    (AR(AR))

    )z(A)z(R)z(V)z(G)z(T

    1.1. Mt s khi nim c bnMt s khi nim c bn

    1K2

    1i

    i

    iza1)z(A

    )n(u)in(xa)n(xp

    1i

    i

    )z(A)z(T

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    20/63

    20

    Nu tnh n khoang miNu tnh n khoang mi

    xut hin cc imxut hin cc imkhng(ARMA)khng(ARMA)

    )z(A

    )z(C

    )z(A)z(A

    )z(T2

    2

    1

    11zc)z(C -i

    q

    0i

    i 0c

    1.1. Mt s khi nim c bnMt s khi nim c bn

    )in(uc)in(xa)n(x

    q

    0i

    i

    p

    1i

    i

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    21/63

    21

    Bi tpBi tp

    1.1. Mt s khi nim c bnMt s khi nim c bn

    2

    k k kk 21 2

    k k k

    1 2 z cos zH (z)

    1 2 z cos z z z +

    = +

    i 1.

    m truyn t ca mt b lc s tn s formant Fk c cho bi:

    rong , , T: chu k ly mu, : di thng.

    . V cc im cc ca Hk(z) trong mt phng Z

    . Vit phng trnh sai phn m t quan h gia tn hiu ra yk(n) v tn hiu vo xk(n)

    . V s khi ca b lc s ny vi 3 b nhn.

    . Bng cch sp xp li cc s hng ca phng trnh sai phn,

    kT

    kz e

    =k k2 F T = k2

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    22/63

    22

    Bi tpBi tp

    1.1. Mt s khi nim c bnMt s khi nim c bn

    i 1.

    m truyn t ca mt b lc s tn s formant Fk c cho bi:

    rong , , T: chu k ly mu, : di thng.

    2

    k k kk 21 2

    k k k

    1 2 z cos zH (z)

    1 2 z cos z z z +

    = +

    kT

    kz e=k k2 F T = k2

    k

    ' 2 2 2 2 2k k k k k

    1,2 k k k k

    jk

    | z | cos |z | |z | sin

    p |z |cos j|z |sin

    |z |e

    = =

    =

    =

    1. H(z) c 2 im cc l nghim ca mu s:

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    23/63

    23

    Bi tpBi tp

    1.1. Mt s khi nim c bnMt s khi nim c bn

    1

    0,7

    f

    K

    Di thng

    Fk

    Bk

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    24/63

    24

    Bi tpBi tp

    1.1. Mt s khi nim c bnMt s khi nim c bn

    k

    k Re(z)

    Im(z)

    |zk|

    |zk|

    p1

    p2

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    25/63

    25

    Bi tpBi tp

    1.1. Mt s khi nim c bnMt s khi nim c bn

    a) Xc nh bin i z ca g(n): Tra bng

    http://var/www/apps/conversion/current/tmp/scratch23243/dsp-presentation/xlths.ppt#Slide%2084http://var/www/apps/conversion/current/tmp/scratch23243/dsp-presentation/xlths.ppt#Slide%2084
  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    26/63

    26

    Phn tch ph tn hiu tingPhn tch ph tn hiu tingnini

    2.2. X l tn hiu ting niX l tn hiu ting ni

    2.2. XX l tn hiu ting nil tn hiu ting ni

    B lcB lchiuhiu

    chnhchnh

    B lcB lchiuhiu

    chnhchnh

    Ca sCa sCa sCa s FFTFFTFFTFFT

    LogLog1010|.||.|LogLog1010|.||.|

    H(z)=1-az-1

    a = 0,95..0,98

    Hamming

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    27/63

    27

    x(n)= x(n).w(n)

    X(f) = X(f) * W(f)

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    28/63

    28

    s(n) = h(n) * e(n) S() = H().E()

    2.2. X l tn hiu ting niX l tn hiu ting ni

    X l ng hnhX l ng hnh(homomorphisme)(homomorphisme)

    log[S()]= log[H()]+ log[E()]

    FFT-1{log[S()]}=FFT-1{log[H()]}+ FFT-1{log[E()]}FFT-1{log[S()]}: cepstrum:

    FFT-1{log[H()]}: thng tin v`h(n):FFT-1{log[E()]}: thng tin v`ngu`n:

    s(n))

    h(n))

    e(n))

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    29/63

    29

    2.2. X l tn hiu ting niX l tn hiu ting ni

    S khi x l ng

    hnh

    B lc

    hiuchnh

    B lc

    hiuchnh

    Ca

    s

    Ca

    s

    FFTFFT

    Log10|.

    |

    Log10|.

    |

    FFT1FFT1

    c(n)

    FFT

    ?

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    30/63

    30

    T0

    h(n))

    = +

    s(n) h(n) e(n)

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    31/63

    31

    2.2. X l tn hiu ting niX l tn hiu ting ni

    Tin on tuyn tnh (LinearPrediction Coding)

    Tin

    on

    p

    1i

    i )in(xa)n(x

    Sai s tinon

    )n(x)n(x)n(e

    Sai s bnh ph-ngton phn n

    2)n(eE

    Ti thiu hosai s

    p,...,2,1i,0a

    E

    i

    M hnh tonim cc

    )n(u)in(xa)n(xp

    1i

    i

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    32/63

    32

    22.. X l tn hiu ting niX l tn hiu ting ni

    Xc nh tn s cbn Fo

    Ging nam: 80 .. 250 Hz. Ging n:150..500 Hz

    Xcnh

    Fo

    Xcnh

    Fo

    nhgi

    kt qu

    nhgi

    kt qu

    Tin

    x l

    Tin

    x l

    Mt s ph-ng php xc nh Fo Da vo hm t t-ng quan

    Da vo hm vi sai bin trung bnh Dng b lc o v hm t t-ng quan

    X l ng hnh

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    33/63

    33

    2.2. X l tn hiu ting niX l tn hiu ting ni

    Da vo hm t tng quan

    1

    1

    ( ) ( ) ( ) 0,1,...,N k

    n

    r k x n x n k k K

    =

    = + =Fs = 10 kHz, N = 300, K =Fs = 10 kHz, N = 300, K =

    150150Tm cc i trong khongTm cc i trong khong

    (0, K)(0, K)

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    34/63

    34

    2.2. X l tn hiu ting niX l tn hiu ting ni

    Da vo hm t tng quan

    Hn ch, loi b |x|

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    35/63

    35

    2.2. X l tn hiu ting niX l tn hiu ting ni Da vo hm vi sai bin trung bnh

    (Average Magnitude Difference

    Function) (1)

    ( ) 0, 0,1,...D iP i= =

    1/ 21 1

    2

    0 0

    1 1( ) ( )

    N N

    n nu n u nN N

    = =

    2

    1/ 2

    1( ) [ ( ) ( )]

    2[ (0) ( )] 0,1,...,1

    1/2N-1

    n=0

    D k x n x n kNr r k k K

    = +

    = =

    3.3. M ho ting niM ho ting ni

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    55/63

    55

    g g

    Cc tnh cht l-ng t uCc tnh cht l-ng t uT s tn hiu trn nhiu

    2

    210lg (d B) 6,02 4,77 20lgx s

    xe

    xSN b

    = = +

    max4 (d B) 6 7,3Nu sx SN b= =

    Vi b 6, tng 6 dB mi khi tng 1 bit l-ngt

    c cht l-ng thch hp cn c b 11

    3.3. M ho ting niM ho ting ni

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    56/63

    56

    g

    s

    n

    dB 10

    WNSN

    N W

    SN 10log SN

    ng l- ng tn hiung l- ng nhiu

    = =

    =

    dB 10

    BiSN 20log Bi

    n tn hiun nhiu

    =

    Hoc

    3.3. M ho ting niM ho ting ni

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    57/63

    57

    Nng lng SN (dB)

    Tn hiu = Nhiu 0

    Tn hiu = 2 Nhiu 2

    Tn hiu = 10 Nhiu 10

    Tn hiu = 100 Nhiu 20

    Tn hiu = 1000 Nhiu 30Tn hiu = 10N Nhiu N x 10

    3.3. M ho ting niM ho ting ni

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    58/63

    58

    L-ng t logaritL-ng t logarit Sau khi ly logarit bin tn hiu s m

    ho tuyn tnh

    log[]log[] Q[]Q[] M hoM ho

    signe[]signe[]

    x(n) c(n)

    y(n)

    y'(n)

    exp[]exp[]Gii mGii m

    signe[x(n)]

    c(n)

    x'(n)

    x'(n)

    3.3. M ho ting niM ho ting ni

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    59/63

    59

    L-ng t logaritL-ng t logarit Hai gii php dng cho inHai gii php dng cho in

    thoithoiLutLut (dng M)(dng M)

    log(1 )

    log(1 )

    xy

    +=

    +

    Lut A (dng Lut A (dng

    chu u)chu u)1 log1 log

    A xyA

    += +255 87,56A = =:

    8 bit logarit ~ 12 bit l-ng t8 bit logarit ~ 12 bit l-ng t

    uu

    3.3. M ho ting niM ho ting ni

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    60/63

    60

    L-ng t thch nghiL-ng t thch nghi B-c l-ng t tu thuc vo bin B-c l-ng t tu thuc vo bin

    tn hiutn hiu Thch nghi tr-cThch nghi tr-cy(n)y(n)

    Q[]Q[] M hoM hox(n)x(n)

    c(n)c(n)Thchnghi

    k.i

    Thchnghi

    k.iG(n)G(n) G(n)G(n)

    y(n)

    y'(n)

    Gii mGii m c(n)c(n):: y'(n)x'(n)=G'(n)

    G(n)G(n)

    3.3. M ho ting niM ho ting ni

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    61/63

    61

    L-ng t thch nghiL-ng t thch nghi Thch nghi sauThch nghi sau

    Q[]Q[] M hoM hox(n)x(n)

    c(n)c(n)

    y(n)y(n)

    Thchnghi

    k.i

    Thchnghi

    k.i

    G(n)G(n)

    y(n)

    y'(n)

    Gii mGii m c(n)c(n)::

    y'(n)x'(n)=

    G'(n)

    G(n)G(n) Thchnghi

    k.i

    Thchnghi

    k.i

    3.3. M ho ting niM ho ting ni

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    62/63

    62

    M ho vi sai (DPCM)M ho vi sai (DPCM) L-ng t hoL-ng t ho

    3.3. M ho ting niM ho ting ni

  • 7/31/2019 Xu Li Tieng Noi - Thay Loan

    63/63

    G.721 : ADPCM, 32 kbps, 4bits, 8kHz G.722 : ~ADPCM, 48 n 64 kbps, G.723 : ~ADPCM, 24 kbps, 3 bits, 8kHz

    G.728 : 16 Kbps GSM : in thoi di ng, 13 kbps Linear Predictive Encoding (Xerox), 5 kbps Code Excited Linear Prediction (CELP)

    Digital Video Interactive : ~ADPCM, 4 n 8 bits VoIP: G723.1 (6.4kbits/s), G728, G729 (8kbits/s)