InTech-Segmenting the License Plate Region Using a Color Model

8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model

1/18

5GIOGPVKPIVJG.KEGPUG2NCVG4GIKQP7UKPIC%QNQT/QFGN

:


.DXVKLN'HEDQG.DQJ+\XQ-R

8QLYHUVLW\RI8OVDQ6RXWK.RUHD

+PVTQFWEVKQP

+XPDQV FDQ SHUIRUP XVXDO WDUJHW UHFRJQLWLRQ ZLWKRXW WRR PXFK HIIRUW +RZHYHU E\FRPSXWHUWKHWDVNRIUHFRJQL]LQJVSHFLILFREMHFWLQDQLPDJHRQHRIWKHPRVWGLIILFXOWWRSLFVLQWKHILHOGRIFRPSXWHUYLVLRQRUGLJLWDOLPDJHSURFHVVLQJ9HKLFOHOLFHQVHSODWHGHWHFWLRQ9/3'WDVNLVTXLWHFKDOOHQJLQJIURPYHKLFOHLPDJHVGXHWRWKHPXOWLVW\OHSODWHIRUPDWVYLHZ SRLQW FKDQJHV DQG WKH QRQXQLIRUP RXWGRRU LOOXPLQDWLRQ FRQGLWLRQV GXULQJ LPDJHDFTXLVLWLRQ$QDJQRVWRSRXORVHWDO DQG-LDRHWDO,QDGGLWLRQ9/3'V\VWHPVKRXOG RSHUDWH IDVW HQRXJK UHDO WLPH WR VDWLVI\ WKH QHHGV RI LQWHOOLJHQW WUDQVSRUWDWLRQV\VWHPV,76VDQGQRWWRPLVVDVLQJOHLQWHUHVWREMHFWIURPWKHYHKLFOHLPDJH9/3'LVDOVRYHU\LQWHUHVWLQJLQILQGLQJOLFHQVHSODWHDUHDIURPYHKLFOHLPDJH7KH9/3'LVZLGHO\XVHG

IRUGHWHFWLQJVSHHGLQJFDUVVHFXULW\FRQWUROLQUHVWULFWHGDUHDVLQXQDWWHQGHGSDUNLQJ]RQHVIRUWUDIILFODZHQIRUFHPHQWDQGHOHFWURQLFWROOFROOHFWLRQHWF:LWKWKHUDSLGGHYHORSPHQWRIKLJKZD\DQGWKHZLGHXVHRIYHKLFOHVSHRSOHKDYHVWDUWHGWRSD\PRUHDQGPRUHDWWHQWLRQWRWKHDGYDQFHGHIILFLHQWDQGDFFXUDWH,76V5HFHQWO\WKHQHFHVVLW\RIYHKLFOHOLFHQVHSODWHUHFRJQLWLRQ9/35KDVLQFUHDVHGVLJQLILFDQWO\7KHOLFHQVHSODWHGHWHFWLRQLVDFUXFLDODQGLQGLVSHQVDEOHFRPSRQHQW RI9/35V\VWHP2QH RI WKH PDMRUSUREOHPV LQ/3 GHWHFWLRQ LVGHWHUPLQLQJ /3 V\VWHPV 7KLV V\VWHP PXVW JXDUDQWHH UREXVW GHWHFWLRQ XQGHU YDULRXVZHDWKHUDQGOLJKWLQJFRQGLWLRQVLQGHSHQGHQWRIRULHQWDWLRQDQGVFDOHRIWKHSODWH,Q WKH UHFHQW \HDUV GHYHORSPHQWV GHDOLQJ ZLWK VLPSOH LPDJHV KDYH EHHQ DFKLHYHG ZLWKDFFHSWDEOHUHVXOWV+RZHYHUUHFHQWUHVHDUFKHVKDYHEHHQDGGUHVVHGWRSURFHVVLQJFRPSOH[LPDJHVZLWKXQFRQVWUDLQHGFRQGLWLRQV 0DWDV7KH SURSRVHGOLFHQVHSODWHGHWHFWLRQ

IUDPHZRUNGHDOVZLWKVXFKYHKLFOHLPDJHV,QWKLVSURSRVHG9/3'PHWKRGFRQVLVWVRIWZRPDLQVWDJHV,QLWLDOO\+6,FRORUPRGHOLVDGRSWHGIRUGHWHFWLQJFDQGLGDWHUHJLRQV$FFRUGLQJWRGLIIHUHQWFRORUHG/3WKHVHFDQGLGDWHUHJLRQV PD\ LQFOXGH /3 UHJLRQV JHRPHWULFDO SURSHUWLHV RI /3 DUH WKHQ XVHG IRUFODVVLILFDWLRQ 7KH SURSRVHG PHWKRG LV DEOH WR GHDO ZLWK FDQGLGDWH UHJLRQV XQGHULQGHSHQGHQWRULHQWDWLRQDQGVFDOHRIWKHSODWH0RUHWKDQRQHOLFHQVHSODWHFDQEHGHWHFWHGLQWKHVDPHLPDJH)LQDOO\WKHGHFRPSRVLWLRQRIFDQGLGDWHUHJLRQVFRQWDLQSUHGHWHUPLQHG/3DOSKDQXPHULFFKDUDFWHUVE\XVLQJSRVLWLRQLQWKHKLVWRJUDPWRYHULI\DQGGHWHFWYHKLFOHOLFHQVHSODWHUHJLRQ


2/18

2CVVGTP4GEQIPKVKQP

7KHIRFXVRIWKLVFKDSWHULVRQWKHFRQVROLGDWLRQRIDQHZPHWKRGWRVHOHFWDXWRPDWLFDOO\VWDWLVWLFDOWKUHVKROGYDOXHLQ+6,FRORUPRGHOIRUGHWHFWLQJFDQGLGDWHUHJLRQV*HQHUDOO\DVDFRPPRQ ZD\ RIFRORUEDVHG9/3' V\VWHP WKUHVKROG YDOXH LVGHILQHG E\SUHGHWHUPLQHG

FRHIILFLHQWV RU E\ XVHU ,W SURYLGHV VWDEOH UHVXOW EXW LQ SRRU OLJKWLQJ FRQGLWLRQ LW LV WRRVHQVLWLYH:KHUHDVLQRXUH[SHULPHQWVZHFDOFXODWHWKUHVKROGYDOXHLQDVWDWLVWLFDOZD\RIVDPSOHGDWDRQO\JUHHQ\HOORZDQGZKLWH/3DUHDVDUHUDQGRPO\VHOHFWHGIRUWUDLQLQJ$IWHUWUDLQLQJIURPWKRVHVDPSOHGDWDWKHPHDQDQGVWDQGDUGGHYLDWLRQYDOXHVRI KXHDUHFRPSXWHGIRUGHWHFWLRQRIJUHHQDQG\HOORZ/3SL[HOV'HWHFWLQJZKLWHOLFHQVHSODWHSL[HOVWKHPHDQDQGVWDQGDUGGHYLDWLRQYDOXHVRIVDWXUDWLRQDQGLQWHQVLW\DUHFRPSXWHGWRGHWHFWJUHHQ\HOORZDQGZKLWH/3IURPYHKLFOHLPDJHV,Q DGGLWLRQ WKH SURSRVHG PHWKRG LV DEOH WR GHDO ZLWK SODWHV FDQGLGDWH UHJLRQV XQGHULQGHSHQGHQWRULHQWDWLRQDQGVFDOHRIWKHSODWH0RUHWKDQRQHOLFHQVHSODWHFDQEHGHWHFWHGLQ WKH VDPH LPDJH )XUWKHUPRUH FDQGLGDWH UHJLRQV PD\ LQFOXGH /3UHJLRQVJHRPHWULFDOSURSHUWLHV RI /3 DUH WKHQ XVHG IRU FODVVLILFDWLRQ )LQDOO\ WKH GHFRPSRVLQJ RI FDQGLGDWH

UHJLRQZKLFKFRQWDLQVSUHGHWHUPLQHG/3 DOSKDQXPHULFFKDUDFWHUE\XVLQJSRVLWLRQ LQWKHKLVWRJUDPWRYHULI\DQGGHWHFWYHKLFOHOLFHQVHSODWHUHJLRQLVSHUIRUPHG

4GNGXCPVYQTM

7KLVVHFWLRQSURYLGHVDGHVFULSWLYHVXPPDU\RIVRPHPHWKRGVWKDWKDYHEHHQLPSOHPHQWHGDQGWHVWHGIRU9/3'$VIDUDVGHWHFWLRQRIWKHSODWHUHJLRQLVFRQFHUQHGUHVHDUFKHUVKDYHIRXQGPDQ\PHWKRGVRIORFDWLQJOLFHQVHSODWH)RUH[DPSOHVXUYH\SDSHU$QDJQRVWRSRXORVHW DO RIIHUV WR UHVHDUFKHUVD OLQN WRD SXEOLF LPDJH GDWDEDVH WRGHILQH D FRPPRQUHIHUHQFHSRLQWIRU9/35DOJRULWKPLFDVVHVVPHQW,QDGGLWLRQWKLVVXUYH\SDSHUGLVFXVVHVDERXWFXUUHQWWUHQGVDQGDQWLFLSDWHGUHVHDUFKLQ9/35V\VWHP,Q$QDJQRVWRSRXORVHWDO

DPHWKRGEDVHGRQLPDJHVHJPHQWDWLRQWHFKQLTXHQDPHGDVVOLGLQJZLQGRZV6:KDV DOVR EHHQ SURSRVHG IRU GHWHFWLQJ FDQGLGDWH UHJLRQ /3 UHJLRQ 7KH PDLQ WKRXJKW RILPDJHVHJPHQWDWLRQ WHFKQLTXH LQ/3 FDQ EHYLHZHG DVLUUHJXODULWLHV LQWKH WH[WXUH RI WKHLPDJH DQG WKHUHIRUH DEUXSW FKDQJHV LQ WKH ORFDO FKDUDFWHULVWLFV RI WKH LPDJH PDQLIHVWSUREDEO\WKHSUHVHQFHRIDQ/3$FRQYHQWLRQDOVWDWLVWLFDOFODVVLILHUEDVHGRQWKHNQHDUHVWQHLJKERUUXOH LVXVHGWRFODVVLI\HYHU\ SL[HORI D WHVW LPDJHWRREWDLQ DSL[HOPDSZKHUHJURXSRISRVLWLYHVDPSOHVSUREDEO\LQGLFDWHVWKHORFDWLRQRIDOLFHQVHSODWH,QWKLVV\VWHPWLPHFRQVXPLQJ WH[WXUH DQDO\VLV LV SUHVHQWHG LQ &DQR 3HUH]&RUWHV ZKHUH DFRPELQDWLRQ RI D NGWUHH GDWD VWUXFWXUH DQG DQ DSSUR[LPDWH QHDUHVW QHLJKERU ZDVHVSRXVHG7KHFRPSXWDWLRQDOUHVRXUFHGHPDQGRIWKLVVHJPHQWDWLRQWHFKQLTXHLVWKHPDLQGUDZEDFN WDNLQJ DQ DYHUDJH RI VHFRQGV WR SURFHVV RI VLQJOH LPDJH ,Q &KDFRQ

=LPPHUPDQ WKH SXOVHFRXSOHG QHXUDO QHWZRUN 3&11 LV SURSRVHG WR JHQHUDWHFDQGLGDWHUHJLRQVWKDWPD\FRQWDLQDOLFHQVHSODWH,IWKHOLFHQVHSODWHLVQRWORFDWHGLQWKHVHWRIFDQGLGDWHUHJLRQV WKH3&11QHWZRUNSDUDPHWHUVDUHDGMXVWHGWRJHQHUDWHQHZUHJLRQVIRU/3LGHQWLILFDWLRQ)X]]\ORJLFKDVEHHQDSSOLHGLQGHWHFWLQJOLFHQVHSODWHV$XWKRUVPDGHVRPHLQWXLWLYHUXOHVWR GHVFULEH WKH OLFHQVH SODWHV DQG JDYH VRPH PHPEHUVKLS IXQFWLRQV IRU IX]]\ VHWV HJEULJKWGDUNEULJKWDQGGDUNVHTXHQFHWH[WXUH\HOORZQHVVWRJHWWKHKRUL]RQWDODQGYHUWLFDOSODWH SRVLWLRQV &KDQJHWDO $ WHFKQLTXHEDVHG RQH[WUDFWVFDQGLGDWHUHJLRQVE\ILQGLQJYHUWLFDODQGKRUL]RQWDOHGJHVIURPYHKLFOHUHJLRQKDGDOVREHHQSURSRVHGDQG WKLV VHJPHQWDWLRQ PHWKRG LV QDPHG DV VOLGLQJ FRQFHQWULF ZLQGRZV )LQDOO\ YHKLFOH


3/18


OLFHQVH SODWH LV YHULILHG DQG GHWHFWHG E\ XVLQJ +6, FRORU PRGHO DQG SRVLWLRQ KLVWRJUDPUHVSHFWLYHO\ LQ 'HE HWDO D3ULRUNQRZOHGJH RI/3DQG FRORUFROORFDWLRQKDV EHHQXVHGWR ORFDWH WKH OLFHQVHSODWH LQWKHLPDJH*DRHW DO DVSDUWRIWKHSURFHGXUH RI

ORFDWLRQ DQG VHJPHQWDWLRQ ,Q +RQJOLDQJ &KDQJSLQJ D K\EULG OLFHQVH SODWHORFDOL]DWLRQ DOJRULWKP EDVHG RQ WKH HGJH VWDWLVWLFV DQG PRUSKRORJ\ IRU PRQLWRULQJ WKHKLJKZD\ WLFNHWLQJ V\VWHP LVSURSRVHG 7KLV WHFKQLTXH FDQ EH GLYLGHG LQWR IRXU VHFWLRQVZKLFKDUHYHUWLFDOHGJHGHWHFWLRQHGJHVWDWLVWLFDODQDO\VLVKLHUDUFKLFDOEDVHGOLFHQVHSODWHORFDWLRQDQGPRUSKRORJ\EDVHGOLFHQVHSODWHH[WUDFWLRQ7KHDYHUDJHDFFXUDF\RIORFDWLQJOLFHQVHSODWHLVDQLPSUHVVLYHUDWHRI+RZHYHULQSXWLPDJHVZHUHDFTXLUHGIURPDIL[HG GLVWDQFH DQG YLHZ SRLQW DQG WKHUHIRUH FDQGLGDWH UHJLRQV LQ D VSHFLILF SRVLWLRQDUHGHYRWHSULRULW\DVDOUHDG\GHSLFWHG7KHOLFHQVHSODWHORFDWLRQVLQLPDJHVDUHLGHQWLILHGE\PHDQV RI LQWHJUDWHG KRUL]RQWDO DQG YHUWLFDO SURMHFWLRQV WKDW DUH VFDQQHG XVLQJ D VHDUFKZLQGRZ+XDQJHWDO0RUHRYHUDFKDUDFWHUUHFRYHU\PHWKRGLVH[SORLWHGWRHQKDQFHWKHVXFFHVVUDWH$UHJLRQEDVHGOLFHQVHSODWHGHWHFWLRQPHWKRGKDVEHHQSUHVHQWHGLQ-LDHW

DOZKLFKILUVWO\DSSOLHVDPHDQVKLIWSURFHGXUHLQVSDWLDOUDQJHGRPDLQWRVHJPHQWDFRORUYHKLFOHLPDJHLQRUGHUWRJHWFDQGLGDWHUHJLRQV$FFRUGLQJWRWKHVWDWLVWLFDODQDO\VLVSHUIRUPHG IRU FRPSDULVRQ WR RWKHU /3 OLNH REMHFWV /3V DGKHUH WR D XQLTXH IHDWXUHFRPELQDWLRQRIUHFWDQJXODULW\DVSHFWUDWLRDQGHGJHGHQVLW\7KHVHWKUHHIHDWXUHVZHUHWKHQHVWLPDWHGWR FDQGLGDWHUHJLRQVWR GHFLGH ZKHWKHU WKHVH UHJLRQV LQWHUSUHWDQ/3RUQRW $XVXDOIDLOXUHRIWKLVPHWKRGLVWKHIDLOXUHWRGHWHFWOLFHQVHSODWHVZKHQYHKLFOHERGLHVDQGWKHLU OLFHQVH SODWH KDYH VLPLODU FRORUV ,Q -LDR HW DO D PHWKRG IRU PXOWLVW\OH /3UHFRJQLWLRQ KDV EHHQ SUHVHQWHG 7KLV PHWKRG KDV LQWURGXFHG WKH GHQVLW\EDVHG UHJLRQJURZLQJ DOJRULWKP IRU /3 ORFDWLRQ WKH VNHZ UHILQHPHQW DOJRULWKP WKH PXOWLOLQH /3VHSDUDWLRQ DOJRULWKP WKH RSWLPL]HG FKDUDFWHU VHJPHQWDWLRQ DOJRULWKP DQG WUDLQDEOHFKDUDFWHU UHFRJQLWLRQ PHWKRG IRU FKDUDFWHU UHFRJQLWLRQ +RXJK 7UDQVIRUP +7 IRU OLQH

GHWHFWLRQ KDV EHHQ SURSRVHGRQ WKH DVVXPSWLRQ WKDW WKH VKDSHRI OLFHQVH SODWHKDV EHHQGHILQHGE\OLQHVLQ.DPDW*DQVHQ$ PRGLILHG FRORU WH[WXUHEDVHG PHWKRG IRU GHWHFWLQJ OLFHQVH SODWH LQ LPDJHV KDV EHHQSUHVHQWHGLQ.LPHWDO$VXSSRUWYHFWRUPDFKLQH690KDVEHHQXVHGWRDQDO\]HWKH FRORU DQG WH[WXUH SURSHUWLHV RI/3V DQG WR ORFDWH WKHLUERXQGLQJ ER[HVDSSOLHG E\ DFRQWLQXRXVDGDSWLYHPHDQVKLIWDOJRULWKP &$06KLIW7KHFRPELQDWLRQRI&$06KLIWDQG690V SURGXFHV HIILFLHQW /3 GHWHFWLRQ DV WLPHFRQVXPLQJ FRORU WH[WXUH DQDO\VLV IRU OHVVUHOHYDQWSL[HOVLVUHVWULFWHGOHDYLQJRQO\DVPDOOSDUWRIWKHLQSXWLPDJHWREHDQDO\]HG,QDGGLWLRQ ILQGLQJ FDQGLGDWH DUHDV E\ XVLQJ JUDGLHQW LQIRUPDWLRQ LW KDV EHHQ YHULILHGZKHWKHULWFRQWDLQVWKHSODWHDUHDDPRQJWKHFDQGLGDWHVDQGDGMXVWLQJWKHERXQGDU\RIWKHDUHD E\ LQWURGXFLQJ D WHPSODWH RI WKH /3 LQ .LP HW DO 2WKHU DSSURDFKHV XVLQJ

PDWKHPDWLFDOPRUSKRORJ\PHWKRGWRGHWHFWOLFHQVHSODWHDUHD0DUWLQHWDODQGDQDSSURDFKIRUVHJPHQWDWLRQRIYHKLFOHSODWHVVXFKDVHGJHLPDJHLPSURYHPHQWWRGHWHFWDQXPEHURIFDUSODWHVLQ0LQJHWDOKDYHDOVREHHQSURSRVHG7KHSURSRVHGPHWKRGLQ1RPXUDHWDO LV FRPPLWWHG WRWKH WDVNRIFKDUDFWHU VHJPHQWDWLRQGHVFULELQJ DPRUSKRORJ\EDVHGDGDSWLYHDSSURDFKIRUGHJUDGHGSODWHLPDJHV0RUHRYHUDVVXPLQJWKDW/3UHJLRQVDUHGHWHFWDEOHHYHQLQQRLV\ORZUHVROXWLRQSUHVHQWHGDUREXVW VXSHUUHVROXWLRQ DOJRULWKP IRU YLGHR VHTXHQFHV 6XUHVK HW DO KDV EHHQSURSRVHGWRHQKDQFHWKH/3WH[WRIPRYLQJYHKLFOHVZLWKSURPLVLQJUHVXOWV,Q:DQJHWDO D FDVFDGH IUDPHZRUN XWLOL]LQJ SODWH FKDUDFWHULVWLFV DQG GHYHORSLQJ IDVW RQH SDVVDOJRULWKPVKDVEHHQXVHGIRUDUHDOWLPHSODWHUHFRJQLWLRQV\VWHP


4/18

2CVVGTP4GEQIPKVKQP

&XUUHQWO\ VRPH UHVHDUFKHUV SUHIHU D K\EULG GHWHFWLRQ DOJRULWKP ZKHUH OLFHQVH SODWHORFDWLRQPHWKRGEDVHGRQFRUQHUGHWHFWLRQHGJHGHWHFWLRQFKDUDFWHULVWLFVRIOLFHQVHVKDSHFKDUDFWHUVFRQQHFWLRQDQGSURMHFWLRQKDVEHHQSUHVHQWHGLQ;X=KX=KDQJHWDO

DQG


5/18


DOSKDQXPHULFFKDUDFWHUVZULWWHQLQDVLQJOHOLQHDQGDQRWKHUW\SHRI\HOORZ/3LVIRXQGWKDWFRQWDLQ.RUHDQ/3LQWZRURZV7KHXSSHUURZFRQVLVWVRIWZRVPDOO.RUHDQFKDUDFWHUVRIUHJLRQ QDPH IROORZHGE\ RQHRUWZRQXPEHUVRIFODVV FRGH7KH ORZHUURZFRQWDLQV RQH

.RUHDQ FKDUDFWHU DQG IRXU ELJ QXPEHUV WR LQGLFDWH WKH XVDJH DQG VHULDO QXPEHUUHVSHFWLYHO\

9HKLFOHW\SH 3ODWHFRORU &KDUDFWHUFRORU

3ULYDWHDXWRPRELOH:KLWH %ODFN

*UHHQ :KLWH

7D[LWUXFNDQGEXV


6/18

2CVVGTP4GEQIPKVKQP

DOSKDQXPHULF FKDUDFWHU E\ XVLQJ SRVLWLRQ LQ WKH KLVWRJUDP WR YHULI\ DQG GHWHFW YHKLFOHOLFHQVHSODWH9/3UHJLRQ

)LJ9HKLFOHOLFHQVHSODWHGHWHFWLRQIUDPHZRUN

5GIOGPVKPIEQNQT,QWKHSURSRVHGPHWKRGLQSXWYHKLFOHLPDJHVDUHFRQYHUWHGLQWR+6,FRORULPDJHV7KHQWKHFDQGLGDWHUHJLRQVDUHIRXQGE\XVLQJ+6,FRORUPRGHORQWKHEDVLVRIXVLQJKXHVDWXUDWLRQDQGRULQWHQVLW\0DQ\DSSOLFDWLRQVXVHWKH+6,FRORUPRGHO0DFKLQHYLVLRQXVHV+6,FRORUVSDFHLQLGHQWLI\LQJWKHFRORURIGLIIHUHQWREMHFWV7KH5*%FRORUPRGHOFRQVLVWVRIWKHWKUHHDGGLWLYHSULPDULHVUHGJUHHQDQGEOXH6SHFWUDOFRPSRQHQWVRIWKHVHFRORUVFRPELQHDGGLWLYHO\WRSURGXFHDUHVXOWDQWFRORU7\SLFDOO\+6,FRORUVDUHQRWGHVFULEHGRQWKHEDVLVRISHUFHQWDJHVRISULPDU\FRORUVEXWUDWKHUE\WKHLUKXHVDWXUDWLRQDQGLQWHQVLW\7KHVDWXUDWLRQLVWKHSXUHQHVVRIWKHFRORUWKHKXHLVWKHFRORULWVHOIDQGLQWHQVLW\GHVFULEHVWKHEULJKWQHVVRIWKHFRORU7KH+6,FRORUPRGHOVHSDUDWHVDOOWKHFRORULQIRUPDWLRQGHVFULEHGE\KXHDQGVDWXUDWLRQIURPWKHLQWHQVLW\FRPSRQHQW7KH +6, FRORUPRGHO LVEDVHGRQ FRORUGHVFULSWLRQVWKDWDUHPRUHQDWXUDO WRKXPDQVDQGKHQFHFDQ SURYLGH DQ LGHDO WRRO IRU LPDJHSURFHVVLQJ DOJRULWKPV7KH +6, FRORU VSDFH LVUHSUHVHQWHGE\ WKH GLDPRQGDV VKRZQLQ )LJXUH 7KHKXH+ LVUHSUHVHQWHG DV DQJOHYDU\LQJIURPWR$GMXVWLQJWKHKXHZLOOYDU\WKHFRORUIURPUHGDWWKURXJK\HOORZDWJUHHQDWEOXHDWDQGEDFNWRUHGDW6DWXUDWLRQ6FRUUHVSRQGVWRWKHUDGLXVYDU\LQJIURPWR:KHQ6FRORULVDJUD\YDOXHRILQWHQVLW\:KHQ6FRORULVRQWKHERXQGDU\RIWRSFRQHEDVH,QWHQVLWLHV ,YDU\DORQJ=D[LVZLWKEHLQJEODFNDQGEHLQJZKLWH


7/18


)LJ7KH+6,FRORUVSDFH

7KHWUDQVIRUPIURP5*%WR+6,LQ8PEDXJKLV

FRV

PLQ

6 5 * %5 * %

5 * %

5 * 5 %+

5 * 5 % * %

,

3ODWHFRORULQIRUPDWLRQLVXVHGWRGHWHFWFDQGLGDWHUHJLRQVLQRXUH[SHULPHQWVDQGVKDSHSURSHUWLHVRI/3DOORZUHGXFLQJQXPEHURI/3OLNHFDQGLGDWHV2QHRIWKHFRPPRQZD\VRIFRORUEDVHGYHKLFOHOLFHQVHSODWHGHWHFWLRQFDQEHIRUPDOL]HGDVIROORZV

5 * %

5* 5%

5 [ \ * [ \ % [ \

5 [ \ * [ \ 5 [ \ % [ \

D D D

E E

! ! !! !

ZKHUH 5 * DQG% DUH UHG JUHHQ DQG EOXH FRPSRQHQWV RI [ u \ LPDJH D DQG E DUHSUHGHILQHG FRHIILFLHQWV (TXDWLRQ VHWV XS OLPLWDWLRQV IRU WKH PLQLPDO YDOXHV RI SL[HOFRPSRQHQWV (TXDWLRQ IRUPDOL]HV GHSHQGHQFLHV EHWZHHQ SL[HO FRPSRQHQWV IRU /3*HQHUDOO\FRPPRQZD\RIXVLQJFRORUEDVHGYHKLFOHOLFHQVHSODWHGHWHFWLRQLVEDVHGRQWZRW\SHVRIUHVWULFWLRQVILUVWUHVWULFWLRQLVEDVHGRQ(SVDQG,WSURYLGHVJRRGUHVXOWVLQJRRGOLJKWLQJFRQGLWLRQV+RZHYHULWLVQRWJRRGIRUORZFRQWUDVWLPDJHV3L[HOEHORQJVWRJUHHQDQG\HOORZ/3UHVSHFWLYHO\OLNHIROORZLQJ(TVDQG


8/18

2CVVGTP4GEQIPKVKQP

^ ` ^ `

JUHHQ

5 [ \ * [ \ % [ \ * [ \E

RWKHUZLVH

- d d

^ ` ^ `

\HOORZ

% [ \ 5 [ \ % [ \ * [ \E

RWKHUZLVH

- d d

ZKHUHEJUHHQDQGE\HOORZDUHJUHHQDQG\HOORZFDQGLGDWHELQDU\PDVNV7KHVHFRQGUHVWULFWLRQLVEDVHGRQ(TVDQGDQGDWKUHVKROGYDOXHLVWDNHQKHXULVWLFDOO\,WSURYLGHVVWDEOHUHVXOWZKHUHDVLQEDGOLJKWLQJFRQGLWLRQLWLVWRRVHQVLWLYH,QWKLVSURSRVHGPHWKRG/3GHWHFWLRQLVEDVHGRQLWVFRORUSURSHUWLHVQDPHO\PHDQDQGVWDQGDUG GHYLDWLRQ YDOXHV RI KXH )RU GHWHFWLRQ RI JUHHQ DQG \HOORZ /3 SL[HOV KXHSDUDPHWHU RI+6,FRORU LVXVHGLQRXU H[SHULPHQW7R GHWHFW ZKLWH/3SL[HOVKXH YDOXHLVPHDQLQJOHVVKHQFHRQO\VDWXUDWLRQDQGLQWHQVLW\SDUDPHWHUVDUHLPSRUWDQWIRUWKLVFDVH7RHVWLPDWH WKHVH SURSHUWLHV ZH XVHG LPDJHV RI /3 WDNHQ XQGHU GLIIHUHQW OLJKWLQJ DQG

ZHDWKHUFRQGLWLRQV$IWHUWUDLQLQJIURPWKRVHVDPSOHGDWDWKHPHDQDQGVWDQGDUGGHYLDWLRQYDOXHVRIKXHDUHFRPSXWHGIRUGHWHFWLRQRIJUHHQDQG\HOORZ/3SL[HOV'HWHFWLQJZKLWHOLFHQVHSODWHSL[HOVWKHPHDQDQGVWDQGDUGGHYLDWLRQYDOXHVRIVDWXUDWLRQDQGLQWHQVLW\DUHFRPSXWHGWRGHWHFWJUHHQ\HOORZDQGZKLWH/3IURPYHKLFOHLPDJHV)RUGHWHFWLRQRIJUHHQDQG\HOORZ/3SL[HOVWKHELQDUL]DWLRQSURFHVVFDQEHIRUPXODWHGDVIROORZV

^ ` ^ `

^ `

+ + + +

JUHHQ

+ [ \ 6 [ \

E , [ \

RWKHUZLVH

P G P G - d d t

d d

^ ` ^ `

^ `

+ + + +

\HOORZ

+ [ \ 6 [ \

E , [ \

RWKHUZLVH

P G P G - d d t d d

ZKHUH+[\6[\DQG ,[\DUHKXHVDWXUDWLRQDQGLQWHQVLW\FRPSRQHQWVRI[WK\WK

SL[HOUHVSHFWLYHO\P+DQGG+DUHPHDQKXHDQGKXHVWDQGDUGGHYLDWLRQYDOXHVIRUJUHHQDQG\HOORZ/3RIVDPSOHGDWDUHVSHFWLYHO\+RZHYHU WKH DXWRPDWLF IRFXV DQG ZKLWH EDODQFLQJ RI FDPHUD RIWHQ FDXVH WKH FKDQJLQJLOOXPLQDWLRQ 2XU SURSRVHG /3 GHWHFWLRQ PHWKRG FDQ ZRUN ZHOO LQ QRUPDO LOOXPLQDWLRQFRQGLWLRQ EXW LW VHHPV QRW JRRG HQRXJK WR ZRUN LQ EDG LOOXPLQDWLRQ FRQGLWLRQV 7RRYHUFRPHWKLVSUREOHPZHXVHDQDGDSWLYH/3GHWHFWLRQPHWKRGZHXVHLWLQWKHFDVHRI

UHDOO\KLJKRUORZLOOXPLQDWLRQFRQGLWLRQ)RU QRUPDO ORZ DQG KLJKLOOXPLQDWLRQ FRQGLWLRQV RI ZKLWH OLFHQVH SODWH SL[HOV WKHELQDUL]DWLRQSURFHVVFDQEHIRUPXODWHGDVIROORZVUHVSHFWLYHO\

^ ` ^ `

6 6 , , ZKLWH Q

6 [ \ , [ \E

RWKHUZLVH

P G P G - d t

^ ` ^ `

6 6 , , ZKLWH O

6 [ \ , [ \E

RWKHUZLVH

P G P G - d t


9/18


^ ` ^ `

6 6 , , ZKLWH K

6 [ \ , [ \E

RWKHUZLVH

P G P G - d t

ZKHUH 6[ \ DQG ,[ \ DUH VDWXUDWLRQ DQG LQWHQVLW\ FRPSRQHQWV RI [WK \WK SL[HO

UHVSHFWLYHO\ P6 DQG P, DUH PHDQ YDOXHV IRU VDWXUDWLRQ DQG LQWHQVLW\ G6 G, DUH VWDQGDUGGHYLDWLRQYDOXHVIRUVDWXUDWLRQLQWHQVLWLHVRIZKLWH/3RIVDPSOHGDWDUHVSHFWLYHO\ EZKLWHQEZKLWHODQGEZKLWHKDUHZKLWHFDQGLGDWHELQDU\PDVNV$Q/3LPDJHDQGLWVFRORUVHJPHQWDWLRQUHVXOWVDUHGHSLFWHGLQ)LJDFJUHHQ\HOORZDQGZKLWHEDFNJURXQG/3UHVSHFWLYHO\

)LJ$Q/3LPDJH OHIWDQGLWVFRORUVHJPHQWDWLRQUHVXOWVULJKWXVLQJ+6,FRORUPRGHO&RORUVHJPHQWDWLRQSDUDPHWHUVDUHYHU\VHQVLWLYHLQRUGHUWRGHWHFWDVPDQ\FDQGLGDWHVDVSRVVLEOH$OOIDOVHFDQGLGDWHVZLOOEHILOWHUHGRXWRQWKHQH[WVWDJHV$FFRUGLQJWRWKHSULRUNQRZOHGJHRIYHKLFOH/3LQVSHFWLRQDOOOLFHQVHSODWHVPXVWEHUHFWDQJXODULQVKDSHDQGKDYHWKH GLPHQVLRQV DQG KDYH DOO DOSKDQXPHULF FKDUDFWHUV ZULWWHQ LQRQH RU WZR URZV LQ/3UHJLRQ$IWHUWKHVHJPHQWDWLRQWKHUHPD\VWLOOH[LVWQRLVHVLQWKHLPDJHDQGWKDWLVQRWLGHDO7KHVHQRLVHVKDYHPDQ\W\SHVVXFKDVVPDOOKROHVRUDQGEXOJHVRIWKHWDUJHWFDQGLGDWHUHJLRQV 7KH SUREOHP PD\ EH UHVROYHG E\ XVLQJ PDWKHPDWLFDO PRUSKRORJ\ SURFHVVLQJPHWKRG 0DWKHPDWLFDO PRUSKRORJ\ LV XVHG DV D SRWHQW WRRO IRU LPDJH DQDO\VLV ZKLFK LVEDVHG RQ VKDSHV LQ WKH LPDJH QRW SL[HO LQWHQVLWLHV 7KH WZR SULQFLSDO PRUSKRORJLFDORSHUDWLRQVDUHGLODWLRQDQGHURVLRQ'LODWLRQDOORZVREMHFWVWRH[SDQGDQGHURVLRQVKULQNVREMHFWVE\HWFKLQJDZD\HURGLQJWKHLUERXQGDULHV7KHVHRSHUDWLRQVFDQEHFXVWRPL]HGE\WKHSURSHUVHOHFWLRQRIWKHVWUXFWXULQJHOHPHQWZKLFKGHWHUPLQHVH[DFWO\KRZWKHREMHFWVZLOO EH GLODWHG RU HURGHG 'LODWLRQDQG HURVLRQ DUH FRPELQHG LQWR RWKHU WZR RSHUDWLRQVRSHQLQJDQGFORVLQJ ,QWKLVSDUWRIWKHDSSOLFDWLRQZHXVHWKHFORVLQJRSHUDWLRQZKLFKLV


10/18

2CVVGTP4GEQIPKVKQP

GLODWLRQIROORZHGE\HURVLRQWRILOOLQKROHVDQGJDSVVPDOOHUWKDQWKHVWUXFWXULQJHOHPHQWRQWKHSODWHLPDJH5HPRYDORIWKRVHKROHVSOD\VDQLPSRUWDQWUROHLQFDOFXODWLQJERXQGLQJER[UHJLRQ ,PSOHPHQWDWLRQ RIPRUSKRORJLFDOFORVLQJ RSHUDWLRQ LV GHSLFWHG LQ )LJ F F

UHVSHFWLYHO\

.CDGNKPICPFHKNVGTKPI

$IWHUWKHFDQGLGDWHUHJLRQVDUHREWDLQHGE\DSSO\LQJFRORUVHJPHQWDWLRQIHDWXUHVRIHDFKUHJLRQDUHWREHH[WUDFWHGLQRUGHUWRFRUUHFWO\GLIIHUHQWLDWHWKH/3UHJLRQVIURPRWKHUV1H[WVWHSRISURSRVHGDOJRULWKPLVODEHOLQJWKHFRQQHFWHGFRPSRQHQWV,QWKHSURSRVHGPHWKRGD UHFXUVLYH DOJRULWKP LV LPSOHPHQWHG IRU FRQQHFWHG FRPSRQHQW ODEHOLQJ RSHUDWLRQ5HFXUVLYHDOJRULWKP6KDSLURHWDOZRUNVRQRQHFRPSRQHQWDWDWLPHEXWFDQPRYHDOORYHUWKHLPDJH,QWKLVVWHSZHH[WUDFWFDQGLGDWHUHJLRQVZKLFKPD\LQFOXGH/3UHJLRQVIURP WKH ELQDU\ PDVN REWDLQHG LQ WKH SUHYLRXV VWHS 'XULQJ WKLV VWHSPDLQ JHRPHWULFDOSURSHUWLHVRI/3FDQGLGDWHVXFKDVDUHDERXQGLQJER[DQGDVSHFWUDWLRDUHFRPSXWHG)ROORZLQJWKHVXFFHVVIXOFRQQHFWHGFRPSRQHQWODEHOLQJRSHUDWLRQLQLPDJHPHDVXUHPHQWVVXFKDVWKHDUHDWKHERXQGLQJER[DQGWKHDVSHFWUDWLRIRUHYHU\ELQDU\REMHFWLQWKHLPDJHDUHSHUIRUPHG$ERXQGLQJER[LVDUHFWDQJOHZKRVHKRUL]RQWDODQGYHUWLFDOVLGHVHQFORVHWKHUHJLRQDQGWRXFKLWVWRSPRVWERWWRPPRVWOHIWPRVWDQGULJKWPRVWSRLQWV5HFWDQJXODULW\LVGHILQHGDVWKHUDWLRRIWKHDUHDRIFDQGLGDWHREMHFWV0(5PLQLPXPHQFORVLQJUHFWDQJOHDQGWKHDUHDRIWKHREMHFW+HUHWKHDUHDLVPHDVXUHGLQSL[HOVDQGLQGLFDWHVWKHUHODWLYHVL]HRIWKHREMHFW7KH DVSHFW UDWLR DOVR FDOOHG HORQJDWLRQ RU HFFHQWULFLW\ LV GHILQHG E\ WKH UDWLR RI WKHERXQGLQJER[RIDQREMHFW7KLVFDQEHIRXQGE\VFDQQLQJWKHLPDJHDQGWKHPLQLPXPDQGPD[LPXPYDOXHVRQWKHURZDQGWKHFROXPQVZKHUHWKHREMHFWOLHV7KLVUDWLRLVGHILQHGE\

PD[ PLQ

PD[ PLQ

$

F F

U UU

ZKHUHFDQGULQGLFDWHFROXPQVDQGURZUHVSHFWLYHO\2EMHFWVZKLFKVDWLVI\U$DVSHFWUDWLRERXQGV WR IRU JUHHQ WR IRU \HOORZ DQG WR IRU ZKLWH /3V DUH FRQVLGHUHG DVFDQGLGDWH UHJLRQV7KHVH SDUDPHWHUV DUH XVHG IRU ILOWHULQJ RSHUDWLRQ WR HOLPLQDWH /3OLNHREMHFWV IURP FDQGLGDWH OLVW )LOWHULQJ RSHUDWLRQ LV GRQH RQ JHRPHWULFDO SURSHUWLHV RI /3UHJLRQV)LJVLOOXVWUDWHWKHVWHSVIRUOLFHQVHSODWHVHJPHQWDWLRQDDQ/3LPDJHEFRORU VHJPHQWDWLRQ UHVXOW F LPSOHPHQWDWLRQ RI PRUSKRORJLFDO FORVLQJ RSHUDWLRQ IRUUHPRYLQJ VPDOO KROHV LQ FDQGLGDWH UHJLRQ G GHWHFWHG FDQGLGDWH DIWHU ILOWHULQJ DQG H

FDQGLGDWHUHJLRQGHWHFWLRQ7KHPRVWLPSRUWDQW/3SDUDPHWHUVDUHJURXSHGLQ7DEOH

)LOWHULQJSDUDPHWHU &5JUHHQ &5\HOORZ &5ZKLWH

%RXQGLQJER[ >@ >@ >@

$VSHFWUDWLR >@ >@ >@

3RVVLEOHVKDSHV 5HFWDQJOH

7DEOH)LOWHULQJSURSHUWLHV


11/18


+HUH&5LQGLFDWHVFDQGLGDWHUHJLRQ

)LJ,OOXVWUDWLRQRIOLFHQVHSODWHVHJPHQWDWLRQDDQ/3LPDJHLQDQLJKWWLPHEFRORUVHJPHQWDWLRQUHVXOW F LPSOHPHQWDWLRQ RI PRUSKRORJLFDOFORVLQJRSHUDWLRQ IRU UHPRYLQJVPDOO KROHV LQ FDQGLGDWH UHJLRQ G GHWHFWHG FDQGLGDWH DIWHU ILOWHULQJ DQG H FDQGLGDWHUHJLRQGHWHFWLRQ

)LJ,OOXVWUDWLRQRIOLFHQVHSODWHVHJPHQWDWLRQDDQ/3LPDJHLQDVWURQJVXQVKLQHEFRORU VHJPHQWDWLRQ UHVXOW F LPSOHPHQWDWLRQ RI PRUSKRORJLFDO FORVLQJ RSHUDWLRQ IRUUHPRYLQJ VPDOO KROHV LQ FDQGLGDWH UHJLRQ G GHWHFWHG FDQGLGDWH DIWHU ILOWHULQJ DQG H

FDQGLGDWHUHJLRQGHWHFWLRQ

)LJ ,OOXVWUDWLRQ RI OLFHQVH SODWH VHJPHQWDWLRQ D DQ /3 LPDJH LQ D VWURQJ VXQVKLQHUHIOHFWHG E\ YHKLFOH PLUURU DQG DOVR D OLJKW SRVW ORFDWHG LQ IURQW RI YHKLFOH E FRORU

VHJPHQWDWLRQUHVXOW F LPSOHPHQWDWLRQ RI PRUSKRORJLFDOFORVLQJRSHUDWLRQ IRU UHPRYLQJVPDOO KROHV LQ FDQGLGDWH UHJLRQ G GHWHFWHG FDQGLGDWH DIWHU ILOWHULQJ DQG H FDQGLGDWHUHJLRQGHWHFWLRQ

&GVGTOKPKPIVJGCPINGQHVJGECPFKFCVGTQVCVKQPCFLWUVOGPV$VOLFHQVH SODWHV FDQ DSSHDU DW PDQ\ GLIIHUHQW DQJOHV LQ RXU H[SHULPHQW LVPRUH UREXVWZKHQ/3 LVURWDWHGIURP WRGHJUHH WRWKHFDPHUDVRSWLFDOD[LV HDFKUHFWDQJXODUFDQGLGDWHUHJLRQVLVURWDWHGXQWLOWKH\DUHDOODOLJQHGLQWKHVDPHZD\EHIRUHWKHFDQGLGDWHGHFRPSRVLWLRQ)ROORZLQJWKHVXFFHVVIXOILOWHULQJRSHUDWLRQLQLPDJHPHDVXUHPHQWVVXFKDV


12/18

2CVVGTP4GEQIPKVKQP

FHQWHU RI DUHD DQG WKH D[LV RI OHDVW VHFRQG PRPHQW DUH HPSOR\HG WR VROYH WKH URWDWLRQDGMXVWPHQWSUREOHP7KHFHQWHURIDUHDFHQWURLGLVWKHPLGSRLQWDORQJHDFKURZDQGFROXPQD[LVFRUUHVSRQGLQJ

WRWKHPLGGOHEDVHGRQWKHVSDWLDOGLVWULEXWLRQZLWKLQFDQGLGDWHREMHFW7KLVIHDWXUHXVHGWRORFDWHDQREMHFWLQWKH'LPDJHSODQLVGHILQHGE\WKHSDLU L LU F

1 1

L LL U F

1 1

L LL U F

U U , U F$

F F , U F$

ZKHUH LU DQG LF LQGLFDWHVURZDQGFROXPQFRRUGLQDWHRIWKHFHQWHURIDUHDIRUWKH LWKREMHFW

7KHDUHD L$ LVPHDVXUHGLQSL[HOVDQGLQGLFDWHVWKHUHODWLYHVL]HRIWKHREMHFW

7KHOHDVWVHFRQGPRPHQWSURYLGHVWKHSULQFLSDOD[LVDVWKHRULHQWDWLRQZLWKWKHFDQGLGDWHREMHFW)RUJHWWLQJSULQFLSDOD[LVRIGHWHFWHGFDQGLGDWHUHJLRQZHFRPSXWHFHQWUDOPRPHQWVRIGHWHFWHGFDQGLGDWHUHJLRQ7KHFHQWUDOPRPHQWVDUHGHILQHGDV

1 1S T

ST

U F

U U F F , U FP

:HDSSO\WKLVUHVXOWWRREWDLQDGLUHFWLRQRISULQFLSDOD[LVE\FHQWURLGRIGHWHFWHGFDQGLGDWHUHJLRQ$QJOHRISULQFLSDOD[LVPRPHQWVLVREWDLQHGDV

DUFWDQ

PT

P P

ZKHUHTGHQRWHVDQDQJOHEHWZHHQEDVLVKRUL]RQWDOFRRUGLQDWHDQGSULQFLSDOD[LVRIUHJLRQ)LJXUHSRUWUD\VDVHTXHQFHRIVXFFHVVIXOOLFHQVHSODWHLGHQWLILFDWLRQ

)LJ,OOXVWUDWLRQRIOLFHQVHSODWHVHJPHQWDWLRQDDQ/3LPDJHEGHWHFWHGFDQGLGDWHDIWHUILOWHULQJFSULQFLSDOD[LVGURWDWLRQDGMXVWPHQWDQGHH[WUDFWHGFDQGLGDWH

&GEQORQUKPIECPFKFCVGU

,QIRUPDWLRQ H[WUDFWHG IURP LPDJH DQG LQWHQVLW\ KLVWRJUDPV SOD\V D EDVLF UROH LQ LPDJHSURFHVVLQJ LQ DUHDV VXFKDV HQKDQFHPHQW VHJPHQWDWLRQ DQGGHVFULSWLRQ ,Q WKLV VHFWLRQ


13/18


YHULILFDWLRQ DQG GHWHFWLRQ RI WKH 9/3 UHJLRQ DV ZHOO DV FKDUDFWHU VHJPHQWDWLRQ DUHFRQVLGHUHGDQGGLVFXVVHGLQWKLVVWXG\7KHDOJRULWKPVFKHPHIRUFDQGLGDWHGHFRPSRVLWLRQLVVKRZQLQ)LJ

2QFH WKH FDQGLGDWH DUHD LVELQDUL]HG WKH QH[W VWHS LV WR H[WUDFW WKH LQIRUPDWLRQ $WILUVWUHJLRQV ZLWKRXW LQWHUHVW VXFK DV ERUGHU RU VRPH VPDOO QRLV\ UHJLRQV DUH HOLPLQDWHG WKHFKHFNLQJ LV PDGH E\ KHLJKW FRPSDULVRQ ZLWK RWKHU SODWH FKDUDFWHUV KHLJKW )ROORZLQJSURFHGXUHLVSHUIRUPHGZKHQ/3FRORULVJUHHQDQG\HOORZILUVWZHSURFHHGE\SHUIRUPLQJKRUL]RQWDOSRVLWLRQLQWKHKLVWRJUDPWZRREMHFWVDUH IRXQGZKHUHHDFKREMHFWFRUUHVSRQGVZLWKRQHURZ7KHQWKHURZVDUHLVRODWHGDQGSURFHVVHGVHSDUDWHO\$VPHQWLRQHGEHIRUHLQ6HFWWZRW\SHVRISODWHDUHFRQVLGHUHG

)LJ$OJRULWKPVFKHPHIRUFDQGLGDWHGHFRPSRVLWLRQ3URFHVVLQJRIWKHXSSHUURZILUVWILOWHUSKDVHLVSHUIRUPHGWRHOLPLQDWHWKHUHJLRQVZLWKRXW

LQWHUHVW7KHQYHUWLFDOSRVLWLRQKLVWRJUDPLVSURFHVVHG7KHXSSHUURZDOVRKDVWZRGLIIHUHQWW\SHVDVZHPHQWLRQHGLQ6HFW$VLWFDQEHREVHUYHGXVXDOO\LQWKHXSSHUURZZHFDQILQGWZRSODWHIL[LQJGRWVDVVKRZQLQ)LJ7KHULJKWSODWHIL[LQJGRWGRHVQRWHYHQDSSHDULQWKHELQDUL]DWLRQSURFHVVGXHWRWKHIDFWWKDWLWLVSULQWHGJUHHQ7KHOHIWSODWHIL[LQJGRWLVDOVRHOLPLQDWHG7KHFKHFNLQJLVPDGHE\KHLJKWFRPSDULVRQ)URPWKHYHUWLFDOSRVLWLRQLQWKHKLVWRJUDPZHFDQILQGLVRODWHGDOSKDQXPHULFFKDUDFWHUV


14/18

2CVVGTP4GEQIPKVKQP

)LJ ([DPSOH LPDJHV D GLIIHUHQW LOOXPLQDWLRQV E FRPSOH[ VFHQHV F YDULRXVHQYLURQPHQWVDQGGGDPDJHGOLFHQVHSODWHV

3URFHVVLQJRIWKHORZHUURZILUVWILOWHUSKDVHLVSHUIRUPHGWRHOLPLQDWHWKHUHJLRQVZLWKRXWLQWHUHVW 7KHQ YHUWLFDO SRVLWLRQ KLVWRJUDP LV SHUIRUPHG DQG IURP WKH YHUWLFDO SRVLWLRQKLVWRJUDPWKHDOSKDQXPHULFFKDUDFWHUVDUHLVRODWHG$FFRUGLQJ WR WKH SULRU NQRZOHGJH RI YHKLFOH /3 LQVSHFWLRQ DOO ZKLWH /3V FRQWDLQ VHYHQDOSKDQXPHULF FKDUDFWHUV DV ZHOO DV ZULWWHQ LQ D VLQJOH URZ 7KH IROORZLQJ SURFHGXUH LVSHUIRUPHGIRUFKDUDFWHUVHJPHQWDWLRQ$IWHUHOLPLQDWLQJERUGHUDUHDYHUWLFDOSRVLWLRQLQWKHKLVWRJUDPLVSHUIRUPHGIRUVHJPHQWLQJSUHGHWHUPLQHGDOSKDQXPHULFFKDUDFWHUV$VLWFDQEHREVHUYHGXVXDOO\ZHFDQILQGDOVRWZRSODWHIL[LQJGRWVLQXSSHUDUHDRISODWHUHJLRQ7KHULJKWSODWHIL[LQJGRWRUERWKSODWHIL[LQJGRWVGRQRWHYHQDSSHDULQWKHELQDUL]DWLRQ


15/18


SURFHVVGXHWRWKHIDFWWKDWLWLVSULQWHGZKLWH7KHOHIWSODWHIL[LQJGRWLVDOVRHOLPLQDWHGWKLVFKHFNLQJLVPDGHE\KHLJKWFRPSDULVRQ)LJXUHVKRZVWKHIROORZLQJVWHSVIRUYHULI\LQJSUHGHWHUPLQHGDOSKDQXPHULFFKDUDFWHUV

ZKLWHEDFNJURXQG/3DH[WUDFWLQJFDQGLGDWHUHJLRQEYHUWLFDOSRVLWLRQKLVWRJUDPZLWK/3 ERUGHU F KRUL]RQWDO SRVLWLRQ KLVWRJUDP ZLWK /3 ERUGHU G KRUL]RQWDO SRVLWLRQKLVWRJUDP ZLWKRXW /3 ERUGHUH YLHZ RI QRUPDOL]DWLRQ FDQGLGDWH UHJLRQ DIWHU UHPRYLQJERUGHUDQGQRLV\DUHDIYHUWLFDOSRVLWLRQKLVWRJUDPVHYHQSHDNVIRUSUHGHWHUPLQHGVHYHQDOSKDQXPHULFFKDUDFWHUVLQ/3UHJLRQDQGJFKDUDFWHUH[WUDFWLRQ

'ZRGTKOGPVCNTGUWNVU

$OOH[SHULPHQWVKDYHEHHQGRQHRQ3HQWLXP,9*+]ZLWK0%5$0XQGHU0DWODE

HQYLURQPHQW,QWKHH[SHULPHQWVLPDJHVZHUHXVHGWKHVL]HLV uSL[HOVVRPHLPDJHVZKLFKDUHVKRZQLQ)LJ7KHLPDJHVDUHWDNHQIURPDGLIIHUHQWLOOXPLQDWLRQV

QLJKWWLPHVWURQJVXQVKLQHDQGVKDGRZEFRPSOH[VFHQHVZKHUHVHYHUDOREMHFWVVXFKDVWUHHV OLJKWSRVW LQ IURQWRIYHKLFOHV FYDULRXV HQYLURQPHQWV LQFDPSXV SDUNLQJDFFHVVDUHDVDQGPRUHWKDQRQHOLFHQVHSODWHVLQWKHVDPHLPDJHDQGGGDPDJHG/3DVEHQWRUROG7KH\ZHUHWDNHQLQGLVWDQFHIURPXSWRPDQGWKHFDPHUDZDVIRFXVHGLQWKHSODWHUHJLRQ 8QGHU WKHVH FRQGLWLRQV VXFFHVV RI /3 GHWHFWLRQ KDV UHDFKHG WR PRUH WKDQ 5HVXOWVRIFDQGLGDWHUHJLRQGHWHFWLRQDUHVKRZQLQ7DEOH

,PDJHJURXS 7RWDOLPDJHV 'HWHFWHG/3V 6XFFHVVUDWH

'LIIHUHQWLOOXPLQDWLRQV

&RPSOH[VFHQHV

9DULRXVHQYLURQPDQWV

'DPDJHG/3

7RWDO

7DEOH'HWHFWLRQUHVXOWV$FRPPRQGUDZEDFNRIWKHSURSRVHG9/3'V\VWHPLVWKHIDLOXUHWRGHWHFWWKHERXQGDULHVRUERUGHU RI OLFHQVH SODWHV 7KLV RFFXUV ZKHQ YHKLFOH ERGLHV DQG WKHLU OLFHQVH SODWH SRVVHVVVLPLODU FRORUV 7KH DYHUDJH FRPSXWDWLRQDO WLPH IRU WKH FRORU VHJPHQWDWLRQ DQG ILOWHULQJRSHUDWLRQVRIWKHSURSRVHGPHWKRGDUHVKRZQLQ7DEOH

6WDJH $YJWLPHV 6WGGHYLDWLRQV

&RORUVHJPHQWDWLRQ

)LOWHULQJ

7DEOH$YHUDJHFRPSXWDWLRQWLPH


16/18

2CVVGTP4GEQIPKVKQP

)LJ6WHSVIRUYHULI\SUHGHWHUPLQHGDOSKDQXPHULFFKDUDFWHUVZKLWHEDFNJURXQG/3D

H[WUDFWLQJFDQGLGDWHUHJLRQEYHUWLFDOSRVLWLRQKLVWRJUDPZLWK/3ERUGHUFKRUL]RQWDOSRVLWLRQKLVWRJUDPZLWK/3ERUGHUGKRUL]RQWDOSRVLWLRQKLVWRJUDPZLWKRXW/3ERUGHUHYLHZRIQRUPDOL]DWLRQFDQGLGDWHUHJLRQDIWHUUHPRYLQJERUGHUDQGQRLV\DUHDIYHUWLFDOSRVLWLRQKLVWRJUDP VHYHQ SHDNV IRU SUHGHWHUPLQHG VHYHQ DOSKDQXPHULF FKDUDFWHUV LQ /3UHJLRQDQGJFKDUDFWHUH[WUDFWLRQ

%QPENWUKQP

,QFRQFOXVLRQDQHZPHWKRGLVDGRSWHGLQWKLVSDSHUWRVHOHFWVWDWLVWLFDOWKUHVKROGYDOXHLQ+6,FRORUPRGHO,QWKHSURSRVHGPHWKRGFDQGLGDWHUHJLRQVDUHIRXQGE\XVLQJ+6,FRORUPRGHO7KHVHFDQGLGDWHUHJLRQVPD\LQFOXGH/3UHJLRQVJHRPHWULFDOSURSHUWLHVRI/3DUH

WKHQ XVHG IRU FODVVLILFDWLRQ 7KH SURSRVHGPHWKRG LVDEOH WRGHDOZLWK FDQGLGDWH UHJLRQVXQGHU LQGHSHQGHQW RULHQWDWLRQ DQG VFDOH RI WKH SODWH )LQDOO\ 9/3 UHJLRQV FRQWDLQLQJSUHGHWHUPLQHG /3 DOSKDQXPHULF FKDUDFWHU DUH YHULILHG DQG GHWHFWHG E\ XVLQJ SRVLWLRQKLVWRJUDP&RORUDUUDQJHPHQWDQGSUHGHWHUPLQHG/3DOSKDQXPHULFFKDUDFWHURIWKH.RUHDQOLFHQVHSODWHDUHLPSRUWDQWIHDWXUHVIRUYHULILFDWLRQDQGGHWHFWLRQRIOLFHQVHSODWHUHJLRQV:KLOH FRQGXFWLQJ WKHH[SHULPHQWV GLIIHUHQWLOOXPLQDWLRQFRQGLWLRQV DQGYDULHG GLVWDQFHVEHWZHHQYHKLFOHDQGFDPHUDRIWHQRFFXUUHG,QWKDWFDVHWKHUHVXOWWKDWKDVEHHQFRQILUPHGLVYHU\PXFKHIIHFWLYHZKHQWKHSURSRVHGDSSURDFKLVXVHG+RZHYHUWKHSURSRVHGPHWKRGLVVHQVLWLYH ZKHQ YHKLFOH ERGLHV DQG WKHLU OLFHQVH SODWHV SRVVHVV VLPLODU FRORUV :HOHDYHWKHVHLVVXHVWREHFRQVLGHUHGLQIXWXUHVWXGLHV


17/18


#EMPQYNGFIOGPVU

7KHDXWKRUVZRXOGOLNHWRWKDQNWR8OVDQ0HWURSROLWDQ&LW\0.(DQG0(67ZKLFKKDYH

VXSSRUWHGWKLVUHVHDUFKLQSDUWWKURXJKWKH1$5&WKH+XPDQ5HVRXUFH7UDLQLQJSURMHFWIRU UHJLRQDO LQQRYDWLRQ WKURXJK.27() WKH+XPDQ 5HVRXUFH 'HYHORSPHQW3URJUDPIRU&RQYHUJHQFH5RERW6SHFLDOLVWVWKURXJK.,$7DQGSRVW%.DW8QLYHUVLW\RI8OVDQ$OVRZHH[SUHVVVSHFLDOWKDQNVWR,,7$IRUWKHLULQWHUQDWLRQDOJUDGXDWHVWXGHQWVVFKRODUVKLS

4GHGTGPEGU

$QDJQRVWRSRXORV&$QDJQRVWRSRXORV,/RXPRV9.D\DIDV(/LFHQVHSODWHUHFRJQLWLRQIURPVWLOOLPDJHVDQGYLGHRVHTXHQFHVDVXUYH\,(((7UDQVRQ,QWHOO7UDQVS6\VWV9RO1R6HSWHPEHUSS

$QDJQRVWRSRXORV & $QDJQRVWRSRXORV , /RXPRV 9 .D\DIDV ( $ OLFHQVH

SODWHUHFRJQLWLRQDOJRULWKPIRULQWHOOLJHQWWUDQVSRUWDWLRQV\VWHPDSSOLFDWLRQ,(((7UDQVRQ,QWHOO7UDQVS6\VWV9RO1R6HSWHPEHUSS&DQR-3HUH]&RUWHV-& 9HKLFOHOLFHQVHSODWHVHJPHQWDWLRQLQQDWXUDOLPDJHV

,Q/HFWXUHQRWHVRQFRPSXWHUVFLHQFH9ROSS&KDFRQ0,=LPPHUPDQ$ /LFHQVHSODWHORFDWLRQEDVHGRQD G\QDPLF3&11

VFKHPH,Q3URFHHGLQJVRIWKH,QW-RLQW&RQIRQ1HXUDO1HWZ9ROSS

&KDQJ 6 / &KHQ / 6 &KXQJ


18/18

2CVVGTP4GEQIPKVKQP

.LP6.LP'5\X

Documents

InTech-Segmenting the License Plate Region Using a Color Model