&RPSDULQJ0DFKLQH/HDUQLQJ0HWKRGV LQ(VWLPDWLRQRI0RGHO8QFHUWDLQW\ 'XUJD/DO6KUHVWKD0HPEHU,((('LPLWUL36RORPDWLQH0HPEHU,(((
$EVWUDFW−7KHSDSHUSUHVHQWVDJHQHUDOL]DWLRQRIWKHIUDPHZRUN IRUDVVHVVPHQWRISUHGLFWLYHPRGHOVXQFHUWDLQW\XVLQJPDFKLQH OHDUQLQJ WHFKQLTXHV +LVWRULFDO PRGHO HUURUV ZKLFK DUH PLVPDWFKEHWZHHQREVHUYHGDQGSUHGLFWHGYDOXHVDUHDVVXPHG WREHLQGLFDWRUVRIWRWDOPRGHOXQFHUWDLQW\ LWLVPHDVXUHGLQWKH IRUP RI SUHGLFWLRQ LQWHUYDOV DQG FRPSULVHV DOO VRXUFHV RI XQFHUWDLQW\ LQFOXGLQJ PRGHO VWUXFWXUH PRGHO SDUDPHWHUV LQSXW DQG RXWSXW GDWD 6HYHUDO PDFKLQHOHDUQLQJ PHWKRGV DUH FRPSDUHG7KHDSSURDFKLVWHVWHGRQDFRQFHSWXDOK\GURORJLFDO PRGHOVHWXSWRSUHGLFWVWUHDPIORZVRIWKH%UXHFDWFKPHQWLQ WKH8QLWHG.LQJGRP
,
,1752'8&7,21
9DULRXVW\SHVRIVLPXODWLRQ SK\VLFDOO\EDVHG PRGHOVDUH ZLGHO\XVHGLQYDULRXVDUHDVRIKXPDQDFWLYLW\)RUH[DPSOH ZDWHU UHVRXUFH PDQDJHPHQW DQG SODQQLQJ LV LPSRVVLEOH ZLWKRXW XVLQJK\GURORJLFDO PRGHOV WKDW VLPXODWH WKH VWUHDP UXQRII ZLWK UHVSRQVH WR D FRPELQDWLRQ RI IRUFLQJ PHWHRURORJLFDO HYHQWV 6XFK PRGHOV DUH RIWHQ IDFHG ZLWK XQFHUWDLQW\ IURP GLIIHUHQW VRXUFHV LQFOXGLQJ QDWXUDO UDQGRPQHVV LQSXW GDWD PRGHO SDUDPHWHUV DQG PRGHO VWUXFWXUH HWF 'XH WR WKLV IDFW LQ IRUHFDVWLQJ K\GURORJLFDO YDULDEOHV VXFK DV IORZV LQ ULYHU WKH GHFLVLRQ PDNHUV RIWHQ UHTXLUH QRW RQO\ SRLQW IRUHFDVWV EXW DOVR WKH DVVRFLDWHG XQFHUWDLQW\HVWLPDWHV,QZHDWKHUSUHGLFWLRQVXFKSUDFWLFHLV FRPPRQ EXW LQ RSHUDWLRQDO K\GURORJ\ WKH UHVHDUFKHV IRFXV SULPDULO\ RQ DFFXUDWH GHWHUPLQLVWLF IRUHFDVWLQJ RI WKH K\GURORJLFDO YDULDEOHV DQG WKH\ XVXDOO\ GR QRW SURYLGH DQ\ LQIRUPDWLRQUHJDUGLQJWKHFRQILGHQFHZLWKZKLFKWKH\PDNH WKHVH IRUHFDVWV ,QFRUSRUDWLQJ XQFHUWDLQW\ HVWLPDWHV LQWR WKH FRQYHQWLRQDO GHWHUPLQLVWLF IRUHFDVWLQJ HQKDQFHV WKH UHOLDELOLW\ DQG FUHGLELOLW\ RI ERWK WKH IRUHFDVWLQJ DQG WKH ZDUQLQJ V\VWHP LQ UHDO WLPH DQG HQDEOHV DXWKRULWLHV WR VHW ULVNEDVHG FULWHULD IRU IORRG ZDUQLQJ ,W DOVR SURYLGHV LQIRUPDWLRQ QHFHVVDU\ IRU PDNLQJ UDWLRQDO GHFLVLRQV DQG RIIHUVSRWHQWLDOIRUDGGLWLRQDOHFRQRPLFEHQHILWVRIIRUHFDVWV WRHYHU\UDWLRQDOGHFLVLRQPDNHU>@ ,Q UHFHQW \HDUV WKHUH KDV EHHQ DQ LQFUHDVLQJ LQWHUHVW LQ GHYHORSLQJ PHWKRGV WR TXDQWLI\ PRGHO XQFHUWDLQW\ RI PRGHOV $ QXPEHU RI DSSURDFKHV KDYH EHHQ SURSRVHG WR HVWLPDWHPRGHOXQFHUWDLQW\,QJHQHUDOWKHVHDSSURDFKHVIDOO LQWRIRXUFDWHJRULHV>@ 'XUJD /DO 6KUHVWKD LV ZLWK WKH 81(6&2,+( ,QVWLWXWH IRU :DWHU (GXFDWLRQ32%R['$'HOIW7KH1HWKHUODQGV FRUUHVSRQGLQJ DXWKRUSKRQH HPDLO GVKUHVWKD#XQHVFRLKHRUJ 'LPLWUL 3 6RORPDWLQH LV ZLWK WKH 81(6&2,+( ,QVWLWXWH IRU :DWHU (GXFDWLRQ 32 %R[ '$ 'HOIW 7KH 1HWKHUODQGV HPDLO GVRORPDWLQH#XQHVFRLKHRUJ
0RQWH &DUOR DSSURDFK VHH HJ >@ ,W LV VLPXODWLRQ DQGUHVDPSOLQJEDVHGWHFKQLTXHZKLFKLVDZLGHO\XVHG PHWKRGIRUXQFHUWDLQW\DQDO\VLVRIK\GURORJLFDOPRGHOV 2QHRIWKHYHUVLRQVRIVXFKDSSURDFKLQK\GURORJ\LVD JHQHUDOL]HGOLNHOLKRRGXQFHUWDLQW\HVWLPDWRU*/8(>@ %D\HVLDQ DSSURDFK 0RGHO RXWSXWV DUH IRUHFDVWHG SUREDELOLVWLFDOO\EDVHGRQ%D\HVLDQIUDPHZRUN>@ 6WDWLVWLFDO DSSURDFK 8QFHUWDLQW\ LV HVWLPDWHG E\ DQDO\]LQJ WKH VWDWLVWLFDO SURSHUWLHV RI WKH PRGHO HUURUV WKDW RFFXUUHG LQ UHSURGXFLQJ WKH REVHUYHG KLVWRULFDO GDWD0RQWDQDULDQG%UDWK>@XVHGWKLVDSSURDFKIRUWKH HVWLPDWLRQ RI UDLQIDOOUXQRII VLPXODWLRQ XQFHUWDLQW\ DSSO\LQJPHWD*DXVVLDQPRGHO )X]]\WKHRU\EDVHGDSSURDFK 7KLVDSSURDFKSURYLGHVD QRQSUREDELOLVWLF DSSURDFK IRU PRGHOLQJ WKH NLQG RI XQFHUWDLQW\ DVVRFLDWHG ZLWK YDJXHQHVV DQGLPSUHFLVLRQ 0DVNH\ HW DO >@ XVH WKLV DSSURDFK WR TXDQWLI\ XQFHUWDLQW\LQUDLQIDOOUXQRIIPRGHOLQJ 7KHILUVWWZRDSSURDFKHVUHTXLUHWKHSULRUGLVWULEXWLRQVRI WKHXQFHUWDLQLQSXWSDUDPHWHUVWREHSURSDJDWHGWKURXJKWKH PRGHO WR WKH RXWSXWV 7KH VWDWLVWLFDO DSSURDFK UHTXLUHV FHUWDLQ DVVXPSWLRQV DERXW WKH GDWD DQG WKH HUURUV DQG REYLRXVO\ WKH UHOHYDQF\ DQG DFFXUDF\ RI VXFK DSSURDFK GHSHQGV RQ WKH YDOLGLW\ RI WKHVH DVVXPSWLRQV 7KH IX]]\ WKHRU\ EDVHG DSSURDFK UHTXLUHV NQRZOHGJH RI WKH PHPEHUVKLS IXQFWLRQ RI WKH TXDQWLW\ VXEMHFW WR WKH XQFHUWDLQW\DQGLWLVYHU\VXEMHFWLYH )XUWKHUPRUH WKH ILUVW DQG WKH ODVW DSSURDFKHV GHDO RQO\ ZLWK D VLQJOH VRXUFH RI XQFHUWDLQW\ W\SLFDOO\ SDUDPHWHU XQFHUWDLQW\ 'XH WR WKH LQWHUDFWLRQ EHWZHHQ YDULRXV VRXUFHV RI XQFHUWDLQW\ HJ PRGHO VWUXFWXUH LQSXWVDQG SDUDPHWHUV LW LV QRW DOZD\V SRVVLEOH WR GLVDJJUHJDWH WKH LQGLYLGXDO FRQWULEXWLRQV IURP WKH WRWDO PRGHO XQFHUWDLQW\ DQG WKH DXWKRUV GR QRW IXOO\ LQYHVWLJDWH KRZ WKHVH GLIIHUHQW VRXUFHV LQWHUDFW DQG FRQWULEXWH WR WKH WRWDO PRGHO XQFHUWDLQW\ )RU GHFLVLRQPDNLQJLWLVRIWHQHQRXJKWRNQRZWKHWRWDOPRGHO XQFHUWDLQW\ DJJUHJDWH DIIHFW RI DOO VRXUFHV RI XQFHUWDLQW\ DQG QRW WKH LQGLYLGXDO VRXUFHV RI XQFHUWDLQW\ 5HFHQWO\ 6KUHVWKDDQG6RORPDWLQH>@SUHVHQWHGWKHEDVLFVRIDQRYHO PHWKRGWRHVWLPDWHWKHWRWDOPRGHOXQFHUWDLQW\WKDWWDNHVLQWR DFFRXQW DOO VRXUFHV RI XQFHUWDLQW\ ZLWKRXW DWWHPSWLQJ WR VHSDUDWH WKH FRQWULEXWLRQJLYHQ E\ WKH LQGLYLGXDO VRXUFHV RI XQFHUWDLQWLHV 7KH\ PHDVXUH WKH PRGHO XQFHUWDLQW\ E\ HVWLPDWLQJRQO\WZRTXDQWLOHVRIWKHSUREDELOLW\GLVWULEXWLRQ RIWKHPRGHOHUURUWKDWFRQVWLWXWHVWKHSUHGLFWLRQLQWHUYDORI WKH PRGHO RXWSXW 7KLV SDSHU SUHVHQWV D FHUWDLQ JHQHUDOL]DWLRQ RI WKH PHWKRG SDUWLFXODUO\ QRW OLPLWLQJ WKH PHDVXUHPHQW RI XQFHUWDLQW\ RQO\ E\ WZR TXDQWLOHV DQG E\
1411 c 978-1-4244-1821-3/08/$25.002008 IEEE
DVVXPLQJ WKH SRVVLELOLW\ RI XVLQJ D ZLGH FODVV RI PDFKLQH OHDUQLQJ WHFKQLTXHV IURP UHJUHVVLRQ WR LQVWDQFHEDVHG OHDUQLQJ DQG FODVVLILFDWLRQ 7KH DSSURDFK LV UHIHUUHG WR DV 81FHUWDLQW\ (VWLPDWLRQ EDVHG RQ /RFDO (UURUV DQG &OXVWHULQJ 81((& 7KH 81((& PHWKRG HVWLPDWHV WRWDO PRGHO XQFHUWDLQW\ VLPLODUWRWKHVWDWLVWLFDODSSURDFKLHE\DQDO\]LQJDQGXVLQJ VWDWLVWLFDO SURSHUWLHV RI WKH KLVWRULFDO PRGHO HUURUV 7KH PHWKRG DVVXPHV WKH PRGHO HUURU PLVPDWFK EHWZHHQ WKH REVHUYHGDQGPRGHOHGYDOXH WREHDQLQGLFDWLRQRIWKHWRWDO PRGHO XQFHUWDLQW\ 7KH PDLQ LGHD KHUH LV WR HVWLPDWH WKH SUREDELOLW\ GLVWULEXWLRQ IXQFWLRQ SGI RI WKH PRGHO RXWSXW XVLQJ PDFKLQH OHDUQLQJ WHFKQLTXHV ,Q WKLV SDSHU ZH DSSUR[LPDWHWKLVSGIRQO\E\WKHWZRTXDQWLOHVWKDWSHUPLWWR LGHQWLI\ WKH SUHGLFWLRQ LQWHUYDO RI WKH PRGHO RXWSXW FRUUHVSRQGLQJWRVRPHFRQILGHQFHOHYHO VD\HJ :H DOVR FRPSDUHG WZR FODVVHV RI PDFKLQH OHDUQLQJ PHWKRGV QDPHO\ WKH LQVWDQFH EDVHG DQG UHJUHVVLRQ WR HVWLPDWHWKHWRWDOPRGHOXQFHUWDLQW\7KH+%9K\GURORJLFDO PRGHO >@ RI WKH %UXH FDWFKPHQW ZDWHUVKHG LQ WKH 8QLWHG .LQJGRPLVXVHGDVDQH[DPSOH ,,
0(7+2'2/2*<
$ PRGHO 0 RI D UHDOZRUOG V\VWHP SUHGLFWLQJ D V\VWHP RXWSXWYDULDEOH\LVFRQVLGHUHG \ = 0 = θ + ε = \Ö + ε
ZKHUH=LVWKHPDWUL[RIWKHLQSXWYDULDEOHV θLVDYHFWRURI WKH SDUDPHWHUV YDOXHV \Ö LV WKH PRGHO RXWSXW DQG ε LV DQ DGGLWLYHHUURUWHUP,WLVDVVXPHGWKDWZHKDYHDQREVHUYHG GDWDVHW' ^=M\M`M «QZKHUHQLVQXPEHURIGDWD 2QWKHEDVLVRIVHW'DPRGHO RUVHWRIPRGHOV 8LV DUH EXLOW WKDW ZLOO SUHGLFW SUREDELOLW\ GLVWULEXWLRQ RI WKH PRGHO HUURU ε 7KH SUREDELOLW\ GLVWULEXWLRQ RI WKH HUURU LV WKHQ WUDQVIHUUHGWRWKHSUHGLFWLYHXQFHUWDLQW\E\XVLQJLQIRUPDWLRQ RI WKH PRGHO SUHGLFWLRQV ,GHQWLILFDWLRQ RI IXOO SGI LV QRW D WULYLDO SUREOHP ,QD SDUWLFXODU FDVH ZKHQ ZH DUH LQWHUHVWHG RQO\LQWKHXQFHUWDLQW\ FRQILGHQFH ERXQGVIRUH[DPSOHLQ WKH ERXQGLWLVHQRXJKWRXVHDQG TXDQWLOHVRI SUREDELOLW\GLVWULEXWLRQRIWKHHUURU,QWKLVFDVHDSUREOHPLV VLPSOHUDQGRQO\WZRLQGHSHQGHQWPDFKLQHOHDUQLQJPRGHOV 8 DUH WKHQ EXLOW WR PDS WKH FRQVWUXFWHG TXDQWLOHV ZLWK WKH LQSXW GDWD DQG ODWHU WKHVH WUDLQHG PRGHOV DUH HPSOR\HG WR SUHGLFWWKHTXDQWLOHVLQWKHQHZGDWDZKHUHZHGRQRWKDYH LQIRUPDWLRQ DERXW WKH PRGHO UHVLGXDOV EHFDXVH ZH KDYH RQO\PRGHOSUHGLFWLRQEXWQRWWKHREVHUYHGGDWD 2QFHWKH TXDQWLOHV RI XQGHUO\LQJ GLVWULEXWLRQ RI WKH PRGHO HUURU DUH SUHGLFWHGRQHFDQHVWLPDWHWKHSUHGLFWLYHXQFHUWDLQW\ RIWKH PRGHO RXWSXW E\ DGGLQJ WKH SUHGLFWHG HUURU TXDQWLOH WR WKH PRGHO RXWSXW 0RGHO 8 ZLOO EH UHIHUUHG KHUHDIWHU DV XQFHUWDLQW\SURFHVVRU 'DWDVHWWRWUDLQWKHPRGHO8LVFRQVWUXFWHGRQWKHEDVLVRI WKH VHW ' EXW VLQFH WKH QDWXUH RI PRGHOV 0 DQG 8 LV YHU\ GLIIHUHQW LQ PRVW FDVHV DGGLWLRQDO DQDO\VLV VXFK DV FRUUHODWLRQ RU DYHUDJH PXWXDOLQIRUPDWLRQDQDO\VLV EHWZHHQ
WKHFKDUDFWHULVWLFVRIWKHSUREDELOLW\GLVWULEXWLRQRIWKHHUURU DQG WKH YDULDEOHV FRQVWLWXWLQJ ' LV QHHGHG WR FKRRVH WKH DGHTXDWH YDULDEOHV $ SRVVLELOLW\ RI LQFOXGLQJ WKHLU ODJJHG YDULDEOHV VKLIWHGLQWLPHZLWKVRPHLQWHJHUVRIODJV VKRXOG EH FRQVLGHUHG DV ZHOO )RU H[DPSOH K\GURORJLFDO PRGHO +%9 ZKLFK ZDV XVHG KHUH DV 0RGHO 0 VHH HTXDWLRQ KDV UDLQIDOO 5W DQG HYDSRWUDQVSLUDWLRQ (W DV LQSXW YDULDEOHV WR VLPXODWH WKH RXWSXW YDULDEOH UXQRII 4W +RZHYHU WKH XQFHUWDLQW\ PRGHO 8 ZKRVH DLP LV WR SUHGLFW SGI RI WKH PRGHO HUURU RI WKH VLPXODWHG UXQRII 4ÖW ZLOO EH WUDLQHG ZLWK WKH ODJJHG YDULDEOHV RI UDLQIDOO HYDSRWUDQVSLUDWLRQ DQG UXQRII 7KH VHW RI WKHVH YDULDEOHV ZLOOEHGHQRWHGDV^[M` WKH\ IRUPWKHLQSXWVSDFH DQGWKH VHWRIH[DPSOHVLQWKLVVSDFHXVHGWRWUDLQ8ZLOOEHGHQRWHG E\; 7KH 81((& PHWKRG LV EDVHG RQ DQ DVVXPSWLRQ WKDW WKH KLVWRULFDOUHVLGXDOV HUURUV EHWZHHQWKHPRGHO0RXWSXWV \Ö DQG WKH REVHUYHG GDWD \ DUH WKH EHVW DYDLODEOH TXDQWLWDWLYH LQGLFDWRUV RI WKH GLVFUHSDQF\ EHWZHHQ WKH PRGHO DQG WKH UHDOZRUOGV\VWHPRUSURFHVVDQGWKH\SURYLGHWKHYDOXDEOH LQIRUPDWLRQWKDWFDQEHXVHGWRDVVHVVWKHPRGHOXQFHUWDLQW\ 7KHVH UHVLGXDOV DUH RIWHQ IXQFWLRQV RI WKH PRGHO 0 LQSXWV¶ YDOXHVDQGFDQEHPRGHOHG1RWHWKDWLQFRQWUDVWWRWKHRWKHU PHWKRGV GHVFULEHG LQ WKH LQWURGXFWLRQ VHFWLRQ ZH GR QRW DVVXPH DQ\ GLVWULEXWLRQ RI PRGHO HUURUV DV D FRQVHTXHQFH WKHPRGHOELDVFDQEHQRQ]HUR
)LJ7KHJHQHUDOL]HGIUDPHZRUNRIWKH81((&PHWKRG,WKDVWKUHH VWHSV FOXVWHULQJWKHLQSXWVSDFHHVWLPDWLQJSUREDELOLW\GLVWULEXWLRQRIWKH PRGHOHUURUWRWKHHDFKFOXVWHUDQGEXLOGLQJWKHXQFHUWDLQW\SURFHVVRUWR HVWLPDWHXQFHUWDLQW\
7KH81((&PHWKRGFRQVLVWVRIWKUHHPDLQVWHSV VHH)LJ $ FOXVWHULQJ % HVWLPDWLQJSGIRIWKHHUURU & EXLOGLQJ XQFHUWDLQW\ SURFHVVRU 7KH GHVFULSWLRQ RI WKH VWHSV LV SUHVHQWHGLQWKHIROORZLQJVXEVHFWLRQV $ &OXVWHULQJ 7KH VHW ; RI LQSXW YHFWRUV LV SDUWLWLRQHG LQWR VHYHUDO QDWXUDO JURXSV FOXVWHUV 7KH PRWLYDWLRQ LV WKDW H[DPSOHV ZKLFKDUHFORVHLQWKHLQSXWVSDFHFRUUHVSRQGWRVLPLODUUHDO OLIH VLWXDWLRQVDQG ZLOOKDYH VLPLODU YDOXHV RI PRGHO HUURUV 7KLVVHHPVWREHDVWURQJDVVXPSWLRQRIWKH81((&PHWKRG
1412
2008 International Joint Conference on Neural Networks (IJCNN 2008)
ZKLFKKDVWREHWHVWHGEHIRUHDSSO\LQJWKLVPHWKRGRORJ\,Q K\GURORJ\ WKLV DVVXPSWLRQ VHHPV WR EH TXLWH QDWXUDO IRU H[DPSOHKLJKYDOXHVRIUDLQIDOOVSURGXFHKLJKUXQRIIVDQGLQ JHQHUDO WKH K\GURORJLFDO PRGHO LV LQDFFXUDWH LQ VLPXODWLQJ VXFK H[WUHPH HYHQWV UHVXOWLQJ WKH KLJK PRGHO HUURUV ZKLFK FDQEHLGHQWLILHGLQRQHJURXSE\WKHSURFHVVRIFOXVWHULQJ 2QH RI WKH SUREOHPV RI PRVW FOXVWHULQJ DOJRULWKPV LV XVXDOO\ WR DVVXPH D FHUWDLQ VWUXFWXUH RI WKH GDWD ILUVW ,Q SULQFLSOH GLIIHUHQW FOXVWHULQJ WHFKQLTXHV VXFK DV NPHDQV IX]]\ FPHDQV KLHUDUFKLFDO FOXVWHULQJ FDQ EH XVHG WR SDUWLWLRQ WKH LQSXW GDWD YHFWRU ; ZH WHVWHG NPHDQV DQG IX]]\ FOXVWHULQJ >@ 7KH NPHDQV FOXVWHULQJ SDUWLWLRQV WKH LQSXW GDWD LQWR F PXWXDOO\ H[FOXVLYH FOXVWHUV ZLWK FHQWHUV 9 VXFKWKDW9 ^YL `L «FDQGSDUWLWLRQPDWUL[3 ^μLM`M «QVXFKWKDW μLM LIMWKH[DPSOHKDVEHHQDVVLJQHGWR WKH LWK FOXVWHU RWKHUZLVH μLM ,Q IX]]\ FOXVWHULQJ HDFK H[DPSOHRILQSXWGDWDLVDOORZHGWREHORQJWRPDQ\FOXVWHUV ZLWK GLIIHUHQW GHJUHH RI PHPEHUVKLS LH μLM ∈ >@ 8VXDOO\ PHPEHUVKLS IXQFWLRQV DUH GHILQHG EDVHG RQ D GLVWDQFH IXQFWLRQ VXFK WKDW PHPEHUVKLS GHJUHHV H[SUHVV SUR[LPLWLHV RI WKH LQSXW GDWD WR WKH FOXVWHU FHQWHUV LH SURWRW\SHV $QRWKHUSUREOHPRIFOXVWHULQJDOJRULWKPVLVWKHGLIILFXOW\ LQ GHWHUPLQLQJ WKH RSWLPDOQXPEHU RI FOXVWHUV ZKLFK LVQRW NQRZQ D SULRUL 'LIIHUHQW YDOLGLW\ PHDVXUHV DUH UHSRUWHG LQ WKHOLWHUDWXUHVWRILQGWKHRSWLPDOQXPEHURIFOXVWHUVVXFKDV WKH %H]GHN¶V SDUWLWLRQ FRHIILFLHQW >@ DQG WKH ;LH±%HQL¶V VHSDUDWLRQLQGH[> @+RZHYHUWKHRSWLPDOFOXVWHUVREWDLQHG WKURXJK WKH YDOLGLW\ PHDVXUHV KDYH WR EH FKHFNHG WKURXJK WKHILQDOUHVXOWVRIDSSOLFDWLRQZKHUHWKHFOXVWHULQJWHFKQLTXH ZDVDSSOLHG % (VWLPDWLQJSUREDELOLW\GLVWULEXWLRQRIWKHHUURU 3UREDELOLW\GLVWULEXWLRQRIWKHPRGHOHUURUVIRULQGLYLGXDO FOXVWHUV LV HVWLPDWHG LQGHSHQGHQWO\ EDVHG RQ WKH DYDLODEOH KLVWRULFDO PRGHO UHVLGXDOV )URP WKLV GLVWULEXWLRQ ZH FDQ FRPSXWH VRPH TXDQWLOH HFS RI WKH HUURU GLVWULEXWLRQ FRUUHVSRQGLQJ WR WKH SUREDELOLW\ S ZKHUH S KDV YDOXHV LQ >@ 7KH HVWLPDWLRQ RI TXDQWLOH HFS GHSHQGV RQ WKH FOXVWHULQJ PHWKRGXVHG)RUH[DPSOHLI.PHDQVLVXVHGHDFKLQVWDQFH RI GDWD EHORQJV WR RQO\ RQH FOXVWHU LH ³PDQ\ WR RQH´ UHODWLRQVKLSV DUH HVWDEOLVKHG DQG WKH TXDQWLOHV DUH GHWHUPLQHG IURP WKH HPSLULFDO HUURU GLVWULEXWLRQ IRU HDFK FOXVWHU LQGHSHQGHQWO\ +RZHYHU LQ WKH FDVH RI IX]]\ FOXVWHULQJ ZKHUH HDFK LQVWDQFH EHORQJV WR PRUH WKDQ RQH FOXVWHU LH ³PDQ\ WR PDQ\´ UHODWLRQVKLSV DUH HVWDEOLVKHG DQG LV DVVRFLDWHG ZLWK VHYHUDO PHPEHUVKLS IXQFWLRQV WKH FRPSXWDWLRQ RI WKH TXDQWLOHV VKRXOG WDNH WKLV LQWR DFFRXQW 7KHIROORZLQJH[SUHVVLRQLVXVHGWRHVWLPDWHWKHTXDQWLOHRI WKHSUREDELOLW\GLVWULEXWLRQRIWKHPRGHOHUURUIRUFOXVWHUL M
Q
N =
M =
HFLS = ε M M ¦ μL N < S ¦ μL M
ZKHUHHFLSLVWKHTXDQWLOHFRUUHVSRQGLQJWRWKHSUREDELOLW\ S IRU FOXVWHU L M LV WKH PD[LPXP LQWHJHU YDOXH UXQQLQJ IURP XQLW\ WKDW VDWLVILHV WKH DERYH LQHTXDOLW\ εM LV WKH UHVLGXDO
DVVRFLDWHGZLWKWKHMWKGDWD GDWDDUHVRUWHGZLWKUHVSHFWWRWKH DVVRFLDWHGUHVLGXDO μLMLVWKHPHPEHUVKLSIXQFWLRQRIWKHMWK GDWDWRFOXVWHUL & %XLOGLQJXQFHUWDLQW\SURFHVVRU 7KH XQFHUWDLQW\ SURFHVVRU 8 SUHGLFWV WKH SUREDELOLW\ GLVWULEXWLRQRIWKHPRGHOHUURUVIRUWKHXQVHHQLQSXWYHFWRUV HJLQYDOLGDWLRQGDWD $QDSSURDFKKHUHFRXOGEHWRWUDLQ VHYHUDO PRGHOV 8S WR HVWLPDWH WKH TXDQWLOHV RI SGI RI WKH PRGHOHUURUV HS =8 S ;
ZKHUHHSLVWKHTXDQWLOHRISGIRIWKHPRGHOHUURUVUHODWHGWR WKH LQGLYLGXDO LQSXW GDWD 1RWH WKDW HFS ZDV XVHG WR GHQRWH WKHTXDQWLOHRIWKHSGIIRUWKHFOXVWHU8QFHUWDLQW\SURFHVVRU 8 FDQ EH EXLOW XVLQJ D QXPEHU RI DSSURDFKHV DV SUHVHQWHG EHORZ (DJHU FODVVLILFDWLRQ 7KH FODVVLILHULV WUDLQHG RQ WKH GDWD VHW ; WR FODVVLI\ WKH LQSXW VSDFH WR WKH FOXVWHUV ZKLFK ZHUH LGHQWLILHGGXULQJWKHFOXVWHULQJSURFHVV VHH VXEVHFWLRQ$ 7KH FKRLFH RI YDULDEOHV ^[L ` WR WUDLQ WKH FODVVLILHU PD\ UHTXLUH VRPH DQDO\VLV HQVXULQJ WKH KLJK DFFXUDF\ RI WKH FODVVLILHU 3UHGLFWLRQ RI WKH TXDQWLOH HS IRU WKH XQVHHQ LQSXW GDWD HJ LQ YDOLGDWLRQ GDWD FRQVLVWV RI DWWULEXWLQJLWWR WKH RQH RI WKH FOXVWHU ILUVW DQG DVVLJQLQJ WKH FRUUHVSRQGLQJ TXDQWLOH RI WKH FOXVWHU HFS VHH )LJ 7KLV PHWKRG LV RQO\ DSSOLFDEOHWRWKHFULVSFOXVWHULQJ ,QVWDQFHEDVHG OHDUQLQJ ,Q LQVWDQFHEDVHG OHDUQLQJ LQVWHDGRIEXLOGLQJDFODVVLILHUDGLVWDQFHIXQFWLRQLVXVHGWR LGHQWLI\WKHFOXVWHUIRUWKHXQVHHQLQSXWYHFWRUDQGUHSUHVHQW LW E\ WKH SURWRW\SH YHFWRU RU LWV FHQWHU >@ WKH GLVWDQFH IURPWKHQHZYHFWRUWRWKHFOXVWHUSURWRW\SHRUFHQWHUVKRXOG EHPLQLPDO
)LJ8QFHUWDLQW\SURFHVVRUXVLQJDFODVVLILHU &ODVVLILHULVILUVWWUDLQHG EDVHG RQ WKH UHVXOWV RI FOXVWHULQJ 7KHQ XQVHHQ LQSXW GDWD LH YDOLGDWLRQ GDWD LVFODVVLILHGWRRQHRIWKHFODVVHVDQGWKHTXDQWLOHFRUUHVSRQGLQJWRWKLV FODVVLVXVHGDVWKHTXDQWLOHRIWKHXQVHHQGDWD
)LJ SUHVHQWV WKH PRGLILHG PHWKRG WR LQVWDQFH EDVHG OHDUQLQJ IRU WKH HVWLPDWLRQ RI WKH TXDQWLOH HS XVLQJ WKH VR FDOOHG IX]]\ FRPPLWWHH DSSURDFK ,QVWHDG RI DVVLJQLQJ DQ
2008 International Joint Conference on Neural Networks (IJCNN 2008)
1413
LQSXWYHFWRUWRDSDUWLFXODUFOXVWHUIX]]\PHPEHUVKLSZHLJKW μLM LV FRPSXWHG XVLQJ GLVWDQFH IXQFWLRQ EHWZHHQ FOXVWHU FHQWHUVDQGLQSXWGDWDZKLFKUHIOHFWVSUR[LPLWLHVRIWKHLQSXW GDWDWRWKHFOXVWHUFHQWHUV7KHUHDUHPDQ\GLIIHUHQWZD\VRI GHILQLQJ D GLVWDQFH IXQFWLRQ DQG LW LV KDUG WR ILQG UDWLRQDO JURXQGVIRUFKRRVLQJDSDUWLFXODURQH7\SLFDOO\WKHUHODWLRQ EHWZHHQZHLJKWDQGGLVWDQFHIXQFWLRQVWDNHVWKHIRUPRI
μ L M = G 9L [ M − P
S
S
ZKHUH θ LV WKH YHFWRU RI SDUDPHWHUV RI WKH PRGHO 8 IRU TXDQWLOH ZLWK SUREDELOLW\ S 7KXV WKH PRGHO 8 DIWHU EHLQJ WUDLQHG HQFDSVXODWHV WKH XQGHUO\LQJ SUREDELOLW\ GLVWULEXWLRQ RI WKH PRGHO HUURU DQG PDSV WKH LQSXWWR WKLV SUREDELOLW\ GLVWULEXWLRQ 1RWH WKDWPRGHO 8 FDQWDNHDQ\ RI IRUP IURP OLQHDU WR QRQOLQHDU IXQFWLRQ VXFK DV DQ DUWLILFLDO QHXUDO QHWZRUN7KHFKRLFHRIWKHPRGHOGHSHQGVRQWKHFRPSOH[LW\ RI WKH SUREOHP WR EH KDQGOHG DQG WKH DYDLODELOLW\ RI GDWD 2QFH WKH PRGHO 8 LV WUDLQHG RQ WKH LQSXW GDWD ; LW FDQ EH HPSOR\HG WR HVWLPDWH WKH TXDQWLOHV RI WKH SGI RI WKH PRGHO HUURU LQ WKH YDOLGDWLRQ GDWD VHW WKH QHZ GDWD VHW ZKLFK DUH QRWXVHGLQDQ\PRGHOEXLOGLQJSURFHVV
HMS = 8 S ; θ S
ZKHUHPLVWKHVPRRWKLQJH[SRQHQWLDOFRHIILFLHQWG 9L [M LV WKH RUGLQDU\ (XFOLGHDQ GLVWDQFH EHWZHHQ FOXVWHU FHQWHUV 9L DQGWKH LQSXW GDWD [M7KH VPDOOHU YDOXH RI P ≈ JLYHV UHODWLYHO\KLJKHUZHLJKWWRWKHOHDVWGLVWDQFHZKLOHWKHKLJKHU YDOXHRILW ≈ JLYHVDOPRVWHTXDOZHLJKWV
H MS = 8 S ; θ S
F
¦μ
L M
F
HFLS
H S = ¦ μL HFLS
L =
L =
)LJ8QFHUWDLQW\SURFHVVRUXVLQJLQVWDQFHEDVHGOHDUQLQJ)RUHDFKXQVHHQ GDWDWKHZHLJKWμLMLVFRPSXWHGE\WKHGLVWDQFH7KHTXDQWLOHHFSRIWKH XQVHHQGDWDLVWKHFRPSXWHGE\FRPELQLQJWKHHSRIWKHFOXVWHUVXVLQJWKH ZHLJKWμLM
2QFHWKHIX]]\ ZHLJKWVDUHFRPSXWHGWKHTXDQWLOH HSIRU WKH JLYHQ LQSXW GDWD FDQ EH FRPSXWHG XVLQJ WKH IX]]\ FRPPLWWHHDVIROORZV F
H MS =
¦ μ L M HF
S L
L =
F
¦μ
L M
L =
ZKHUHHMSLVWKHTXDQWLOHRIWKHSGIRIWKHPRGHOHUURUIRUMWK LQVWDQFHZLWKSUREDELOLW\SDQGHFL SLVWKHTXDQWLOHRIWKHLWK FOXVWHU 5HJUHVVLRQ ,Q WKLV DSSURDFK ILUVW HMS IRU HDFK WUDLQLQJ H[DPSOH KDYH WR EH FRPSXWHG EDVHG RQ WKH HFLS IRU HDFK FOXVWHU 7KH DWWULEXWLRQ RI WKH TXDQWLOHV WR WKH WUDLQLQJ H[DPSOHV GHSHQGV RQ WKH W\SHV RI FOXVWHULQJ WHFKQLTXHV HPSOR\HG )RU H[DPSOH LQ FULVS FOXVWHULQJ D FODVVLILFDWLRQ DSSURDFK DV GHVFULEHG SUHYLRXVO\ FDQ EH XVHG +RZHYHU LQ WKHFDVHRI IX]]\FOXVWHULQJDIX]]\FRPPLWWHHDSSURDFKDV GHVFULEHGLQLQVWDQFHEDVHGPHWKRGLVXVHG 2QFH WKH TXDQWLOHV HMS IRU HDFK H[DPSOH LQ WKH WUDLQLQJ GDWDDUHREWDLQHGUHJUHVVLRQPRGHO VHH)LJ LVEXLOWWKDW HVWLPDWHWKHXQGHUO\LQJIXQFWLRQDOUHODWLRQVKLSVEHWZHHQWKH LQSXWGDWDPDWUL[;DQGWKHTXDQWLOHHMSDV
$VPHQWLRQHGDERYHWKHVHSUHGLFWHGTXDQWLOHVVKRXOGEH WUDQVIHUUHGWRDPRUHPHDQLQJIXODQGXQGHUVWDQGDEOHHQWLW\ SUHGLFWLYH XQFHUWDLQW\ RI WKH PRGHO RXWSXW 7KH TXDQWLOH RI WKH SUHGLFWLYH XQFHUWDLQW\ RI WKH PRGHO RXWSXW FDQ EH HVWLPDWHGDV \ S = \Ö + H S
ZKHUH \ S LVWKHSWK TXDQWLOHRIWKHSGI RIWKHPRGHORXWSXW 2QHFDQVHHWKDWHTXDWLRQ LVDUHIRUPXODWLRQRIHTXDWLRQ ,Q RUGHU WR HVWLPDWH IRU H[DPSOH SUHGLFWLRQ LQWHUYDO LW LV UHTXLUHG WR EXLOG WZR PRGHOV 8 DQG 8 WKDW ZLOOSUHGLFWDQG TXDQWLOHVRISGIRIWKHPRGHOHUURU ,,, $33/,&$7,21 +<'52/2*,&$/02'(/,1* $ 6WXG\$UHD 7KH %UXH FDWFKPHQW ORFDWHG LQ 6RXWK :HVW RI (QJODQG 8. LV VHOHFWHG IRU WKH VWXG\ 7KLV FDWFKPHQW KDV EHHQ H[WHQVLYHO\XVHGIRUUHVHDUFKUHODWHGWRXVHRIZHDWKHUUDGDU TXDQWLWDWLYH SUHFLSLWDWLRQ IRUHFDVWLQJ DQG UDLQIDOOUXQRII PRGHOLQJDVLWKDVEHHQIDFLOLWDWHGZLWKDGHQVHUDLQJDXJH QHWZRUN DV ZHOO DV WKH FRYHUDJH E\ ZHDWKHU UDGDUV )LJ VKRZV WKH %UXH FDWFKPHQW DQG ORFDWLRQ RI WKH JDXJLQJ
1414
)LJ8QFHUWDLQW\SURFHVVRUXVLQJUHJUHVVLRQ5HJUHVVLRQPRGHOLVWUDLQHG RQWKHLQSXWGDWDWROLQNWKHLQSXWGDWDZLWKWKHFRPSXWHGTXDQWLOHVHSDQG ODWHUWKHPRGHOLVXVHGWRSUHGLFWWKHHSIRUWKHXQVHHQLQSXWGDWD
2008 International Joint Conference on Neural Networks (IJCNN 2008)
VWDWLRQV7KHGDWDZDVREWDLQHGYLDWKH%ULWLVK$WPRVSKHULF 'DWD&HQWUH:HEVLWHDWKWWS ZZZEDGFUODFXNGDWDK\UH[ 7KH FDWFKPHQW KDV D GUDLQDJH DUHD RI NP ZLWK WKH DYHUDJH DQQXDO UDLQIDOO RI PP DQG DQ DYHUDJH PHDQ ULYHU IORZ RI PV IRU WKH SHULRG IURP WR %HVLGHV ZHDWKHUUDGDU WKHUH LV D GHQVH UDLQ JDXJHQHWZRUN ZKLFK FRPSULVHV UDLQJDXJHV 7KH GLVFKDUJH LV PHDVXUHG DW/RYLQJWRQ 7KH KRXUO\ GDWD RI UDLQIDOO GLVFKDUJH DQG DXWRPDWLF ZHDWKHU GDWD WHPSHUDWXUH ZLQG VRODU UDGLDWLRQ HWF LV FRPSXWHG IURP WKH PLQXWH GDWD 7KH EDVLQ DYHUDJH UDLQIDOO GDWD ZDV XVHG LQ WKH VWXG\ 7KH KRXUO\ SRWHQWLDO HYDSRWUDQVSLUDWLRQ ZDV FRPSXWHG XVLQJ WKH PRGLILHG 3HQPDQ PHWKRG UHFRPPHQGHG E\ )$2 >@ 2QH \HDU KRXUO\GDWDIURP WR ZDV VHOHFWHG IRU FDOLEUDWLRQ RI K\GURORJLFDO PRGHO DQG WKH 81((& PHWKRG DQG GDWD IURP WR ZDVXVHGIRUWKHYHULILFDWLRQ
)LJ7KH%UXHFDWFKPHQWVKRZLQJGHQVHUDLQJDXJHVQHWZRUN WKH KRUL]RQWDODQGYHUWLFDOD[HVUHIHUWRWKHHDVWLQJDQGQRUWKLQJLQ%ULWLVK QDWLRQDOJULGUHIHUHQFHFRRUGLQDWHV
% &RQFHSWXDO+\GURORJLFDO0RGHO 6)± 6QRZ 5)± 5DLQ ($± (YDSRWUDQVSLUDWLRQ 63± 6QRZFRYHU
6)
,1± ,QILOWUDWLRQ
5) ($
5± 5HFKDUJH 60± 6RLOPRLVWXUH &)/8;± &DSLOODU\WUDQVSRUW
63
8=± 6WRUDJHLQXSSHUUHVHUYRLU
,1
3(5&± 3HUFRODWLRQ
60
/=± 6WRUDJHLQORZHUUHVHUYRLU 5
4R ± )DVWUXQRIIFRPSRQHQW
&)/8; 4
8= 3(5&
4
4± 6ORZUXQRIIFRPSRQHQW 4± 7RWDOUXQRII
4 44 7UDQVIRUP IXQFWLRQ
/=
)LJ6FKHPDWLFUHSUHVHQWDWLRQRI+%9 PRGHO>@ZLWKURXWLQHIRU VQRZ XSSHU VRLO PLGGOH DQGUHVSRQVH ERWWRP
$ VLPSOLILHG YHUVLRQ RI +%9 PRGHO ZDV XVHG WR VLPXODWH ULYHU IORZV LQ WKH FDVH VWXG\ 7KH +%9 PRGHO >@ LV D UDLQIDOOUXQRII PRGHO ZKLFK LQFOXGHV FRQFHSWXDO QXPHULFDO GHVFULSWLRQV RI K\GURORJLFDO SURFHVVHV DW WKH FDWFKPHQW VFDOH 7KH PRGHO FRQVLVWV RI VXEURXWLQHV IRU PHWHRURORJLFDO LQWHUSRODWLRQ VQRZ DFFXPXODWLRQ DQG PHOW HYDSRWUDQVSLUDWLRQ HVWLPDWLRQ VRLO PRLVWXUH DFFRXQWLQJ SURFHGXUH URXWLQHV IRU UXQRII JHQHUDWLRQ DQG ILQDOO\ D VLPSOHURXWLQJSURFHGXUHEHWZHHQVXEEDVLQVDQGODNHV7KH PRGHO VWUXFWXUH RI +%9 LV SUHVHQWHG VFKHPDWLFDOO\ LQ )LJ 7KH LQSXW GDWD DUH REVHUYDWLRQV RI SUHFLSLWDWLRQ DLU WHPSHUDWXUH DQG HVWLPDWHV RI SRWHQWLDO HYDSRWUDQVSLUDWLRQ 7KH WLPH VWHS LV XVXDOO\ RQH GD\ EXW LW LV SRVVLEOH WR XVH VKRUWHUWLPHVWHSV7KHHYDSRUDWLRQYDOXHVXVHGDUHQRUPDOO\ PRQWKO\DYHUDJHVDOWKRXJKLWLVSRVVLEOHWRXVHGDLO\YDOXHV $LU WHPSHUDWXUH GDWD DUH XVHG IRU FDOFXODWLRQV RI VQRZ DFFXPXODWLRQDQGPHOW,WFDQDOVREHXVHGWRDGMXVWSRWHQWLDO HYDSRUDWLRQ ZKHQ WKH WHPSHUDWXUH GHYLDWHV IURP QRUPDO YDOXHVRUWRFDOFXODWHSRWHQWLDOHYDSRUDWLRQ
40 C1 C2 C3 C4 C5
35
3
Discharge (m /s)
30 25 20 15 10 5 0
0
1000
2000
3000
4000 5000 Time (hours)
6000
7000
8000
)LJ)X]]\FOXVWHULQJRIWKHLQSXWGDWDIRUWKHFDOLEUDWLRQSHULRG \HDU XQWLO 7KHFOXVWHUODEHOV&WKURXJK&VKRZWKHLQSXWH[DPSOHVKDYLQJWKHKLJKHVWGHJUHHRIPHPEHUVKLSWRWKHFOXVWHUV
2008 International Joint Conference on Neural Networks (IJCNN 2008)
1415
0
3
Errors (m /s)
3
Discharge (m /s)
40 5 C1 C2 C3 C4 C5
30 20
5 15
10
10 10
15
15
10
20
5
20
0 20
25
0 2
25
0 -20 4200
3
20
Prediction Interval (m /s)
0
0 4300 4400 Time (hours)
-2 4700
4500
4800 4900 Time (hours)
5000
)LJ3UHGLFWLRQLQWHUYDOVIRUDSDUWRIYHULILFDWLRQGDWDVHW XQWLO OHIWILJXUH DQG XQWLO ULJKWILJXUH +\GURORJLFDOPRGHOVLPXODWLRQHUURUVDUHVKRZQLQWKHEHORZRIWKHPDLQILJXUH7KHFOXVWHUODEHOVDQGWKHZLGWKRIWKH3,VDUHVKRZQLQ WKHWRSD[LVRIWKHILJXUH
,9 5(68/76$1'',6&866,216 7KH SDUDPHWHUVRIWKHXVHG+%9PRGHOZHUHFDOLEUDWHG RSWLPL]HG XVLQJWKHJOREDORSWLPL]DWLRQURXWLQHDGDSWLYH FOXVWHU FRYHULQJ DOJRULWKP $&&2 >@ $&&2 LV UDQGRP VHDUFK JOREDO RSWLPL]DWLRQ DOJRULWKP ZKLFK ZDV LPSOHPHQWHG LQ JOREDO RSWLPL]DWLRQ WRRO */2%( KWWS ZZZGDWDPDFKLQHFRP 7KH $&&2 DOJRULWKP FRQWDLQV WKH IROORZLQJ VWHSV LQLWLDO SRSXODWLRQ RI SDUDPHWHUV SRLQWV LVVDPSOHGXQLIRUPO\LQIHDVLEOHGRPDLQ WKHSRSXODWLRQLVUHGXFHGE\FKRRVLQJWKH³JRRG´SRLQWV SURPLVLQJ SRLQWV ZKLFK DUH FORVH WR WKH SRWHQWLDO RSWLPDO SRLQW ³JRRG´ SRLQWV DUH JURXSHG LQWR WKH FOXVWHUV IRU HDFK FOXVWHU VPDOOHU UHJLRQV DUH UHSHWLWLYHO\ IRUPHG DURXQGWKHFXUUHQWEHVWSRLQWDQGSURJUHVVLYHO\FRYHUHG :H XVHG 1DVK6XWFOLIIH >@ FRHIILFLHQW RI HIILFLHQF\ &2( DV D SHUIRUPDQFH PHDVXUH RI +%9 PRGHO &2( LV RQH RI WKH PRVW ZLGHO\ XVHG IRUPV RI ILWWLQJ FULWHULRQ LQ PRGHOLQJRIK\GURORJLFDOHYHQWVDQGLVGHILQHGDVRQHPLQXV WKHVXPRIWKHVTXDUHGGLIIHUHQFHEHWZHHQWKHREVHUYHG \ DQG WKH SUHGLFWHG YDOXHV \Ö QRUPDOL]HG E\ WKH YDULDQFH RI WKHREVHUYHGYDOXHV:HREWDLQHGWKH&2(YDOXHRI IRU WKH FDOLEUDWLRQ SHULRG 7KH PRGHO ZDV YDOLGDWHG E\ VLPXODWLQJWKHIORZVIRUWKHLQGHSHQGHQWYDOLGDWLRQGDWDVHW 7KH&2(ZDVIRUWKHYDOLGDWLRQSHULRG 7KHLQSXWYDULDEOHV^[L `XVHGLQFOXVWHULQJFRQVLVWHGRIWKH SUHYLRXVYDOXHVRIHIIHFWLYHUDLQIDOO 5(W5(W 5(W DQG UXQRII 4W 4W 4W 7DEOH , 7KH VWUXFWXUH RI WKH LQSXW
GDWD XVHG LQ FOXVWHULQJLV GHWHUPLQHG E\ WKH DQDO\VLV RI WKH FRUUHODWLRQDQGDYHUDJHPXWXDOLQIRUPDWLRQEHWZHHQUDLQIDOO DQG WKH UXQRII DQG DXWRFRUUHODWLRQ DQDO\VLV IRU WKH UXQRII 7KH RSWLPDO QXPEHU RI FOXVWHUV ZDV VHW WR EDVHG RQ WKH SUHYLRXV UHVHDUFK >@ WKDW KDV VKRZQ WKDW WKLV YDOXH LV UHDVRQDEOH WR UHSUHVHQW GLIIHUHQW VLWXDWLRQVUHODWHG WR UXQRII JHQHUDWLRQSURFHVV 7$%/(, ,13879$5,$%/(6
9DULDEOHV ,QSXW
+%9 PRGHO 5W(W
8QFHUWDLQW\ SURFHVVRU 5(W5(W 5(W 5(W5(W 5(W 4W4W4W 4W4W4W 93 HWHW &OXVWHULQJ
2XWSXW 4W )LJVKRZVFOXVWHULQJRIFDOLEUDWLRQGDWDVHWE\IX]]\& PHDQV FOXVWHULQJ PHWKRG >@ &OXVWHU & FRQWDLQV LQSXW H[DPSOHV ZLWK YHU\ ORZ UXQRII ZKHUHDV FOXVWHU & LV DVVRFLDWHG ZLWK YHU\ KLJK YDOXHV RI UXQRII )X]]\ &PHDQV FOXVWHULQJ LV DEOH WR LGHQWLI\ FOXVWHUV FRUUHVSRQGLQJ WR YDULRXV PHFKDQLVPV RI UXQRII JHQHUDWLRQ SURFHVV VXFK DV KLJK IORZ EDVH IORZ HWF ,QYHVWLJDWLQJ WKH FOXVWHU ODEHOV ZLWKWKHLUFHQWHUVDQG3,VUHYHDOVWKDWWKHFOXVWHUVZLWKKLJK YDOXHV RI UDLQIDOO DQG UXQRII DOVR KDYH ZLGH 3,V ZKLOH WKH FOXVWHUV ZLWK ORZ YDOXHV RI UDLQIDOO DQGUXQRII KDYH QDUURZ 3,V
1416
2008 International Joint Conference on Neural Networks (IJCNN 2008)
)LJ VKRZV WKH HVWLPDWHG SUHGLFWLRQ OLPLWV IRU WKH WHVW GDWD XVLQJ ERWK UHJUHVVLRQ DQG LQVWDQFH EDVHG OHDUQLQJ XVHGLQXQFHUWDLQW\SURFHVVRU0PRGHOWUHH>@ZDVXVHG DVDUHJUHVVLRQPRGHO,QLQVWDQFHEDVHGOHDUQLQJZHXVHGD IX]]\FRPPLWWHHDSSURDFKDQGWKHZHLJKWLVFRPSXWHGZLWK VHWWLQJP LHLQYHUVHVTXDUH(XFOLGHDQGLVWDQFH ,WZDVREVHUYHGWKDWZKHQLQVWDQFHEDVHGPHWKRGLVXVHG RI WKH REVHUYHG GDWD SRLQWV DUH HQFORVHG ZLWKLQ WKH FRPSXWHG3,V,QWKHFDVHRIWKHUHJUHVVLRQPHWKRGDVOLJKWO\ KLJKHUVKDUH RIWKHREVHUYHGGDWDLVLQVLGHWKH3,V ZLWK WKH UHJUHVVLRQ PHWKRG RI WKH YDOLGDWLRQ GDWD SRLQWV IDOO EHORZ ORZHU 3, ZKHUHDV RQO\ ZLWKWKHUHJUHVVLRQPHWKRG GDWDSRLQWVIDOODERYHXSSHU3, 7KLVGLIIHUHQFHLVFRQVLVWHQWZLWKWKHIDFWWKDWWKHVLPXODWLRQ PRGHO 0 LV ELDVHGDQG RYHUHVWLPDWHV WKH IORZ LQ YDOLGDWLRQ GDWD 7KH DYHUDJH YDOXH RI 3,V LV P V DQG PV XVLQJ WKH LQVWDQFH EDVHG DQG WKH UHJUHVVLRQ PHWKRG UHVSHFWLYHO\$OVRLWFDQEHQRWLFHGIURP)LJWKDWWKH3,V FRPSXWHGZLWKWKHUHJUHVVLRQPHWKRGDUHVOLJKWO\ZLGHUWKDQ WKRVHREWDLQHGZLWKWKHLQVWDQFHEDVHGPHWKRG7KHVHYDOXHV DUH UHDVRQDEOH LI FRPSDUHG ZLWK WKH RUGHU RI PDJQLWXGH RI PRGHOHUURULQWHVWGDWD WKHURRWPHDQVTXDUHGHUURU PV 9
&21&/86,216
7KLV SDSHU SUHVHQWV D IUDPHZRUN H[WHQGLQJ WKH PHWKRG SUHVHQWHG LQ >@ IRU DVVHVVLQJ WRWDO PRGHO XQFHUWDLQW\ 7KH SDSHU GHVFULEHV WKH JHQHUDOL]DWLRQ RI WKHPHWKRG E\ DLPLQJ DWWKHDVVHVVPHQWRIWKHSUREDELOLW\GLVWULEXWLRQRIWKHPRGHO RXWSXW UHSUHVHQWHG E\ RQO\ WZR TXDQWLOHV KRZHYHU :H DOVR SURSRVHG LQVWDQFH EDVHG OHDUQLQJ DQG FODVVLILFDWLRQ PHWKRG DV D PDFKLQH OHDUQLQJ WHFKQLTXHV WR HVWLPDWH WKH PRGHOXQFHUWDLQW\ %RWK UHJUHVVLRQ DQG LQVWDQFHEDVHG OHDUQLQJ PHWKRGV ZHUHXVHGWREXLOGDQXQFHUWDLQW\SURFHVVRUSUHGLFWLQJWKH PRGHO SUHGLFWLRQ LQWHUYDOV ,W LV ZRUWKZKLOH WR PHQWLRQ WKDW WKHFRPSXWHG3,VH[SOLFLWO\WDNHLQWRDFFRXQWDOOVRXUFHV RI XQFHUWDLQW\ RI WKH PRGHO RXWSXWV ZLWKRXW VHSDUDWLQJ WKH FRQWULEXWLRQJLYHQE\WKHGLIIHUHQWVRXUFHVRIXQFHUWDLQW\ :HDSSOLHGWKHPHWKRGRORJ\WRDVVHVVWKHXQFHUWDLQW\WKH VLPXODWLRQUHVXOWVRIDFRQFHSWXDOK\GURORJLFDO+%9PRGHO DSSOLHG WR WKH %UXH FDWFKPHQW LQ 8QLWHG .LQJGRP 7KH UHVXOWVWRWKHFDVHVWXG\VKRZWKDWWKHUHJUHVVLRQPHWKRGDQG LQVWDQFHEDVHG PHWKRG DUH FRPSDUDEOH KRZHYHU WKH LQVWDQFHEDVHGPHWKRGLVVOLJKWO\EHWWHULQWHUPVRIWKHZLGWK RI 3,V %RWK PHWKRGV JHQHUDWH LQWHUSUHWDEOH XQFHUWDLQW\ HVWLPDWHV DQG WKLV LV DQ LQGLFDWRU WKDW WKH SUHVHQWHG PDFKLQHOHDUQLQJEDVHGDSSURDFKFDQEHDYDOXDEOHWRROIRU DVVHVVLQJXQFHUWDLQW\RIYDULRXVSUHGLFWLYHPRGHOV
>@ * .XF]HUD DQG ( 3DUHQW ³0RQWH &DUOR DVVHVVPHQW RI SDUDPHWHU XQFHUWDLQW\ LQ FRQFHSWXDO FDWFKPHQW PRGHOV WKH 0HWURSROLV DOJRULWKP´ - RI +\GURORJ\ YRO SS >@ .-%HYHQDQG-%LQHO\³7KHIXWXUHRIGLVWULEXWHGPRGHOV PRGHO FDOLEUDWLRQ DQG XQFHUWDLQW\ SUHGLFWLRQ´ +\GURORJLFDO 3URFHVVHVYROSS >@ $ 0RQWDQDUL DQG $ %UDWK ³$ VWRFKDVWLF DSSURDFK IRU DVVHVVLQJWKHXQFHUWDLQW\RIUDLQIDOOUXQRIIVLPXODWLRQV´:DWHU 5HVRXUFHV5HVHDUFKYRO >@ 6 0DVNH\ 9 *XLQRW DQG 5 . 3ULFH ³7UHDWPHQW RI SUHFLSLWDWLRQ XQFHUWDLQW\ LQ UDLQIDOOUXQRII PRGHOOLQJ´ $GYDQFHVLQ:DWHU5HVRXUFHVYROSS >@ * /LQGVWU|P % -RKDQVVRQ % -RKDQVVRQ 0 3HUVVRQ 0 *DUGHOLQ 6 %DUQVWRUP ³'HYHORSPHQW DQG WHVW RI WKH GLVWULEXWHG +%9 K\GURORJLFDO PRGHO´ - RI +\GURORJ\ YROSS >@ - & %H]GHN 3DWWHUQ 5HFRJQLWLRQ ZLWK )X]]\ 2EMHFWLYH )XQFWLRQ $OJRULWKPV 1RUZHOO0$ 86$ .OXZHU $FDGHPLF 3XEOLVKHUV > @ ; / ;LH DQG * %HQL ³$ YDOLGLW\ PHDVXUH IRU IX]]\ FOXVWHULQJ´ ,((( 7UDQV RQ 3DWWHUQ $QDO\VLV DQG 0DFKLQH ,QWHOOLJHQFHYROQRSS± >@: 'XFK DQG . *UXG]LQVNL 3URWRW\SH EDVHG UXOHVD QHZ ZD\ WR XQGHUVWDQG WKH GDWD ,QWHUQDWLRQDO -RLQW &RQIHUHQFH RQ1HXUDO1HWZRUNV:DVKLQJWRQ >@5 * $OOHQ 6 / 3HUHLUD ' 5DHV DQG 0 6PLWK &URS (YDSRWUDQVSLUDWLRQ JXLGHOLQHV IRU FRPSXWLQJ FURS ZDWHU UHTXLUHPHQWV )$2 ,UULJDWLRQ DQG 'UDLQDJH 3DSHU 5RPH >@'3 6RORPDWLQH 7ZR VWUDWHJLHV RI DGDSWLYH FOXVWHU FRYHULQJ ZLWK GHVFHQW DQG WKHLU FRPSDULVRQ WR RWKHU DOJRULWKPV - RI *OREDO2SWLPL]DWLRQYRO1RSS >@-(1DVKDQG-96XWFOLIIH5LYHUIORZIRUHFDVWLQJWKURXJK FRQFHSWXDO PRGHOV 3DUW $ 'LVFXVVLRQ 3ULQFLSOHV - RI +\GURORJ\YROSS >@- 5 4XLQODQ ³/HDUQLQJ ZLWK FRQWLQXRXV FODVVHV´ 7KH WK $XVWUDOLDQ-RLQW&RQIHUHQFHRQ$,:RUOG6FLHQWLILF
5()(5(1&(6 >@ 5 .U]\V]WRIRZLF] ³7KH FDVH IRU SUREDELOLVWLF IRUHFDVWLQJ LQ K\GURORJ\´-RI+\GURORJ\YRO SS >@ ' / 6KUHVWKD DQG ' 3 6RORPDWLQH ³0DFKLQH OHDUQLQJ DSSURDFKHVIRUHVWLPDWLRQRISUHGLFWLRQLQWHUYDOIRUWKHPRGHO RXWSXW´1HXUDO1HWZRUNVYRO QRSS
2008 International Joint Conference on Neural Networks (IJCNN 2008)
1417
