1
⳿⸂ꞿⵖ䖴罋䣁׃鋅⳿׃欰䧭رךךխ 㣐鋉垷٦ أػ➂鋅꧅㣕 1 խ歊〡꧅ㆂ 1 խ歊啾猕僇 1 խ銮둷纷✳龤 2 խ蝍歊崘 2 䀤䃵湫錁 3 խ✜⨳㣕龤 4,5 խ㤴募㷕 3 吳䒭⠓爡劉傈倜耀爡 1 խ吳䒭⠓爡ز غ2 խ匌❨䊨噟㣐㷕 3 խ匌⻌㣐㷕 4 խ椚⻉㷕灇瑔䨽AIPإة٦ 5 {hitomi-y1, taguchi-y2, tamori-h}@asahi.com 1 劤灇瑔כדծ⳿⸂ꞿ罋䣁׃鋅⳿׃欰䧭ر鐰⣣ך٦ أػչJAMULպהծ傈劤铂ך鋅⳿׃欰䧭ךך㷕统٦أػչJNCպ稱➜կ ך٦דأػ傀㶷ך鐰⣣鏣㹀ד黝ⴖח鐰⣣דגאחג陽锷կ JNCכ10䎃ⴓך鎸✲ה秵鋅⳿،لך׃秈183♰⟝ ꐮկ圫ղזך鋅⳿׃ろծ♧菙涸ז鋅⳿ ׃欰䧭رךז׆ծ⳿⸂ꞿ罋䣁׃رךחⵃ欽〳կ 鎸✲ծ秵鋅⳿ה׃ծ10俑㶵٥13俑㶵٥26俑㶵♳ ➰ג׃הةآر鋅⳿ך׃穈1524⟝  ꐮկ7٠剢חꂁ⥋דךծJNCכהꅾ醱 זկ1ךא鎸✲ח׃ծ醱侧ךך鋅⳿׃ ג挿ծ䖞勻ך٦הأػזկ⳿⸂ꞿⵖ䖴 ر欰䧭׃זך鋅⳿׃鐰⣣〳腉կ 2.1 鋅⳿׃欰䧭ؿך٦ 2.2 JNC JNC ꐮ鋅⳿ך׃ꞿⴓ䋒 26char-ref כחծ10/13char- ref⽃ךהקות ג ⯓걧n俑㶵ⴖ⳿ ׃鐰⣣כדծ⽃铂笨繎 ג⼧♶׆׃׆ꞿ銲秈ך חꅾ銲ז٦٦س꧊⚥ ׃גזכד 6ךא䩛岀ך穈さאחג鐰⣣ 欰䧭堣圓 ⳿⸂ꞿⵖ䖴堣圓 (1) Seq2Seq LenEmb[Kikuchi et al. (2016)] (2) Seq2Seq LenInit[Kikuchi et al. (2016)] (3) Seq2Seq SP-token[Fan et al. (2018)] (4) ConvS2S[Gehring et al. (2017)] SP-token (5) ConvS2S LC[Liu et al. (2018)] (6) Transformer[Vaswani et al. (2017)] SP-token 㷕统ر٦ةJNC ؍ؿةד秈157♰⟝《䖤 157♰⟝ךծחيت䬄⳿׃ 1%Validation Data׃ה 铂䔿圓眠խByte Pair Encoding 鐰⣣ر٦ةJAMUL JNCהず圫؍ؿךةד秈1,100 ⟝《䖤 鐰⣣䭷垥խROUGE-1٥ROUGE-2٥ ROUGE-L ⳿⸂ꞿⵖ䖴ח《穈傀㶷灇瑔ח 鐰⣣כדծ30٥50٥75 俑㶵♳ꣲ ח䭷㹀׃⳿يذأءח׃ծ75 俑 㶵♳ꣲח⡲撑銲秈(DUC 2004)欽גկ ⳿يذأءה撑銲秈ך㖇簭桦殯 ז㜥さծ黝ⴖח鐰⣣דג ך ⳿يذأء⸂ꞿ撑銲秈ד鐰⣣ה 撑銲秈 10俑㶵 碛㬗嚂㣐䩛㡰⽱❛幧 26俑㶵 21⚅秀ؿحأծصؤ؍ر٦✲ח噟㡰⽱խ❛幧碛㜠麣 ⳿يذأء⸂⳿⸂ꞿ10俑㶵 ر 鋅⳿ ׃10char-ref (R-1) = Gold 26char-ref (R-1) (1) 21 ⚅秀ؿح أ0.00 25.00 (2) ؿحأծ荈爡㡰⽱ 16.67 25.00 (3) ؿحأծ✲噟⼿陽 0.00 25.00 (4) ،؍رծ㡰⽱⼿陽 33.33 25.00 (5) ،؍ر㣐䩛㡰⽱ פ50.00 16.67 (6) 碛㬗嚂㣐䩛㡰⽱⼿陽 83.33 16.67 26char-ref ד鐰⣣׃קծ10char-ref(GOLD)ד鐰⣣״أ، ♶䔲ח鐰⣣ג〳腉䚍 JAMUL״ח鐰⣣דגה חג⢪欽⽃铂ח㢌⻉ծꞿ銲秈׃חתז ״⽃ז♶䔲חROUGEأ،♳ג־〳腉䚍 罋俑柃 Yuta Kikuchi, Graham Neubig, Ryohei Sasano, Hiroya Takamura, and Manabu Okumura. Controlling output length in neural encoder-decoders. In EMNLP, pp. 1328~1338, 2016. Angela Fan, David Grangier, and Michael Auli. Controllable abstractive summarization. In WNMT, pp. 45~54, 2018. Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, and Yann N. Dauphin. Convolutional sequence to sequence learning. In ICML, pp. 1243~1252, 2017. Yizhu Liu, Zhiyi Luo, and Kenny Zhu. Controlling lengthin abstractive summarization using a convolutional neural network. In EMNLP, pp. 4110~4119, 2018. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. Attention is all you need. In NIPS, pp. 6000~6010, 2017. 㷕统欽ךJNC秵鋅⳿׃ה鐰⣣欽ךJAMUL آرة鋅⳿׃כדծ䲓鯹⯓殯זծةآر׃⳿秵鋅⳿ח׃׃ծךו玎䏝暴䗙涸ז嗚鏾կ ةآر鋅⳿ד׃铂䔿⼱ך侧⟃♳כ秵鋅⳿ ׃ח歋勻ծ秈4ⶴכ秵鋅 כח׃⳿זկ ˘铂䔿ך麩㣐 JAMUL ꐮ鋅⳿ך׃ꞿⴓ䋒 ״ך铣罏ח鎸✲ꠘ鋮ג׃ծ1ךא鎸✲醱侧ך رװ،؍رחأ؎غꂁ⥋ג׃կ♧倯דծꂁ⥋⯓؎ؠرךװחؤ؎؟ג鋅⳿ ך׃俑㶵侧⿑חזⵖ秈կEnc-Decر״ח荈鋅⳿׃欰䧭㹋欽 כחծ䨽劄ךד鋅⳿׃欰䧭أةח《穈䗳銲կ 胜兝 1. כ ח2. JNCהJAMUL 3. JAMUL״ח傀㶷䩛岀ך鐰⣣ 2.3 JAMUL 2.4 秵鋅⳿ةآرה׃鋅⳿ך׃嫰鯰 2.5 殯זةآرך鋅⳿׃ך嫰鯰 3.2 JAMUL״ח鐰⣣ JAMUL״ח鐰⣣ 26char-refꞿ撑銲秈ך⢪欽׃鐰⣣ ROUGEך갫⡘ Ⰵ剏 撑銲秈ꞿ أ،ך㼎⦼㼭ծ 䚍腉䊴㼭 ז 傀㶷灇瑔 4. הת JNC٥JAMULך鑫稢٥Ⰵ䩛כ 3.1 ⳿⸂ꞿⵖ䖴罋䣁׃鋅⳿׃欰䧭 ׆ Transformer + SP-token أך،剑 넝˘ 鎸✲DB 鎸罏 秵鋅⳿ ׃כ秵؎، زחוז⣛㶷 ةآر鋅⳿ ׃10俑㶵鋅⳿ ׃( 10char-ref ) 13俑㶵鋅⳿ ׃( 13char-ref ) 26俑㶵鋅⳿ ׃( 26char-ref ) ةآر箟꧊ 秵箟꧊ JNC JAMUL ؎،؍رأծչ⯓⡝孖做ךꞿպ؞䐖姺פխ㣐٦ չ⯓⡝孖做ךꞿպ؞䐖姺 פ評価が適切にできる例(文圧縮) حؠ٦غ٦孑ծ،ف锃叨邌僇խ♶姻崧⳿㉏겗 FBծ،ف锃叨邌僇 زةծآך鮦珏ئפխ2025䎃׀ زةծⰋ鮦珏חչ鮦պ 評価が適切にできない例(抽象化)

,ÿ. §¿-VE´ þ KHÁ Ã Ë Å,ÿ Ãk0Ií L 1 U Ú Ë í Ú m 8Ð ÉW· f › pdfs › NLP2019-poster-a4.pdf,ÿ. ¿-VE´ þ KHÁ Ã Ë Å,ÿ Ãk0Ií L 1 U Ú Ë í Ú m 8Ð ÉW·

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: ,ÿ. §¿-VE´ þ KHÁ Ã Ë Å,ÿ Ãk0Ií L 1 U Ú Ë í Ú m 8Ð ÉW· f › pdfs › NLP2019-poster-a4.pdf,ÿ. ¿-VE´ þ KHÁ Ã Ë Å,ÿ Ãk0Ií L 1 U Ú Ë í Ú m 8Ð ÉW·

⳿⸂ꞿⵖ䖴罋䣁׃鋅⳿׃欰䧭ךךرխ�㣐鋉垷أػ٦�➂鋅꧅㣕�խ歊〡꧅ㆂ�խ歊啾猕僇�խ銮둷纷✳龤�խ蝍歊崘��䀤䃵湫錁�խ✜⨳㣕龤� �խ㤴募㷕��

吳䒭⠓爡劉傈倜耀爡�խ吳䒭⠓爡غز�խ匌❨䊨噟㣐㷕�խ匌⻌㣐㷕�խ椚⻉㷕灇瑔䨽"*1٦ةإ��\IJUPNJ�Z� �UBHVDIJ�Z� �UBNPSJ�I^!BTBIJ�DPN�

劤灇瑔כדծ⳿⸂ꞿ罋䣁׃鋅⳿׃欰䧭ر鐰⣣أػ٦ךչ+".6-պהծ傈劤铂ך鋅⳿׃欰䧭ךך㷕统أػ٦չ+/$պ稱➜կדأػ٦ך傀㶷ך鐰⣣鏣㹀ד黝ⴖח鐰⣣גאחגד陽锷կ

ⵃ欽〳կח㷕统ךر׃罋䣁ծ⳿⸂ꞿ׆זךر欰䧭׃⳿鋅זծ♧菙涸ろ׃⳿鋅ךꞿז秈���♰⟝ ꐮկ圫ղ،لך׃⳿秵鋅ה✲鎸ך��䎃ⴓכ$/+

鎸✲ծ秵鋅⳿ה׃ծ��俑㶵٥��俑㶵٥��俑㶵♳ꣲةآر➰ג׃ה鋅⳿ך׃穈����⟝ ꐮկ�٠剢חꂁ⥋דךծ+/$כהꅾ醱זկךא�鎸✲ח㼎׃ծ醱侧ךꞿך鋅⳿ג➰׃挿ծ䖞勻הأػ٦ך殯זկ⳿⸂ꞿⵖ䖴ر欰䧭׃殯זꞿך鋅⳿׃鐰⣣〳腉կ

����鋅⳿׃欰䧭٦ؿך

����+/$

+/$ ꐮ鋅⳿ך׃ꞿⴓ䋒

��DIBS�SFGכח�ծ�����DIBS�SFGך⽃铂והקろגת• ⯓걧O俑㶵ⴖ׃⳿鐰⣣כדծ⽃铂笨繎׆ג♶⼧ⴓ�• 䗳׃׆ꞿ銲秈ך鿇חꅾ銲س٦٦ז꧊⚥זכדג׃

鐰⣣גאחさ穈ך䩛岀ךא�欰䧭堣圓 ⳿⸂ꞿⵖ䖴堣圓

� 4FR�4FR -FO&NC<,JLVDIJ�FU�BM������>� 4FR�4FR -FO*OJU<,JLVDIJ�FU�BM������>� 4FR�4FR 41�UPLFO<'BO�FU�BM������>� $POW4�4<(FISJOH�FU�BM������> 41�UPLFO� $POW4�4 -$<-JV�FU�BM������>� 5SBOTGPSNFS<7BTXBOJ�FU�BM������> 41�UPLFO

• 㷕统ة٦ر+/$�• �䖤》⟞♰���秈דة؍ؿ• �׃ה7BMJEBUJPO�%BUB��׃⳿䬄חيتծך⟞♰���

• 铂䔿圓眠խ#ZUF�1BJS�&ODPEJOH�• 鐰⣣ة٦ر+".6-�

• �䖤》⟞��� �秈דة؍ؿךず圫ה$/+• 鐰⣣䭷垥խ306(&��٥306(&��٥306(&�-

⳿⸂ꞿⵖ䖴》ח穈傀㶷灇瑔ח鐰⣣כדծ��٥��٥���俑㶵♳ꣲח䭷㹀ח⸃⳿يذأء׃㼎׃ծ���俑㶵♳ꣲח⡲撑銲秈%6$������կג欽ךגד鐰⣣ח㜥さծ黝ⴖז㖇簭桦殯ך撑銲秈ה⸃⳿يذأء

瀉⸃⳿يذأءꞿ撑銲秈ד鐰⣣ה撑銲秈

��俑㶵 碛㬗嚂㣐䩛㡰⽱❛幧��俑㶵 ��⚅秀أحؿծח٦صؤ؍ر✲噟㡰⽱խ❛幧碛㜠麣

⳿⸂ꞿ��俑㶵⸃⳿يذأءر 鋅⳿׃ ��DIBS�SFG�3���

��(PME ��DIBS�SFG�3��� ���⚅秀أحؿ ���� ������ ⽱ծ荈爡㡰أحؿ ������ ������ ծ✲噟⼿陽أحؿ ���� ������ 碛؍ر،ծ㡰⽱⼿陽 ����� ������ 碛؍ر،㣐䩛㡰⽱פ ������ ������ 碛㬗嚂㣐䩛㡰⽱⼿陽 ����� �����

��DIBS�SFGד�鐰⣣ק׃ծ��DIBS�SFG(0-%�،أ넝״鐰⣣ד♶䔲ח鐰⣣ג〳腉䚍

�הגד鐰⣣״ח-6."+ꞿח䘔ג⢪欽⽃铂ח㢌⻉ծꞿ銲秈׃חろזת〳腉䚍ג־♳،أ&)306ח铂♶䔲⽃ז״

罋俑柃• :VUB�,JLVDIJ �(SBIBN�/FVCJH �3ZPIFJ�4BTBOP �)JSPZB�5BLBNVSB �BOE�.BOBCV�0LVNVSB��$POUSPMMJOH�PVUQVU�MFOHUI�JO�OFVSBM�FODPEFS�EFDPEFST��*O�&./-1 �QQ������_���� �������• "OHFMB�'BO �%BWJE�(SBOHJFS �BOE�.JDIBFM�"VMJ��$POUSPMMBCMF�BCTUSBDUJWF�TVNNBSJ[BUJPO��*O�8/.5 �QQ����_�� �������• +POBT�(FISJOH �.JDIBFM�"VMJ �%BWJE�(SBOHJFS �%FOJT�:BSBUT �BOE�:BOO�/��%BVQIJO��$POWPMVUJPOBM�TFRVFODF�UP�TFRVFODF�MFBSOJOH��*O�*$.- �QQ������_���� �������• :J[IV�-JV �;IJZJ�-VP �BOE�,FOOZ�;IV��$POUSPMMJOH�MFOHUIJO�BCTUSBDUJWF�TVNNBSJ[BUJPO�VTJOH�B�DPOWPMVUJPOBM�OFVSBM�OFUXPSL��*O�&./-1 �QQ������_���� �������• "TIJTI�7BTXBOJ �/PBN�4IB[FFS �/JLJ�1BSNBS �+BLPC�6T[LPSFJU �-MJPO�+POFT �"JEBO�/��(PNF[ �-VLBT[�,BJTFS �BOE�*MMJB�1PMPTVLIJO��"UUFOUJPO�JT�BMM�ZPV�OFFE��*O�/*14 �QQ������_���� ������

㷕统欽ך+/$秵鋅⳿׃ה鐰⣣欽6."+ך-ةآر鋅⳿׃כדծ䲓鯹⯓殯זծةآر鋅⳿׃秵鋅⳿ח׃㼎׃ծךו玎䏝暴䗙涸ז麩嗚鏾կ麩㣐ךկ�˘铂䔿ז邌כח׃⳿秵鋅כծ秈�ⶴ歋勻ח׃⳿秵鋅כ♳⟄侧⼱ך铂䔿欽ד׃⳿鋅ةآر

+".6- ꐮ鋅⳿ך׃ꞿⴓ䋒

կ䗳銲穈》חأة欰䧭׃⳿鋅דꞿךծ䨽劄כח⻉㹋欽欰䧭׃⳿荈鋅״חرկ&OD�%FDⵖ秈ז㺘⿑ח俑㶵侧ך׃⳿鋅ג䘔חؤ؎؟歗װ؎ؠرך⯓⥋ծꂁדկ♧倯ג׃⥋ꂁחأ؎غرװ،؍رך醱侧✲鎸ךא�ծג׃ꠘ鋮✲鎸ח铣罏ך㢳״胜兝

חכ���

-6."+ה$/+���

鐰⣣ך傀㶷䩛岀״ח-6."+���

����+".6-

����秵鋅⳿ةآرה׃鋅⳿ך׃嫰鯰

����殯זꞿةآرך鋅⳿׃ך嫰鯰

鐰⣣״ח-6."+�����鐰⣣״ח-6."+

��DIBS�SFGꞿ撑銲秈ך⢪欽׃鐰⣣

• �剏갫⡘Ⰵך&)306• 撑銲秈ꞿך،أ窫㼎⦼㼭ծ䚍腉䊴㼭ז

傀㶷灇瑔

הת���

כ鑫稢٥Ⰵ䩛ך-6."+٥$/+

�����⳿⸂ꞿⵖ䖴罋䣁׃鋅⳿׃欰䧭

�5SBOTGPSNFS׆ ��41�UPLFOأך�،剑넝˘鎸✲%#

鎸罏

秵鋅⳿׃ꞿכ秵؎،ز

⣛㶷חוז

׃⳿鋅ةآر��俑㶵鋅⳿׃�10char-ref ��俑㶵鋅⳿׃�13char-ref ��俑㶵鋅⳿׃�26char-ref )ةآر箟꧊

秵箟꧊+/$

+".6-

խ㣐٦פ䐖姺؞ꞿպךծչ⯓⡝孖做أ،؍ر؎չ⯓⡝孖做ךꞿպ؞䐖姺פ評価が適切にできる例(文圧縮)

邌僇խ♶姻崧⳿㉏겗锃叨ف،٦孑ծغ٦حؠ'#ծ،ف锃叨邌僇

׀խ����䎃פئ鮦珏ך鮦آծةزչ鮦պחծⰋ鮦珏ةز

評価が適切にできない例(抽象化)