33
@? ?L?|h@_@M*it }i?ih@|i tMt|@?|@* üL4i M@tq œ L@L*L Liti?| @?_ ,hU æ@? ‘?ULLT 6i_ih@* +itihæi @?! Lu ßiŒ vLh! œTh* 2fff W Zh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjr/ dqg vhplqdu sduwlflsdqwv dw wkh Xqlyhuvlw| ri Pddvwulfkw dqg Frshq0 kdjhq Exvlqhvv Vfkrro iru khosixo frpphqwv dqg vxjjhvwlrqv1 Vfrww Qlfkrovrq kdv surylghg h{fhoohqw uhvhdufk dvvlvwdqfh1 Suholplqdu| zrun rq wklv sdshu zdv fduulhg rxw zkloh wkh dxwkruv zhuh uhvhdufk ihoorzv dw wkh Lqqrfhq}r Jdvsdulql Lqvwlwxwh iru Hfrqrplf Uhvhdufk lq Plodq1 Zh judwhixoo| dfnqrzohgjh æqdqfldo vxssruw iurp Rolyhwwl/ dqg iurp wkh Hxurshdq Frppxqlw| xqghu wkh Kxpdq Fds0 lwdo Prelolw| Surjudp1 Wkh ylhzv h{suhvvhg khuh duh wkrvh ri wkh dxwkruv/ dqg gr qrw qhfhvvdulo| uhhfw wkh srvlwlrq ri wkh Ihghudo Uhvhuyh Edqn ri Qhz \run ru wkh Ihghudo Uhvhuyh V|vwhp1 Fruuhvsrqghqfh= hulf1ydqzlqfrrsCq|1iue1ruj dqg sdror1shvhqwlCq|1iue1ruj1

ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

ç@? ?L?|h@_@M*it }i?ih@|itýMt|@?|ð@* üL4i Mð@tqú

è@L*L èiti?|ð @?_ ,hðU ñ@? `ð?ULLT6i_ih@* +itihñi î@?! Lu ûiê vLh!

úThð* 2fff

WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/Nhq Urjrò/ dqg vhplqdu sduwlflsdqwv dw wkh Xqlyhuvlw| ri Pddvwulfkw dqg Frshq0kdjhq Exvlqhvv Vfkrro iru khosixo frpphqwv dqg vxjjhvwlrqv1 Vfrww Qlfkrovrqkdv surylghg h{fhoohqw uhvhdufk dvvlvwdqfh1 Suholplqdu| zrun rq wklv sdshu zdvfduulhg rxw zkloh wkh dxwkruv zhuh uhvhdufk ihoorzv dw wkh Lqqrfhq}r JdvsdulqlLqvwlwxwh iru Hfrqrplf Uhvhdufk lq Plodq1 Zh judwhixoo| dfnqrzohgjh ñqdqfldovxssruw iurp Rolyhwwl/ dqg iurp wkh Hxurshdq Frppxqlw| xqghu wkh Kxpdq Fds0lwdo Prelolw| Surjudp1 Wkh ylhzv h{suhvvhg khuh duh wkrvh ri wkh dxwkruv/ dqg grqrw qhfhvvdulo| uhðhfw wkh srvlwlrq ri wkh Ihghudo Uhvhuyh Edqn ri Qhz \run ruwkh Ihghudo Uhvhuyh V|vwhp1 Fruuhvsrqghqfh= hulf1ydqzlqfrrsCq|1iue1ruj dqgsdror1shvhqwlCq|1iue1ruj1

Page 2: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

úMt|h@U|

Aüi T@t| _iU@_i ü@t êð|?itti_ @? ð?Uhi@ti ð? |üi uh@U|ðL? Lu i^ýð|) TLh|uL*ðLtð?ñit|i_ @MhL@_c @t M@hhðiht |L ð?|ih?@|ðL?@* @tti| |h@_i ü@ñi tð}?ð�U@?|*)_iU*ð?i_ë `ü@| @hi |üi *L?}íhý? ð4T*ðU@|ðL?t Lu |üðt ThLUittq W? |üðt T@Tihêi ð?ñit|ð}@|i |L êü@| i |i?| ?L?|h@_@M*it EUL?tý4T|ðL? @?_ *iðtýhiä U@?@giU| |üi TLh|uL*ðL @**LU@|ðL? _iUðtðL? ð? L|üihêðti ð?|i}h@|i_ U@Tð|@* 4@hí!i|të i �?_ |ü@| üi_}ð?} @}@ð?t| ?L?|h@_@M*it tüLU!t U@? @UULý?| uLh L?*)@ t4@** TLh|uL*ðL Mð@t |Lê@h_t _L4it|ðU @tti|të Aüiti hitý*|t tý}}it| |ü@|ð? |üi ?i@h uý|ýhi êi U@? i TiU| |L LMtihñi tð3@M*i @__ð|ðL?@* ð?|ih?@|ðL?@*_ðñihtð�U@|ðL?ë

aë,ëwë U*@ttð�U@|ðL? 62fc 6ôSc B�Dëki)êLh_tG ð?|ih?@|ðL?@* TLh|uL*ðL UüLðUi( üL4i Mð@t( ?L?|h@_@M*itë

Page 3: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

� W?|hL_ýU|ðL?

ú ?ý4Mih Lu hiUi?| t|ý_ðit ü@ñi _LUý4i?|i_ @ tð}?ð�U@?|c )i| t*Lê*) u@**ð?}øüL4i Mð@t< ð? ð?|ih?@|ðL?@* �?@?Uð@* TLh|uL*ðLt @4L?} ð?_ýt|hð@*ð3i_ ULý?|hðitë�

Aüi 4Lt| hiUi?| iñð_i?Uic uhL4 Ait@h @?_ ih?ih E�bbHäc tüLêt |ü@| M) |üii?_ Lu �bbS |üi uh@U|ðL? Lu t|LU!í4@h!i| êi@*|ü ð?ñit|i_ ð? uLhið}? @tti|tê@t �fI uLh |üi N5c ��I uLh ç@?@_@c �HI uLh Bih4@?)c @?_ 22I uLh |üiNkë Aüiti ?ý4Miht ü@ñi ð?Uhi@ti_ uhL4 @ _iU@_i @}Lë W? �bH. N5 hitð_i?|tð?ñit|i_ eI @MhL@_c ç@?@_ð@? ð?ñit|Lht SIc @?_ îhð|ðtü ð?ñit|Lht �.Ië

W| ðt *ð!i*) |ü@| |üi _i4@?_ uLh _ðñihtð�U@|ðL? êð** ð?Uhi@ti ð? |üi ?i@huý|ýhic @t |üi _iñi*LT4i?| Lu Uüi@Tih @?_ 4Lhi iæUði?| ð?uLh4@|ðL? @?_UL44ý?ðU@|ðL? |iUü?L*L}ðit hi_ýUi ð?uLh4@|ðL? @t)44i|hðitë2 Aüi _ðgýtðL?Lu @ ULhi ti| Lu ð?|ih?@|ðL?@* @UULý?|ð?} t|@?_@h_t @?_ @ 4Lhi *ðMih@* hi}íý*@|Lh) i?ñðhL?4i?| êLh*_êð_i @hi *ð!i*) |L UL?|hðMý|i |L |üðt ThLUitt @têi**ëô

ú !i) ^ýit|ðL? ðt êüihi |üi ThLUitt Lu ð?Uhi@tð?} TLh|uL*ðL _ðñihtð�U@|ðL?êð** iñi?|ý@**) ti||*i _Lê?ë W? L|üih êLh_tc êü@| ðt |üi *L?}í|ih4 øMi?Uü4@h!TLh|uL*ðL< ð? |üi @Mti?Ui Lu hi}ý*@|Lh) LMt|@U*itc U@Tð|@* UL?|hL*tc ð?uLh4@|ðL?@t)44i|hðitc Lh @?) L|üih |)Ti Lu UL?t|h@ð?| L? ð?ñit|Lht< @U|ðñð|)ë Aüit|@?_@h_ |üiLhi|ðU@* M@ti*ð?i @ttý4it t)44i|h) @UhLtt @}i?|t @?_ ULý?|hðitc@?_ Thi_ðU|t |ü@| @}i?|t êLh*_êð_i üL*_ |üi t@4i TLh|uL*ðLë Aüi uh@U|ðL?ð?ñit|i_ @| üL4i ðt |üihiuLhi i^ý@* |L |üi ñ@*ýi Lu |üi _L4it|ðU t|LU! 4@h!i|hi*@|ðñi |L |üi ñ@*ýi Lu |üi êLh*_ t|LU! 4@h!i|ë

6ð}ýhi � tüLêt |üðt Mi?Uü4@h! @**LU@|ðL? hi*@|ðñi |L Uýhhi?| @}}hi}@|iTLh|uL*ðL tü@hitc |üýt ThLñð_ð?} @ ñðtý@* hiThiti?|@|ðL? Lu |üi ø*L?} ê@) |L}L< |L Mhð_}i |üi }@T Mi|êii? LMtihñi_ @?_ Thi_ðU|i_ TLh|uL*ðLtë 6Lh i @4íT*ic îhð|ðtü hitð_i?|t Uýhhi?|*) ð?ñit| .HI @| üL4ic Mý| êLý*_ ð?ñit| �fI_L4it|ðU@**) ý?_ih |üi Mi?Uü4@h!ë 5ð4ð*@h*)c N5 hitð_i?|t ð?ñit| bfI @|üL4ic Mý| êLý*_ ð?ñit| e2I ð? _L4it|ðU tiUýhð|ðit ý?_ih |üi Mi?Uü4@h!ë

Aüihi @hi tiñih@* hi@tL?t |üLý}ü êü) |üi t)44i|hðU TLh|uL*ðL M@ti_ L?4@h!i| U@Tð|@*ð3@|ðL? 4@) ?L| Mi |üi ULhhiU| *L?}í|ih4 Mi?Uü4@h!ë Ah@_i_tiUýhð|ðit týUü @t i^ýð|) @?_ ULhTLh@|i ML?_t @hi igiU|ðñi*) U*@ð4t L? tL4iUL4TL?i?| Lu ULhTLh@|i ThL�|të îý| ULhTLh@|i ThL�|t 4@!i ýT L?*) @MLý|�fI Lu ?@|ðL?@* ð?UL4ië #iTi?_ð?} L? |üi ULhhi*@|ðL? Mi|êii? |üi hi|ýh? L?|h@_i_ @?_ ?L?í|h@_i_ @tti|tc hitð_i?|t ð? _ðgihi?| ULý?|hðit êð** }i?ih@**)üL*_ _ðgihi?| TLh|uL*ðLtë ú ?ý4Mih Lu t|ý_ðit ü@ñi hiUi?|*) ð?ñit|ð}@|i_ |üihL*i Lu ?L?í|h@_i_ üý4@? U@Tð|@* uLh TLh|uL*ðL UüLðUic ð? T@h|ðUý*@h îL||@33ðc

Page 4: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

èiti?|ð @?_ ñ@? `ð?ULLT E�bbSä @?_ î@ |ih @?_ aih4@?? E�bb.äëe

úMLý| ü@*u Lu @ UL?tý4ih<t Mý_}i| ðt tTi?| L? ð|i4t |ü@| U@? Mi ^ý@*ð�i_@t ?L?|h@_@M*ië �LhiLñihc *iðtýhi U@? Mi UL?tð_ihi_ @ ?L?|h@_i_ }LL_ @têi**ë 6*ýU|ý@|ðL?t ð? ?L?|h@_@M*it U@? @giU| |üi LT|ð4@* TLh|uL*ðL UüLðUi|ühLý}ü |üiðh ð4T@U| L? |üi 4@h}ð?@* ý|ð*ð|) uhL4 |h@_@M*it UL?tý4T|ðL?ë

çL?tð_ih uLh i @4T*i |üi U@ti êüihi *iðtýhi @?_ UL?tý4T|ðL? @hi týMt|ðí|ý|itë W?|ýð|ðñi*)c L?i U@? ð?|ihThi| *iðtýhi @t ?L?í4@h!i| ThL_ýU|ðL? Et|@)ð?}@| üL4i |L |@!i U@hi Lu |üi M@M)ä |ü@| U@? Mi týMt|ð|ý|i_ uLh 4@h!i| ThLí_ýU|ðL? Eüðhð?} @ M@M)ítð||ihäë `üi? ?L?í4@h!i| ThL_ýU|ðL? ðt *Lê Eðëiëc @U)U*ðU@* ýT|ýh?äc |üi ?ii_ |L �?@?Ui @ *@h}ih @4Lý?| Lu 4@h!i| UL?tý4T|ðL?ðt t|hL?}ë W?ñit|ð?} ð? _L4it|ðU @tti|t 4@!it ð| L? @ñih@}i i@tðih |L �?@?UitýUü @__ð|ðL?@* UL?tý4T|ðL? tð?Ui |üi T@)Lg L? _L4it|ðU @tti|t ðt *ð!i*) |L Miüð}ü hi*@|ðñi*) |L uLhið}? @tti|t _ýhð?} @ MLL4ë W? L|üih êLh_tc ð| ðt LT|ð4@*|L ð?ñit| @| üL4i MiU@ýti |üihi ðt @ ?i}@|ðñi ULhhi*@|ðL? Mi|êii? _L4it|ðU@tti| hi|ýh?t @?_ *iðtýhië `ð|ü hi}@h_t |L ?L?|h@_@M*it UL?tý4T|ðL?c L? |üiL|üih ü@?_c L?i 4ð}ü| i TiU| @ TLtð|ðñi ULhhi*@|ðL? Mi|êii? @tti| hi|ýh?t@?_ ?L?|h@_@M*itë W? |ü@| U@ti ð| MiUL4it @||h@U|ðñi |L ð?ñit| @| üL4i êüi?|h@_@M*it @?_ ?L?|h@_@M*it UL?tý4T|ðL? @hi UL4T*i4i?|të

Aüi @ð4 Lu |üðt T@Tih ðt |L ^ý@?|ðu) |L êü@| i |i?| |üi Thiti?Ui Lu ?L?í|h@_@M*it h@ðtit |üi uh@U|ðL? Lu t|LU!í4@h!i| êi@*|ü ð?ñit|i_ @| üL4i ñðtíö@íñðt|üi t)44i|hðU M@ti*ð?i Lu 6ð}ýhi �ë #Lit |üi _ðtUhiT@?U) Mi|êii? LMtihñi_@?_ Thi_ðU|i_ TLh|uL*ðLt tð}?ð�U@?|*) tühð?! êüi? |üi @TThLThð@|i |üiLhi|ðU@*Mi?Uü4@h! ðt |@!i? ð?|L @UULý?|q

Aüi hiUi?| *ð|ih@|ýhi ü@t i4Tü@tð3i_ tiñih@* hi@tL?t êü) êi 4@) i TiU|?L?|h@_@M*it |L T*@) @? ð4TLh|@?| hL*i ð? TLh|uL*ðL UüLðUië 6Lh ð?t|@?Uicwiêðt E�bbSä �?_t |ü@| TihuiU| hðt!tü@hð?} U@??L| Mi hiéiU|i_ @4L?} @ ti|Lu ULý?|hðit êð|ü ý?hit|hðU|i_ U@Tð|@* ãLêtc @t *L?} @t L?i @**Lêt uLh ?L?ítiT@h@Mð*ð|) ð? Thiuihi?Uit Mi|êii? |h@_@M*it @?_ ?L?|h@_@M*it EUL?tý4T|ðL?Lh *iðtýhiäë W? |üi UL?|i | Lu |üi UL4T*i|ií4@h!i|t wiêðt E�bbSä 4L_i*c |üiLMtihñi_ üL4i Mð@t U@? L?*) Mi i T*@ð?i_ @t |üi hitý*| Lu @? LT|ð4ý4 üi_}i@}@ð?t| ?L?|h@_@M*it ý?Uih|@ð?|)ë

, |i?tðñi iñð_i?Ui L? ð4TihuiU| TLh|uL*ðL _ðñihtð�U@|ðL? êð|üð? |üi Në5ë@*tL tý}}it|t |ü@| ?L?|h@_@M*it 4@) T*@) @? ð4TLh|@?| hL*i ð? i T*@ð?ð?} |üiLMtihñi_ üL4i Mð@tëD W? u@U|c |L |üi i |i?| |ü@| ?L?|h@_@M*it @hi ?L| |h@_i_êð|üð? ULý?|hðit @t êi** @t @4L?} ULý?|hðitc i T*@?@|ðL?t M@ti_ L? ?L?|h@_í@M*it ThLñð_i @ }i?ih@* ð?|ihThi|ðñi uh@4iêLh! |L h@|ðL?@*ð3i |üi i ðt|i?Ui LuML|ü ð?|o@ @?_ ð?|eo?@|ðL?@* üL4i Mð@t ð? ð?ñit|Lht< TLh|uL*ðLtë

2

Page 5: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

�Lt| Lu |üi *ð|ih@|ýhi L? |üi hL*i T*@)i_ M) ?L?|h@_@M*it ð? |üi øüL4i Mð@tTý33*i< ðt |üiLhi|ðU@*ëS ú*|üLý}ü |üi ð4TLh|@?Ui Lu ?L?|h@_@M*it ðt uhi^ýi?|*)h@ðti_ @t @ TL|i?|ð@* i T*@?@|ðL? uLh |üi üL4i Mð@t Tý33*ic. |üi i4TðhðU@**ð|ih@|ýhi hi4@ð?t ^ýð|i *ð4ð|i_ë Ait@h E�bbDä uLUýtit L? |üi hL*i Lu ?L?|h@_i_}LL_t @?_ ThLñð_it Thi*ð4ð?@h) iñð_i?Ui L? i4TðhðU@* 4i@týhit Lu TLh|uL*ðLêið}ü|t ð? |üi UL?|i | Lu @ t|@|ðU |êLíULý?|h) ti|ýT êüihi |üi L?*) |h@_i_@tti|t @hi U*@ð4t L? |h@_@M*it Lý|Tý|ë aih4@?? E�bbHä UL?tð_iht |üi hL*i LuãýU|ý@|ðL?t ð? *iðtýhi ð? |üi UL?|i | Lu @ 4L_i* êð|ü ThL_ýU|ðñð|) tüLU!të

W? |üðt T@Tih Lýh @ð4 ðt |L ThLñð_i @ t)t|i4@|ðU @?@*)tðt Lu |üi igiU|tLu ?L?|h@_@M*it ý?Uih|@ð?|) L? ð?|ih?@|ðL?@* @tti| @**LU@|ðL?c LM|@ð?ð?} i4íTðhðU@* 4i@týhit Lu |üi TLh|uL*ðL üL4i Mð@t êüi? ML|ü ?L?|h@_i_ *iðtýhi @?_UL?tý4T|ðL? @hi UL?tð_ihi_ë i U@t| Lýh i4TðhðU@* @?@*)tðt ð? |üi UL?|i | Lu@ tð4T*i UL?|ð?ýLýtí|ð4ic ð?�?ð|i üLhð3L? 4L_i* êð|ü t|@|ií_iTi?_i?| ý|ð*ð|)Lu |h@_@M*it UL?tý4T|ðL?c êüihi |üi t|@|i ñ@hð@M*i hiThiti?|t |üi t|LUü@t|ðUi?_Lê4i?| Lu ?L?|h@_@M*itë W? |üi i4TðhðU@* @TT*ðU@|ðL? @tti| hi|ýh?t @hiið|üih i^ýð|) hi|ýh?t Lh @TThL ð4@|ðL?t Lu øuý?_@4i?|@* hi|ýh?t< @ttLUð@|i_êð|ü U*@ð4t L? L?i TihðL_<t ThL�|t Lh U*@ð4t L? |üi Thiti?| _ðtULý?|i_ ñ@*ýiLu �h4t< ThL�|të

Aüi T@Tih ðt Lh}@?ð3i_ @t uL**Lêtë W? 5iU|ðL? 2 êi _ihðñi U*Lti_íuLh4i ThittðL?t uLh LT|ð4@* ð?|ih?@|ðL?@* TLh|uL*ðL tü@hit @?_ TLh|uL*ðL üL4iMð@të ûi |c êi T@h@4i|ihð3i Thiuihi?Uit ð? |ih4t Lu |üi ç,5 U*@tt Lu ý|ð*ð|)uý?U|ðL?t |L LM|@ð? @? i T*ðUð| i ThittðL? Lu |üi ThLTi?tð|) |L üi_}i @t @uý?U|ðL? Lu Thiuihi?Ui T@h@4i|ihtë 5iU|ðL? ô @TT*ðit |üi 4L_i* |L @ ti| LuuLýh|ii? ï,ç# ULý?|hðitc ýtð?} |ühii @*|ih?@|ðñi 4i@týhit Lu ?@|ðL?@* @tti|hi|ýh?të i it|ð4@|i êð|ü B�� |üi Thiuihi?Ui T@h@4i|iht |ü@| _i|ih4ð?i|üi ThLTi?tð|) |L üi_}i @?_ LM|@ð? it|ð4@|it Lu |üi üL4i Mð@të Aüi 4@ð?UL?U*ýtðL?t @hi tý44@hð3i_ ð? tiU|ðL? eë

2 ú 4L_i* Lu ð?|ih?@|ðL?@* TLh|uL*ðL UüLðUi

êð|ü ?L?|h@_@M*it

2ë� Aüi ti|ýT

W? Lýh |üiLhi|ðU@* uh@4iêLh!c M) ?L?|h@_@M*it Lh ?L?|h@_@M*it UL?tý4T|ðL?êi hiuih ð?_ðgihi?|*) |L UL?tý4T|ðL? Lu ?L?|h@_i_ }LL_t EtihñðUitäc Lh *iðtýhië#L4it|ðU hitð_i?|t hiUiðñi @? i?_Lê4i?| t|hi@4 Lu ?L?|h@_@M*it 7E|äc êüLti

ô

Page 6: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

t|LUü@t|ðU h@|i Lu }hLê|ü ðt }ðñi? M)

_7E|ä

7E|ä' >_|n jf_1E|ä E�ä

êüihi > @?_ jf @hi UL?t|@?| T@h@4i|iht @?_ 1 ðt @ t|@?_@h_ `ði?ih ThLUittëH

û@|ðL?@* tiUýhð|ðit @hi ð?|ih?@|ðL?@**) |h@_i_ êð|üLý| hit|hðU|ðL?të Aüi ð?ít|@?|@?iLýt*) t|LUü@t|ðU hi|ýh?t L? _L4it|ðU @?_ uLhið}? @tti|t @hiG

_-E|ä ' #_|n j-_/E|ä E2ä

_-WE|ä ' #_|n j-W_/WE|ä Eôä

Oihi - ðt |üi Uý4ý*@|ðñi hi|ýh? L? |üi _L4it|ðU @tti| @?_ -W |üi Uýí4ý*@|ðñi hi|ýh? L? |üi uLhið}? @tti|ë Aüi T@h@4i|iht j2- @?_ j2-W _i?L|i|üi ð?t|@?|@?iLýt UL?_ð|ðL?@* ñ@hð@?Uitc êüð*i # _i?L|it |üi i TiU|i_ hií|ýh? Tih ý?ð| |ð4ic @ttý4i_ |L Mi i^ý@* @UhLtt ULý?|hðit @?_ UL?t|@?| Lñih|ð4iëb Aüi ð?t|@?|@?iLýt ULhhi*@|ðL? Mi|êii? |üi hi|ýh?t ðt _i?L|i_ 4 ìd. E_/_/Wäo *_|ë Aüi ULhhi*@|ðL?t Mi|êii? |üi }hLê|ü h@|i Lu ?L?|h@_@M*itUL?tý4T|ðL? @?_ |üi |êL @tti| hi|ýh?t @hi _i?L|i_ 4-f ì d. E_/_1äo *_|@?_ 4-Wf ì d. E_/W_1äo *_|ë

Aüi t|LUü@t|ðU ThLUitt uLh _L4it|ðU êi@*|ü ` E4i@týhi_ ð? |ih4t Lu|h@_i_ }LL_tä ðt

_` E|ä ' d? E|ä _- E|ä n E�ý ? E|ää _-W E|äo` E|ä

nR E|ä7 E|ä _|ý ä E|ä _|ý R E|äf E|ä _| Eeä

êüihi äE|ä ðt _L4it|ðU UL?tý4T|ðL? Lu |h@_@M*itc f E|ä UL?tý4T|ðL? Lu ?L?í|h@_@M*itc ?E|ä ðt |üi uh@U|ðL? Lu êi@*|ü ð?ñit|i_ @| üL4i @?_ R E|ä ðt |üihi*@|ðñi ThðUi Lu ?L?|h@_@M*itë

#L4it|ðU hitð_i?|t _i|ih4ð?i LT|ð4@* UL?tý4T|ðL? @?_ TLh|uL*ðL T*@?tM) 4@ ð4ð3ð?} |üi i TiU|i_ Thiti?| _ðtULý?|i_ ñ@*ýi Lu |üiðh ý|ð*ð|) t|hi@4cL däcfoë èhiuihi?Uit @hi @ttý4i_ |L Mi t)44i|hðU @UhLtt ð?ñit|Lht êLh*_íêð_ië Aüi ñ@*ýi uý?U|ðL? T d`cfo ðt _i�?i_ @tG

T d` E|äc fE|äo ì 4@ äE|äc?E|ä

.|

] "

|e3BEr3|äL däEräcfEräo_r EDä

êüihi B ðt |üi h@|i Lu |ð4i Thiuihi?Uië W? i^ýð*ðMhðý4 êi ü@ñi 7 E|ä ' f E|äc@?_ |üi hi*@|ðñi ThðUi Lu ?L?|h@_@M*it RE|ä ðt i^ý@* |L |üi h@|ðL Lu |üi 4@h}ð?@*

e

Page 7: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

ý|ð*ð|ðit Lf*Lä ë ïT|ð4@* UL?tý4T|ðL?%TLh|uL*ðL UüLðUi äE|ä @?_ ?E|ä tL*ñit|üi îi**4@? i^ý@|ðL?G

BT d` E|äc fE|äo ' 4@ äE|äc?E|ä

L dä E|ä c f E|äo n E.|_T d` E|ä cf E|äoä *_| ESä

týMéiU| |L E�äíEeä @?_ |üi @TThLThð@|i MLý?_@h) UL?_ð|ðL?tëW? |üi tTiUð�U@|ðL? @MLñic |iUü?ðU@* UL4T*i ð|ðit @hi _i*ðMih@|i*) _Lê?í

T*@)i_ |L üi*T uLUýt L? üi_}ð?} @}@ð?t| ?L?|h@_@M*it ý?Uih|@ð?|)ë vi|c ð| ðtêLh|ü i4Tü@tð3ð?} |ü@| |üi M@tðU uh@4iêLh! U@? Mi }i?ih@*ð3i_ |L i?UL4T@tt@tti| hi|ýh? ui@|ýhit týUü @t 4i@? hiñihtðL? Lh t|LUü@t|ðU ñL*@|ð*ð|)c êð|üLý|týMt|@?|ð@**) @*|ihð?} Lýh @?@*)tðt Lu |üi TLh|uL*ðL Mð@të�f

2ë2 Aüi øMð@t< uLh4ý*@

úTT*)ð?} t|@?_@h_ |iUü?ð^ýit Lu t|LUü@t|ðU _)?@4ðU ThL}h@44ð?}c�� |üi �ht|Lh_ih UL?_ð|ðL? uLh @ 4@ ð4ý4 êð|ü hitTiU| |L UL?tý4T|ðL? )ði*_t |üi i?íñi*LTi i ThittðL?G

Lä ' T` E.ä

@?_ |üi �ht| Lh_ih UL?_ð|ðL? êð|ü hitTiU| |L ? _i|ih4ð?it |üi LT|ð4@* TLh|íuL*ðL tü@hitG

? 'j2-W ý 4j-Wj-

j2- n j2-W ý 24j-j-Wn Kð@r EHä

êüihi |üi |ih4 Kð@r U@? Mi êhð||i? @tG

Kð@r ì Mjf#j-4-f ý j-W4-Wfj2- n j2-W ý 24j-j-W

$Ebä

W? i^ëEbäc |üi i ThittðL? M _i?L|it |üi øThLTi?tð|) |L üi_}i< @}@ð?t| ý?@?í|ðUðT@|i_ ãýU|ý@|ðL?t ð? ?L?|h@_@M*it UL?tý4T|ðL?c @?_ ðt _i�?i_ @t

M ì ýT`f

T``

f

`c E�fä

@ uý?U|ðL? Lu Thiuihi?Uit @?_ |üi h@|ðL Lu ?L?|h@_@M*it UL?tý4T|ðL? |L êi@*|üëAüi �ht| |ih4 L? |üi hð}ü| ü@?_ tð_i Lu EHä ðt |üi 4ð?ð4ý4íñ@hð@?Ui

TLh|uL*ðL tü@hië ï?i ULý*_ |üð?! Lu |üðt i ThittðL? @t |üi Mi?Uü4@h! Lu 6ð}ýhi�c tð?Ui |üi 4ð?ð4ý4íñ@hð@?Ui TLh|uL*ðL 4ýt| Mi ð_i?|ðU@* êLh*_êð_ië�2 AüitiUL?_ |ih4c _i?L|i_ Kð@r @?_ _i�?i_ ð? i^ëEbäc 4i@týhit |üi _i}hii Lu

D

Page 8: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

t!iê?itt |Lê@h_t _L4it|ðU Eðu TLtð|ðñiä Lh uLhið}? Eðu ?i}@|ðñiä tiUýhð|ðit @t@ hitý*| Lu üi_}ð?} @}@ð?t| ?L?|h@_@M*it ãýU|ý@|ðL?të W? L|üih êLh_tc Kð@r4i@týhit |üi i |i?| |L êüðUü |üi ULhhiU| *L?}í|ih4 Mi?Uü4@h! ðt _ðgihi?|uhL4 |ü@| ð? 6ð}ýhi �ë 6Lh ð?t|@?Uic ðu Kð@r êihi i^ý@* |L 2fIc |üi Mi?Uü4@h!*L?} |ih4 ð?ñit|4i?| TLh|uL*ðL uLh Në5ë hitð_i?|t êLý*_ ð?ñL*ñi @? ð?ñit|4i?|Lu S2I @| üL4ic @t LTTLti_ |L |üi e2I hiTLh|i_ ð? 6ð}ýhi �ë

W? i^ëEbäc uLh @ }ðñi? ThLTi?tð|) |L üi_}i |üi |ih4 Kð@r _iTi?_t L? |üitiUL?_ 4L4i?|t Lu |üi ThLUittit uLh @tti| hi|ýh?t @?_ ?L?|h@_@M*it UL?tý4Tí|ðL?ë Aüi iUL?L4ðU hL*i T*@)i_ M) |üiti 4L4i?|t ðt ð?|ýð|ðñië W? @MtL*ý|iñ@*ýi |üi |ih4 Kð@r ðt @? ð?Uhi@tð?} uý?U|ðL? Lu |üi ñL*@|ð*ð|) Lu ?L?|h@_@M*itUL?tý4T|ðL? }hLê|ü jf Q @ 4i@týhi Lu TL|i?|ð@* tULTi uLh üi_}ð?}ë útítý4ð?} |ü@| M ðt TLtð|ðñic ð?ñit|Lht êð** üL*_ @ *@h}ih uh@U|ðL? Lu _L4it|ðU@tti|t |L |üi i |i?| |ü@| _L4it|ðU ?L?|h@_@M*it UL?tý4T|ðL? }hLê|ü ðt 4LhiULhhi*@|i_ êð|ü _L4it|ðU |ü@? uLhið}? hi|ýh?të Aüi LTTLtð|i üL*_t ðu M ðt?i}@|ðñië ûL|ðUi |ü@|c ðu hi|ýh?t @hi *itt ñL*@|ð*i @MhL@_ |ü@? @| üL4i Eðëiëcðu j-W ÷ j-äc

�ô |üi ýtiuý*?itt Lu |üi øuLhið}?< @tti| @t @ üi_}i *itti?të

2ëô Aüi ThLTi?tð|) |L üi_}i ý?_ih ç,5 Thiuihi?Uit

ú| |üi *iñi* Lu }i?ih@*ð|) Lu |üi ThiñðLýt tiU|ðL?c ñih) *ð||*i U@? Mi t@ð_ @MLý||üi Lh_ih Lu 4@}?ð|ý_i Lu |üi ThLTi?tð|) |L üi_}ië i U@? L?*) LMtihñi |ü@|� ðt |üi ýTTih *ð4ð| uLh M ðu |üi ð?t|@?|@?iLýt ý|ð*ð|) uý?U|ðL? L däcfo ðtüL4L}i?iLýt Lu _i}hii �ý ò Eêüihi ò hiThiti?|t @?) ?L?í?i}@|ðñi ?ý4Mihäð? ä @?_ fc tL |ü@| |üi ñ@*ýi uý?U|ðL? ðt üL4L}i?iLýt Lu |üi t@4i _i}hiið? ` @?_ fë Ntð?} |üi üL4L}i?ið|) ThLTih|)c ð| ðt t|h@ð}ü|uLhê@h_ |L tüLê|ü@|�e

M ' � n òë

T`T```

êé � E��ä

i U@? ð**ýt|h@|i ð? 4Lhi _i|@ð* |üi Uü@h@U|ihðt|ðUt Lu |üi ThLTi?tð|) |Lüi_}i uLh @ UL?t|@?| i*@t|ðUð|) Lu týMt|ð|ý|ðL? Eç,5ä ý|ð*ð|) uý?U|ðL?ë 5ýTTLti|ü@| |üi ð?t|@?|@?iLýt ý|ð*ð|) uý?U|ðL? |@!it |üi uLh4�D

L däcfo '�

�ý ò dkf�3�*" n E�ý kää�3�*"o "

"3� E�3òä f ÷ k ÷ � E�2ä

êüihi " ðt |üi i*@t|ðUð|) Lu týMt|ð|ý|ðL? Mi|êii? |h@_@M*it @?_ ?L?|h@_@M*itc@?_ ò ðt |üi h@|i Lu hi*@|ðñi hðt! @ñihtðL?ë Aüi tð}? Lu Läf ðt |üi t@4i @t

S

Page 9: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

|ü@| Lu �ýò"ë Ah@_@M*it @?_ ?L?|h@_@M*it @hi UL4T*i4i?|@h) ð? Thiuihi?Uitêüi? ò" ÷ �c êüð*i |üi) @hi týMt|ð|ý|it êüi? ò" : �ë

A@!ð?} ð?|L @UULý?| |üi ThLTih|ðit Lu üL4L}i?iLýt uý?U|ðL?tc�S ð| ðt ýtiuý*|L |h@?tuLh4 |üi ThLM*i4 ð? |ih4t Lu @ ý?ð^ýi t|@|i ñ@hð@M*ië èLtð?} 5 ìf*` c T ì )E5äf�3ò @?_ ä ì ô E5ä` êð|üLý| *Ltt Lu }i?ih@*ð|)c ð| U@? MitüLê? |ü@| |üi ThLTi?tð|) |L üi_}i M U@? Mi êhð||i? @t @ uý?U|ðL? Lu |üit|@|i ñ@hð@M*i 5G�.

ME5ä ' �ý ò" E� n6ä

E� n ò"6ä

#�ý ô

â5ô

$ E�ôä

êüihi 6E5ä ì ä*Rf ðt |üi h@|ðL Lu |h@_@M*it |L ?L?|h@_@M*it UL?tý4T|ðL?ëAüihi @hi tTiUð@* U@titc @?_ T@h@4i|ih UL?�}ýh@|ðL?tc uLh êüðUü |üi

ThLTi?tð|) |L üi_}i ðt ?L| t|@|ií_iTi?_i?|ë 6Lh ð?t|@?Uic ðu ò ' f Eð?�í?ð|i i*@t|ðUð|) Lu ð?|ih|i4TLh@* týMt|ð|ý|ðL?ä ð| ðt ð44i_ð@|i uhL4 i^ëE�ôä|ü@| |üi ThLTi?tð|) |L üi_}i ðt @*ê@)t i^ý@* |L �c ð|t 4@ ð4ý4 ñ@*ýië î)|üi t@4i |L!i?c |üi ThLTi?tð|) |L üi_}i ðt � êüi? " ' fc |üi U@ti Lu i |hi4ið?|h@|i4TLh@* UL4T*i4i?|@hð|) ý?_ih wiL?|ðiu Thiuihi?Uitë Wu � ý ò" ' fc|üi ý|ð*ð|) uý?U|ðL? ðt @__ð|ðñi*) tiT@h@M*i ð? |üi |êL UL?tý4T|ðL? }LL_t E@tð? 5|LU!4@? @?_ #i**@t E�bHbääë W? |üðt U@tic Uü@?}it ð? f _L ?L| @giU||üi 4@h}ð?@* ý|ð*ð|) Lu |h@_@M*it UL?tý4T|ðL?c |üihi ðt ?L tULTi uLh üi_}ð?}EM ' fäc @?_ @}i?|t uý**) _ðñihtðu) |üiðh TLh|uL*ðLt Lu U*@ð4t L? |h@_@M*i}LL_të�H Wu " ' �c ð| ðt i@t) |L ñihðu) |ü@| |üi ñ@*ýi uý?U|ðL? |@!it |üi uLh4T ' dfkEô` ä�3koE�3òä*dôE� ý òäo uLh tL4i UL?t|@?| ô ë N?_ih |üiti UL?_ðí|ðL?tc UL?tý4T|ðL? Lu |h@_@M*it ðt i^ý@* |L ô` c üi?Ui ð?_iTi?_i?| Lu fc @?_|üi ThLTi?tð|) |L üi_}i ðt @ UL?t|@?| i^ý@* |L E�ý òä * d� n òE�ý käk3�oë

Wu ?L?i Lu |üi Ehit|hðU|ðñiä UL?_ð|ðL?t Lý|*ð?i_ @MLñi üL*_c |üi ThLTi?tð|)|L üi_}i êð** ?L| Mi UL?t|@?| Lñih |ð4ië OLêiñihc |üihi ðt @?L|üih U@ti Q@? i4TðhðU@**) hi*iñ@?| L?ic @t êi _ðtUýtt *@|ih Q ð? êüðUü |üi ThLTi?tð|)|L üi_}i êð** Mi @TThL ð4@|i*) UL?t|@?|ë 6Lh øt4@**< *iñi*t Lu hðt! @?_ týæíUði?|*) tð4ð*@h h@|it Lu UL?tý4T|ðL? }hLê|ü ð? |üi |êL tiU|Lht E|üýt UL?t|@?|R @?_ 6äc |üi ThLTi?tð|) |L üi_}i ðt @TThL ð4@|i*) i^ý@* |L

M '�ý ò"� n6"ò

c E�eä

@ uý?U|ðL? Lu |üi UL?tý4T|ðL? h@|ðL 6 L?*)ë

.

Page 10: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

AL LM|@ð? |üi @MLñi uLh4ý*@c LMtihñi |ü@| ð? |üi @Mti?Ui Lu ý?Uih|@ð?|)|üi |êL UL?tý4T|ðL? }LL_t êLý*_ }hLê @| |üi t@4i h@|i ðu @?_ L?*) ðu# ' B n ò>ë W? |üðt U@tic 6 @?_ ô êLý*_ ML|ü Mi UL?t|@?| Lñih |ð4ic@?_ ô â êLý*_ Mi 3ihLë Wu êi øTih|ýhMi_< |üðt M@*@?Ui_í}hLê|ü iUL?L4) M)@__ð?} @ 4@h}ð?@* @4Lý?| Lu ý?Uih|@ð?|)c |üi Uü@h@U|ihðt|ðUt Lu UL?tý4T|ðL?Miü@ñðLh êLý*_ ?L| Mi ti?tð|ðñi*) @giU|i_G�b |üi ThLTi?tð|) |L UL?tý4i Lý|Lu êi@*|ü êLý*_ hi4@ð? týMt|@?|ð@**) ý?Uü@?}i_c ô â êLý*_ t|ð** Mi ?i}*ð}ðM*ic@?_ i^ëE�eä êLý*_ hiThiti?| @ }LL_ *LU@* @TThL ð4@|ðL?ë

W? |üi _@|@ _ðtUýtti_ ð? |üi ?i | tiU|ðL? |üi tü@hi tTi?| L? ?L?|h@_@M*itUL?tý4T|ðL? ü@t @U|ý@**) ð?Uhi@ti_ _ýhð?} Lýh t@4T*i TihðL_ë W? |üi @Mti?UiLu M@*@?Ui_ }hLê|ü ô â êLý*_ ?L *L?}ih Mi 3ihLc iñi? êð|üð? @ _i|ih4ð?ðt|ðUuh@4iêLh!ë W| U@? Mi tüLê? |ü@|c êüi? ML|ü }LL_t @hi UL4T*i4i?|t ð?Thiuihi?Uitc |üi tð}? Lu ô â ðt |üi LTTLtð|i Lu |ü@| Lu |üi }hLê|ü h@|i Lu |üiuh@U|ðL? tTi?| L? ?L?|h@_@M*itë2f Aüi ð4T*ðU@|ðL?t uLh |üi uLh4ý*@ Kð@r @hið?|ýð|ðñiG ðu ô â êihi ?i}@|ðñic |üi @?|ðUðT@|i_ üð}üih hi*iñ@?Ui Lu ?L?|h@_@M*itð? uý|ýhi UL?tý4T|ðL? êLý*_ tüðu| ýTê@h_ |üi Uýhhi?| ThLTi?tð|) |L üi_}ic|üýt i?ü@?Uð?} |üi Uýhhi?| TLh|uL*ðL Mð@të

OLêiñihc ð? úTTi?_ð ú êi tüLê |ü@| |üi LMtihñi_ ð?Uhi@ti ð? |üi tü@hitTi?| L? ?L?|h@_@M*it ðt ?L| *@h}i i?Lý}ü |L tð}?ð�U@?|*) @giU| |üi it|ð4@|iLu |üi ThLTi?tð|) |L üi_}i @?_ üL4i Mð@të 5TiUð�U@**)c ð? úTTi?_ð ú êi_ðtUýtt üLê |L LM|@ð? @ ?ý4ihðU@* tL*ý|ðL? |L ô E5äc @?_ |üihiuLhi ME5äc ýtð?}|üi çüiM)tüiñ ð?|ihTL*@?| 4i|üL_ _itUhðMi_ ð? aý__ E�bb2äë W| ðt tüLê? ð?úTTi?_ð ú |ü@| ý?_ih |üi M@*@?Ui_ }hLê|ü @ttý4T|ðL? # ' B n ò>c |üitL*ý|ðL? |L ME5ä ðt @TThL ð4@|i*) ð_i?|ðU@* |L E�eäë W? |üi ?i | tiU|ðL? êiêð** |üihiuLhi @_LT| |üi M@*@?Ui_ }hLê|ü T@h@4i|ihð3@|ðL? @?_ ýti E�eä @t @U*Lti @TThL ð4@|ðL? Lu |üi ThLTi?tð|) |L üi_}ië

ô ûL?|h@_@M*it @?_ üL4i Mð@t ð? |üi ï,ç#

ULý?|hðit

W? êü@| uL**Lêtc êi @TT*) Lýh 4L_i* |L @ t@4T*i Lu uLýh|ii? ï,ç# ULý?|hðitë2�

AL ð4T*i4i?| i4TðhðU@**) |üi üL4i Mð@t uLh4ý*@ Ebäc êi ?ii_ it|ð4@|it Lu|üi hi*iñ@?| 4L4i?|t M@ti_ L? 4i@týhit Lu |üi hi|ýh? L? U@Tð|@* @?_ ?L?í|h@_@M*it }hLê|üë i �ht| _ðtUýtt |üi _ðgihi?| 4i@týhit Lu |üi hi|ýh?tchi*i}@|ð?} _i|@ð*t @MLý| |üi _@|@ |L úTTi?_ð îë ûi | êi it|ð4@|i |üi T@í

H

Page 11: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

h@4i|iht ?ii_i_ |L UL4Tý|i |üi ThLTi?tð|) |L üi_}ië Aüi �?@* týMtiU|ðL?_ðtUýttit |üi üL4i Mð@t hitý*|të

ôë� �i@týhit Lu |üi hi|ýh? |L U@Tð|@* @?_ ?L?|h@_@M*it

ú?) UüLðUi Lu @ øUL4Thiüi?tðñi< 4i@týhi Lu |üi ?@|ðL?íêð_i hi|ýh? L? U@Tð|@*i?|@ð*tc @*4Lt| M) _i�?ð|ðL?c @ üð}ü _i}hii Lu @hMð|h@hð?ittë W? |üðt T@Tihêi UL?tð_ih |ühii @*|ih?@|ðñi @TThL@Uüitc |êL Lu êüðUü @hi øuý?_@4i?|@*t<M@ti_ êüð*i |üi |üðh_ ýtit �?@?Uð@* hi|ýh?të Aüi �ht| 4i@týhi Lu U@Tð|@*hi|ýh?c hiuihhi_ |L @t {-�c ðt }ðñi? M) |üi ThL�| h@|i ð? |üi |h@_@M*it tiU|Lhc_i�?i_ @t LTih@|ð?} týhT*ýt _ðñð_i_ M) |üi U@Tð|@* t|LU!ë22 út _iu@ý*|c êið_i?|ðu) |üi |h@_@M*it tiU|Lh êð|ü |üi 4@?ýu@U|ýhð?} ð?_ýt|h)( üLêiñihc ð?Lýh ti?tð|ðñð|) @?@*)tðt êi UL?tð_ih @ MhL@_ih _i�?ð|ðL? êüðUü @*tL ð?U*ý_it4ð?ð?} @?_ @}hðUý*|ýhië ú??ý@* _@|@ uLh |üi TihðL_ �b.fí�bbô @hi LM|@ð?i_uhL4 |üi ï,ç# W?|ih?@|ðL?@* 5iU|Lh@* #@|@ î@tië

O)TL|üi|ðU@**)c {-� êLý*_ hiThiti?| |üi ULhhiU| 4i@týhi Lu U@Tð|@* hi|ýh?ð? @ êLh*_ ð? êüðUü ð?|ih?@|ðL?@* ð?ñit|Lht êihi @**Lêi_ |L @**LU@|i |üiðh uý?_t@4L?} @ ti| Lu ?@|ðL?@* øêLh!tüLTt<c UL?ñih|ð?} U@Tð|@* ð?|L UL?tý4T|ðL?}LL_t @| 3ihL ULt|ë Aüi 4@ð? _h@êM@U! Lu {-� @t @ 4i@týhi Lu |üi hi|ýh?|L U@Tð|@* ðt ð|t ð?@Mð*ð|) |L |@!i ð?|L @UULý?| U@Tð|@* }@ð?të2ô

ïýh tiUL?_ 4i@týhi Lu U@Tð|@* hi|ýh?c ð?_i i_ M) {-2c i4Tü@tð3it |üihL*i Lu @_éýt|4i?| ULt|t @?_ |üi @ttLUð@|i_ U@Tð|@* }@ð?t @?_ *Lttitë W| ðtM@ti_ L? @ ñ@*ý@|ðL? ThLUi_ýhi tð4ð*@h |L êü@| îh@ð?@h_c 5üLñi? @?_ iðttE�bHfä U@** |üi øUL?t|@?|íU@Tð|@*< ð?|hð?tðU ñ@*ýi Lu |üi �h4c üihi }i?ih@*ð3i_|L @**Lê uLh @ EUL?t|@?|ä }hLê|ü h@|i Lu ?i| ð?ñit|4i?|ë Aüi ð??Lñ@|ðL? ð? |üihi|ýh? |L U@Tð|@* ðt êhð||i? @t |üi ð??Lñ@|ðL? |L |üi Thiti?| _ðtULý?|i_ ñ@*ýiLu i TiU|i_ ThL�| h@|itë2e Aüi _ðtULý?| h@|i ðt #ý}c êüihi # ðt |üi EUL?t|@?|äi TiU|i_ hi|ýh? @?_ } ðt |üi }hLê|ü h@|i Lu U@Tð|@* E@?_ ð?ñit|4i?|äë W? Lýh@TT*ðU@|ðL?c êi ti| } i^ý@* |L >c |üi @ñih@}i h@|i Lu }hLê|ü Lu ?L?|h@_@M*itctL |ü@|

{-2c|n� ì # n E.|n� ý.|ä"[r'f

{-�c|nrn�E� n # ý >är E�Dä

Aüi UL4Tý|@|ðL? Lu |üi ð??Lñ@|ðL? |L |üi i TiU|i_ Thiti?| _ðtULý?|i_ ñ@*ýiLu ThL�|t ðt M@ti_ L? @? it|ð4@|i_ �ht|íLh_ih @ý|Lhi}hittðñi ThLUitt uLh |üiThL�| h@|i {-�( @? ú+E2ä ðt UL?tð_ihi_ ð? ti?tð|ðñð|) @?@*)tðtë

Aüi ThL�| h@|ic L? êüðUü ML|ü {-� @?_ {-2 @hi M@ti_c i üðMð|t @ t|hL?}|hi?_ ð? ñðh|ý@**) @** ULý?|hðit ð? Lýh t@4T*ië W? tiñih@* ULý?|hðitc |üi ThL�|

b

Page 12: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

h@|i ðt _Lê?ê@h_ |hi?_ð?} ð? |üi �b.ft @?_ ýTê@h_ |hi?_ð?} ð? |üi �bHftcêüð*i ð? L|üiht ð| ðt _Lê?ê@h_ Lh ýTê@h_ |hi?_ð?} |ühLý}üLý| |üi i?|ðhit@4T*ië `üð*i týUü 4Lñi4i?|t @hi TLttðM*) |h@?tð|Lh) Tü@tit Lu *L?} U)U*it@hLý?_ t|@M*i 4i@?tc Lýh t@4T*i ðt |LL tüLh| |L @**Lê uLh @? @?@*)tðt Lu |üi*Lêíuhi^ýi?U) ui@|ýhit Lu |üiti tihðitë Aüýtc |L i |h@U| |üi |h@?tð|Lh) UL4íTL?i?|t Lu |üi tihðit êi �*|ih Lý| @ tiUL?_íLh_ih TL*)?L4ð@* |hi?_ë OLêiñihcð? |üi ti?tð|ðñð|) @?@*)tðt êi @*tL UL?tð_ih hitý*|t LM|@ð?i_ êüi? i |h@U|ð?}@ OL_hðU!íèhitUL|| |hi?_c Lh ?L |hi?_ @| @**ë

ïýh �ht| |êL 4i@týhit Lu @tti| hi|ýh?t @hi ð?_ðhiU|ë Aüi |üðh_ 4i@týhiuLUýtit L? t|LU! 4@h!i| _@|@ _ðhiU|*)ë2D W| ðt _i�?i_ @t

{-ô ì {-7Aïägc E�Sä

êüihi {-7Aïäg ðt |üi @ñih@}i @??ý@* hi|ýh? L? t|LU!c UL4Tý|i_ uhL4 �Lhí}@? 5|@?*i) ð?_i _@|@ Etii úTTi?_ð î uLh _i|@ð*täë

Aüi hi|ýh? ðt üi_}i_ uLh i Uü@?}i h@|i hðt!c ýtð?} L?ií)i@h uLhê@h_ Thií4ðý4 _@|@ë 5ð?Ui |üi uLhê@h_ Thi4ðý4 ðt }i?ih@**) ?L| i^ý@* |L |üi ð?ã@|ðL?_ðgihi?|ð@* @UhLtt |êL _ðgihi?| ULý?|hðitc |üi hi@* hi|ýh? Lu ð?ñit|ð?} ð? @T@h|ðUý*@h ULý?|h) _ðgiht @UhLtt ð?ñit|Lht *LU@|i_ ð? _ðgihi?| ULý?|hðitë út @hitý*|c uLh i@Uü ULý?|h) êi LM|@ð? @ tiT@h@|i 4@|hð Lu hi|ýh?t L? ð?ñit|4i?|ð? @** L|üih ULý?|hðitë Aüiti _@|@ @hi @ñ@ð*@M*i uLh ?ð?i ULý?|hðit2S Lñih |üiTihðL_ �b.ôí�bbôë

6Lh @** |ühii 4i@týhit Lu U@Tð|@* hi|ýh?c {-W ðt UL4Tý|i_ M) |@!ð?} @êið}ü|i_ @ñih@}i Lu U@Tð|@* hi|ýh?t ð? uLhið}? ULý?|hðitë 6Lh |üi �ht| |êLhi|ýh? 4i@týhit |üi êið}ü|t @hi M@ti_ L? @ñih@}i B#è tü@hit Lñih �bHDí�bHbc êüð*i uLh |üi t|LU! hi|ýh?t |üi êið}ü|t @hi M@ti_ L? @ñih@}i t|LU!4@h!i| U@Tð|@*ð3@|ðL? tü@hit Lñih �bHDí�bHbë

i ýti |êL @*|ih?@|ðñi 4i@týhit Lu |üi ?L?|h@_@M*it }hLê|ü h@|i _f*fG?L?|h@_@M*it UL?tý4T|ðL? @?_ *iðtýhië ú*|üLý}ü ML|ü 4@) @giU| ð?ñit|Lht<TLh|uL*ðL UüLðUic êi UL?tð_ih L?*) L?i @| @ |ð4i uLh |üi TýhTLtit Lu i TLítð|ðL?@* tð4T*ðUð|) @?_ UL?tðt|i?U) êð|ü |üi 4L_i*ë Aüýtc êüi? ýtð?} ?L?í|h@_@M*it UL?tý4T|ðL? @t @ 4i@týhi Lu fc êi @ttý4i |ü@| *iðtýhi i?|ihtý|ð*ð|) ð? @? @__ð|ðñi*) tiT@h@M*i ê@)c tL |ü@| ð| _Lit ?L| @giU| TLh|uL*ðL _iíUðtðL?të îL|ü ?L?|h@_@M*it UL?tý4T|ðL? @?_ *iðtýhi 4i@týhit @hi _ðñð_i_ M)TLTý*@|ðL? @?_ UL?ñih|i_ ð?|L Tih U@Tð|@ |ih4të

ûL?|h@_@M*it UL?tý4T|ðL? _@|@ @hi |@!i? uhL4 |üi N?ð|i_ û@|ðL?t û@í|ðL?@* úUULý?|t 5|@|ðt|ðUtë ûL?|h@_@M*it U@|i}Lhðit @hi }hLtt hi?|c uýi* @?_

�f

Page 13: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

TLêih( 4i_ðU@* U@hi @?_ üi@*|ü i Ti?tit( TýM*ðU |h@?tTLh|@|ðL? @?_ UL44ýí?ðU@|ðL?( hiUhi@|ðL?c i?|ih|@ð?4i?|c i_ýU@|ðL? @?_ Uý*|ýh@* tihñðUit( TihtL?@*U@hi( i Ti?_ð|ýhi ð? hit|@ýh@?|tc U@uitc üL|i*t( L|üih }LL_t @?_ tihñðUitë i_i�?i |üi hi4@ð?ð?} U@|i}Lhðit Q uLL_( U*L|üð?} @?_ uLL|êi@h( uýh?ð|ýhicüLýtiüL*_ i^ýðT4i?| @?_ LTih@|ðL?( @?_ TihtL?@* |h@?tTLh|@|ðL? Q @t |h@_í@M*it UL?tý4T|ðL?ë ú** UL?tý4T|ðL? U@|i}Lhðit _i�?i_ @MLñi hiuih |L Thðñ@|ii Ti?_ð|ýhië Bðñi? |üi êi**í!?Lê? UL?UiT|ý@* @?_ t|@|ðt|ðU@* _ðæUý*|ðit ð?_ðt|ð?}ýðtüð?} @TThLThð@|i*) Mi|êii? |h@_@M*it @?_ ?L?|h@_@M*it UL?tý4Tí|ðL?c ð? ti?tð|ðñð|) @?@*)tðt êi _ðtUýtt |üi ð4T*ðU@|ðL?t Lu týUü 4i@týhi4i?|ThLM*i4t uLh |üi üL4i Mð@t it|ð4@|itc @?_ @*tL UL?tð_ih tL4i @*|ih?@|ðñi4i@týhit Lu ?L?|h@_@M*it UL?tý4T|ðL?ë2.

i UL4Tý|i *iðtýhi @t |L|@* üLýht Tih êii! @ñ@ð*@M*i uLh ML|ü êLh! @?_*iðtýhic 4ð?ýt |L|@* üLýht êLh!i_ë i ti| |L|@* üLýht @ñ@ð*@M*i uLh êLh! @?_*iðtýhi i^ý@* |L |üi ?ý4Mih Lu TiLT*i ð? |üi *@MLh uLhUi |ð4it |êi*ñi üLýhtTih _@) EHe üLýht Tih êii!äë W? |üi ti?tð|ðñð|) @?@*)tðt êi @*tL UL?tð_ih �SüLýht Tih _@) @ñ@ð*@M*i uLh ML|ü êLh! @?_ *iðtýhië úU|ý@* üLýht êLh!i_ ðtUL4Tý|i_ @t |L|@* i4T*L)4i?| |ð4it üLýht êLh!i_ Tih êii! Tih i4T*L)iië#@|@ L? üLýht êLh!i_ Tih êii! Tih i4T*L)ii @hi LM|@ð?i_ uhL4 |üi vi@híMLL! Lu w@MLýh 5|@|ðt|ðUtë #@|@ @hi ?L| @ñ@ð*@M*i uLh @** ULý?|hðit L? üLýhtêLh!i_ ð? ?L?í@}hðUý*|ýh@* @U|ðñð|ðitë i |üihiuLhi ýti üLýht êLh!i_ Tihêii! ð? 4@?ýu@U|ýhð?}c êüðUü ðt @ñ@ð*@M*i uLh @** ULý?|hðitc @?_ ðt üð}ü*) ULhíhi*@|i_ êð|ü üLýht ð? ?L?í@}hðUý*|ýh@* @U|ðñð|ðit ð? ULý?|hðit uLh êüðUü ML|ü@hi @ñ@ð*@M*ië ï?Ui @}@ð?c ð? ti?tð|ðñð|) @?@*)tðt êi _ðtUýtt |üi igiU|t Lu4i@týhi4i?| ihhLh uLh |üi üL4i Mð@t it|ð4@|itë

ôë2 OLê *@h}i ðt |üi ThLTi?tð|) |L üi_}iq

út tüLê? ð? i^ëE�eäc êi ?ii_ it|ð4@|it Lu 6c " @?_ ò |L UL4Tý|i |üi ThLTi?ítð|) |L üi_}ië Aüi @ñih@}i tü@hi tTi?| L? ?L?|h@_@M*it ðt i^ý@* |L �*E�n6äcêüðUü êi ti| i^ý@* |L |üi @ñih@}i ð? |üi t@4T*i E@UhLtt |ð4i @?_ ULý?|hðitäë

i LM|@ð? it|ð4@|it uLh " @?_ ò @t uL**Lêtë wi| ù Mi |üi ?ý4Mih LuULý?|hðit ð? |üi t@4T*ië 6Lh @?) ULý?|h) æ @| |ð4i |c _i�?i |üi ñiU|LhüæE"c òä @t

üæ '

3EC ,?f|n�f|

ý ,?ä|n�ä|

n " ,?R|n�R|

Läc|E{-| ý{-`| ä

4FD c E�.ä

��

Page 14: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

êüihi Lä ' E�ýkäEä*Lä3�*" @?_ L ðt _i�?i_ ð? i^ý@|ðL? E�2äë Aüi 4L_i* Lu5iU|ðL? 2 ð4T*ðit |ü@| . üæ ' fë AüiLhi|ðU@**)c |üi �ht| i^ý@|ðL? üL*_t iñi?êð|üLý| |üi i TiU|@|ðL?t LTih@|Lhc @t ð| uL**Lêt uhL4 |üi �ht|íLh_ih UL?_ð|ðL?hiThiti?|ð?} |üi |h@_iíLg Mi|êii? |h@_@M*it @?_ ?L?|h@_@M*it UL?tý4T|ðL?GLf*Lä ' Rë Aüi tiUL?_ i^ý@|ðL?c . LäE{-ý{-` ä ' fc ðt @ _ðtUhi|i |ð4iñihtðL? Lu |üi |h@_iíLg Mi|êii? ð?ñit|ð?} ð? _L4it|ðU @tti|t @?_ @ êLh*_TLh|uL*ðLë Aüi *@||ih ðt @ êið}ü|i_ @ñih@}i Lu |üi hi|ýh? Lu ð?ñit|ð?} ð? @**ULý?|hðitë #i�?ð?} |üi 4@|hð

ME"c òä '

3C ü�ééüù

4D c E�Hä

ð| uL**Lêt |ü@| . ME"c òä ' fc êüðUü U@? Mi ýti_ |L it|ð4@|i " @?_ ò éLð?|*)M) ýtð?} |üi }i?ih@*ð3i_ 4i|üL_t Lu 4L4i?|t EB��äë2H

i 4i@týhi |üi hi*@|ðñi ThðUi R @t |üi h@|ðL Lu ið|üih |üi ?L?|h@_@M*it UL?ítý4T|ðL? ThðUi ð?_i |L |üi |h@_@M*it UL?tý4T|ðL? ThðUi ð?_i Lh |üi h@|ðL Lu|üi üLýh*) ê@}i h@|i |L |üi |h@_@M*it UL?tý4T|ðL? ThðUi ð?_i ë Aüi üLýh*)ê@}i h@|i ðt 4i@týhi_ @t |L|@* i4T*L)ii UL4Ti?t@|ðL? Eï,ç# û@|ðL?@* úUíULý?|t 5|@|ðt|ðUtä _ðñð_i_ M) |üi ?ý4Miht Lu üLýht êLh!i_ Ei4T*L)4i?| |ð4itüLýhtäë út @ U@ñi@|c ð| ðt êLh|ü i4Tü@tð3ð?} |ü@| tL4i 4i@týhi Lu 4@h}ð?@*ê@}i h@|i êLý*_ Mi 4Lhi @TThLThð@|i ð? Lýh UL?|i |ë ïñih|ð4i üLýht @hi}i?ih@**) T@ð_ @| @ _ðgihi?| h@|ic @*|üLý}ü |üðt ðt L?*) @ UL?Uih? êüi? |üih@|ðL Lu 4@h}ð?@* |L @ñih@}i ê@}it ðt ñL*@|ð*ië vi|c MiU@ýti Lu Th@U|ðU@* _ðuí�Uý*|ðit ð? UL?t|hýU|ð?} @ 4@h}ð?@* ê@}i h@|i _@|@ti| uLh @ *@h}i ?ý4Mih LuULý?|hðitc ð? Lýh i ihUðti êi L?*) UL?tð_ih |üi @ñih@}i ê@}i h@|ic uL**Lêð?}@ UL44L? Th@U|ðUi ð? it|ð4@|ð?} *@MLh týTT*) i^ý@|ðL?të2b

ú?L|üih ThLM*i4 êi u@Ui ðt |ü@| êüi? f ðt _i�?i_ @t ?L?|h@_@M*it UL?ítý4T|ðL?c ð? @** Mý| L?i ULý?|h) ML|ü f*ä @?_ R hðti _ýhð?} |üi t@4T*ië 6LhTLtð|ðñi " |üðt ðt ð?UL?tðt|i?| êð|ü |üi �ht| Lu |üi |êL �ht| Lh_ih UL?_ð|ðL?tëú TLttðM*i i T*@?@|ðL?c êüðUü ü@t hiUi?|*) hiUiðñi_ UL?tð_ih@M*i @||i?|ðL?cðt |ü@| ð?ã@|ðL? 4@) Mi Lñiht|@|i_ @t @ hitý*| Lu ð4TihuiU| 4i@týhi4i?| Lu^ý@*ð|) ð4ThLñi4i?|të Aüðt êLý*_ Mi T@h|ðUý*@h*) hi*iñ@?| uLh |h@_i_ }LL_tcêüihi 4Lt| ^ý@*ð|) ð4ThLñi4i?|t ü@ñi |@!i? T*@Uiëôf

úUULý?|ð?} uLh |üi *@||ih igiU|c êi ð?|hL_ýUi @ T@h@4i|ih @ |ü@| U@T|ýhit|üi }hLê|ü h@|i Lu |h@_@M*it UL?tý4T|ðL? @t @ hitý*| Lu ý?4i@týhi_ ^ý@*ð|)ð4ThLñi4i?|t @?_ TLtð|G

ä ' e@|ä_@|@c E�bä

�2

Page 15: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

êüihi ä_@|@ ðt LMtihñi_ UL?tý4T|ðL? @?_ ä ðt ^ý@*ð|)í@_éýt|i_ UL?tý4T|ðL?ëîiU@ýti |üðt 4i@týhi4i?| ThLM*i4 _Lit ?L| @TT*) |L |L|@* ?L4ð?@* tTi?_í

ð?} L? |h@_@M*itc ð| ðt @TThLThð@|i |L @ttý4i |ü@| |üi ^ý@*ð|)í@_éýt|i_ hi*@|ðñiThðUi Lu |h@_@M*it UL?tý4T|ðL? ðt RA ' e3@|R_@|@A c êð|ü ti*uíi T*@?@|Lh) ?L|@í|ðL?ë i |üi? it|ð4@|i @ éLð?|*) êð|ü " @?_ òë N*|ð4@|i*)c |üi ð_i?|ð�U@|ðL?Lu " ðt M@ti_ ?L| L? |üi @ñih@}i hi*@|ðñi }hLê|ü h@|it Lu f*ä @?_ Rc Mý| L?|üi UL4T@hðtL? @UhLtt |ð4i @?_ ULý?|hðit Lu |üi }hLê|ü h@|it Lu f*ä @?_ Rë

ú �?@* T@h@4i|ih |ü@| i?|iht |üi �ht|íLh_ih UL?_ð|ðL?t ðt |üi Thiuihi?Uiêið}ü| k E|ühLý}ü |üi i ThittðL? uLh Lääë i U@*ðMh@|i ð|c @t LTTLti_ |Lit|ð4@|ð?} ð| êð|ü B��c ML|ü MiU@ýti ð| ðt i@tð*) LMtihñi_ _ðhiU|*) uhL4 |üi_@|@ @?_ MiU@ýti êi _L ?L| ê@?| |L ð4TLti @?) hit|hðU|ðL? L? ð|t ñ@hð@Mð*ð|)@UhLtt ULý?|hðitë 6Lh i@Uü ULý?|h) êi |üihiuLhi ti| k i^ý@* |L |üi @ñih@}iuh@U|ðL? tTi?| L? ?L?í|h@_@M*it ð? �bHfë

5ð?Ui ð| ðt |üi |h@_iíLg Mi|êii? hðt! @?_ i TiU|i_ hi|ýh?t |ü@| @**Lêtýt |L it|ð4@|i |üi h@|i Lu hðt!í@ñihtðL? òc êi TihuLh4 |üi B�� it|ð4@|ðL?L?*) uLh |üi týMti| Lu ULý?|hðit uLh êüðUü êi ü@ñi i^ýð|) hi|ýh? _@|@ë AüitiUL?_ uý?_@4i?|@*t hi|ýh? 4i@týhic êüðUü ðt @ñ@ð*@M*i uLh @** ULý?|hðitcU@??L| Mi ýti_ |L it|ð4@|i |üi T@h@4i|iht @t ð| L?*) ThLñð_it @ 4i@týhi Luhi|ýh? ð??Lñ@|ðL?tc ?L| Lu @ñih@}i hi|ýh?ë {-` ðt UL4Tý|i_ @t |üi êið}ü|i_@ñih@}i Lu t|LU! hi|ýh?t Lu @** ?ð?i ULý?|hðitc @}@ð? ýtð?} @ñih@}i t|LU! 4@h!i|U@Tð|@*ð3@|ðL? tü@hit Lñih |üi TihðL_ �bHDí�bHb @t êið}ü|të

Aüi hitý*|t @hi tüLê? ð? A@M*i �ë i hiTLh| Lýh it|ð4@|it Lu "c òc @têi** @t "òë 5|@?_@h_ ihhLht @hi ð? Mh@U!i|të Aüi *@t| |êL UL*ý4?t tüLêULhhitTL?_ð?} it|ð4@|it Lu |üi ThLTi?tð|) |L üi_}ië Mer|ð6@|e ULhhitTL?_t |L|üi TLð?| it|ð4@|it Lu " @?_ òc êüð*i M6@% ðt |üi tð3i Lu |üi ThLTi?tð|) |Lüi_}i |ü@| *i@_t |L |üi *@h}it| TLttðM*i üL4i Mð@tc UL?_ð|ðL?@* L? !iiTð?} "òêð|üð? |êL t|@?_@h_ _iñð@|ðL?t Lu |üi TLð?| it|ð4@|ië W| êð** Mi ýti_ Mi*Lê |LThLñð_i @? ýTTih MLý?_ L? |üi tð3i Lu |üi üL4i Mð@t |ü@| êi U@? h@|ðL?@*ð3i@t |üi hitý*| Lu üi_}ð?} @}@ð?t| ?L?|h@_@M*it ý?Uih|@ð?|)ë

`üð*i " ðt ^ýð|i ThiUðti*) it|ð4@|i_ |L Mi @MLý| fëe uLh ML|ü ?L?|h@_@M*itUL?tý4T|ðL? @?_ *iðtýhic |üi it|ð4@|it Lu ò i üðMð| *@h}i t|@?_@h_ ihhLhtë`üi? f ðt ?L?|h@_@M*it UL?tý4T|ðL?c |üi it|ð4@|it tý}}it| |ü@| |h@_@M*it@?_ ?L?í|h@_@M*it @hi UL4T*i4i?|tëô� Aüi ð4T*ði_ üi_}ð?} ThLTi?tð|) ðtfëbHc U*Lti |L |üi ýTTih MLý?_ Lu �c @*|üLý}ü |üi ð4ThiUðtðL? Lu ò @**LêtuLh *Lêih ñ@*ýit Lu |üi |hýi üi_}ð?} ThLTi?tð|)ë út êi tüLê Mi*Lêc |üiýTTih MLý?_ Lu |üi üi_}ð?} ThLTi?tð|) M ' � *i@_t |L |üi *@h}it| TLttðM*iüL4i Mð@tc _ýi |L |üi TLtð|ðñi ULhhi*@|ðL? Mi|êii? |üi hi|ýh? L? U@Tð|@* @?_

�ô

Page 16: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

?L?|h@_@M*it UL?tý4T|ðL? }hLê|üë`üi? f ðt *iðtýhic |üi it|ð4@|i_ "ò ðt fëD2 @?_ M ' féefë ,ñi? |üLý}ü

|üi TLð?| it|ð4@|i tý}}it|t |ü@| UL?tý4T|ðL? @?_ *iðtýhi @hi UL4T*i4i?|tc|üi *@h}i t|@?_@h_ ihhLh @ttLUð@|i_ êð|ü ò @**Lêt uLh |üi TLttðMð*ð|) |ü@|UL?tý4T|ðL? @?_ *iðtýhi @hi týMt|ð|ý|itc êð|ü |üi *Lêit| @_4ðttðM*i üi_}ð?}ThLTi?tð|) Lu í�ëô2 Eh@ðtð?} "ò M) |êL t|@?_@h_ ihhLhtäë út êi tüLê Mi*Lêc|üi hi|ýh? L? U@Tð|@* @?_ |üi }hLê|ü h@|i Lu *iðtýhi @hi ?i}@|ðñi*) ULhhi*@|i_ð? |üi _@|@c tL |ü@| @ ?i}@|ðñi üi_}ð?} ThLTi?tð|) }i?ih@|it @ TLtð|ðñi üL4iMð@të ú üi_}ð?} ThLTi?tð|) Lu í�ëô2 |üihiuLhi *i@_t |L |üi *@h}it| TLttðM*iüL4i Mð@t UL?tðt|i?| êð|ü |üi _@|@ë

ôëô OLê *@h}i ðt |üi Thi_ðU|i_ TLh|uL*ðL Mð@tq

6Lh @ }ðñi? ThLTi?tð|) |L üi_}ic êi U@? ýti |üi uLh4ý*@ Ebä |L UL4Tý|i |üiüL4i Mð@t @t @ hitý*| Lu @? LT|ð4@* üi_}i @}@ð?t| ?L?|h@_@M*it ý?Uih|@ð?|)ëA@M*it 2c ô @?_ e hiTLh| |üi t|@|ðt|ðU@* 4L4i?|t |ü@| i?|ih |üi üL4i Mð@tuLh4ý*@c uLh @** |ühii 4i@týhit Lu hi|ýh? L? U@Tð|@*ë ,@Uü |@M*i hiTLh|t|üi 4L4i?|t uLh ML|ü 4i@týhit Lu ?L?|h@_@M*itc ?L?|h@_@M*it UL?tý4T|ðL?Ehiuihhi_ |L @t Sùä @?_ *iðtýhi Eìäë

ï? @ñih@}i ?L?|h@_@M*it UL?tý4T|ðL? }hLê|ü ðt TLtð|ðñi*) ULhhi*@|i_ êð|ü|üi hi|ýh? L? _L4it|ðU U@Tð|@* uLh @** |ühii 4i@týhit Lu hi|ýh?c êüð*i |üi}hLê|ü h@|i Lu *iðtýhi ðt ?i}@|ðñi*) ULhhi*@|i_ êð|ü |üi hi|ýh? L? _L4it|ðUU@Tð|@*ë Aüi ULhhi*@|ðL?t @hi üð}üih Eð? @MtL*ý|i ñ@*ýiä uLh |üi uý?_@4i?|@*thi|ýh?t |ü@? |üi i^ýð|) hi|ýh?tc @*|üLý}ü |üi ?ý4Miht @hi tð4ð*@h êüi? f ðt*iðtýhië `üð*i |üi it|ð4@|i_ 4L4i?|t ñ@h) tð}?ð�U@?|*) @UhLtt ULý?|hðitc |üitð}? Lu |üi ULhhi*@|ðL? êð|ü |üi _L4it|ðU hi|ýh? ðt |üi t@4i ð? 4Lt| ULý?|hðitë

Aüðt T@||ih? Lu ULhhi*@|ðL?t *i@_t |L üL4i Mð@t êüi? |h@_@M*it @?_ ?L?í|h@_@M*it UL?tý4T|ðL? @hi UL4T*i4i?|@h) EM : fä Lh |h@_@M*it UL?tý4T|ðL?@?_ *iðtýhi @hi týMt|ð|ý|it EM ÷ fäë `üð*i |üi ULhhi*@|ðL? Mi|êii? ?L?|h@_í@M*it }hLê|ü @?_ uLhið}? hi|ýh? }i?ih@**) ü@t |üi t@4i tð}? @t |üi ULhhi*@|ðL?Mi|êii? ?L?|h@_@M*it }hLê|ü @?_ _L4it|ðU hi|ýh?c ð| ðt tL4iêü@| t4@**ih L?@ñih@}i Eð? @MtL*ý|i |ih4tä @?_ hiUiðñit *itt êið}ü| ð? |üi Mð@t uLh4ý*@ EbäëAüðt ðt MiU@ýti L? @ñih@}i |üi hi|ýh? L? @ êi**í_ðñihtð�i_ TLh|uL*ðL Lu uLhið}?U*@ð4t ðt *itt ñL*@|ð*i |ü@? |üi _L4it|ðU hi|ýh?ë

A@M*i D hiTLh|t |üi ULhhitTL?_ð?} üL4i Mð@t uLh @** |ühii 4i@týhit Luhi|ýh?ë 6Lh i@Uü ULý?|h) |üi �ht| hLê hiTLh|t |üi üL4i Mð@t M@ti_ L? |üiTLð?| it|ð4@|i Lu |üi ThLTi?tð|) |L üi_}ic êüð*i |üi tiUL?_ hLê Eð? ð|@*ðUtä

�e

Page 17: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

hiTLh|t |üi üL4i Mð@t êüi? @ttý4ð?} M ' � uLh f ' Sù @?_ M ' ý�éô2 uLhf ' ìë út _ðtUýtti_ @MLñic |üi *@||ih U@*ðMh@|ðL? )ði*_t |üi *@h}it| @ñih@}iüL4i Mð@t UL?tðt|i?| êð|ü |üi _@|@ë Aüi |êL ML||L4 hLêt ThLñð_i _ðgihi?|4i@týhit Lu @ñih@}i üL4i Mð@të Aüi �ht| L?i ðt @ tð4T*i ý?êið}ü|i_ @ñih@}iLu |üi üL4i Mð@t it|ð4@|i_ uLh |üi ð?_ðñð_ý@* ULý?|hðitë Aüi tiUL?_ L?ihiTLh|t |üi Mð@t uLh @ hiThiti?|@|ðñi ULý?|h)c uLh êüðUü êi @ttý4i |ü@| |üi4L4i?|t |ü@| i?|ih |üi üL4i Mð@t uLh4ý*@ Ebä @hi i^ý@* |L @? ý?êið}ü|i_@ñih@}i @UhLtt ULý?|hðitë Aüi *@||ih 4@) ThLñð_i @ Mi||ih t|@|ðt|ðUc @t |üiý?êið}ü|i_ @ñih@}i Lu Kð@r Lñih ð?_ðñð_ý@* ULý?|hðit U@? Mi ñih) ti?tð|ðñi |Li |hi4i Lý|*ðihtë

Aüi Lñih@** UL?U*ýtðL? |ü@| U@? Mi _h@ê? uhL4 A@M*i e ðt |ü@| L?*) @ t4@**TLh|uL*ðL üL4i Mð@t U@? Mi @||hðMý|i_ |L LT|ð4@* üi_}ð?} @}@ð?t| ?L?|h@_í@M*itë `üi? f ' Sù |üi 4@ ð4ý4 üL4i Mð@t uLh @ hiThiti?|@|ðñi ULý?|h)ðt fë2Sc fëf. @?_ fëffc hitTiU|ðñi*)c uLh |üi |ühii 4i@týhitë `üi? f ' ì|üi ýTTih MLý?_ uLh üL4i Mð@t ð? @ hiThiti?|@|ðñi ULý?|h) ðt fë�.c fëfbc @?_fëf�c hitTiU|ðñi*)c uLh |üi |ühii @tti| hi|ýh? 4i@týhitëô2 Aüiti �}ýhit @hitýMt|@?|ð@**) t4@**ih |ü@? |üi üL4i Mð@t tii? ð? |üi _@|@ë ,ñi? ðu êi tüðu|ýT |üi Mi?Uü4@h! ð? 6ð}ýhi � M) 2S TihUi?|@}i TLð?|tc |üi @ñih@}i uh@U|ðL?ð?ñit|i_ _L4it|ðU@**) hi4@ð?t eDI @MLñi |üi Mi?Uü4@h!ë �LhiLñihc A@M*iD tüLêt |ü@| |üi Mð@t Lu|i? ü@t |üi êhL?} tð}? uLh ð?_ðñð_ý@* ULý?|hðitë

i ü@ñi TihuLh4i_ týMt|@?|ð@* ti?tð|ðñð|) @?@*)tðt uLh ML|ü 4i@týhit Luuý?_@4i?|@*t hi|ýh?ëôô i ü@ñi UL?tð_ihi_ |üi ti?tð|ðñð|) Lu hitý*|t êð|ühitTiU| |L |üi 4i|üL_ Lu _i|hi?_ð?} |üi ThL�| h@|ic |üi tiU|Lht ð?U*ý_i_ ð?|üi 4i@týhi Lu |üi ThL�| h@|ic @?_ |üi 4i@týhi Lu ?L?|h@_@M*it UL?tý4T|ðL?@?_ *iðtýhië út @*|ih?@|ðñit |L i |h@U|ð?} @ tiUL?_íLh_ih TL*)?L4ð@* |hi?_uhL4 |üi ThL�|t h@|i êi ü@ñi UL?tð_ihi_ ?L| i |h@U|ð?} @ |hi?_ @| @**c Lhi |h@U|ð?} @ OL_hðU!íèhitUL|| �*|ihë i ü@ñi UL?tð_ihi_ @ MhL@_ih 4i@týhiLu |üi |h@_@M*it tiU|Lh |L UL4Tý|i |üi ThL�| h@|ic ð?U*ý_ð?} @*tL @}hðUý*|ýhi@?_ 4ð?ð?}ë W? UL4Tý|ð?} |üi tiUL?_ 4i@týhi Lu |üi hi|ýh? L? U@Tð|@* êiü@ñi UL?tð_ihi_ @ tiUL?_íLh_ih @ý|Lhi}hittðL? ð? |üi ThL�| h@|i E@t LTTLti_|L |üi �ht|íLh_ih @ý|Lhi}hittðL? ð? |üi Mi?Uü4@h!äë

`üð*i Lýh 4i@týhi Lu ?L?|h@_@M*it UL?tý4T|ðL? L?*) ð?U*ý_it Thðñ@|iUL?tý4T|ðL?c êi ü@ñi UL?tð_ihi_ @__ð?} }Lñih?4i?| UL?tý4T|ðL?ë i ü@ñi@*tL i Tihð4i?|i_ êð|ü ?@hhLêih 4i@týhit Lu ?L?|h@_@M*it UL?tý4T|ðL?c týMí|h@U|ð?} EL?i @| @ |ð4i Lh @** |L}i|üihä uhL4 |üi ThiñðLýt _i�?ð|ðL? |üi U@|íi}Lhðit øTýM*ðU |h@?tTLh|@|ðL? @?_ UL44ý?ðU@|ðL?<c øhiUhi@|ðL?c i?|ih|@ð?í4i?|c i_ýU@|ðL? @?_ Uý*|ýh@* tihñðUit<c @?_ øi Ti?_ð|ýhit ð? hit|@ýh@?|tc

�D

Page 18: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

üL|i*t @?_ U@uit<ë i ü@ñi �?@**) UL?tð_ihi_ UL4Tý|ð?} *iðtýhi ý?_ih |üi@ttý4T|ðL? |ü@| |üi |L|@* týTT*) Lu |ð4i uLh *iðtýhi T*ýt êLh! ðt �S Eð?t|i@_Lu �2ä üLýht Tih _@)ë ûL?i Lu |üiti Uü@?}it @*|ih |üi UL?U*ýtðL? |ü@| |üii |i?| Lu üL4i Mð@t |ü@| U@? Mi @||hðMý|i_ |L @? LT|ð4@* üi_}i @}@ð?t| ?L?í|h@_@M*it u@**t u@h tüLh| Lu |üi LMtihñi_ üL4i Mð@të Aüi *@h}it| üL4i Mð@têi uLý?_ uLh |üi hiThiti?|@|ðñi ULý?|h) ðt fë2. EuLh |üi *@h}it| ThLTi?tð|) |Lüi_}i UL?tðt|i?| êð|ü |üi _@|@äë

`üð*i êi ü@ñi U@hhði_ Lý| ti?tð|ðñð|) @?@*)tðt êð|ü hi}@h_t |L |üi 4i@ítýhi Lu ?L?|h@_@M*it UL?tý4T|ðL?c |üihi @*ê@)t hi4@ð? _LýM|t UL?Uih?ð?}4i@týhi4i?| ihhLhë ú** UL?tý4T|ðL? U@|i}Lhðit ü@ñi UL4TL?i?|t Lu ML|ü|h@_@M*it @?_ ?L?|h@_@M*it UL?tý4T|ðL?ë ,@Uü |h@_@M*i }LL_ }Lit |ühLý}ü@ *LU@* _ðt|hðMý|ðL? ?i|êLh! MiuLhi ð| hi@Uüit |üi UL?tý4ihë 5ð4ð*@h*)c ð|i4t|)TðU@**) hiuihhi_ |L @t ?L?|h@_i_ }LL_tc týUü @t 4i_ðU@* tihñðUitc @hi ThLíñð_i_ êð|ü |h@_i_ ð?Tý|t *ð!i 4i_ðU@* i^ýðT4i?| @?_ 4i_ðU@|ðL?ë Aüi }hi)@hi@ Mi|êii? |h@_@M*it @?_ ?L?|h@_@M*it *ð!i*) Q @?_ ý?@ñLð_@M*) Q @giU|t|üi 4i@týhit Lu |üi ThL�| h@|it @?_ UL?tý4T|ðL? }hLê|üë

AL tL4i i |i?|c üLêiñihc 4i@týhi4i?| ThLM*i4t t|hi?}|üi? Lýh UL?U*ýítðL?tc ð? |üi ti?ti |ü@| |üi) @hi *ð!i*) |L U@ýti @? Lñihit|ð4@|ðL? Lu üL4iMð@të AL |üi i |i?| |h@_@M*it @?_ ?L?|h@_@M*it UL?tý4T|ðL? @hi *itt UL4T*ií4i?|@h) |ü@? |üi týMíU@|i}Lhðit êð|üð? |üi4c M) ø4ð ð?}< |üi týMíU@|i}Lhðitêi @hi *ð!i*) |L ð4T@h| @? ýTê@h_ Mð@t |L |üi it|ð4@|i_ _i}hii Lu UL4T*ií4i?|@hð|) Mi|êii? |h@_@M*it @?_ ?L?|h@_@M*it UL?tý4T|ðL?ë 5ð4ð*@h*)c M)ø4ð ð?}< |üi UL?tý4T|ðL? týMíU@|i}Lhðit êi U@? Lñihit|ð4@|i |üi i |i?| LutýMt|ð|ý|@Mð*ð|) Mi|êii? |h@_@M*it UL?tý4T|ðL? @?_ *iðtýhië Aüðt ðt MiU@ýti*iðtýhi @?_ ?L?|h@_@M*it UL?tý4T|ðL? @hi *ð!i*) |L Mi U*Ltih týMt|ð|ý|it |ü@?*iðtýhi @?_ |h@_@M*it UL?tý4T|ðL?c T@h|ðUý*@h*) êüi? *iðtýhi ðt ð?|ihThi|i_ @t?L?í4@h!i| ThL_ýU|ðL?ë �i@týhi4i?| ihhLh U@? |üihiuLhi *i@_ |L @? it|ð4@|iLu " |ü@| ðt _Lê?ê@h_ Mð@ti_ êüi? f 4i@týhit ?L?|h@_@M*it UL?tý4T|ðL?@?_ ýTê@h_ Mð@ti_ êüi? f 4i@týhit *iðtýhië W? ML|ü U@titc 4i@týhi4i?|ihhLht 4@!i |üi it|ð4@|i Lu |üi ThLTi?tð|) |L üi_}i i Uittðñi*) *@h}i ð? @MítL*ý|i ñ@*ýië Aüýtc ð| ðt ð4T*@ýtðM*i |ü@| Lýh 4i@týhit Lu üL4i Mð@t êLý*_Mi *@h}ih êð|ü 4Lhi @UUýh@|i 4i@týhit Lu |h@_@M*it @?_ ?L?|h@_@M*itë

�S

Page 19: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

e çL?U*ýtðL?t

W?|ihThi|@|ðL?t @?_ i T*@?@|ðL?t Lu |üi üL4i Mð@t Tý33*i ð? ð?|ih?@|ðL?@*�?@?Ui ü@ñi uhi^ýi?|*) uLUýti_ L? LT|ð4@* ð?týh@?Ui t|h@|i}ðit @}@ð?t| ãýUí|ý@|ðL?t ð? ?L?|h@_@M*itë `üi|üihc @?_ |L êü@| _i}hiic üi_}ð?} @}@ð?t|ãýU|ý@|ðL?t ð? ?L?|h@_@M*it U@? tð}?ð�U@?|*) @giU| |üi ð?|ih?@|ðL?@* @**LíU@|ðL? Lu �?@?Uð@* êi@*|ü ð? |üi @Mti?Ui Lu M@hhðiht |L ð?|ih?@|ðL?@* @tti||h@_i ðt ý*|ð4@|i*) @? i4TðhðU@* ^ýit|ðL?ë Aüðt T@Tih ü@t ð?ñit|ð}@|i_ |Lêü@| i |i?| |üi *L?}í|ih4 ð?|ih?@|ðL?@* TLh|uL*ðL Mi?Uü4@h! ðt @giU|i_ M)|üi Thiti?Ui Lu ?L?|h@_@M*itc ð? |üi uLh4 Lu ML|ü *iðtýhi @?_ ?L?|h@_@M*itUL?tý4T|ðL?ë

ïýh �?_ð?}t ð?_ðU@|i |ü@| |üi i T*@?@|Lh) TLêih Lu |üðt @TThL@Uü ðtcuhL4 @?) hi@tL?@M*i ñ@?|@}i TLð?|c ñih) *ð4ð|i_ë i �?_ |ü@| @UULý?|ð?}uLh ?L?|h@_@M*it *i@_t |L L?*) @ t4@** Mð@t |Lê@h_t _L4it|ðU @tti|të Aüi Mð@tðt ?L *@h}ih |ü@? 2.Ic @?_ ThLM@M*) 4ýUü t4@**ih |ü@? |ü@|ë çýhhi?| _@|@c ð?UL?|h@t|c tüLê |ü@| |üi @ñih@}i Mð@t |Lê@h_t _L4it|ðU @tti|t ðt U*Lti |L .fILu |üi |L|@* TLh|uL*ðLë Aüiti hitý*|t tý}}it| |ü@| êð|ü hi}@h_t |L TLh|uL*ðLt|h@|i}ðit êi @hi t|ð** êð|?ittð?} @ hi*@|ðñi*) i@h*) t|@}i Lu }*LM@*ð3@|ðL?ë W?T@h@**i* êð|ü |üi ð?|i?tð�U@|ðL? Lu |üi ThLUitt Lu ð?|ih?@|ðL?@* U@Tð|@* 4@h!i|tð?|i}h@|ðL?c ð? |üi ?i@h uý|ýhi êi U@? i TiU| |L LMtihñi @ tð3@M*i @__ð|ðL?@*tüðu| ð? _i4@?_ uLh êLh*_êð_i _ðñihtð�U@|ðL?ë

�.

Page 20: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

úTTi?_ð úG ûý4ihðU@* tL*ý|ðL?

Aüi TýhTLti Lu |üðt úTTi?_ð ðt |ühiiuL*_ë 6ðht|c êi _itUhðMi üLê |üi îi**í4@? i^ý@|ðL? U@? Mi tL*ñi_ ?ý4ihðU@**) |ühLý}ü |üi çüiM)tüiñ ð?|ihTL*@?|4i|üL_ë 5iUL?_c |ühLý}ü @? i @4T*i êi ð**ýt|h@|i |ü@| |üi ?ý4ihðU@* tLí*ý|ðL? |L |üi ThLTi?tð|) |L üi_}i ðt Th@U|ðU@**) ð_i?|ðU@* |L |ü@| M@ti_ L?E�eäë Aüðh_c êi ð**ýt|h@|i |ü@| @ hi@*ðt|ðU _iñð@|ðL? uhL4 |üi M@*@?Ui_ }hLê|ü@ttý4T|ðL? _Lit ?L| Uü@?}i 4ýUü |üi it|ð4@|i Lu |üi ThLTi?tð|) |L üi_}ië

èLtð?} 5 ì f*` c T ì )E5äf�3ò @?_ ä ì ô E5ä` c @u|ih týMt|ð|ý|ð?} |üiLT|ð4@* _L4it|ðU Lê?ihtüðT tü@hi ? Ei^?ëEHää ð?|L ESäc |üi îi**4@? i^ý@|ðL?MiUL4itG

wf ) ' E�ý òä3�kkn E�ý kä Eô*5ä�3�*"

l ""3� E�3òä

n)â5 Eô ý w� n 2w2ä n )ââ52w2 ý ò

2 E)âä2 5K)ââ5 n 2)â

Eúë�ä

@?_ |üi i?ñi*LTi UL?_ð|ðL? ET` ' Lää MiUL4it

)â ' ýdkn E�ý käEô*5ä�3�*"o �3ò""3� E�ý käEô*5ä3�*"532 Eúë2ä

Aüi T@h@4i|iht w @hi _i�?i_ @t uL**LêtG

wf ì B ý E�ý òä>n òE�ý òäj2f*2w� ì # ý >n òj2f ý òSý 2òKw2 ì j2f*2 n @ý Ký S@ ì �* E2ðâP3�ðäK ì tâP3� Etý Sðä *2S ì EðâP3�tä * EðâP3�ðä

Eúëôä

êüihi P ðt |üi ñ@hð@?UiíULñ@hð@?Ui 4@|hð Lu @tti| hi|ýh?tc ðëië

P ì#

j2- 4j-j-W4j-j-W j2-W

$Eúëeä

@?_ t ìjf Ej-4-f j-W4-Wfäâ ðt |üi ULñ@hð@?Ui Mi|êii? ?L?|h@_@M*it UL?í

tý4T|ðL? }hLê|ü @?_ |üi @tti| hi|ýh? ñiU|Lhë #ðgihi?|ð@|ð?} |üi i?ñi*LTiUL?_ð|ðL? @?_ hi@hh@?}ð?}c êi LM|@ð? |üi uLh4ý*@ uLh |üi ThLTi?tð|) |L üi_}iM @t @ uý?U|ðL? Lu |üi t|@|i ñ@hð@M*i 5 E�ôä ð? |üi 4@ð? |i |ëôe

�H

Page 21: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

Aüi i?ñi*LTi UL?_ð|ðL? Eúë2ä i Thittit )â @t @ uý?U|ðL? Lu ô @?_ 5c t@))â ' s�Eôc 5äë #ðgihi?|ð@|ð?} |üi îi**4@? i^ý@|ðL? Eúë�ä êð|ü hitTiU| |L 5c@?_ UL?tð_ihð?} |üi i?ñi*LTi UL?_ð|ðL? @?_ ð|t _ihðñ@|ðñic êi LM|@ð? @?L|üihi ThittðL? )â ' s2Eôc ô

âc ô ââc 5äë Aüýtc êi ü@ñi s�Eôc 5ä ' s2Eôc ôâc ô ââc 5äc

êüðUü ð4T*ðUð|*) _i�?it @ tiUL?_íLh_ih _ðgihi?|ð@* i^ý@|ðL? uLh ô @t @ uý?Uí|ðL? Lu 5ë AL tL*ñi ?ý4ihðU@**) |üðt i^ý@|ðL?c êi ð4T*i4i?| |üi çüiM)tüiñð?|ihTL*@?| 4i|üL_ @t hiñðiêi_ ð? aý__ E�bb2äë

i U@? Mhðiã) tý44@hð3i |üi t|h@|i}) Lu tL*ý|ðL? @t uL**Lêtë 6ðht|c ü@ñð?}ti| @hMð|h@hð*) |êL ýTTih @?_ *Lêih |ühitüL*_t 56 @?_ 5� c êi UL?tð_ih @?@TThL ð4@|ðL? uLh ô c _i?L|i_ ÷ô @?_ _i�?i_ Lñih |üi _L4@ð? 56 é 5 é 5�@t

÷ô E5cêä ìU[ð'�

çðúðE5äé EúëDä

Oihi úðE5ä @hi çüiM)tüiñ TL*)?L4ð@*tcôD ê 'Eç� ç2 ééé çUä ðt |üi ñiU|Lh LuT@h@4i|iht |L Mi UL4Tý|i_ ?ý4ihðU@**)c @?_ U |üi _i}hii Lu @TThL ð4@í|ðL?ë èhLTih|ðit Lu çüiM)tüiñ TL*)?L4ð@*t }ý@h@?|ii |ü@| @ hi*@|ðñi*) *Lê?ý4Mih Lu |ih4t ðt hi^ýðhi_ |L }i| @ }LL_ @TThL ð4@|ðL?ë 5iUL?_c êi _ií�?i |üi øhitð_ý@* uý?U|ðL?< @t -E5cêä ì s�E÷ô c 5ä ý s2E÷ô c ÷ô âc ÷ô ââc 5äë Aüðh_cêi UL?tð_ih U ñ@*ýit Lu 5c _i?L|i_ M) 5ðc ð ' �c éééc Uc @?_ êi UüLLti |üiñiU|Lh ê tL |ü@| -E5ðcêä ' f uLh i@Uü ðë ú*|üLý}ü ð| ðt TLttðM*i |L UL4íTý|i |üi ñiU|Lh ê uLh @?) UL**iU|ðL? Lu 5ðc |üi Mit| UüLðUi uLh |üi ñ@*ýit Lu5ðc @t _ðtUýtti_ M) aý__ E�bb2äc ðt }ðñi? M) |üi U 3ihLit Lu úUn�c ?@4i*)

5ð ' 56 n féD E5� ý 56äq� n ULt

kE2ðý �äZ E2Uä3�

lrë

Aüi tL*ý|ðL? uLh ô E5ä @?_ ô âE5ä U@? Mi týMt|ð|ý|i_ ð? |üi i ThittðL? E�ôäð? Lh_ih |L UL4Tý|i |üi üL4i Mð@t @t @ uý?U|ðL? Lu 5ë AL ð**ýt|h@|i |ü@||üi @TThL ð4@|i i ThittðL? uLh |üi üL4i Mð@t ð? E�eä )ði*_t ñih) @UUýh@|ihitý*|tc @ttý4i |ü@| " ' féôb @?_ ò ' ��éfHë Aüiti T@h@4i|iht ULhhitTL?_|L |üi *@h}it| ñ@*ýi Lu "ò UL?tðt|i?| êð|ü |üi _@|@ êüi? f ðt *iðtýhic êüðUü*i@_t |L |üi *@h}it| üL4i Mð@t uLh *iðtýhi hiTLh|i_ ð? A@M*i Dë i iñ@*ý@|i|üi ThLTi?tð|) |L üi_}i Lu 5 uLh êüðUü �*E� n 6E5ää ' fé.ec êüðUü ðt |üi@ñih@}i tü@hi tTi?| L? f êüi? f ðt *iðtýhië i @*tL ti| > ' féfô @?_B ' féf2ë W? |ü@| U@ti |üi it|ð4@|i Lu |üi ThLTi?tð|) |L üi_}i ðt í�ëô2�bM@ti_ L? |üi @TThL ð4@|i uLh4ý*@ E�eäë Ntð?} |üi ?ý4ihðU@* @TThL ð4@|ðL?4i|üL_c êi �?_ |ü@| |üi ThLTi?tð|) |L üi_}i ðt í�ëô2Hô êüi? ýtð?} @ñih@}i4L4i?|t M@ti_ L? |üi tiUL?_ uý?_@4i?|@*t hi|ýh?c @?_ í�ë2ôô� êüi? ýtð?}@ñih@}i t|LU! hi|ýh? 4L4i?|të îL|ü @hi ^ýð|i U*Lti |L |üi hitý*| M@ti_ L?

�b

Page 22: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

|üi @TThL ð4@|i uLh4ý*@ E�eäëNtð?} |üi ?ý4ihðU@* tL*ý|ðL? 4i|üL_ @MLñi êi U@? @*tL tL*ñi uLh |üi

ThLTi?tð|) |L üi_}i ð? |üi Thiti?Ui Lu _iñð@|ðL?t uhL4 M@*@?Ui_ }hLê|üëúUULh_ð?} |L Lýh _@|@ |üi tü@hi tTi?| L? *iðtýhi ü@t }h@_ý@**) ð?Uhi@ti_Lñih |ð4iG L? @ñih@}ic ð? Lýh t@4T*i �*6 ' Rf*ä }hiê M) 2ë2bI Tih)i@hë úttý4ð?} |üi t@4i T@h@4i|iht uLh " @?_ ò @t @MLñic @? ð?Uhi@ti ð? #M) SëbHDI hi*@|ðñi |L |üi M@*@?Ui_ }hLê|ü T@|ü *i@_t |L @ 2ë2bI i TiU|i_}hLê|ü h@|i uLh �*6ë i �?_ |ü@| |üi ?ý4ihðU@* tL*ý|ðL? uLh |üi ThLTi?tð|)|L üi_}i EM@ti_ L? |üi tiUL?_ uý?_@4i?|@*t hi|ýh?ä |üi? _hLTt L?*) t*ð}ü|*)cuhL4 í�ëô2Hô |L í�ëô.Dôë Aüi tü@hi tTi?| L? ?L?|h@_@M*it UL?tý4T|ðL? @*tLhLti _ýhð?} |üi t@4T*ic L? @ñih@}i @? @??ý@* 2ëDHI ð?Uhi@tic Mý| |üi hiTLh|i_üL4i Mð@t hitý*|t êüi? f ðt ?L?|h@_@M*it UL?tý4T|ðL? @hi @*hi@_) M@ti_ L?@ üi_}ð?} ThLTi?tð|) U*Lti |L �c êüðUü }i?ih@|it |üi *@h}it| TLttðM*i Mð@t ð?|ü@| U@tië

úTTi?_ð îG #@|@ tLýhUit

èhL�| h@|i Aüi ThL�| h@|i ð? |üi |h@_@M*it tiU|Lh ðt _i�?i_ @t LTíih@|ð?} týhT*ýt ð? |üi |h@_@M*it tiU|Lhc _ðñð_i_ M) |üi U@Tð|@* t|LU! Lu |üiThiñðLýt )i@hë #@|@ @hi @??ý@* @?_ @hi uhL4 |üi ï,ç# W?|ih?@|ðL?@* 5iUí|Lh@* #@|@ î@tic @ñ@ð*@M*i uhL4 �b.f |L �bbô uLh �e ULý?|hðitë 5ð?Ui |üiU@Tð|@* t|LU! ðt L?*) @ñ@ð*@M*i @| UL?t|@?| ThðUitc LTih@|ð?} týhT*ýt ðt _ðíñð_i_ M) ?L4ð?@* B#è @?_ |üi? 4ý*|ðT*ði_ M) |üi h@|ðL Lu B#è @| UL?t|@?|ThðUit |L |üi U@Tð|@* t|LU! @| UL?t|@?| ThðUitë Aüi |h@_@M*it tiU|Lh ðt _i�?i_@t ið|üih 4@?ýu@U|ýhð?} L?*)c Lh |üi tý4 Lu 4@?ýu@U|ýhð?}c @}hðUý*|ýhi @?_4ð?ð?} Eð? ti?tð|ðñð|) @?@*)tðt L?*)äë

wiðtýhi wiðtýhi ðt UL4Tý|i_ @tMïL-7úuøî8ýM`ú.�åuc êüihiMïL-7 ðt |üi |L|@* ?ý4Mih Lu üLýht Tih êii! @ñ@ð*@M*i uLh ML|ü *iðtýhi @?_êLh!c M` ðt |üi ?ý4Mih Lu üLýht Tih êii! @**LU@|i_ |L êLh!c uøî8 ðt |üi*@MLh uLhUic @?_ .�åu ðt |L|@* i4T*L)4i?|ë îL|ü uøî8 @?_ .�åu @hiLM|@ð?i_ uhL4 |üi ï,ç# ú??ý@* w@MLýh 6LhUi t|@|ðt|ðUtë MïL-7 ðt ti|@| He E�2 üLýht Tih _@)äë W? ti?tð|ðñð|) @?@*)tðt êi UL?tð_ih �S üLýht Tih_@)ë M` ðt @TThL ð4@|i_ @t |üi ?ý4Mih Lu üLýht êLh!i_ Tih êii! ð? |üi4@?ýu@U|ýhð?} tiU|Lhc uhL4 |üi vi@hMLL! Lu w@MLýh 5|@|ðt|ðUtë 6Lh ULý?|hðituLh êüðUü üLýht Tih êii! ð? @** ?L?í@}hðUý*|ýh@* tiU|Lht ðt @ñ@ð*@M*ic |üðt ðt

2f

Page 23: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

üð}ü*) ULhhi*@|i_ êð|ü üLýht Tih êii! ð? 4@?ýu@U|ýhð?}ë

ûL?|h@_@M*it UL?tý4T|ðL? ú??ý@* _@|@ L? ñ@hðLýt UL?tý4T|ðL? U@|íi}Lhðit @| UL?t|@?| ThðUit @hi @ñ@ð*@M*i uhL4 |üi ï,ç# û@|ðL?@* úUULý?|tcVL*ý4i WWë 6Lh tL4i ULý?|hðit _@|@ @hi 4ðttð?} i@h*) ð? |üi t@4T*i uLh tL4iUL?tý4T|ðL? U@|i}Lhðitë Aüiti _@|@ @hi LM|@ð?i_ uhL4 |üi N?ð|i_ û@|ðL?tû@|ðL?@* úUULý?|t 5|@|ðt|ðUtë ú}}hi}@|i ?L?|h@_@M*it UL?tý4T|ðL? ðt UL4íTý|i_ @t |üi tý4 Lñih |üi U@|i}Lhðit *ðt|i_ ð? |üi |i |ë i _ðñð_i M) TLTýí*@|ðL? @?_ |üi? ýti |üi }hLê|ü h@|i Lu Tih U@Tð|@ ?L?|h@_@M*it UL?tý4T|ðL?@t Lýh i4TðhðU@* 4i@týhi uLh _f*f ð? |üi 4L_i*ë

Ah@_@M*it UL?tý4T|ðL? ú4i@týhi Lu |h@_@M*it UL?tý4T|ðL? ðt ?ii_i_uLh |üi B�� it|ð4@|ðL? Lu " @?_ òë Ah@_@M*it UL?tý4T|ðL? ðt _i�?i_ @t |üitý4 Lu uLL_( U*L|üð?} @?_ uLL|êi@h( uýh?ð|ýhi( üLýtiüL*_ i^ýðT4i?|( TihtL?@*|h@?tTLh|@|ðL?ë îiuLhi @}}hi}@|ð?}c uLh |üi *@t| |ühii U@|i}Lhðitc êüðUü hiuih|L _ýh@M*i }LL_tc êi uL**Lê ñ@? `ð?ULLT E�bbeä ð? UL4Tý|ð?} @ t|LU! ð?_i uhL4 |üi ãLê _@|@c @ttý4ð?} _iThiUð@|ðL? h@|it Lu hitTiU|ðñi*) fëDc fëe @?_fëôë 6Lh i@Uü _ýh@M*it UL?tý4T|ðL? U@|i}Lh) |üi t|LU! Lu _ýh@M*it @| |ð4i3ihL ðt UL4Tý|i_ @t (Efä ' Een ñä3� A3�

SA|'�.E|ä*Een ñä

|c êüihi ñ ðt |üih@|i Lu _iThiUð@|ðL?c . ðt hi@* TýhUü@tit @?_ e |üi 4i@? }hLê|ü h@|i Lu |üiãLê ñ@hð@M*i . Lñih |üi t@4T*ië 5ýMti^ýi?|*) |üi t|LU! Lu _ýh@M*it iñL*ñit@UULh_ð?} |L (E| n �ä ' E� ý ñä(E|ä n .E| n �äë i @ttý4i |ü@| |üi ãLêLu tihñðUit uhL4 _ýh@M*it ðt ThLTLh|ðL?@* |L |üi t|LU!ë 6Lh i@Uü |h@_@M*itUL?tý4T|ðL? U@|i}Lh) êi ð?_i |üi *iñi* ELu ið|üih |üi ãLê Lu _ýh@M*it tihíñðUit Lh ?L?_ýh@M*it UL?tý4T|ðL?ä i^ý@* |L � ð? �bHfë i |üi? @}}hi}@|i @**U@|i}Lhðit ð?|L @ çLMMí#Lý}*@t ð?_i c ýtð?} �bHf ?L4ð?@* tTi?_ð?} êið}ü|të

+i*@|ðñi ThðUi Lu ?L?|h@_@M*it Aüi hi*@|ðñi ThðUi Lu ?L?|h@_@M*it |L|h@_@M*it UL?tý4T|ðL? ðt @*tL ?ii_i_ uLh |üi B�� it|ð4@|ðL? Lu " @?_ òë6Lh ?L?|h@_@M*it UL?tý4T|ðL? |üi ThðUi ð?_i ðt UL4Tý|i_ @t |üi h@|ðL ?L?í|h@_@M*it UL?tý4T|ðL? @| ?L4ð?@* @?_ UL?t|@?| ThðUitc ýtð?} _@|@ uhL4 |üiN?ð|i_ û@|ðL?t û@|ðL?@* úUULý?|t 5|@|ðt|ðUt L? |üi tý4 Lñih @** U@|i}Lhðitë`üi? *iðtýhi ðt |üi ?L?|h@_i_ }LL_c |üi ThðUi ðt _i�?i_ @t |üi üLýh*) ê@}ih@|ic UL4Tý|i_ @t |L|@* i4T*L)ii UL4Ti?t@|ðL? Eï,ç# û@|ðL?@* úUULý?|t5|@|ðt|ðUtä _ðñð_i_ M) |üi ?ý4Miht Lu üLýht êLh!i_ EM` ú .�åuäë Aüi|h@_@M*it UL?tý4T|ðL? ThðUi ð?_i ðt UL4Tý|i_ @t @ çLMMí#Lý}*@t ð?_i Lu

2�

Page 24: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

|üi ThðUit Lu |h@_@M*it UL?tý4T|ðL? U@|i}Lhðitc ýtð?} �bHf tTi?_ð?} êið}ü|t@?_ UL4Tý|ð?} |üi ThðUi Lu i@Uü U@|i}Lh) uhL4 |üi N?ð|i_ û@|ðL?t û@|ðL?@*úUULý?|t 5|@|ðt|ðUt UL?tý4T|ðL? _@|@ @| UL?t|@?| @?_ ?L4ð?@* ThðUitë

5|LU! hi|ýh? i ýti |üiùu t|LU! ð?_i uhL4 �Lh}@? 5|@?*i)ë Aüðt ðt@ *LU@* Uýhhi?U) ð?_i c êð|ü _ðñð_i?_ hið?ñit|4i?| ?i| Lu êð|üüL*_ð?} |@ itë#@|@ @hi 4L?|ü*)ë AL LM|@ð? @??ý@* hi|ýh? _@|@c êi UL4Tý|i |üi @ñih@}i@??ý@* üi_}i_ hi|ýh? L? t|LU! @t uL**LêtG

{-7Aïäg '�2[|'�

�2

éùu|n�2 ýùu|

ùu|ý 8(|c�2

èý áA

Oihi ùu ðt |üi t|LU! ð?_i c 8(�2 |üi �2í4L?|ü uLhê@h_ _ðtULý?|c @?_ áA|üi |h@_@M*it UL?tý4T|ðL? ð?ã@|ðL? h@|ië Aüi tý44@|ðL? ðt Lñih |üi �2@??ý@* hi|ýh?t uhL4 L?i 4L?|ü |L |üi t@4i 4L?|ü ?i | )i@hë 6Lhê@h_ _ðtíULý?| _@|@ @hi LM|@ð?i_ uhL4 |üi O@hhðt î@?! êii!*) hiñðiêë i êLý*_ *ð!i|L |ü@?! çühðt Ai*4ih uLh ThLñð_ð?} ýt @UUitt |L |üðt _@|@M@tië Aüi |h@_í@M*it UL?tý4T|ðL? ð?ã@|ðL? h@|i ðt UL4Tý|i_ M@ti_ L? |üi @??ý@* |h@_@M*itUL?tý4T|ðL? ThðUi ð?_i _ðtUýtti_ @MLñië

22

Page 25: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

ûL|it� 5iic @4L?} L|üihtc çLLTih @?_ k@T*@?ðt E�bHSc �bbeäc 6hi?Uü @?_

èL|ihM@ E�bbfc �bb�äc BL*ýM E�bbfäc k@?} @?_ 5|ý*3 E�bb.äc Ait@h @?_ih?ih E�bbec �bbDc �bbHäc @?_ |üi týhñi)t M) 5L*?ð! E�bb�äc wiêðt E�bbDä

@?_ ïMt|ui*_ E�bbDäë Aüi øüL4i Mð@t< Tý33*i ðt T@h|ðUý*@h*) t|hð!ð?} ð? *ð}ü| Lu|üi *@h}i TL|i?|ð@* }@ð?t uhL4 ð?|ih?@|ðL?@* hðt!tü@hð?}c @t it|ð4@|i_ ië}ë M)ñ@? `ð?ULLT E�bbec �bbSc �bbbä @?_ ú|ü@?@tLý*ðt @?_ ñ@? `ð?ULLT E�bbb@äë

2 5ii îhi??@? @?_ ç@L E�bb.äc çLñ@* E�bbSäc @?_ Biühð} E�bbôä uLhð?uLh4@|ðL?íM@ti_ ð?|ihThi|@|ðL?t Lu |üi LMt|@U*it |L _ðñihtð�U@|ðL?ë

ô 6Lh ð?t|@?Uic |üi uh@U|ðL? |ü@| Ti?tðL? uý?_t @hi @**Lêi_ |L ð?ñit|@MhL@_ ü@t hðti? uhL4 �fI |L ôfI ð? a@T@? ð? �bHSc @?_ uhL4 �fI |L 2fIð? ç@?@_@ _ýhð?} �bbfí�bbDë `ð|üð? |üi ?iê iýhL 3L?ic Uýhhi?U)í4@|Uüð?}hý*it |ü@| @TT*ði_ |L Ti?tðL? uý?_t @?_ ð?týh@?Ui UL4T@?ðit ð? tiñih@* ,ýíhLTi@? ULý?|hðit @hi ?L *L?}ih Mð?_ð?}ë

e Aüi |êL T@Tiht _L ?L| UL4i |L |üi t@4i UL?U*ýtðL?ë îL||@33ðcèiti?|ð @?_ ñ@? `ð?ULLT E�bbSä �?_ @ t4@** üL4i Mð@t ð? LT|ð4@* TLh|uL*ðLtcêüð*i î@ |ih @?_ aih4@?? E�bb.ä hiTLh| @ *@h}i uLhið}? Mð@të Aüi 4@ð?_ðgihi?Ui Mi|êii? |üi |êL T@Tiht ðt |ü@| î@ |ih @?_ aih4@?? E�bb.ä @ttý4i@ t|LUü@t|ðU |hi?_ ð? ML|ü ê@}it @?_ ThL�|t |ü@| _ðgiht @UhLtt ULý?|hðitc êüð*iîL||@33ðc èiti?|ð @?_ ñ@? `ð?ULLT E�bbSä @ttý4i @ UL44L? |hi?_ @4L?}ULý?|hðit |ü@| _Lit ?L| @giU| ð?|ih?@|ðL?@* TLh|uL*ðL UüLðUië 6Lh @ |üiLhi|ðU@*týhñi) Lu ð?|ih?@|ðL?@* TLh|uL*ðL 4L_i*t êð|ü ?L?|h@_i_ *@MLh ð?UL4it tiiBüLtü @?_ èiti?|ð E�bbeäë

D OýMih4@? E�bb.ä _LUý4i?|t @ týMt|@?|ð@* üL4i Mð@t ð? U*@ð4t üi*_M) Në5ë ð?ñit|Lht L? +i}ðL?@* îi** ïTih@|ð?} çL4T@?ðitë 5Uüý*|3 E�bbSähiTLh|tc M@ti_ L? @ �bbS týhñi) Lu 2eS UL4T@?ðitc |ü@| eôI Lu 4L?i) ð?ñit|i_ð? _i�?i_ UL?|hðMý|ðL? T*@?t ðt üi*_ ð? i4T*L)ih t|LU!ë çLñ@* @?_ �LtULñð|3E�bb.ä �?_ |ü@| Në5ë ð?ñit|4i?| 4@?@}iht i üðMð| @ t|hL?} Thiuihi?Ui uLh*LU@**)íüi@_^ý@h|ihi_ �h4të 6ð?@**)c ú|ü@?@tLý*ðt @?_ ñ@? `ð?ULLT E�bbbMä�?_ |ü@| |üi t|@?_@h_ _iñð@|ðL? Lu _ðñð_i?_ ð?UL4i Lu t|@|i hitð_i?|t ðt L?*)t*ð}ü|*) *Lêih |ü@? |üi t|@?_@h_ _iñð@|ðL? Lu t|@|i ThL�|të 6Lh @ hiñðiê Lu|üðt *ð|ih@|ýhi tii OýMih4@? E2fffäë

S 5ii ië}ë ,*_Lhc èð?it @?_ 5Uüê@h|3 E�bHHäc 5|LU!4@? @?_ #i**@tE�bHbäc 5ihh@| E�bbSä @?_ î@ |ihc aih4@?? @?_ kð?} E�bbHäë 5ii @*tL |üi_ðtUýttðL? ð? ïMt|ui*_ @?_ +L}Lg E�bbSäc TTë ô2Síô2Hë

. 5ii uLh i @4T*i Ait@h E�bbôäc ïMt|ui*_ E�bbDä @?_ wiêðt E�bbDäëH Aüi i L}i?ið|) Lu |üi t|LUü@t|ðU ThLUitt uLh ?L?|h@_@M*it 4@) @Tí

Page 26: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

Ti@h TiUý*ð@hc T@h|ðUý*@h*) êüi? 7E|ä ðt ð?|ihThi|i_ @t *iðtýhië OLêiñihc tð?Uiêi @hi L?*) ð?|ihit|i_ ð? |üi ð4T*ðU@|ðL?t Lu Lýh 4L_i* uLh üL4i Mð@tc êð|üLý|*Ltt Lu }i?ih@*ð|) L?i U@? |üð?! Lu |üi ThLUitt uLh 5 @t |üi hitý*| Lu LT|ð4@**@MLh%*iðtýhi _iUðtðL?t @?_ Lýh T@h|ð@*íi^ýð*ðMhðý4 @?@*)tðt Lu LT|ð4@* TLh|íuL*ðLt @t UL?_ð|ðL?@* L? týUü _iUðtðL?të

b W? @ |iUü?ðU@* @TTi?_ð @ñ@ð*@M*i L? hi^ýit| êi tüLê |ü@| |üi 4L_i*U@? Mi }i?ih@*ð3i_ |L @UULý?| uLh |ð4iíñ@h)ð?} i TiU|i_ hi|ýh?të 6Lh ð?ít|@?Uic i TiU|i_ hi|ýh?t # @?_ #W U@? Mi 4L_i*i_ @t 4i@?íhiñih|ð?} ThLíUittitc t@)

_# E|ä ' ý& E# E|äý 7#ä _|n è_/E|ä

_#W E|ä ' ý& E#W E|äý 7#ä _|n èW_/WE|ä

êð|ü 7#c è @?_ èWUL?t|@?| TLtð|ðñi T@h@4i|ihtë N?_ih |üðt tTiUð�U@|ðL? @tüLU! _/ h@ðtit ML|ü |üi Uýhhi?| hi|ýh? @?_ |üi uý|ýhi i TiU|i_ hi|ýh? L?_L4it|ðU @tti|të Wu |üi i TiU|i_ hi|ýh? # ðt Uýhhi?|*) @MLñi ð|t *L?}íhý?@ñih@}i 7#c ð| ðt i TiU|i_ |L _iU*ð?ië

�f W? @ 4Lhi }i?ih@* ti|ýTc ð?ñit|Lht üi_}i @}@ð?t| @** tLýhUit Luý?Uih|@ð?|)c ?L| L?*) ?L?|h@_@M*it ãýU|ý@|ðL?të OLêiñihc ý?Uih|@ð?|) ð?t|@|i ñ@hð@M*it _ðgihi?| uhL4 ULý?|h)ítTiUð�U ?L?|h@_@M*it @giU|t ð?ñit|Lht<UüLðUit t)44i|hðU@**) @UhLtt ULý?|hðitë út @** ð?ñit|Lht êLh*_êð_i @_éýt||üiðh TLh|uL*ðLt |L üi_}i @}@ð?t| |üiti @__ð|ðL?@* }*LM@* tLýhUit Lu ý?Uihí|@ð?|)c ?L t)t|i4@|ðU üL4i Mð@t U@? @hðti @t @ hitý*| Lu týUü }*LM@* üi_}itë5ð4ð*@h*)c _ðgihi?Uit ð? i TiU|i_ hi|ýh?t # @?_ #W Etii ThiñðLýt uLL|?L|iä*i@_ ð?ñit|Lht Lu @** ULý?|hðit |L tüðu| |üiðh TLh|uL*ðL @**LU@|ðL?t |Lê@h_ |üiULý?|h) êð|ü |üi üð}üit| i TiU|i_ hi|ýh?c @?_ _L ?L| *i@_ |L @ t)t|i4@|ðU_ðgihi?Ui ð? TLh|uL*ðL tü@hit @UhLtt ð?ñit|Lht ð? _ðgihi?| ULý?|hðitë

�� 5ii ië}ë �ih|L? E�bbfäc W?}ihtL** E�bH.äc Uüë�ôc @?_ #ýæi E�bbSäcUüëbë

�2 5ð?Ui i^ýð*ðMhðý4 @tti| ThðUit @hi 4@h!i| U*i@hð?} @?_ ð? |üi @Mti?UiLu üL4i Mð@t @** @}i?|t üL*_ |üi t@4i TLh|uL*ðLc |üi uh@U|ðL? ð?ñit|i_ @| üL4iULhhitTL?_t |L |üi ñ@*ýi Lu |üi _L4it|ðU i^ýð|) 4@h!i| hi*@|ðñi |L |üi êLh*_i^ýð|) 4@h!i|ë Aüðt ðt êü) |üi M@ti*ð?i TLh|uL*ðL Lu 6ð}ýhi � _Lit ?L| _iTi?_L? |üi Uü@h@U|ihðt|ðUt Lu @tti| hi|ýh?të

�ô W?|ihThi|ð?} |üi uLhið}? ULý?|h) @t |üi hit| Lu |üi êLh*_c |üðt ðtð?_ii_ |üi }i?ih@* U@ti ð? Lýh i4TðhðU@* @TT*ðU@|ðL? Mi*Lêë

�e OL4L}i?ið|) ð4T*ðit |ü@| E�ýòäT ' T``nTffë #ðgihi?|ð@|ð?}êð|ü hitTiU| |L ` @?_ týMt|ð|ý|ð?} |üi hitý*| ð? E�fä )ði*_t E��äë

2e

Page 27: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

�D 5ýUü Thiuihi?Uit U@? Mi tL4iêü@| ThLM*i4@|ðU êüi? f _i?L|it*iðtýhië N?*itt " ' �c |üi �ht| Lh_ih UL?_ð|ðL? Lf*Lä ' R ðt ð?UL?tðt|i?|êð|ü i^ý@* t|i@_)ít|@|i }hLê|ü h@|it Lu hi@* ê@}it @?_ UL?tý4T|ðL? UL4Mð?i_êð|ü UL?t|@?| t|i@_)ít|@|i *iðtýhië ú*|üLý}ü |üiLhi|ðU@**) |üðt ðt @ UL?Uih?cuhL4 @? i4TðhðU@* ñ@?|@}i TLð?| ð| ðt êLh|ü ?L|ðUð?} |ü@| _ýhð?} Lýh t@4T*i|üihi ü@t Mii? @ |hi?_ ð?Uhi@ti ð? *iðtýhië Aüýtc uLh |üi t@!i Lu t)44i|h) êiü@ñi UüLti? |L @_LT| |üi t@4i Thiuihi?Uit ML|ü êüi? f _i?L|it *iðtýhi @?_?L?|h@_@M*it UL?tý4T|ðL?ë aih4@?? E�bbHä @_LT|t @ tð4ð*@h tTiUð�U@|ðL? LuUL?tý4T|ðL?%*iðtýhi Thiuihi?Uitë

�S 5ð?Ui ML|ü ð?t|@?|@?iLýt ý|ð*ð|) @?_ |üi ñ@*ýi uý?U|ðL? @hi üLí4L}i?iLýt Lu |üi t@4i _i}hii E� ý òä ð? |üiðh hitTiU|ðñi @h}ý4i?|tc |üiT@h|ð@* _ihðñ@|ðñit Lä @?_ T` @hi üL4L}i?iLýt Lu _i}hii ýò ð? |üiðh @hí}ý4i?|të ú*tLc LT|ð4@* UL?tý4T|ðL? Lu |h@_@M*it ðt üL4L}i?iLýt Lu _ií}hii � ð? f @?_ ` G uLh b : f êi ü@ñi Lä dbäc bfo ' b3òLä däcfo @?_T` db`c bfo ' b3òT` d`cfo( UüLLtð?} b ' �*` @?_ hiU@**ð?} |üi i?ñi*LTiUL?_ð|ðL? Lä ' T` êi U@? êhð|i Lä dä*`cf*` o ' T` d�c f*` oc êüðUüð4T*ðUð|*) _i�?it ä*` @t @ uý?U|ðL? Lu f*` ë

�. 5ii úTTi?_ð úë Aüi i ThittðL? E�ôä U@? Mi _ihðñi_ M) týMt|ð|ý|ð?}T ì )E5äf�3ò ð?|L E�fäc @?_ ýtð?} |üi hitý*| uhL4 _ðgihi?|ð@|ð?} Eúë2ä ð?|üi úTTi?_ð ë

�H Aüðt U@? @*tL Mi tii? uhL4 E�ôäc hi@*ð3ð?} |ü@| ð? |üðt U@ti ô êð**Mi @ UL?t|@?| @?_ |üýt ô â ' fë

�b 6Lh4@**)c ð| U@? Mi tüLê? |ü@| @? ð?�?ð|itð4@* ð?Uhi@ti ð? jf c üL*_íð?} jf*j- @?_ jf*j-W UL?t|@?|c ü@t @ tiUL?_ Lh_ih igiU| L? |üi ThLTi?tð|)|L UL?tý4i Lý| Lu êi@*|ü ô @?_ ð|t _ihðñ@|ðñi ô âë

2f îL|ü |üðt ThLLu @?_ |üi L?i 4i?|ðL?i_ ð? |üi ThiñðLýt uLL|?L|i @hið?U*ý_i_ ð? @ |iUü?ðU@* @TTi?_ð @ñ@ð*@M*i L? hi^ýit|ë

2� úýt|h@*ð@c îi*}ðý4c ç@?@_@c #i?4@h!c 6ð?*@?_c 6h@?Uic Bih4@?)cW|@*)c a@T@?c ûi|üih*@?_tc ûLhê@)c 5êi_i?c N?ð|i_ kð?}_L4c @?_ N?ð|i_5|@|itë

22 W? |üi uý?_@4i?|@* 4i@týhit êi L?*) UL?tð_ih U*@ð4t L? |üi |h@_i_}LL_t tiU|Lhc 4@!ð?} i@tðih |üi UL4T@hðtL? Lu Lýh hitý*|t êð|ü |üi �?_ð?}tM) Ait@h E�bbôc �bbDäë

2ô ï? |üi i4TðhðU@* @_ñ@?|@}it @?_ _h@êM@U!t Lu {-�c tii uLh ð?t|@?Uiçühðt|ð@?L E�bbfäë

2e 5ii îL||@33ðc èiti?|ð @?_ ñ@? `ð?ULLT E�bbSä uLh _i|@ð*të2D ï? |üi ?i}@|ðñi tð_ic MiU@ýti Lu |üi i4Tü@tðt L? @ T@h|ðUý*@h U*@tt

2D

Page 28: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

Lu �?@?Uð@* tiUýhð|ðitc |üðt 4i@týhi ðt *itt UL4Thiüi?tðñi |ü@? |üi �ht| |êLë2S Aüi ULý?|hðit @hi *ðt|i_ ð? |üi uLL|?L|i @MLñic i U*ý_ð?} úýt|h@*ð@

@?_ |üi 5U@?_ð?@ñð@? ULý?|hðitë2. 5L4i Lu |üi tiU|Lht _itUhðMi_ @t ?L?|h@_@M*it @MLñi @h}ý@M*) ü@ñi

týMt|@?|ð@* |h@_@M*it UL4TL?i?|të i Thiuih |L ihh L? |üi tð_i Lu @ MhL@_4i@týhi Lu ?L?|h@_@M*it ð? |üi Mi?Uü4@h! ð? Lh_ih |L }ðñi |üi ?L?|h@_@M*iti T*@?@|ðL? uLh üL4i Mð@t @t 4ýUü Uü@?Ui @t TLttðM*ië W? ti?tð|ðñð|) @?@*)tðtêi UL?tð_ih ñ@hðLýt ?@hhLêih 4i@týhit Lu ?L?|h@_@M*itë

2H ûL|i |ü@| |üi �ht| i*i4i?| Lu üæ U@? L?*) Mi ?L?í3ihL _ýi |L 4i@ítýhi4i?| ihhLhc êüð*i |üi tiUL?_ i*i4i?| U@? Mi ?L?í3ihL @t |üi UL4Mð?@|ðL?Lu ML|ü 4i@týhi4i?| @?_ i TiU|@|ðL?@* ihhLhtë W? UL4Tý|ð?} |üi tTiU|h@*_i?tð|) 4@|hð êi @ttý4i |ü@| M ðt tihð@**) ý?ULhhi*@|i_ E|üðt ðt |üiLhi|ðíU@**) |üi U@ti uLh |üi i TiU|@|ðL?@* ihhLhä @?_ |ü@| uLh @?) T@ðh Lu ULý?|hðitEðc æäc |üi ñiU|Lht üð @?_ üæ @hi ý?ULhhi*@|i_ë Aüðt ðt @TThLThð@|i uLh |üitiUL?_ i^ý@|ðL? MiU@ýti |üi _iñð@|ðL? Lu |üi ?@|ðL?@* hi|ýh? uhL4 |üi }*LM@*hi|ýh? ðt L? @ñih@}i ý?ULhhi*@|i_ @UhLtt ULý?|hðitc ThLñð_i_ |ü@| |üi ?ý4MihLu ULý?|hðit ð? |üi t@4T*i ðt týæUði?|*) *@h}ië ú*tLc |üihi ðt ?L @TT@hi?|hi@tL? êü) 4i@týhi4i?| ihhLht tüLý*_ Mi ULhhi*@|i_ @UhLtt ULý?|hðitë i*i| |üi ñ@hð@?Ui Lu üæ Mi ULý?|h)ítTiUð�Uë

2b 5ii �@?!ðêc +L|i4Mih}c @?_ 5ý44iht E�bHDäc ,ðUüi?M@ý4c O@?ti?c@?_ 5ð?}*i|L? E�bHHä @?_ èi?U@ñi* E�bHSäë

ôf 5ii uLh i @4T*i îLt!ð? i|ë@*ë E�bbSäc êüL hiTLh| |üi *@h}it| Mð@tð? @TT*ð@?Uit @?_ UL?tý4ih i*iU|hL?ðUtë

ô� wiêðt E�bbSä @*tL �?_t |ü@| |h@_@M*it @?_ ?L?|h@_@M*it UL?tý4Tí|ðL? @hi UL4T*i4i?|të

ô2 W| 4@) Mi @h}ýi_ |ü@| |üi Mð@t M@ti_ L? |üi t|LU! hi|ýh? ðt |LL t4@**MiU@ýti |üi t|LU! 4@h!i| ðt L?*) @ t4@** uh@U|ðL? Lu |L|@* �?@?Uð@* U@Tð|@*c*i@_ð?} ýt |L Lñiht|@|i |üi ñL*@|ð*ð|) Lu |üi hi|ýh? L? _L4it|ðU @?_ uLhið}?U@Tð|@*ë îý| êi �?_ |ü@| êüi? êi ýti |üi t|@?_@h_ _iñð@|ðL? Lu _L4it|ðU@?_ uLhið}? hi|ýh?t uhL4 |üi tiUL?_ uý?_@4i?|@*t hi|ýh? 4i@týhic @t êi**@t |üiðh ULhhi*@|ðL?c UL4Mð?i_ êð|ü |üi ULhhi*@|ðL?t Mi|êii? ?L?|h@_@M*it}hLê|ü @?_ t|LU! hi|ýh?tc |üi 4@ ð4ý4 üL4i Mð@t uLh |üi hiThiti?|@|ðñiULý?|h) hi4@ð?t fëf� uLh *iðtýhi @?_ 4@h}ð?@**) hðtit |L fëf2 uLh ?L?|h@_@M*itUL?tý4T|ðL?ë

ôô A@M*it êð|ü |üi hitý*|t uhL4 |üi ti?tð|ðñð|) @?@*)tðt @hi @ñ@ð*@M*iL? hi^ýit|ë

ôe Aüi hi*@|ðñi ThðUi R ðt i^ý@* |L Lf*Lä ' k E�ý kä3� E5*ô ä3�*"ë

2S

Page 29: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

�ý*|ðT*)ð?} M) f*ä ' 5*ô @?_ |@!ð?} |üi hiUðThLU@* )ði*_t 6E5ä ì ä*Rf '

E�ý käk3� dô E5ä *5oE�3�*"äëôD Aüi _i�?ð|ðL? Lu çüiM)tüiñ TL*)?L4ð@* uLh ð ' �c 2éééU ðt

úðE5ä ì ULtqEðý �ä @hUULt

k2 E5 ý 56ä E5� ý 56ä3� ý �

lrë

2.

Page 30: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

+iuihi?Uit

ú|ü@?@tLý*ðtc 5|iu@?Lc @?_ ,hðU ñ@? `ð?ULLTë RBhLê|üc N?Uih|@ð?|) @?_ +ðt!tü@híð?}ëâ aLýh?@* Lu �L?i|@h) ,UL?L4ðUt E�bbbäc uLh|üUL4ð?} E@äë

QQQQQQQë R+ðt!tü@hð?} `ð|üð? |üi N?ð|i_ 5|@|itG `ü@| O@ñi 6ð?@?Uð@*�@h!i|t @?_ 6ðtU@* 6i_ih@*ðt4 úUUL4T*ðtüi_qâc êLh!ð?} T@Tihc 6i_ih@* +iítihñi î@?! Lu ûiê vLh! E�bbbMäë

î@ |ihc �@hð@??ic @?_ NhM@? aë aih4@??ë RAüi W?|ih?@|ðL?@* #ðñihtð�U@|ðL? èý33*iðt Lhti |ü@? vLý Aüð?!ëâ ú4ihðU@? ,UL?L4ðU +iñðiê H. E�@hUü �bb.äc�.fí�Hfë

î@ |ihc �@hð@??ic NhM@? aë aih4@??c @?_ +LMih| Bëkð?}ë RûL?|h@_i_ }LL_tcûL?|h@_i_ u@U|Lhtc @?_ W?|ih?@|ðL?@* ûL?í_ðñihtð�U@|ðL?ëâ aLýh?@* LuW?|ih?@|ðL?@* ,UL?L4ðUt ee EúThð* �bbHäc 2��í2bë

îLt!ð?c �ðUü@i* aëc ,**i? +ë #ý*Mih}ihc +LMih| aë BLh_L?c ~ñð Bhð*ðUüitc #@*i aLhí}i?tL?ë RALê@h_ @ �Lhi úUUýh@|i �i@týhi Lu |üi çLt| Lu wðñð?}ëâ 6ð?@*+iTLh| |L |üi 5i?@|i 6ð?@?Ui çL44ð||ii uhL4 |üi ú_ñðtLh) çL44ð||ii |L5|ý_) |üi çL?tý4ih èhðUi W?_i c �bbSë

îL||@33ðc w@ýh@c è@L*L èiti?|ðc @?_ ,hðU ñ@? `ð?ULLTë R @}itc èhL�|tc @?_ |üiW?|ih?@|ðL?@* èLh|uL*ðL èý33*iëâ ,ýhLTi@? ,UL?L4ðU +iñðiê ef E6iMhý@h)�bbSäc 2�bí2Deë

îh@ð?@h_c `ð**ð@4 çëc aLü? îë 5üLñi?c @?_ w@ýhi?Ui iðttë RAüi 6ð?@?Uð@* V@*íý@|ðL? Lu |üi +i|ýh? |L ç@Tð|@*ëâ îhLL!ð?} è@Tiht L? ,UL?L4ðU úU|ðñð|) 2E�bHfäc eDôíD��ë

îhi??@?c �ðUü@i* aëc @?_ Oë Oi?h) ç@Lë RW?|ih?@|ðL?@* èLh|uL*ðL W?ñit|4i?| 6*LêtëâaLýh?@* Lu 6ð?@?Ui D2 E#iUi4Mih �bb.äc �HD�íHfë

çühðt|ð@?Lc w@ýhi?Ui aëë RçL44i?|â ð? ûî,+ �@UhLiUL?L4ðUt ú??ý@*c i_ð|i_ M)ï*ðñðih î*@?Uü@h_ @?_ 5|@?*i) 6ðtUüihc TTë 2�Sí2ôôë ç@4Mhð_}ic �úG �WAèhittc �bbfë

çLLTihc W@?c @?_ ,ñð k@T*@?ðtë RçLt|t |L çhLttMLh_ih W?ñit|4i?| @?_ W?|ih?@|ðL?@*,^ýð|) �@h!i| ,^ýð*ðMhðý4âc ð? +iUi?| ú_ñ@?Uit ð? çLhTLh@|i 6ð?@?Uic i_ð|i_M) ,_ê@h_ Wë ú*|4@? @?_ �@h|ð Bë 5ýMh@ü4@?)@4c TTë 2fbí2efë ç@4íMhð_}ic NëkëG ç@4Mhð_}i N?ðñihtð|) èhittc �bHSë

QQQQQQQë ROL4i îð@t ð? ,^ýð|) èLh|uL*ðLtc W?ã@|ðL? Oi_}ð?}c @?_ W?|ih?@í|ðL?@* ç@Tð|@* �@h!i| ,^ýð*ðMhðý4ëâ +iñðiê Lu 6ð?@?Uð@* 5|ý_ðit . E5Thð?}�bbeäc eDíSfë

çLñ@*c aLtüý@ #ëë RW?|ih?@|ðL?@* ç@Tð|@* 6*Lêt êüi? W?ñit|Lht O@ñi wLU@* W?uLhí4@|ðL?ëâ Lh!ð?} è@Tihc N?ðñihtð|) Lu �ðUüð}@? îýtð?itt 5UüLL*c �bbSë

2H

Page 31: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

çLñ@*c aLtüý@ #ë @?_ Aë �Lt!Lêð|3ë ROL4i îð@t @| OL4iG wLU@* ,^ýð|) èhiuihíi?Ui ð? #L4it|ðU èLh|uL*ðLtâc êLh!ð?} T@Tihc N?ðñihtð|) Lu �ðUüð}@? îýtð?itt5UüLL*c �bb.ë

#ýæic #@hhi**ë #)?@4ðU útti| èhðUð?} AüiLh)c èhð?Ui|L?c ûaG èhð?Ui|L? N?ðñihítð|) èhittc �bbSë

,ðUüi?M@ý4c �@h|ð? 5ëc w@ht èi|ih O@?ti?c @?_ ki??i|ü aë 5ð?}*i|L?ë Rú Að4i5ihðit ú?@*)tðt Lu +iThiti?|@|ðñi ú}i?| �L_i*t Lu çL?tý4T|ðL? @?_ wiðtýhiçüLðUi ý?_ih N?Uih|@ð?|)ëâ "ý@h|ih*) aLýh?@* Lu ,UL?L4ðUt �fô E6iMhý@h)�bHHäc D�í..ë

,*_Lhc +@u@i* ,ëc #@ñð_ èð?itc @?_ úMM@ 5Uüê@h|3ë ROL4i útti| èhiuihi?Ui @?_èhL_ýU|ðñð|) 5üLU!tëâ aLýh?@* Lu W?|ih?@|ðL?@* ,UL?L4ðUt 2D Eúý}ýt| �bHHäc�SDí�.Së

6hi?Uüc ki??i|ü +ëc @?_ a@4it �ë èL|ihM@ë Ra@T@?iti @?_ Në5ë çhLttíîLh_ih çL4í4L? 5|LU! W?ñit|4i?|tëâ aLýh?@* Lu |üi a@T@?iti @?_ W?|ih?@|ðL?@* ,UL?L4ðUte E#iUi4Mih �bbfäc e.Síebôë

6hi?Uüc ki??i|ü +ëc @?_ a@4it �ë èL|ihM@ë RW?ñit|Lh #ðñihtð�U@|ðL? @?_ W?|ihí?@|ðL?@* ,^ýð|) �@h!i|tëâ ú4ihðU@? ,UL?L4ðU +iñðiê H� E�@) �bb�äc 222í22Së

Biühð}c AüL4@të Rú? W?uLh4@|ðL? î@ti_ , T*@?@|ðL? Lu |üi #L4it|ðU îð@t ð? W?|ihí?@|ðL?@* ,^ýð|) W?ñit|4i?|ëâ 5U@?_ð?@ñð@? aLýh?@* Lu ,UL?L4ðUt bD E�bbôäcb.í�fbë

BüLtüc ú|ðtü +ëc @?_ è@L*L èiti?|ðë RW?|ih?@|ðL?@* èLh|uL*ðL çüLðUic Oý4@? i@*|ü@?_ BhLê|üG 5L4i èý33*it @?_ W?|ihThi|@|ðL?tëâ Lh!ð?} è@Tihc 6i_ih@*+itihñi î@?! Lu ûiê vLh!c �bbeë

BL*ýMc 5|iTüi? 5ëë RW?|ih?@|ðL?@* ç@Tð|@* �LMð*ð|)G ûi| ñihtýt BhLtt 5|LU!t @?_6*Lêtëâ aLýh?@* Lu W?|ih?@|ðL?@* �L?i) @?_ 6ð?@?Ui b E#iUi4Mih �bbfäce2eíeôbë

OýMih4@?c Býhë R6@4ð*ð@hð|) îhii_t W?ñit|4i?|âc êLh!ð?} T@Tihc çL*ý4Mð@ îýtðí?itt 5UüLL*c �bb.ë

QQQQQQQë ROL4i îð@t ð? ,^ýð|) �@h!i|tG W?|ih?@|ðL?@* @?_ W?|h@?@|ðL?@*,ñð_i?Uiâ ð? W?|h@?@|ðL?@* �@UhLiUL?L4ðUtc i_ð|i_ M) Bhi}Lh) Oitt @?_,hðU ñ@? `ð?ULLTc ûiê vLh!G ç@4Mhð_}i N?ðñihtð|) èhittc uLh|üUL4ð?}c2fffë

W?}ihtL**c aL?@|ü@? ,ëë AüiLh) Lu 6ð?@?Uð@* #iUðtðL? �@!ð?}ë AL|@ê@c ûaG +Lêí4@? @?_ wð||*i�i*_c �bH.ë

aih4@??c NhM@?ë RW?|ih?@|ðL?@* èLh|uL*ðL #ðñihtð�U@|ðL? @?_ ,?_L}i?Lýt w@MLh5ýTT*) çüLðUiâc êLh!ð?} T@Tihc `ü@h|L? 5UüLL*c �bbHë

2b

Page 32: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

aý__c ki??i|ü wë RèhLéiU|ðL? �i|üL_t uLh 5L*ñð?} ú}}hi}@|i BhLê|ü �L_i*tëâaLýh?@* Lu ,UL?L4ðU AüiLh) DH E#iUi4Mih �bb2äc e�fíeD2ë

k@?}c aý?íkLLc @?_ +i?i �ë 5|ý*3ë R`ü) ðt Aüihi @ OL4i îð@tq ú? ú?@*)tðt Lu6Lhið}? èLh|uL*ðL ,^ýð|) ïê?ihtüðT ð? a@T@?ëâ aLýh?@* Lu 6ð?@?Uð@* ,UL?L4ðUteS EïU|LMih �bb.äc ôí2Hë

wiêðtc k@hi?ë Rèý33*it ð? W?|ih?@|ðL?@* 6ð?@?Uð@* �@h!i|tâc ð? O@?_MLL! LuW?|ih?@|ðL?@* ,UL?L4ðUtc ñL*ë WWWc i_ð|i_ M) Bi?i BhLtt4@? @?_ ki??i|ü+L}Lgc TTë �b�ôí�b.�c ú4t|ih_@4G ûLh|ü OL**@?_c �bbDë

QQQQQQQë R`ü@| ç@? , T*@ð? |üi úTT@hi?| w@U! Lu W?|ih?@|ðL?@* çL?tý4Tí|ðL? +ðt! 5ü@hð?}qâ aLýh?@* Lu èL*ð|ðU@* ,UL?L4) �fe EúThð* �bbSäc 2S.í2b.ë

�@?!ðêc ûë Bhi}Lh)c aý*ðL aë +L|i4Mih} @?_ w@êhi?Ui Oë 5ý44ihtë RW?|ih|i4íTLh@* 5ýMt|ð|ý|ðL? ð? �@UhLiUL?L4ðUtëâ "ý@h|ih*) aLýh?@* Lu ,UL?L4ðUt �fE6iMhý@h) �bHDäc 22.í2D�ë

�ih|L?c +LMih| çëë çL?|ð?ýLýtíAð4i 6ð?@?Uië ç@4Mhð_}ic �úG î@tð* î*@U!êi**c�bbfë

ïMt|ui*_c �@ýhðUië RW?|ih?@|ðL?@* ç@Tð|@* �LMð*ð|) ð? |üi �bbftâc ð? N?_iht|@?_ð?}W?|ih_iTi?_i?UiG Aüi �@UhLiUL?L4ðUt Lu |üi ïTi? ,UL?L4)c i_ð|i_ M) èií|ih ki?i?c èhð?Ui|L?c ûaG èhð?Ui|L? N?ðñihtð|) èhittc �bbDë

ïMt|ui*_c �@ýhðUic @?_ ki??i|ü +L}Lgë 6Lý?_@|ðL?t Lu W?|ih?@|ðL?@* �@UhLiUL?L4ðUtëç@4Mhð_}ic �úG �WA èhittc �bbSë

èi?U@ñi*c aLü?ë Rw@MLh 5ýTT*) Lu �i?G ú 5ýhñi)âc ð? O@?_MLL! Lu w@MLh ,UL?L4ðUtVL*ë WWc i_ð|i_ M) ïh*i) útüi?ui*|ih @?_ +ðUü@h_ w@)@h_c ú4t|ih_@4G ûLh|üíOL**@?_c �bHSë

5Uüý*|3c ,ëë R Lh!iht èý| ALL�ýUü ð? Aüiðh ,4T*L)ih<t 5|LU!âc @** 5|hii| aLýh?@*c5iT|i4Mih �ôc �bbSë

5ihh@|c ú?}i*ë Rú #)?@4ðU ,^ýð*ðMhðý4 �L_i* Lu W?|ih?@|ðL?@* +ðt!í5ü@hð?} èý3í3*itëâ Lh!ð?} è@Tihc N?ðñihtð|) Lu çüðU@}Lc �bbSë

5L*?ð!c îhý?Lë W?|ih?@|ðL?@* W?ñit|4i?|të +i@_ð?}c �úG ú__ðtL?í it*i)c �bb�ë5|LU!4@?c ú*@? çëc @?_ O@hhðt #i**@të RW?|ih?@|ðL?@* èLh|uL*ðL ûL?í_ðñihtð�U@|ðL?

@?_ , Uü@?}i +@|i V@hð@Mð*ð|)ëâ aLýh?@* Lu W?|ih?@|ðL?@* ,UL?L4ðUt 2S E�@)�bHbäc 2.�íHbë

Ait@hc wð?_@ë RW?|ih?@|ðL?@* +ðt!ítü@hð?} @?_ ûL?|h@_i_ BLL_tëâ aLýh?@* LuW?|ih?@|ðL?@* ,UL?L4ðUt ôD Eúý}ýt| �bbôäc SbíHbë

Ait@hc wð?_@ë R,ñ@*ý@|ð?} B@ð?t 6hL4 W?|ih?@|ðL?@* +ðt!tü@hð?}ëâ ç@h?i}ði +LUüit|ihçL?uihi?Ui 5ihðit L? èýM*ðU èL*ðU) e2 Eaý?i �bbDäc bDí�eôë

Ait@hc wð?_@c @?_ W?}hð_ ih?ihë RW?|ih?@|ðL?@* ,^ýð|) Ah@?t@U|ðL?t @?_ N5 èLh|uLí

ôf

Page 33: ç@??L?|h@ @M*it}i?ih@|ipeople.virginia.edu/~ev4n/papers/benchm17.pdf · œThð*2fff WZh wkdqn wzr dqrq|prxv uhihuhhv/ Mrqdwkdq Hdwrq/ Uh{ Jkrvk/ Qhovrq Pdun/ Nhq Urjrò/ dqg vhplqdu

*ðL çüLðUiâc ð? Aüi W?|ih?@|ðL?@*ð3@|ðL? Lu ,^ýð|) �@h!i|tëc i_ð|i_ M) aighi)úë 6h@?!i*c TTë �HDí2�Sc çüðU@}LG N?ðñihtð|) Lu çüðU@}L èhittc �bbeë

Ait@hc wð?_@c @?_ W?}hð_ ih?ihë ROL4i îð@t @?_ Oð}ü Aýh?Lñihëâ aLýh?@* LuW?|ih?@|ðL?@* �L?i) @?_ 6ð?@?Ui �e Eúý}ýt| �bbDäc eS.íeb2ë

Ait@hc wð?_@c @?_ W?}hð_ ih?ihë RAüi W?|ih?@|ðL?@*ð3@|ðL? Lu 5iUýhð|ðit �@h!i|t5ð?Ui |üi �bH. çh@tüëâ îhLL!ð?}t è@Tiht L? 6ð?@?Uð@* 5ihñðUitc �ðUüð}@?GN?ðñihtð|) Lu �ðUüð}@?c �bbHë

ñ@? `ð?ULLTc ,hðUë R i*u@hi B@ð?t uhL4 W?|ih?@|ðL?@* +ðt!tü@hð?}ëâ aLýh?@* Lu�L?i|@h) ,UL?L4ðUt ôe EïU|LMih �bbeäc �.Dí2ffë

ñ@? `ð?ULLTc ,hðUë Rú �ý*|ðíçLý?|h) +i@* îýtð?itt ç)U*i �L_i* êð|ü Oi|ihL}ií?iLýt ú}i?|tâc 5U@?_ð?@ñð@? aLýh?@* Lu ,UL?L4ðUt bH Eaý?i �bbSäc 2ôôí2D�ë

ñ@? `ð?ULLTc ,hðUë ROLê îð} @hi èL|i?|ð@* B@ð?t uhL4 W?|ih?@|ðL?@* +ðt!tü@hð?}qâaLýh?@* Lu W?|ih?@|ðL?@* ,UL?L4ðUt e. E6iMhý@h) �bbbäc �fbí�ôDë

ô�