21

K - Machine Intelligence Laboratorymi.eng.cam.ac.uk/reports/svr-ftp/auto-pdf/rummery_tr166.pdf · k ! #"$ # % '& ( ) +* l+)@t,.-0/ %24ac3bp>@bp[12121312121412121312141212131212131212141212131212141213121213121214121

Embed Size (px)

Citation preview

����������� �������������������������

�������������� �!��� �"�#�%$��"���&'�

(!)+*,).-0/+1!1�2436587:9;)=<?>@3�ACB D�ACB�����E�F=GH�����G?I����F=�J�LK=MNM

OP24QPR�241,S+243JT4UCUWV

X0AC1,S+36>ZY+[C2,\IBP>Z]C243_^�>ZR`5�a�BP[b>cBP2243_>cBP[�de24Q+Ab36Rf1,24BbRg 3h/+1!QP>@BP[CR�ijB�OPRf3622RX0AC1,S+36>ZY+[C2�X0kHl�T m�n

a�BP[Co@ACBPY

a�1!Ap>qosrt[jAC3�u�24BP[N)wv4AC1�)xApvC)x/+y.zPBP>@3�ACB D�ACB+u�24BP[.)wv4AC1�)xAWvC)x/+y

����������� ������������������������ �"!#�%$ �&�'�#�'()$!#(*���&�#��+'��,"$�&�-$/.0�12���3��4'!5�6$ �7+'�#�'�8!#�%$���'�#�'()�����7+'�'�#9:4'��;

<=�12��>*���%?@��4'�7+A����&+'�B12�*�&C8�*�D�&+'��,��6$ !�(*��������+'��,=+�$,FE������-G'��>*��!#��.0��GD1��#�&+D����( $ �&GD�&�G'�#,����&�����IH0�'�#�&�7J3,&�7$�&�5K8$��C��>:�L$��.'����E'!#���B,%?:1�+'�#�7+"��,����:���&��,��&�&�#�����#>��F�������"$�:MN���%$!OJ312�*�&!#G���:>:�#�&�*�'�����:��,%;@P�+'���&�Q��������?0���R�#,�G'��,����7$E'!#�S�&����T �����'G8��+'��,��I������+'�:G',R�&��+'�#(�+BG'�#�����U,&�#����$ !���*�:�&�#�:4'��4',S,��V$���7J3,&.�$ ����,%?R1�+'�#�7+A�&��9:4'�#�&��,N��+'��4',�����R��4'�'���&�#���-$ .'.'�&�T:�#�6$ �&�#���"���6(*���'���WJ$ !��#,��2��+'�X�#�:���*�&�"$�&�#�*�Y!#�%$ �&�:�RE M5�&+U��,&M:,&�����Z;\[3����+'�#,��&��.0�����%?:��+'�X4',��X� �]E�$ �7C�J3.'����.�$ ( $���#����'��4'�V$ !��'���312�*�&C:,Y^_��4'�B��!#+�$���%?�<X�#�:�&�*��$�'G�`a��!#!#�L$��,�b�c�d�e*f@��,g�����',��#G'���&��G6�#����+'�#,������:����T:�%;

`D�S�����U,&�#G'���S$5� 4U��E������ ��G'�Oh]�������:�Y$ !�(*��������+'��,gE�$,���GZ$����4'�UGZijJWkl�%$���'�#�'(8^L`-$ �&C:�#�',b�c�d�c*f=������E'�#�'��GZ1��#�&+A�&+U��P\����.0���7$!�m=�Oh]�������'���"$!#(��*�&�#�&+U�n^�o�4'�&�����)b%c*d�d*f�?p�#�'��!#4'GU���U(q$�'��1r$ !#(������#�&+'�s^_K"�:G'�OH���G-tR���U�'���������*�'�#,&�NijJ&kp�%$ �&�'�#�'(:f�?\$�'GDi5^�u0f�^_v@���'(Z$ �'GD`)�#!#!��L$ ��,b�c�cw:f�;S[3�D$G'GU�����#���x?01R�N.'����,&��� ��$!#(*���&�#��+'��,R���*�Y$ .'.'!#M:���U(��&+U��,&��4'.0G�$ �&��,I�*�:J3!��#�'�FG'4'�&�#�'(���&�L$!#,%?U4'�'!#�#C��SE�$ �VC:1�$��G6����.'!L$�M"4',&��GZE:M6kl�#�y^�b%c*c�z�fR��+�$�=�&��9:4'�#����,S1{$ �����#�'(N4U� ���#!x�&+U�I���'G� �|�%$ �V+"���&�L$!pE0�7���*�&�I4'.0G�$ �&�#�'(5�%$�"�:����4'��;2}=�:J3!#���U�Y4U.�G�$ �&�#�'(5�#,R����4'�UG��&��E0�I�B���&������E'4U,&����N��+'�S�V+U���#���S��\�&�V$ �#�'�#�'(N.0$�V$ ���������&,R�&+0$�"E�$�7C:1�$�&GB�&��.U!~$�M:?'$�UG6$!#,��N���0$E'!#��,���+'�I$!#(�� J������+'��,R�&��E0�S4',&��G8�#�6�����:�&�#�:4'��4U,&!#M��*.����7$�����U(�,&M:,&������,�1�+'���&�I�'�����'G8��\�&���~$ !p�����UG'�#�&�#���',�:����4U�%;

`D�5�����B.�$���N��+'��.����3���*�&�6$ �'���5����&+'��,&�6$ !#(������#�&+'�B,����D$����%$!#�#,&���#�N����E0���I��$�>:�#( $ �&�#���.'����E'!#���A?:1�+'������$�,&�#��4'!L$ �&��GB����EU��!#�=�&��E0���=�#,Y���V$ ���U��G8�&�B(�4'�#G'�F����,&��!O�2���6$�(�� $ !x.0��,������#����#�A�&+'��.'����,&���'���"��2�*E',&�7$��!#��,�;�P�+U���&��E0���S��4',��X����!#MZ�*�Z!#�#���#�&��G6,����',����&MA�_����G'E�$ �7C8��������#�&,S,�4'�&����4'�'GU���U(�,%?\$�UG8�6$ C��IG'�����#,&�#���',F�&+�$ �Y��$�AE���(*���'���7$!#�#,&��GA�&�8$��E'�#�&�7$�&M�!~$�M*��4'��,S���*E',&�7$��!#��,�;

P�+'��,���,�����4U!~$ �&�#���U,�,&+'�1��&+�$ �I���:J3!#�#�'�N!#�%$ �&�'�#�'("$!#(��*�&�#�&+U��,Y$ �&��!#��,�,I,&���U,&�#�&�#>������"�&+'��7+'�*�����I����&�7$�#�'�#�'(�.�$ �V$ ���������&,=�&+�$ �8E�$�7C:1�$�&G��&��.'!L$�M:?�$ �'G"�&+�$ �X�&+U��$ !������&�0$�&�#>*�Y4U.�G�$ �&���4'!#��,����K8t�ijJWkD$ �'G8iN^_u�f=$���Y�B�����X�&�*E'4',����&+�$ �6,��V$ �'G�$��GZijJ�!#�%$ �&�'�#�'(54'.0G�$����,%;

T

�������������

K ���� ����������� ������ �

� �������� !�������#"$�#�� �%�'&��(���)�+* �l+)@T ,.-0/%24AC3�BP>@BP[ 12121312121412121312141212131212131212141212131212141213121213121214121 Vl+)xl g 241�Q+ij3�Apo de>65"243624BPv27/%24AC3�BP>@BP[8141212131212131212141212131212141213121213121214121 Vl+):9 a�;+QPoZij3�AWR�>ZijB<12121312121412121312141212131212131212141212131212141213121213121214121 V

� �3���=�+�>�� ��������@?A ��������B&��(�C���+* D9+)@T XHij1,SP>@BP>@BP[E,.-0/%24Ab3�BP>@BP[�ACBPY g 241�Q+ij3�Apo"de>65�243_24BPv23/%24AC3�BP>@BP[F1213121213121214121 G9+)xl 9�ijY+>6H.2Y X ijB+BP2vR�>ZijBP>Z^�R2,.-0/%24AC3�BP>@BP[I131212131212141212131212141213121213121214121 J9+):9 ,�K!L�MN1412121312121312121412121312141212131212131212141212131212141213121213121214121 O

P �Q�%�SRT���+� ���B&��(�C����* U

D �7V+� ���+W=�� YX3����W=RZ�#" [G+)@T g�\ 2�-HijS iCRIatBC]P>@36ijB+1,24BbRN121312141212131212131212141212131212141213121213121214121 UG+)xl a�;+Q+2436>@1,24BbRfAWo de2RfAW>ZoZ^E1412121312141212131212131212141212131212141213121213121214121 T�]G+):9 -H2^f/PoZR�^^12121312121312121412121312141212131212131212141212131212141213121213121214121 TCTG+)wV kt2^�RIXHijBbRf36ibo m iCoZ>Zv5$121412121312141212131212131212141212131212141213121213121214121 T�G

M EY�T?��B��?�?������_�# �`�>?a�CR� �? K+MJ+)@T b024/+3_>q^hR�>Zv�m AC3�Ab1,2R�2436^c1412121312141212131212131212141212131212141213121213121214121 T�JJ+)xl deB(- oZ>cBP2,]�kHAWvyfe0AC3_Y8-H24QPo@A 5g12141212131212131212141212131212141213121213121214121 T�OJ+):9 XHij1!Q+Ab36>Z^�ijB�i�h \�Q+Y.ApR�2�-0/PoZ2^ 141212131212131212141212131212141213121213121214121 T�O

U �3�����fR��C?��Z�i�C? K�j

� �3&�R@�B�CR�&� �����* ^RT��*��@Wk�@R@�Z Al �m��&����>? K�[

l

� � ������������=��S�2�9�/Pv \ i�h R \ 22e iP3�yJY+ijBP2e>@B�R \ 2e362>@B(h iP36v241,24BbR0oZ24AC3�BP>@BP[ oZ>ZR�243�ApRf/+362�/P^�2^0Y+>Z^�v43_2R�2e^�RfAWRh2 - ^fQ+AWv2^4ze0>ZR \ oZi�e Y+>c1�24BP^�>ZijB+AWo�>@B+Q+/PR - ^ Q+AWv2^4) g.\ >q^J>Z^�S+2v4Ab/P^�2!v4/+3�3624BbR�362>@B(hsij36v241,24BbR�oZ24AC3�BP>@BP[ AWoZ[Ci�-36>ZR \ 1,^e362 �=/P>@362J2A;jRh24BP^�>Z]C2!3624Q+24AWRh2Y�^�24AC3_v \ 2^�i�h R \ 2�^�R AWR�2 - ^fQ+AWv2e>@B�ij36Y+243 R�i Q+36ijQ+Ap[jAWR�2e>@B(hsij3!-1!AWR�>ZijB;ACS ij/PR!R \ 2�Q+A 5Cia5�^,A ] AW>Zo@ACSPoZ2CzIACBPY;^hi ^f1!AWoZoZ243�^�RfAWR�2 - ^ Q+AWv2^,v4ACB;S+2�2A;=AC1�>cBP2Y 1,ij36224AW^�>ZoZ5C);*IoZ^�iNz=h 3_ij1 A�R \ 2ij362Rh>qv4Apo Q iC>@BCR�i�h ]P>Z2Ae�ztR \ 2 iPBPoq5 Q+3_iji�hs^,i�hIvijBb]C2436[b24BPv2�A4]WAW>Zo@ACSPoZ2h ij3?362>@B(h ij3_v241,24BCReoZ24AC3hBP>cBP[�Apoq[bij36>ZR \ 1,^eAC362�S+AW^h2Y iPB�>@B(h iP3�1!AWR�>ZijB�S+2>@BP[�^�R�iP362Y�2A;+QPoZ>qv>ZR�oZ5 AWR24AWv \ ^�R AWR�2C)2b0i�eH2]C243zN>ZRe>Z^eY+2^�>@3�ACSPoZ2 Rhi 2A;PR�24BPY 362>@B(h iP36v241,24BbR�oZ24AC3�BP>@BP[ Apoq[bij36>ZR \ 1,^�R�iYeHij3�y2�� v>Z24BCR�oZ5�>@B�o@AC36[C2,^�R AWR�2 - ^fQ+AWv2^ z+e \ >Zv \ 362 �+/P>@362^����������������� ��� �"!���R�i8S 2!/P^�2Y R�i�^fQ+3624AWY�>@B(hsij3!-1!AWR�>ZijB�S 2R0eH224B�^�>@1,>Zo@AC30^hRfAWR�2^4z+ACBPY \ 24BPv2�3_2Y./Pv2�R \ 2eAC1,ij/+BbRHi�h >@B(hsij3�1!AWRh>qiPB�R \ AWR01,/P^�R0S+2viCoZoq2vRh2Y") g�\ >Z^0>Z^I2^fQ 2v>@AWoZoq5�>@1!Q ij36RfACBbRH>@B�R \ 2Jv4AW^�2ei�h$#%!&��� �"��'�!�'��(� � ��� � )*�,+-��#%�.� zBe \ 243_2�R \ 24362AC362H2 5"2vR�>Z]C2oZ5 ACBJ>@B(H BP>qRh2�Bj/+1,S+243 i�h ^hRfAWR�2^4zWACBPY!R \ 2IQ+36ijS+ACSP>ZoZ>ZR65!i�h 2]b243 362Rf/+3�BP>@BP[�Rhie2A;=AWvRhoq5R \ 2�^fAb1,2�^�R AWR�2e2]C243�AW[jAW>@B�>Z^�BP2[CoZ>Z[C>@SPoZ2C)/ B�R \ 2^�2�v4Ap^�2^4zN[C24BP243�AWoZ>Z^fAWR�>ZijB�i�h�2A;+Q+243_>q24BPv2�>q^eBPiCRijBPoZ5�Y+2^�>@3�ACSPoZ2Cz S+/PReA,BP2v2^�^�>ZR65C)/ B R \ >Z^!3624Q+iP36R4z�eH2!2A;+AC1,>@BP2�R \ 2�/P^�2�i�h102��# 3�)�+4��!�+-� �5��� �"!��6�7��'��8�&�9�7��� :;!��23��eR�i�^�R�ij3_2 R \ 2>cB(hsij3�1�AWR�>ZijB�oZ24AC3�BbRISb5!R \ 23,.- oZ24AC3�BP>@BP[�AWoZ[Cij36>ZR \ 1 K=< AWRfyb>@BP^�T4U�>CU(M)k/%>@B K6T4UCUf9(M 2A;+AC1,>@BP2Y�R \ 2/P^�2�i�h�BP24/+3hAWo BP2R eHij3�yb^!>@B R \ >Z^�vijBbR�2A;jR z0ACBPY Q+36iW]P>ZY+2Y Apoq[bij36>ZR \ 1,^`h iP3,Rf3�AW>@BP>@BP[ S+AW^�2Y ijBR \ 2 >ZY+24A�i�h?02��# 3@:;����AB����+4����CWz=e \ >Zv \ >@BC]biCoZ]C2^,^�R�ij36>@BP[�R \ 2!^hRfAWR�2 -`AWvRh>qiPB Q+AW>@36^,]j>Z^�>ZR�2Y Sb5 R \ 2^�5j^hR�241 /+BbR�>Zo R \ 2J24BPY iah A!Rf3_>cApoke \ 24B�R \ 2!362Ae0AC3_Y+^IAC362!yPBPi e�B%z ACBPY�R \ 24B�3624QPo@A 5j>@BP[�R \ 241 >@B362]C2436^�2�ij36Y+243JR�i�Rf3�AW>@B R \ 2�BP2R eHij3�yN)D/ B R \ >Z^ 3_24Q+ij36R z \ i�eH2]C243z=eH2 \ A4]b2 2A;+AC1,>@BP2Y;R \ 2�/P^�2i�h�Apoq[bij36>ZR \ 1,^!R \ AWR,v4ACB;S+2�ACQ+QPoZ>q2YE!��F)8���"���4z >cB R \ 2�^�24BP^�2�R \ AWR!R \ 2�/+Q Y.AWR�2^!R�i R \ 2�BP24/+3�AWoBP2R0eHij3hyC^�AC3_2 1!ApY+2IAWR�24Apv \ R�>@1,2�^�R�24Q,Y./+36>@BP[!R \ 2IRf3_>cApo zBe0>ZR \ iP/PR�R \ 2eBP22Y Rhi�^�R�iP362IACBb5,^�RfAWR�2 -AWvR�>ZijBe>@B(hsij3�1!ApR�>ZijB%)G< 2�^ \ i�e R \ AWR >@B�viP1!Q+AC36>Z^�ijB�e0>ZR \ S+AWvyfe0AC36Y�3_24QPocA 5CzWijB(- oZ>@BP2I/+Q Y.AWR�2^�AC362S+2R�R�243?AWR0vijBb]C2436[C>@BP[!Rhi!ijQPR�>@1!AWo"Q iCoZ>qv>Z2^Ji ]b243 A e0>ZY+243I3�AbBP[C2ei�h Rf3�AW>@BP>@BP[ Q+AC3�Ab1,2R�243H]WAWo@/P2^4)< 2,AWoZ^�i 2A;+AC1,>@BP2,iCR \ 243 h ij3h1,^Iiah /+Q Y.AWR�2!3�/PoZ2,R \ ACB�R \ 2�^�RfAbBPY.AC36Yc,.- oZ24AC3�BP>@BP[ Apoq[bij36>ZR \ 1�z>cBbRf36iPY./Pv>@BP[ A�BP2Ae Apoq[bij36>ZR \ 1 e \ >qv \ e 2�v4AWoZo�9�ijY+>6H.2Y;XHijB+BP2vR�>ZijBP>Z^�R�,.-0/%24Ab3�BP>@BP[.z�ACBPY 2A;(-R�24BPY+>@BP[c,�K!L�M3Ksm 24BP[ ACBPYH< >qoZoZ>@AC1,^!T4UbUWV'M%h iP3I/P^�24e0>ZR \ viPBCR�>@BP/Pij/P^.h /+BPvR�>ZijB�ACQ+Q+36i�;P>c1�AWR�ij36^ )g�\ 2 AWoZ[CiP36>ZR \ 1,^ AC362 241!QP>@36>Zv4AWoZoZ5,R�2^�R�2YJijB�A01�ijSP>Zoq2036iPS+iCR Q+3_ijSPoZ241�z�e \ 24362HA0^�>@1,/Po@AWR�2Y,1,ijSP>ZoZ236ijS+ibR0>Z^0Rf3�AW>@BP2Y�R�i![j/P>ZY+2�>ZR�^h2o:h�Rhi�A�[CijAWo"Q+ib^�>ZR�>ZijB�>cB�A,lWd 24BC]P>@36ijB+1,24BbR4)

g�\ 2 3_241!AW>@BPY+243Ji�h R \ >Z^,3624Q+ij3_R�>Z^,ij36[jACBP>Z^�2Y AW^^h iboqoZi�e0^4rJ^�2vR�>ZijB l�>@BCR 36ijY./Pv2^,R \ 2�S+AW^�>Zv^i�h�362>@B(hsij36v241,24BbR�oZ24AC3hBP>cBP[ ACBPY ,.- oq24Ab3�BP>@BP[.z�^h2vR�>ZijB 9 Y+>Z^�v4/P^�^�2^�vijB+BP2vRh>qiPBP>q^hR ,.- oZ24AC3hBP>cBP[ACBPY�>cBbRf36iPY./Pv2^�R \ 2 AWoZR�243�B+AWRh>q]b2�/+Q Y.AWR�2 3h/Poq2^ z ACBPY�^�2vR�>ZijB�V�2A;=QPo@AW>@BP^�R \ 2!ijB(- oZ>@BP28/+Q Y.AWR�>@BP[AWoZ[Cij36>ZR \ 1�)tOP2vR�>ZijBP^ G!ACBPYcJ,Q+362^h24BCR0R \ 2�362^f/PoZR�^IACBPY�Y+>Z^�v4/P^h^�>ZijBP^ei�h R \ 2e2A;+Q+243_>c1�24BCR�^�ijB�R \ 236ijS+ibRIQ+36ijSPoZ241�z.AbBPYYH B+AWoZoZ5�^�2vR�>ZijB O,[C>Z]C2^0R \ 2eviPBPvoc/P^h>qiPBP^4)

I J �K �ML��$�N���PO �m���EQY�KRP�k� �S/ B!362>@B(hsij36v241,24BbR�oZ24AC3hBP>cBP[!Q+36iPSPoq241�^4z+A�^�v4AWo@AC3 ] Apoc/P2�v4AWoZoZ2Y�AT+U��C@!�V >Z^ 362v2>Z]C2Y�SC5JR \ 20vijBbRf36ibo^�5j^hR�241 h iP3 Rf3�ACBP^�>ZR�>ZijBP^=h 36ij1 iPBP2 ^hRfAWR�2HR�ieACBPiCR \ 243 ) g.\ 2IAW>@1 i�h R \ 2 ^h5j^�Rh241 >q^tR�i^H BPY A�vijBbRf36iboQ+iCoZ>Zv5Ye \ >Zv \ 1�A�;j>@1,>Z^�2^?R \ 2I2A;+Q+2vRh2YYh /PRf/+362�Y+>q^hvij/+BCRh2Y�^f/+1'i�h Q+A 5Ci�5"^ 3_2v2>q]b2Y"z.yjBPi�eIB�AW^R \ 2������ '��%�N)

g�\ 2�W�����'5�YX '5�7#�� �"!��!>Z^eA!Q+362Y+>ZvR�>ZijB�i�h R \ 2,362Rf/+3�B�A ]WAW>ZocAbSPoq24h 36ij1'24AWv \ ^�RfAWRh2Cz

Z K"[]\ MY^`_ba6cde%f7g�h e i \kj e5l K6T�M

e \ 24362 i \ >Z^0R \ 2�Q+A 5Ci�5 362v2>Z]C2YYhsij3tR \ 2eRf3hACBP^�>ZR�>ZijB`h 36ij1'^�RfAWRh2I]C2vRhij3Y[N\ Rhi?[]\kj]m ACBPY h >Z^IR \ 2A���� #�!�'5�7�7Xn��#�� !�� K�]po h o T�M)�<0ibR�2�R \ ApR Z K"[N\)M0R \ 243_2 h ij3_2�3624Q+362^h24BCR�^�R \ 2JY+>q^hvij/+BCRh2Y ^f/+1 i�h

9

Q+A45bi�5"^ 362v2>Z]C2Y h 36iP1 R�>@1,2e^�Rh24Q��(!���:;����A@�z+ACBPY�R \ AWRtR \ >Z^0^f/+1 e?>qoZo"Y+24Q 24BPY�ijB�R \ 2�^�2 �+/P24BPv2i�h�ApvR�>ZijBP^!RfACyp24B K R \ 2�Q+iboq>Zv5�M) g�\ 2�vijBCR 36iCoH^�5P^�R�241 >Z^8362 �+/P>@362Y R�i H BPY R \ 2�Q+iCoZ>Zv5 e \ >qv \1!A�;P>c1�>q^h2^ Z K"[N\)MH>@B�24Apv \ ^�R AWR�2C)

����� ��� �������������/ B�� )����%�������"����K"< ApRfyC>@BP^�T U�>CUfM R \ 2e>ZY+24A!>Z^�R�i,oq24Ab3�B�� ) X '5�7#�� �"!��.z e \ >Zv \ >Z^eA!Q+362Y+>ZvR�>ZijB�iah R \ 2362Rf/+3�B�AW^�^hijv>@AWR�2Y e0>ZR \ 24AWv \ AWvRh>qiPB������ >@B�24AWv \ ^�RfAWRh2C) g�\ >Z^�Q+362Y+>ZvR�>ZijB v4ACB�S+2 /+Q Y.AWR�2Ye0>ZR \ 362^ Q+2vR0R�i�R \ 2�Q+362Y+>ZvR�2Y 362Rf/+3�B�iah R \ 2�BP2A;PR0^�R AWR�2e]P>q^h>qRh2Y"z

EK=[N\"!#��\)MY^ i \�$ h Z K"[N\kj]mSM Ksl(M

*I^HR \ 2eiW]C243�Apoqo"AW>@1'i�h R \ 2e^�5j^hR�241'>q^?R�i!1!A�;P>c1�>q^h2eR \ 2 Q+A 5Cia5�^H362v2>Z]C2Y"zNR \ 2Iv4/+3h3624BCR?2^�R�>@1!AWR�2i�h Z K"[ \ Mti�h�A,^�RfApR�2I>Z^�[C>Z]C24B�Sb5�1!A�;&%('*)+ EK"[ \ !#�'MzP^�i,2 �+/+AWR�>ZijB�l!S+2vij1�2^4z

YK"[N\,!-�&\ MP^ i \.$ h 1�A�;%/'0) YK"[N\kj]m1!-�BM K)9(M

g�\ >Z^�>Z^JR \ 2D!��7� ),� � ��+N,.- oZ24AC3�BP>@BP[ /+Q+Y.ApR�2!2 �+/+AWR�>ZijB%z=e \ >Zv \ \ AW^,S+224B ^ \ i�eIB�R�i�vijBb]C2436[b23hsij3H BP>qRh2 - ^�RfAWR�2�9 AC3hyWiW]j>@ACB Q+3_ijSPoZ241,^�e \ 24B;A�oZijiPyj/+Q RfAbSPoq2�>Z^ /P^h2Y;R�i�^�R�ij362�R \ 2�] AWo@/P2^�i�hIR \ 2,.-)h /+BPvR�>ZijB K"< AWRfyb>@BP^�T4U�>bUfM)�deBPv2,R \ 2 ,.-)h /+BPvR�>ZijB \ AW^�vijBb]C2436[C2Y"zNR \ 2�iPQPR�>@1!AWo Q+iCoZ>Zv5�>q^�R�iRfACyW2JR \ 2�AWvRh>qiPB�>@B�24AWv \ ^�R AWR�23e?>qR \ R \ 2 \ >Z[ \ 2^�R�Q+362Y+>ZvR�2Y 362Rf/+3�B%) g�\ >Z^e>q^ev4ApoqoZ2Y R \ 2�5�����%A&CQ+iCoZ>Zv5C)

���2� 34�6587:9;�<�>=@?A�CB4���<���ED.�F4�6�>�<�E���G�a;�+/+AWR�>ZijBI9 >Z^ ACB /+Q+Y.ApR�2 S+AW^�2Y ijB R \ 26� �IH$+-!������ A�� V ��������#�� K O+/PR�R�ijB T4U�>�>fM�S+2R eH224B R \ 2v4/+3�3624BbR ACBPY BP2A;PR Q+362Y+>ZvR�>ZijB i�h 362R /+3�B%) b?i eH2]C243 z R \ 2�BP2A;PR Q+362Y+>ZvR�>ZijB_e?>qoZo�v \ AbBP[C2Ye \ 24B \kj]m�>Z^I/+Q Y.AWR�2Y"zBe \ >Zv \ >@1!QPoZ>Z2^IR \ ApRE \ ^ \ ij/PoZY�S+2eAWYWD�/P^�R�2Y�R�i�RfAbyW20R \ >Z^H>@BCR�i,AWvvij/+BbR4) *I^0A[C24BP243�AWo.3�/PoZ2CzbR \ 24362 hsij362CzW24AWv \ BP2Ae R�241!Q ij3�AWoPY+>65"243624BPv2 e?>qoZo+2 5"2vR�BPiCR%D�/P^�R R \ 2Ho@AW^�R�Q+362Y+>ZvR�>ZijB%zS+/PRp���"� Q+3_2]j>Zij/P^,Q+362Y+>ZvR�>ZijBP^4) g.\ >q^,362^f/PoZR�^J>cB�R \ 2 g 241!Q+ij3hAWo de>65�243_24BPv2!oZ24AC3�BP>@BP[ AWoZ[Cij36>ZR \ 1e \ >Zv \ v4ACB�S+2,ACQ+QPoZ>q2Y�R�i�^fQ+22Y�/+Q�vijBb]C2436[C24BPv2eiah ^�2 �+/P24BbR�>@AWo Q+362Y+>ZvR�>ZijB�RfAW^ yC^4)/ B�h AWvR4zWO+/PR�R�ijB�>@BCRf3_ijY./Pv2^�ACBJ24BbR�>@362�h AC1,>ZoZ5,i�h.AWoZ[Cij36>ZR \ 1,^ v4ApoqoZ2Y g dQK!L�MzAe \ 24362�] oIL o T>q^!A e 2>Z[ \ R�>@BP[�iPB�R \ 2�362oZ2] ACBPv2�i�h0362v24BbR�Rh241!Q+ij3hAWo Y+>65�243_24BPv2^�Rhi�24AC36oZ>Z243,Q+362Y+>ZvR�>ZijBP^4)cb?2^f/P[C[C2^�Rh^0R \ AWR0/P^�>@BP[�oqi�eH243H]WAWo@/P2^Ii�hmL83_2Y./Pv2^IR \ 2e]WAC36>@ACBPv2Ji�h R \ 2�Q+362Y+>ZvR�>ZijBP^e^�224B�Sb5�24AWv \^�RfAWR�2C)G/sR \ AW^�S+224B,^ \ i e�B!SC5Jd�A 5jACBQK_T4UCUClfM R \ AWR g dQK!L�M%vijBb]C2436[C2^=hsij3iH BP>ZR�2 - ^�RfApR�209 AC3�yWiW]P>@ACBQ+36ijSPoZ241,^4z%S+/PRIBPi Q+36iPi�h 2A;j>Z^�Rh^mh iP3HvijBbR�>@Bj/Pij/P^?^�5j^hR�241,^4)

���KJ L+ME7E=�9N���6OP�Q9;�g�\ 2�3624Ap^�ijB`hsij3HRfACyb>@BP[ 2A;+QPoZij3�AWRhij365�AWvR�>ZijBP^�>q^�R \ AWR?>qR�>Z^�BPiCRIQ iC^�^�>@SPoZ24h ij3?R \ 23,.-)h /+BPvR�>ZijBP^eR�ioq24Ab3�B >6hIR \ 2 AWvR�>ZijB e0>ZR \ R \ 2 \ >Z[ \ 2^�RR EK=[N\"!#��\)Me>Z^,v \ iC^�24B AWR�AWoZoHR�>@1,2^4z AW^4z Y./+36>@BP[ R 3�AW>@BP>@BP[.ziCR \ 243!AWvRh>qiPBP^�e0>ZR \ oZi�e 243?+4���%A��"#�� ��A�Q+A 5Ci�5"^!1!A 5 >@B h AWvR!S+2 S 2R�R�243) g�\ 2�1,2R \ iPY /P^�2Y;R�i^�2oZ2vR ApvR�>ZijBP^ \ AW^ A�Y+>c3_2vR 2 5"2vRtijB!R \ 2I3�AWR�2�AWR e \ >Zv \ R \ 2I362>@B(h iP36v241,24BbR oZ24AC3hBP>cBP[�AWoZ[Cij36>ZR \ 1e0>ZoqotvijBb]C2436[C2!Rhi�ACB�ijQPR�>@1!Apo�Q+iCoZ>Zv5C) /sY+24AWoZoZ5Cz R \ 2!^h5j^�Rh241 ^ \ ij/PoZY iPBPoq5 v \ iPiC^�2,R�i�Q 243!h iP3�1 ABPijB(- [j3622Y+5 ApvR�>ZijB,>6h">qRto@AWv yb^HvijB(H.Y+24BPv2�>cB�R \ 20v4/+3h3624BCRt[j3622Y+5!Q+362Y+>ZvR�>ZijB%)t*IoZR \ iP/P[ \ ] Ab36>Zij/P^1,2R \ iPY+^ \ A4]b2�S+224B�^f/P[C[C2^�Rh2Ychsij3�/P^�2,>@B�Y+>Z^�v43_2R�2!^�RfApR�2 - ^fQ+AWv2J^�5j^hR�241,^QK g�\ 3h/+B T4UCUblfMzNR \ 25AC362�BPiCR0[b24BP243�AWoZoZ5�ACQ+QPoZ>qv4AbSPoq2�R�i,^�5j^hR�241,^I/P^�>@BP[�vijBbR�>@Bj/Pij/P^h /+BPvR�>ZijB�ACQ+Q+36i�;P>c1�AWR�ij36^ )

V

� �I�2�7�3�K�=��S�2�S#������QY�KRP�k� �S/%24AC3�BP>@BP[�R \ 27,.-)h /+BPvR�>ZijB�362 �+/P>@362^e^�ij1�2�1,2R \ iPY�iah ^�Rhij36>@BP[ R \ 2�v4/+3�3624BbReQ+362Y+>ZvR�>ZijBP^�AWR�24AWv \^�RfAWR�2ihsij3%24AWv \ AWvR�>ZijB%zWACBPY�/+Q Y.AWR�>@BP[�R \ 241 AW^ BP2Ae >cB(hsij3�1�AWR�>ZijB�>Z^ [PAWR \ 24362Y") OPR�ij36>@BP[IAH^h24Q+AC3�AWR�2] AWo@/P2.h ij3 24AWv \ ^�RfAWRh2 -`AWvR�>ZijB!Q+AW>@3 �=/P>ZvyCoZ5�S+2vij1,2^H>@1!Q+3�ApvR�>Zv4AWo�hsij3�Q+3_ijSPoZ241,^me0>ZR \ o@AC36[C2?^�RfAWR�2 -^fQ+AWv2^4z0ACBPY h iP3,vijBbR�>@Bj/Pij/P^�^�RfApR�2 - ^fQ+AWv2^!>Z^�^�>@1!QPoZ5 BPiCR�Q+iC^�^h>cSPoZ2C) g�\ 24362 hsij362CzHR \ 24362�>Z^�R \ 2BP22Y R�i�/P^h2!^�ij1,2 h ij3h1 i�h h /+BPvR�>ZijB ACQ+Q+36i�;j>@1!ApR�>ZijB e \ >Zv \ [C24BP243�AWoZ>Z^�2^!Q+362Y+>ZvR�>ZijBP^!S+2R eH224B^�RfAWR�2^ z=AbBPY�R \ /P^�Q+36iW]j>ZY+2^eQ+362Y+>ZvR�>ZijBP^e2]C24B�>@B�^�>ZRf/+AWR�>ZijBP^0R \ AWR \ A ]C2�BP2]C2430S 224B�2A;+Q+2436>Z24BPv2YS+2 hsij362C)I<?24/+3�AWo BP2R0eHij3hyC^4z ij3�� '���� ��)��N��C@��� ����#���+4� ��!��F� z+Q+36iW]P>qY+2,^f/Pv \ A�vijBbR�>@Bj/PiP/P^�h /+BPvR�>ZijBACQ+Q+36i�;j>@1!ApR�>ZijB!Rh2v \ BP>��+/P2Cz.ACBPY \ A4]b2IR \ 2eAWY+]WACBCR AW[C20i�h ^�v4AWoZ>@BP[�eH2oqo%R�iJo@AC36[C2�>@B+Q+/PRIACBPY�^�RfAWR�2 -^fQ+AWv2^ Ks/+BPoZ>@yW2Cz#hsij3t>@BP^�RfACBPv2Cz%XH9�*IXH^3K *�o@S+/P^�T4U&>+T�Mtij3H-0AWY+>@AWo kHAW^�>Z^��%/+BPvR�>ZijBP^ M)/ BJij3_Y+243"R�i�3624Q+362^�24BbR R \ 2 ,.-)h /+BPvR�>ZijB!/P^h>cBP[�BP24/+3hAWo=BP2R eHij3�yb^4z2>ZR \ 243 A?^�>@BP[CoZ2IBP2R eHij3�y.e0>ZR \ � ij/PRfQ+/PR�^J>Z^ 362 �+/P>c3_2Y"z ij3 � ^�24Q+AC3�AWRh2 BP2R e iP3�yC^ z"24AWv \ e?>qR \ A�^�>@BP[CoZ2�ij/PRfQ+/PR )��.iCoZoZi�e0>@BP[/%>@B$K6T UCUClfMz�eH2Hv \ iC^�2�R�i�3624Q+362^�24BbR�R \ 2 ,.-)h /+BPvRh>qiPB�/P^�>@BP[�ijBP2IBP24/+3hAWo BP2R eHij3�y h ij3 24AWv \ AWvR�>ZijB%ze \ >Zv \ A ]CiC>ZY+^eR \ 2 \ >ZY+Y+24B;BPiPY+2^�362v2>Z]P>cBP[�vijB��.>ZvR�>@BP[ 243h36ij3�^�>Z[jB+AWoZ^�h 36iP1 Y+>:5"243624BbR�iP/PRfQ+/PR�^4)b0i�eH2]C243zR \ 2�ijB(- oZ>@BP20AWoZ[Cij36>ZR \ 1,^ Q+362^�24BbR�2Y�>@Be^h2vR�>ZijBJV0v4ACBeS+2HACQ+QPoZ>Z2Y!R�i02>ZR \ 243 AC36v \ >ZR�2vRf/+362C)

/%>@B K6T UCUClfM0/P^h2Y R \ 2�iPBP2 - ^�R�24Q ,.- oZ24AC3�BP>@BP[�2 �+/+AWR�>ZijB 9�R�i�v4AWoZv4/Po@AWR�2!R \ 2,243�3_ij30>@B \ m ACBPY/+Q+Y.AWR�2JR \ 2�BP24/+3�AWo BP2R0eHij3hy7eH2>q[ \ R�^���\�AWvvij36Y+>@BP[!Rhi.z

����\������ i \.$ h 1!A�;%/'0) �\kj]m��A �\������N \ K VBM

e \ 24362 ��>q^JR \ 2 ���%�������"���H#%!��F�n� �&��� ACBPY!���; �\ >Z^,A�]C2vR�ij3�i�hHR \ 2,ij/PRfQ+/PRe[j3hAWY+>Z24BCR�^�"6 \$#%"'& \v4AWoZv4/PocApR�2Y SC5�S+AWvy�-`Q+36iPQ+AW[jAWR�>ZijB%)

J���� ( 9;5*)���������� ��� ������������� ���,+ 34�6587:9;����=:?F�2B4�6������D.�A4�6�����E�Q���/ B ij36Y+243eRhi�^fQ 22Y /+Q Rf3�AW>@BP>@BP[.zG< AWR yC>@BP^cK6T4U�>bUfM0^ /P[C[C2^�R�^Jvij1,SP>@BP>cBP[N,.- oZ24AC3�BP>@BP[Ne?>qR \ g d^-oq24Ab3�BP>@BP[ K ^�2vR�>ZijB�l+)xlfM)Y/ B�R \ >q^.hsij3�1,/Po@AWR�>ZijB%z+R \ 2Jv4/+3�3624BbRI/+Q+Y.ApR�2,243�36ij3t>Z^�/P^�2Y�Rhi AWYWD�/P^�RIBPiCRijBPoZ5 R \ 2!v4/+3�3624BbRe2^�R�>@1!AWRh2!i�h �\`z S+/PR�AWoZ^�i�R \ AWRei�h Q+3_2]j>Zij/P^J^�RfAWR�2^ z"SC5 yW224QP>@BP[ A eH2>Z[ \ R�2Y^f/+1 i�h 24AC36oZ>Z2430243h36ij3H[j3hAWY+>Z24BCR�^ z

����\���� � i \�$ h 1!A�;%/'0) �\kj]m��A �\ � \de�f7g K!L h M \$- e ���; e K)G(M

e \ 24362 L eH2>Z[ \ R�^,R \ 2�362oZ2] ACBPv2�i�hIR \ 2 v4/+3�3_24BCR,243�36iP3�iPB 24AC36oZ>Z243�,.- ] AWo@/P2�Q+362Y+>ZvR�>ZijBP^4) g�\ 2ijBP2 - ^�R�24Q ,.- oq24Ab3�BP>@BP[ 2 �+/+AWR�>ZijB�>q^�R \ 24362 hsij362�A�^fQ+2v>@AWo >@BP^�RfACBPv2Ji�h R \ >Z^�2 �=/+AWRh>qiPBYe \ 243627L.� ]+)

/%>@B K6T4UbUf9fMe3624Q ij36R�^,R \ AWR,/P^�>@BP[ R \ >Z^4h iP3�1 i�hI/+Q+Y.AWR�2 hsij3�vijB+BP2vR�>ZijBP>Z^�RY,.- oq24Ab3�BP>@BP[Ne0>ZR \L0/ ]�362^f/PoZR�^�>cB h AW^�R�243?vijBb]C2436[C24BPv2JR \ ACB�R \ 2,ijBP2 - ^�R�24Q ,.- oq24Ab3�BP>@BP[ AWoZ[Cij3_>qR \ 1�) b?i�e 2]b243z \ 2ACQ+QPoZ>q2^e2 �+/+AWR�>ZijBYG�/P^�>@BP[ R \ 2�h iboqoZi�e0>@BP[ AWoZ[CiP36>ZR \ 1�z21

��� \3�4��K 65\ �F \ M7�8�> �\ K)J(M

e \ 24362Cz 5\ � i \.$ h � K_T�� L�M.1!A�;%/'0) �\kj]m�$ L. 5\kj]m � K)O(M

� 36ij1 2 �+/+AWR�>ZijB7O0>ZR v4ACB,S 2 ^h224B�R \ AWR 24Apv \ 5\ Y+24Q+24BPY+^H362v4/+36^�>Z]C2oZ5,ijB�h /PR /+362E 5\ ]WAWo@/P2^4zfe \ >qv \1,24ACBP^�R \ AWRe/+Q+Y.AWR�>@BP[�v4ACB�ijBPoZ5�iPvv4/+3IApRIR \ 2J24BPY�i�h�24AWv \ Rf36>@AWos)�\IBbR�>Zo R \ 24B%z%AWoZo ^�R AWR�2 -`AWvR�>ZijB

9;:=<?>A@;BDC�@FE$>HG;I2JA@$KML�N�EPOQCFCSRUTVJUEPK2>7<QWSXZYF[\K2W'TVW$CSBJUW�J,<V>UE$J]EPK2>A<VJAI^WPOQ>7@;EPOQJ7<QB�L�>7@_Y,`�ab[�cedD[Pf�ghSi'OjK2W�K2WkJ7I2W$>lEPOQC�JAI2m]>A@$K2EPOVnoTQW$CpB�qDN�i'OD@$Tj<�KM<OjK2Wsr'>A@$t�>7<GS>7<j<VCSGSEPK2>7<jK2W$E�ukv�I2CSJA@$<DKM<Qm�CUg mjg�`�i'Oj@$TD<�wpxUxUyzf�gG

Q+AW>@36^01�/P^hR S+2�^�R�iP362Y"zjACBPY�R \ 24B�Q+362^�24BbR�2Y�>cB�AJR�241!Q ij3�AWoZoZ5 02��# 3@:;����AIiP36Y+243 R�i,Q+36ijQ+AW[PAWR�20R \ 2Q+362Y+>ZvR�>ZijB�243�36ij36^Hvij3h362vR�oZ5C) g.\ >q^?>q^�v4AWoZoZ2Y 0 ��#.3 :;����A ����+4����CW)/ B�^�2vR�>ZijBJV^e 2�Q+3_2^�24BCR�Apoq[bij36>ZR \ 1,^ R�i0>@1!QPoZ241,24BbR 2 �=/+ApR�>ZijB7G0Y+>@362vR�oZ5�h ij3 !��-)�� �"��� /+Q Y.AWR�2^4zACBPY ^�i 36241,iW]C2�R \ 2 3_2 �=/P>@36241,24BbR�R�i e0AW>ZR8/+BbR�>ZoIR \ 2�24BPY i�h�24AWv \ Rf36>@AWos) g�\ >Z^�36241�i ]b2^ R \ 2BP2v2^�^�>ZR65 R�i�^�Rhij362�^�RfAWR�2 -`ApvR�>ZijB;Q+AW>@36^4z iP3�2]b24B R�i \ A4]b2�ACB 24BPY;iah Rf3_>cApo viPBPY+>qRh>qiPB%z AW^�24AWv \R�241!Q+iP3�AWo"Y+>65"243624BPv2,243�36ij3 >q^e/P^�2Y�>c1�1,2Y+>@AWR�2oZ5C)0*�^IR \ 2�2A;+Q+2436>@1,24BbR�^e^ \ i�e�zPR \ >Z^�AWoZ^�i 3_2^f/PoZR�^>cB�oZ2^�^I^h24BP^�>ZR�>Z]j>ZR65�R�i!R \ 2eoZ24AC3hBP>cBP[�Q+Ab3�AC1,2R�243_^ hsij3tR \ 2J^�5j^hR�241 R�i,vijBb]C2436[C2C)

*eB�>@1!Q+ij3_RfACBbR�Q+ib>cBbR�AbS+ij/PRJ2 �=/+AWRh>qiPB G�>Z^,R \ AWRe>ZR,>Z^�BPiCR,A�Rf3�/P2 g d^- oZ24AC3�BP>@BP[ AWoZ[Cij36>ZR \ 1/+BPoq2^h^ R \ 2 �5�����%A&C Q+iboq>Zv5;>Z^4h iboqoZi�eH2Y"z�>s)w2C) R \ 2�R�241!Q+iP3�AWo�Y+>65"243624BPv2�243�36ij36^7e0>ZoZoIBPiCR!AWY+Y;/+Qvij3�362vR�oZ5Cz cde�f7g h e � i \"j e $ h 1�A�;%/'0) �\kj e j]m��� �\kj e ���� cde�f7g h e i \"j e �� �\ K >(M/+BPoq2^h^ R \ 2 AWvRh>qiPB vij3�362^ Q+ijBPY+>@BP[ R�i 1�A�;&%('*)+ EK"[ \ !-� \ M�>Z^ Q 243!h iP3�1,2Y AWR�2]C24365 R�>@1,2 ^�R�24Q%)< AWRfyb>@BP^�3_2viC[jBP>Z^�2Y R \ >q^ z�ACBPY;^f/P[C[b2^�R�2Y ^�2R�R�>@BP[ L � ] e \ 24BP2]C243�BPijB(- [j3622Y+5;AWvR�>ZijBP^!AC362Q+243!hsij3�1,2Y KsAW^J>Z^�BP2v2^h^fAC365 hsij3�2A;=QPoZij3�ApR�>ZijB�� ^�22�^�2vR�>ZijB;l+)69fM) g.\ >q^�>q^,^�iP1,2R�>@1,2^�>Z[jBPiP362Y"zACBPY A^H�;P2Y L /P^�2Y"z+S+/PR�2A;+Q+2436>@1,24BbR�^ \ A ]C20^ \ i�eIB,R \ AWR R \ >Z^Hoq24ApY+^ Rhi�A�1,ij3_2I/+B+362oZ>@ACSPoZ2eRf3�AW>@B(->cBP[ 1,2R \ iPY;R \ ACB R \ iC^�2�^�Rf/PY+>Z2Y \ 243_2C)B/sR!>Z^�eHij36R \ BPiCR�>@BP[.z \ i�eH2]C243z R \ AWR /�>cB�� ^ S+AWvyfe0AC36Y3624QPo@A45�2 �=/+ApR�>ZijBP^QK)J+z�OfM.e0>ZR \ LYH�;P2Y AC362J>@B h ApvR ACB�>@1!QPoZ241,24BbRfAWR�>ZijB�i�h ,�K!L�M K ^�2vR�>ZijB 9+):9fM zACBPY�BPiCR0i�h 2 �+/+AWR�>ZijBcG4e0>ZR \ H�;j2Y L")

J��2� � 9F+E��� � + ( 9;���E�6D OP�Q9;�E��IO�� �/ �������E�Q���g�\ 2p�+/P2^�R�>ZijB >Z^7e \ 2R \ 243,1!A�; %('0) EK"[E!#�'Me3_24AWoZoq5 Q+36iW]j>ZY+2^,R \ 2�S+2^�R,2^�R�>@1!ApR�2!i�h0R \ 2�362Rf/+3�Bi�h�R \ 2�^hRfAWR�2 [�) / B�R \ 2J24AC36oZ5�^�RfAp[C2^0i�h oZ24AC3�BP>@BP[.z%R \ 27,.-)h /+BPvR�>ZijB�]WAWo@/P2^ei�h AWvR�>ZijBP^�R \ AWR \ A ]C2BPiCR S+224B 2A;+QPoZij362Y >Z^�oZ>cyp2oq5 R�i S 2 viP1!QPoZ2R�2oZ5 eI36iPBP[.z�ACBPY 2]C24B;>@B;R \ 2�o@AWR�R�243�^�RfAW[C2^ z�R \ 21!A�;P>c1,/+1 ] Apoc/P2�>Z^!1,ij3_2 oZ>@yW2oZ5;R�i S 28AbB iW]C243!- 2^hR�>@1!AWR�>ZijB i�h0R \ 2�Rf3�/P2�362Rf/+3�B A ] AW>Zo@ACSPoZ2 KsAW^AC36[j/P2Y�>@B g�\ 3�/+B�ACBPY�OPv \ e0AC36R�7K6T4UCUf9(MSM)'� /+3_R \ 243zPR \ 2e/+Q+Y.AWR�2�3h/Poq2.hsij3m,.- oq24Ab3�BP>@BP[ vij1,SP>@BP2Ye0>ZR \ Rh241!Q+ij3hAWo.Y+>65"243624BPv2�1,2R \ iPY+^0362 �+/P>c3_2^2L!R�i�S 2�2436iP2Y ijB�2]C24365�^�R�24Q�R \ AWR AJBPijB(- [j3622Y+5AWvR�>ZijB�>q^?RfACyW24B%) *�^ h 36ij1'R \ 2eACS i ]b2 AC3_[j/+1,24BbR�^�R \ 2�[j3622Y+5�AWvR�>ZijB�vij/PoZY�>@B`h ApvR S+2e>@BPvij3h362vRK 2^fQ+2v>@AWoZoZ5 >@B R \ 2�24AC36oZ5 ^�RfAW[C2^,i�heoZ24AC3�BP>@BP['Mz 2436iC>@BP[ R \ 2�2 5"2vR,i�h ^ /+SP^�2 �=/P24BbR Q+362Y+>ZvR�>ZijBP^ijB;R \ ib^�2�Q+36>Zij3�R�i A BPijB(- [P3622Y+5 AWvR�>ZijB >q^�oZ>@yW2oZ5 R�i S 2 1,iP362�i�h�A \ >@BPY.3�ACBPv2�R \ AbB;A \ 2o@Q>cB vijBb]C2436[b>cBP[ ijB;R \ 2�362 �+/P>c3_2Y Q+3_2Y+>qvRh>qiPBP^4)��%/+36R \ 243�1,iP362Cz Ap^!R \ 2�^h5j^�Rh241 vijBb]C2436[b2^!R�i A^�iCo@/PR�>ZijB%z"[P3622Y+5 AWvRh>qiPBP^2e0>ZoqoHS+2 /P^h2Y�1�ij362,R�i�2A;=QPoZiC>ZR�R \ 2 Q+iCoZ>Zv5�oZ24AC3�BbR�SC5�R \ 2,^�5j^hR�241�z%^�iR \ 2 [P3622Y+5 362Rf/+3hBP^ e?>qoZo0S+2�^h224B ACBb5Be A 5C) g.\ 24362 h iP362Cz=e 2�>cBbRf36iPY./Pv2�ACB AWoZR�243�B+AWRh>q]b28/+Q Y.AWR�2AWoZ[Cij36>ZR \ 1'S+AW^�2Y�1,ij3620^hRf36ijBP[CoZ5,ijB g d^- oq24Ab3�BP>@BP[.zPv4AWoZoq2Y�9�iPY+>6H.2Y�XHijB+BP2vR�>ZijBP>Z^�R�,.-0/%24AC3hBP>cBP[K 9 X�,.-0/�M)��

de/+30Q+36iPQ+iC^�2Y�/+Q+Y.AWRh2�3�/PoZ2�>Z^4z

����\������ i \�$ h \kj]mF�A �\�� \de%f7g K h L�M \$- e ��� e KsU(M

g�\ >Z^ Y+>65"2436^`h 36iP1 BPij3�1!Apo ,.- oZ24AC3�BP>@BP[;>@B;R \ 2�/P^�2�i�heR \ 2 \kj]m AW^�^hijv>@AWR�2Y e0>ZR \ R \ 2�AWvR�>ZijB^�2oZ2vR�2Y"z 3�ApR \ 243�R \ ACB�R \ 2![j3622Y+5�1!A�; %('0) \"jNme/P^�2Y >@BN,.- oZ24AC3�BP>@BP[.) g�\ >Z^�24BP^ /+362^eR \ AWReR \ 2R�241!Q+iP3�AWo"Y+>65"243624BPv2!243�3_ij36^�e0>ZoZo�AWY+Y�/+Q�viP3�362vR�oZ5Cz%362[jAC36Y+oZ2^�^�i�h e \ 2R \ 2430[j3_22Y+5 AWvR�>ZijBP^eAC362RfACyW24B�ij3�BPiCR4z e0>ZR \ ij/PR�R \ 2�BP22Y�R�i�243_icL") /@h�[j3622Y+5�ApvR�>ZijBP^?�&�8��RfAbyW24B%z \ i�eH2]C243z+R \ 24B�R \ >Z^

� i'OQ>7TQm7O��3K2G$O��UTVE$E$>A<WPTVmUm]CSW$E$W ��������� X]JUW^NU>AT�<QCpCSB�E$>,t <V>7r � E$J]E$C�v"! GSEPK2>7<jv"��CSr'J7@;B v#� E$JUE$C�v"!sGSEPK2>A<6q%C�L�>7@;C$ C�@$L�>A@;n�KM<QmlJA<T $ BDJUE$CUg

J

2 �=/+AWRh>qiPBe>Z^ 2A;=ApvR�oZ5e2 �=/P>Z] Apoq24BbR�Rhi0^�RfACBPY.Ab36Y3,.- oZ24AC3�BP>@BP[.z+ACBPY�^hi.z4>@B�R \ 2�oZ>@1,>ZR e \ 24B�2A;=QPoZij3hAWR�>ZijB\ AW^�v24AW^h2Y ACBPY R \ 2![j3622Y+5 Q iCoZ>qv5 >Z^!S+2>@BP[ h iCoZoZi�eH2Y"z R \ 2 /+Q+Y.AWRh2^ e?>qoZo0S+2�R \ 2!^ AC1,2 AW^^hsij3^�RfACBPY.AC3_Yc,.- oq24Ab3�BP>@BP[ K 2 �=/+ApR�>ZijBYGfM)

9 X�,.-0/ R \ 24362 hsij362�^fAC1!QPoZ2^4h 36ij1#R \ 2 Y+>Z^�Rf3_>cS+/PRh>qiPB;i�h Q iC^�^�>@SPoZ2 h /PRf/+362�362Rf/+3�BP^,[C>Z]C24B R \ 2v4/+3�3624BbR�2A;+QPoqiP3�AWR�>ZijB Q+iCoZ>Zv5CzH3�AWR \ 243�R \ ACB�D�/P^�R,R \ 2![j3_22Y+5 Q+iCoZ>Zv5;AW^2hsij3�BPiP3�1!AWo ,.- oZ24AC3�BP>@BP[.)g�\ 24362 hsij362Cz+R \ 23,.-)h /+BPvR�>ZijB e0>ZoZo"vijBb]C2436[C2eRhi.z

YK"[ \ !-� \ MY^`_ a i \ $ h d%/'0)�� K2� [ \kj]m M, EK=[ \kj]m !#�'M l K6T�](M

e \ >Zv \ >Z^,R \ 2�2A;=Q 2vR�2Y 362Rf/+3�B [C>Z]C24B R \ 2�Q+36ijS+ACSP>ZoZ>ZR�>Z2^4z � K2� [N\)Mz i�h AWvR�>ZijBP^!S 2>cBP[ ^�2oZ2vR�2Y")XHijBP^�2 �+/P24BCRhoq5Cz AWR�ACBb5 Q iC>@BCRJY./+36>@BP[�Rf3�Ap>cBP>@BP[.z R \ 2�,.-)h /+BPvRh>qiPB ^ \ iP/PoqY [C>Z]C2!ACB�2^�R�>@1!ApR�>ZijB�i�hR \ 2e2A;=Q 2vR�2Y 3_2Rf/+3�BP^0R \ ApR Ab362�A ] AW>Zo@ACSPoZ22hsij3tR \ 2ev4/+3�3624BbR02A;+QPoZij3�AWR�>ZijB�Q+iCoZ>Zv5C)t*I^0>ZR0>Z^eBPij3�1!ApoR�i 362Y./Pv2�R \ 2�AC1,ij/+BbR,i�h02A;=QPoZij3�ApR�>ZijB;AW^,Rf3�AW>@BP>@BP[ Q+36iPv22Y+^4zt2]C24BbRf/+AWoZoZ5 R \ 2�[j3622Y+5 AWvR�>ZijBe0>Zoqo S+2JRfACyW24B�ApR 24Apv \ ^�Rh24Q%z.ACBPY�^hi�R \ 2 ,.-)h /+BPvR�>ZijBYe0>ZoZo vijBC]b2436[C2eR�i,R \ 2JijQPR�>@1!AWo%] Apoc/P2^ )

J��KJ �������m 24BP[ ACBPY < >qoZoZ>@AC1,^$K_T4UCUWV'MeQ+3_2^�24BCRh2Y ACBPibR \ 243�1,2R \ ijY iahIvij1,SP>@BP>cBP[N,.- oZ24AC3�BP>@BP[ AbBPY g d^-oq24Ab3�BP>@BP[.z"v4AWoZoZ2Y ,�K!L�M) g�\ >Z^e>Z^�S+AW^�2Y�ijB�Q+243!hsij3�1�>cBP[�A�BPij3�1�AWo iPBP2 - ^�R�24Q ,.- oZ24AC3�BP>@BP[ /+Q Y.AWR�2R�i�>c1�Q+36iW]C2 R \ 2 v4/+3�3_24BCR!Q+362Y+>ZvR�>ZijB \�z ACBPY;R \ 24B /P^�>@BP[ R \ 2�R�241�Q+ij3�Apo�Y+>65"243624BPv2^ S+2R eH224B^f/Pvv2^�^�>Z]C2�[j3622Y+5;Q+362Y+>ZvR�>ZijBP^�R�i /+Q+Y.AWR�2�>ZR7h 3_ij1 R \ 24362�iPB%z0362[jAC36Y+oZ2^�^�i�h e \ 2R \ 243![P3622Y+5AWvR�>ZijBP^0AC362eQ+243!hsij3�1�2Y�ij3�BPiCR ) g�\ >Z^01,24ACBP^0R \ ApR�L Y+iP2^0BPiCR0BP22Y�R�i!S+2�2436iP2Y"z.S+/PR0362 �+/P>@362^R \ AWR�R eHieY+>65"243624BCRH243�3_ij3 R�243h1,^�R�i,S+2�v4AWoZv4/Po@AWR�2Y�AWRt24AWv \ ^�R�24Q%) m 24BP[!Q+362^�24BbR�2Y�R \ 2eAWoZ[Cij36>ZR \ 1h ij3tY+>Z^�v4362Rh2I^�R AWR�2 - ^fQ+AWv2�^�5P^�R�241,^ z'e \ >qoZ^�R \ 24362 eH2�2A;jRh24BPY�>qR hsij3H/P^�2^e0>ZR \ viPBCR�>@BP/Pij/P^mh /+BPvR�>ZijBACQ+Q+36i�;j>@1!ApR�ij36^4)

*0R 24AWv \ R�>@1,20^�R�24Q%z+ACB�/+Q+Y.AWR�2�>Z^01!AWY+2IAWvviP36Y+>@BP[�Rhi�R \ 20iPBP2 - ^�R�24Q ,.- oq24Ab3�BP>@BP[!2 �=/+ApR�>ZijB,V.zACBPY�R \ 24B�A�^�2vijBPY /+Q Y.AWR�2e>Z^e1!AWY+2�/P^�>@BP[.z

��� \ ��� � i \ $ h 1!Aa;%('0) \"jNm � 1�A�;%/'0) \ � \$-�mde%f7g K h L�M \$- e � � e K6TCT�M

<0iCRh2eR \ 2�^f/+1�1!AWR�>ZijB�>q^�ijBPoZ5 /+Q�R�i!^�Rh24Q�F� TC)t*�^ eH2�AC362JY+24AWoZ>@BP[Ye0>ZR \ A,viPBCR�>@BP/Pij/P^�^�RfAWR�2 -^fQ+AWv2�^�5P^�R�241�ztS+iCR \ /+Q+Y.ApR�2^8A 5�2vRJR \ 2�^fAC1�2QeH2>Z[ \ R�^ ACBPY ^�i 362^f/PoZR!>@B AbB iW]C243�Apoqo0/+Q Y.AWR�2i�h_z

�8��\����� � i \ $ h 1!A�;%('*) �\kj]m_�F \ � ���; \�$ � i \.$ h 1!Aa;%('0) \"jNm�� 1!A�;%('*) \ ��� \� K6T4l(M

g�\ >Z^I362^f/PoZR�^H>@B�Ae^�oZ>Z[ \ R�oZ5�AWoZR�24362Y�ACBPY�oq2^h^02�� v>Z24BCRHijB(- oZ>@BP2�/+Q Y.AWR�2�AWoZ[CiP36>ZR \ 1'R \ ACB h ij3 2>ZR \ 243^�RfACBPY.AC3_Yc,.- oq24Ab3�BP>@BP[�ij3t9�X.,.-0/�K ^h2vR�>ZijB�V'M)

� ���� �3� QY�YR �=�M �MS/ B�R \ >Z^ ^h2vR�>ZijB7eH2IQ+362^�24BbRHR \ 20R�241�Q+ij3�Apo+Y+>:5"243624BPv2�/+Q Y.AWR�2IApoq[bij36>ZR \ 1,^0362 �+/P>@362Y Rhi�ACQ+QPoZ5!R \ 2vijB+BP2vR�>ZijBP>Z^�R0oZ24AC3�BP>@BP[ 1�2R \ ijY+^0AWRt24AWv \ R�>@1,2�^�R�24Q%z+ACBPY \ 24BPv2eoZiC^�2�R \ 2e362 �=/P>@36241�24BCRHR�iJ^�R�ij362AWoZo"^�RfAWRh2 -`AWvR�>ZijB�Q+AW>@36^I/+BbR�>Zo R \ 2e24BPY�i�h 24AWv \ Rf36>@AWos)

g�\ 2eS+AW^�>Zv�AWoZ[Cij3_>qR \ 1 hsij3tACQ+QPoZ5j>@BP[ g d^- oZ24AC3hBP>cBP[�R�2v \ BP>��+/P2^0R�i,Rf3�Ap>cB�BP24/+3�AWo"BP2R eHij3�yb^�v4ACBS+22hsij/+BPY�>@B�O+/PRhR�ijBNK6T4U&>CUfM) a�Apv \ eH2>Z[ \ R0>@B�R \ 2�BP2R eHij3�y!1�AW>@BCRfAp>cBP^eACB ��� � �5� 0 �"���k� C � ����#��4z

� \�� \de�f7g K!L h M \$- e ���; �\kj e �4���; \�$ L h � \$-�m K6T�9(M

O

Tb) - 2^�2R Apoqo 2oq>Z[C>@SP>ZoZ>@R�>Z2^4z � g � ]l ) �F� ]9 ) OP2oZ2vReAWvR�>ZijB%z��&\VN) / h �H/ ]+z� \3� ��\$-�m�$ ��K i \ -4m;$ h \'�A �\$-�m M � \$-�mG ) X?AWoZv4/PocApR�2 � � \ e�)x3 )wR4)"^h2oq2vRh2Y�ApvR�>ZijB� \ iPBPoq5C)J ) � \������ \.$ h L � \ -4mO ) m 2430h ij3h1 ApvR�>ZijB��\�zNACBPY�362v2>Z]C2!Q+A 5Ci�5 i \> ) / h R 36>@AWo \ AW^IBPibR024BPY+2Y"z��Y^ ��$ T�ACBPY�[bi!R�i,^�R�24Q 9+)

� >q[P/+362 TCr�deB(- oZ>@BP2 viPB+BP2vR�>ZijBP>Z^�R8/+Q Y.AWR�2�AWoZ[CiP36>ZR \ 1�) g�\ 2�/+Q Y.AWR�2�>@B ^�RfAW[b2QG�>q^�^ \ i�eIB hsij39 iPY+>6H.2Y XHiPB+BP2vR�>ZijBP>Z^�R3,.-0/%24AC3�BP>@BP[.)

TC) -H2^�2R�AWoZo"2oZ>q[b>cSP>Zo@>ZR�> 2^4z � g � ]+)l+) �F� ]+)9+) OP2oZ2vR ApvR�>ZijB%z��&\�)V.) /@h��H/ ]+z� \ � � \ -4m $ �2K� i \$-�m $ h 1!Aa;&%/'0) \ �F \$-�m �V� � \$-�m $

� i \$-�m�$ h 1!A�; %('0) \�� 1�A�; %('0) \$-�m � � \$-�m MG+) � \3� h L�� � \ -4m�$ �8�; \$-�m �J+) X0AWoZv4/Po@AWR�2����; �\�e�)x3)wR )"^�2oZ2vR�2Y AWvR�>ZijB�&\ ijBPoZ5C)O+) m 243!hsij3�1 AWvR�>ZijB�&\�z.ACBPY�3_2v2>q]b2�Q+A 5Ci�5 i \6)>+) /@h Rf36>@AWo \ AW^IBPiCR024BPY+2Y"z � ^ �>$ T AbBPY�[Ci,R�i!^hR�24QY9+)

� >Z[j/+362�l r deB(- oZ>@BP2!vijB+BP2vRh>qiPBP>q^hR /+Q Y.AWR�2�Apoq[bij36>ZR \ 1 hsij3�,�K!L�M)

R�i yW224Q Rf3�AWvy;iah�R \ 2 eH2>Z[ \ Rh2Y ^f/+1Li�h!Q+362]j>Zij/P^�243�36ij3�[P3�AWY+>Z24BCRh^4) O+/PRhR�ijB Q+362^�24BbR�2Y R \ 2AWoZ[Cij36>ZR \ 1<hsij3,R \ 2�[C24BP243�AWo0v4Ap^�2ce \ 243_2�A 1,/PoqRh>cQPoZ2�ij/PRfQ+/PR�BP2R0eHij3hy \ AW^�Y+>:5"243624BbR!243�3_ij36^!>@B24AWv \ i�h,>ZR�^�ij/PRfQ+/PR�^ z AbBPY \ 24BPv2 R \ 24362 >Z^�R \ 2 BP22Y R�i 1�AW>@BCRfAp>cB ijBP2�2oq>Z[C>@SP>ZoZ>@R65 Rf3�Apv2�Q 243BP2R0eHij3hy�ij/PRfQ+/PR!AWR,24AWv \ eH2>q[ \ R4)_b?i�e 2]b243z >cB R \ 2c,.- oZ24AC3�BP>@BP[ h 3�Ab1,2AeHij3�y�R \ 24362�>Z^�ijBPoZ5 A^�>@BP[CoZ2eR�241!Q+iP3�AWo.Y+>65"243624BPv2e243�3_ij3�AWRt24AWv \ R�>@1,2�^�R�24Q%z(e \ >Zv \ >Z^0/P^�2Y�R�i,/+Q+Y.AWRh2IR \ 22,.- ] Apoc/P2^?i�h���k�NAWvR�>ZijBP^�>cB��Jz"ACBPY \ 24BPv2!362^ /PoqRh^e>cB�R \ 2�h ApvRIR \ ApR0ijBPoZ5 A�^�>@BP[CoZ2!2oZ>Z[C>@SP>qoZ>@R65�>Z^�362 �+/P>c3_2Ychsij324AWv \ eH2>Z[ \ R K ^�22�AbQ+Q+24BPY+> ;�*2M)

g�\ 2,>@1!Q+iP36RfACBbR�Q+iC>@BbR�R�i�BPibR�2,>q^JR \ AWR6���N \3K R \ 2!S+AWvy�-`Q+3_ijQ+AW[jAWRh2Y iP/PRfQ+/PRe[j3�AWY+>Z24BbR M�>Z^ijBPoZ5!v4AWoZv4/Po@AWR�2YYe0>ZR \ 3_2^fQ+2vRHR�iJR \ 20ij/PRfQ+/PRHQ+36iPY./Pv>cBP[�R \ 2 ,.-)h /+BPvR�>ZijB�] AWo@/P2.h iP3 R \ 20^h2oq2vRh2YAWvR�>ZijB � \ ) b?24BPv2CzH>6h�R \ 2$,.-)h /+BPvR�>ZijB >Z^ S+2>@BP[ 3624Q+362^h24BCR�2Y SC5 � ^�24Q+AC3hAWR�2�^�>@BP[CoZ2�ij/PRfQ+/PRBP2R0eHij3hyC^4z R \ 24B �8�� �\I>Z^�2436i h ij3,AWoZomeH2>Z[ \ Rh^!>@B;BP2R0eHij3hyC^,iCR \ 243JR \ AbB R \ 2�ijBP2�AW^�^�iPv>@AWR�2Ye0>ZR \ AWvR�>ZijBA�&\�z"ACBPY�^�i�R \ 2,2oZ>Z[C>@SP>qoZ>@Rh>q2^ h ij3?R \ 2!R \ 2^�2!BP2R0eHij3hyC^eAC362�D�/P^�R /+Q Y.AWR�2Y Apvvij36Y+>@BP[R�i.z

� \�� h L � \$-�m K6TVBM

>

ROBOT15deg

15deg

RANGE SENSORS

OBSTACLE GOAL

goald

Angle to goal

� >Z[j/+36279+rG< \ AWR0R \ 2�36iPS+iCRIyPBPi�e0^0ACS+iP/PR0>ZR�^I^ /+3�36ij/+BPY+>@BP[C^

g�\ 2.h /PoZo%ijB(- oZ>@BP2�AWoZ[CiP36>ZR \ 1 >Z^0^ \ i�eIB�>cB � >Z[.)%TC);/ R >@Bb]CiCoZ]C2^0S+AWvy�-`Q+3_ijQ+AW[jAWRh>cBP[JR�i,vij1!Q+/PR�2R \ 2IiP/PRfQ+/PRH[j3�AWY+>Z24BbR�^l���; \ihsij3 R \ 2eAWvR�>ZijB�v \ iC^�24B%z.ACBPY \ 24BPv2�/+Q+Y.ApR�>@BP[!R \ 2^e 2>Z[ \ RH2oZ>q[b>cSP>ZoZ> -R�>Z2^4z.S+2 hsij362eR \ 2�AWvR�>ZijB�>Z^ ApvRf/+AWoZoZ5�Q+243!hsij3�1,2Y") *0RHR \ 2�BP2A;jR?R�>@1,2e^�R�24Q%z.Apoqo i�h R \ 22eH2>Z[ \ R�^IAC362/+Q+Y.AWR�2Y�AWvvij3_Y+>cBP[,R�iJR \ 2�R�241!Q+iP3�AWo+Y+>65"243624BPv2e243�36ij3t1,/PoqRh>cQPoZ>Z2Y Sb5!R \ 2>@3t2oZ>Z[C>@SP>qoZ>@Rh>q2^ ) g�\ 24362 -h ij3_2CzWR \ 20ijBPoZ5,^�R�ij3hAW[C2 3_2 �=/P>@36241,24BbR�^�AC3_2 hsij3 R \ 2�BP24/+3�AWo.BP2R eHij3�y^eH2>Z[ \ Rh^�ACBPY!2oZ>Z[C>@SP>qoZ>@Rh>q2^ z.ACBPYR \ 2eo@AW^�R ,.-)h /+BPvR�>ZijB�] AWo@/P2+ \�ACBPY�Q+A45bi�5 i \`)

,�K!L�M,/+Q+Y.AWRh>cBP[ >Z^ ^hoq>Z[ \ R�oZ5;Y+>65"243624BCR z0ACBPY;Rf3�ACBP^hocApR�2^!>@BCRhi R \ 2�iPB(- oq>@BP2 /+Q+Y.ApR�2�^�2 �+/P24BPv2^ \ i�eIBJ>cB � >Z[.)Cl+) <?iCR�2HR \ 20v \ ACBP[C20>@B,iP36Y+243 i�h%^�R�24QP^mJeACBPYQO^e \ >Zv \ 362 �+/P>@362^�R \ AWR R \ 2IBP2R eHij3�yij/PRfQ+/PR![j3hAWY+>Z24BCR�^ z����N \�zHAC362�^�R�iP362Y S+2R eH224B ^�R�24QP^4) g�\ 2 AWoZ[CiP36>ZR \ 1 >Z^ R \ 24362 h iP362�^�oZ>Z[ \ Rhoq51,ij362�vij1!Q+/PRfApR�>ZijB+AWoZoZ5 2A;+Q+24BP^�>Z]C2JR \ ACB�^�RfACBPY.Ab36YE,.- oZ24AC3hBP>cBP[�ACBPY�9 X�,.-0/ z+ACBPY�AWoZ^�i!362 �+/P>@362^R \ 2e^�R�ij3hAW[C2�i�h R \ 2e[j3�AWY+>Z24BbR�^�� � \ AW^�eH2oZo AW^0R \ 2�BP2R eHij3�y7eH2>Z[ \ R�^IACBPY�2oZ>Z[C>@SP>Zoq> R�>Z2^4)

� ��� � J ��� �.���6����� � � O/ B�ij36Y+243 Rhi�R�2^�RtR \ 2IAWoZ[CiP36>ZR \ 1,^HY+>Z^�v4/P^�^�2Y"z.AJ3624AWoZ>Z^�R�>Zve1,ijSP>ZoZ2�36ijS+ibR Q+36ijSPoZ241 e0AW^�viPBP^�>ZY+24362Y")g�\ 2!36ijS+ibR�1�/P^hR^H BPY >ZR�^4e0A45�Rhi8A�[CiPAWo Q iC^�>ZR�>ZijB�>@B A�lpd 24Bb]P>c3_ijB+1,24BbR2e \ >Zoq^hR�A ]CiC>ZY+>@BP[�ijS(-^�RfAWvoZ2^4z�S+/PR,ijBPoZ5;362v2>Z]C2^ Q+A 5Ci�5"^,AWR�R \ 2�24BPY;iah 24Apv \ Rf3_>cApo z%e \ 24B R \ 2�ij/PR�vij1,2�>Z^!yjBPi�eIB%)g�\ 2eijBPoZ5 >@B(hsij3�1!ApR�>ZijB�A ] AW>Zo@ACSPoZ2,R�i,>qR?Y./+36>@BP[ A,Rf36>@AWo"AC3_2I^�24BP^hij303624AWY+>@BP[C^ z.ACBPY�>@B(h iP3�1!AWR�>ZijB�>ZR\ AW^Hoq24Ab3�BCRh 36iP1 Q+3_2]j>Zij/P^0R 36>@AWoZ^4)K/ B�iP36Y+243tR�i,24BP^f/+362eR \ 2evijBbRf36ibo Q+iboq>Zv5�oZ24AC3�BbRH>Z^IAW^0[C24BP243hAWoZoq5ACQ+QPoZ>qv4AbSPoq2�AW^IQ+ib^�^�>@SPoZ2Cz.R \ 2,36ijS iCRH>q^�Rf3�Ap>cBP2Y�ijB�A,^�2 �+/P24BPv2�iah 3�AbBPY+ij1,oZ5�[C24BP243�AWRh2Y�24BC]P>@36ijB(-1,24BCRh^4z�e0>ZR \ 24AWv \ /P^�2Y h ij3 ijBPoZ5�A,^�>@BP[CoZ2�Rf3_>cApo )ta=5"2vR�>Z]C2oZ5Cz.R \ >q^eQ+36iW]P>qY+2Y h iP36v2Y�2A;=QPoZij3hAWR�>ZijBi�h BP2Ae 24BC]P>@36ijB+1,24BbR�^�ACBPY�^�>ZRf/+ApR�>ZijBP^4z"ACBPY�^�i�Q+36iW]j>ZY+2Y A�1,ij3_2�36ijS+/P^hR�36ijS+ibRIvijBbRf36ibo Q+iCoZ>Zv5R \ ACB�vij/PoZY S 2�AWv \ >Z2]C2Y�iPB�A4H�;j2Y�24BC]P>@36ijB+1,24BbR4)

���� 3��� ��9�) 9�O LR���E�Q��9;�E5 ���NOg�\ 2 36ijS+ibR�>q^�^h>c1,/Po@AWR�2Y e0>ZR \ H.]C2 3�ACBP[b2cH BPY+>@BP[ >cB+Q+/PRh^ce \ >Zv \ [C>Z]C2 >ZR�AWvv4/+3�ApR�2�Y+>q^hRfACBPv21,24AW^f/+36241�24BCR�^HR�i,ijSP^hRf3�/PvR�>ZijBP^4z e \ >Zv \ AC3_2e^fQ+AWv2Y�AWv436ib^�^HR \ 2�36ijS iCR�^ h iP3 e0AC36Y AC3_v�h 36ij1 ��9f]��

U

R�i $29(] � AWRJT�G � >@BbR�2436]WAWoZ^QK ^�226� >Z[.)+9fM)(/sReAWoZ^�i�AWo e0A 5j^IyPBPi�e0^�R \ 2�Y+>Z^�RfAbBPv2 ACBPY AbBP[CoZ2�Rhi R \ 2[CijAWo"362o@AWR�>Z]C2JR�i,>ZR�^Iv4/+3h3624BCR�Q+iC^�>ZR�>ZijB�ACBPY h AWv>@BP[.)

g�\ 2meHij36oZY�R \ 2 3_ijS+iCR iPvv4/+QP>q2^t>Z^�A�^ �=/+Ab362 36iPij1�z�e?>qR \ 3hACBPY+ij1,oZ5�QPo@AWv2Y!vijBb]C2A;,Q+iCoZ5P[CijB+AWoijSP^�RfAWvoZ2^H>@B�>ZR4) g�\ 2 3_ijS+iCRH^�R AC36R�^�AWRHA,3�ACBPY+ij1'Q+iC^�>ZR�>ZijB e?>qR \ A,3�ACBPY+iP1 ij36>Z24BbRfAWR�>ZijB%z+ACBPY \ AW^R�i 3624AWv \ R \ 2e[CiPAWosz�e \ >Zv \ >Z^IAWoZ^�i AWR�A!3�ACBPY+ij1 Q+iC^�>ZR�>ZijB%)

g�\ 2,36ijS+ibR�1,iW]C2^ISb5�^�2oZ2vR�>@BP[Yh 36ij1 A�Y+>q^hv4362R�2!^�2R�i�h AWvRh>qiPBP^QK ^�22,^�2vR�>ZijB G+)xl(M) / RIY+iP2^R \ >Z^ /+BbR�>Zo ACB�AWvR�>ZijB�362^f/PoZR�^�>@B�A,viboqoZ>Z^�>ZijB e0>ZR \ ACB�ijSP^�RfApvoq2Cz%AC3�3_>q]P>@BP[8ApR R \ 2�[CijApo zPij3?A,R�>@1,2 -ij/PR K R \ 2e36ijS iCR0>Z^IAWoZoZi�eH2Y�ijBPoZ5�A�oZ>@1,>ZR�2Y BP/+1�S 243Hi�h ^�R�24QP^0>@B e \ >Zv \ R�i!3624Apv \ R \ 2e[bijAWoZM) g�\ 2Rf36>@AWo R \ 24B�24BPY+^�ACBPY�R \ 2!36ijS iCRI362v2>Z]C2^�A�Q+A 5Ci�5 S+AW^�2Y�ijB�>ZR�^^H B+AWo Q+ib^�>ZR�>ZijB�AW^IY+2^hv436>@S+2Y >@B^�2vR�>ZijBcG )xl+) g�\ 2�o@A 5Cij/PRHi�h R \ 2,36ijiP1 >Z^�R \ 24B�3hACBPY+ij1,>Z^�2Y"z.AbBPY�R \ 2�36iPS+iCR0^hRfAC36R�^0A!BP2Ae Rf36>@AWos)XHijBP^�2 �+/P24BCRhoq5Cz R \ 2!ijBPoZ5�>@B(h iP3�1!AWR�>ZijB�R \ ApReR \ 2 36ijS iCR \ AW^�AW^eRhi�R \ 2 �=/+AWoZ>ZR65�i�h >ZR�^,AWvR�>ZijBP^e>Z^R \ 2^H B+AWo Q+A 5Ci�5�>ZRI>Z^0[C>Z]C24B%z%ACBPYYe \ ApR0>ZR \ AW^0oZ24AC3�BbRmh 36ij1 Q+3_2]j>Zij/P^�Rf36>@AWoZ^4)

��2� L+ME7:�����Q5 ���NOP��=@?A� OP���Q= �/ B�R \ 2mhsiCoZoZi�e0>@BP[ 362^f/PoZR�^4zBeH2�vij1!Q+AC362?R \ 2I2 5"2vR�^Hi�h ACQ+QPoZ5P>@BP[!R \ 229�Y+>65"243624BbR0/+Q+Y.AWR�2e3�/PoZ2^0ijBR \ 2�36ijS iCR0oZ24AC3�BP>@BP[�RfAW^fy�Y+2^�v436>@S+2Y�>@B�^h2vR�>ZijBcG+) T �

� OPRfAbBPY.AC36Y$,.- oZ24AC3hBP>cBP[_K 2 �+/+AWR�>ZijBcG(M�e0>ZR \ L � ]`e \ 24BP2]C243eA�BPijB(- [j3622Y+5�AWvR�>ZijB�>q^�Q 243!-hsij3�1,2Y")

� ,�K!L�M2K 2 �+/+AWR�>ZijB�T4l(M)

� 9�iPY+>:H.2Y ,.- oZ24AC3�BP>@BP[ K 2 �+/+AWR�>ZijB�UfM)/ B�ApY+Y+>qRh>qiPB%z�eH2evij1!Q+Ab362eR \ 2e2 5"2vR0i�h�ACQ+QPoZ5j>@BP[�R \ 2^�2,/+Q+Y.AWR�2^e/P^�>@BP[�S+iCR \ S+Apv y(e0AC36Y�3624QPo@A45K ^�2vR�>ZijBY9+) T�MHACBPY�R \ 2eiPB(- oq>@BP2!AWoZ[Cij3_>qR \ 1 K ^�2vR�>ZijB�V'M)

g�\ 20^h>c1,/Po@AWR�2Y�36ijS+ibR�e Ap^ Rf3�AW>@BP2Y�e0>ZR \ J�AWvR�>ZijBP^�A ]WAW>ZocAbSPoq2eRhie>qR r R /+3�BJoq2 hsRIT�G � zbRf/+3�B!3_>q[ \ RT�G�� z.ij3?yW224Q�R \ 2�^fAb1,2 \ 24AWY+>@BP[.z"ACBPY�2>qR \ 243e1,iW]C2^h iP3 e0AC36Y�A4H�;P2Y�Y+>q^hRfACBPv2��.z ij3036241!Ap>cB�ijBR \ 2H^fAC1,2H^fQ iCR4) g�\ >Z^ 1,24AbBCR >ZR \ AWY!iPBP2 3_2Y./+BPY.ACBCRHAWvR�>ZijB�� B+AC1�2oq5!BPiCR�1�i ]P>@BP[eij3 v \ ACBP[C>@BP[\ 24AWY+>@BP[8AWR�AWoZo�� R \ ApR e0AW^0BP2]C243�/P^�2 h /Po">@B�AWv \ >Z2]j>@BP[�>ZR�^0iPSPD`2vRh>q]b2C)/ BP^hR�24AWY i�h0362v2>Z]j>@BP[ Q+A 5Ci�5"^ i \0AWRe24Apv \ R�>@1,2�^�R�24Q%z%R \ 2�36ijS+ibReijBPoZ5 362v2>Z]C2Y;A�Q+A45bi�5 AWRR \ 2e24BPY�i�h 24AWv \ Rf36>@AWos) g�\ 2^H B+AWo Q+A 5Ci�5 362v2>Z]C2Y�Y+24Q 24BPY+2Y�ijB \ i�e R \ 2�R 36>@AWo%vijBPvo@/PY+2Y"r�Q��&�R /@h R \ 2�36ijS iCRe1,iW]C2Yce0>ZR \ >@B A�^f1!Apoqo=H�;P2Y 3�AWY+>@/P^ei�h�R \ 2,[CiPAWo Q+ib^�>ZR�>ZijB%z A�Q+A 5Ci�5 [C>Z]C24B

e0AW^eTC)

� ��&�?�V g.\ 2 36ijS iCR 3_2v2>q]b2Y A�Q+A 5Ci�5 S+AW^h2Y iPB�>ZR�^eY+>Z^�RfACBPv27h 36ij1 R \ 2,[CijApoke \ 24B�>qRev43hAW^ \ 2Y>s)w2C) i���� � � ]�1:G 2A;+Q+KS�0l���� � � #�������� � Me \ 243_2���� ����� e0AW^0R \ 2eoZ24BP[CR \ i�h ijBP24e0AWoZo iah R \ 2J^ �+/+AC362�36iPij1�)

��&� !� / h R \ 2�Rf36>@AWo0R�>@1,2YB- iP/PR$K >@B;R \ 2�3_2^f/PoZR�^ Q+362^�24BbR�2Y;>@B;R \ >q^�^�2vR�>ZijB%zHR \ >Z^�e0AW^!A�hsR�243!lf](]^�Rh24QP^ MzPR \ 2�36ijS iCRI362v2>Z]C2Y�R \ 2e^fAC1�2�Q+A45bi�5�AW^ hsij30AJv43�AW^ \ z.S+/PR�e0>ZR \ A $2] ):9!S+iPBj/P^mhsij3BPiCRHv43�Ap^ \ >@BP[.)/sRH^ \ ij/PoZY�S+2eBPiCR�2Y�R \ AWR R \ 2eQ+A 5Ci�5 h ij3 v43�AW^ \ >@BP[7e0AW^ v \ iC^�24B�>cB�A^h AW>@36oZ5 AC3hSP>qR 3�AC3657e0A 5�^�>@1!QPoZ5

R�i�[C>Z]C2 A \ >Z[ \ 243JQ+A45bi�5Nhsij3�24BPY+>@BP[�/+Q BP24AC36243eRhi R \ 2�[CijAWosz AbBPY�A�1�A�;j>@1,/+1 Q+A 5Cia5 i�h iPBPoq5]+):G+)

g�\ 2eY+>Z^�vij/+BbR.h AWvRhij3z h e Ap^0^�2R0R�i ]+)xUCU+zBe \ >Zv \ [C>Z]C2^eA \ >Z[ \ 243.eH2>q[ \ R�>@BP[�R�i AWvRh>qiPBP^0R \ AWRoq24ApY�R�i!R \ 2e[CijAWo%>@B�R \ 2^hs2AeH2^�R0^�Rh24QP^4)

T�]

g 3�AW>@BP>@BP[81�2R \ ijY O+/Pvv2^h^ h /Po 36ijS iCR�^ \�Q+Y.AWR�2^�RfACyp24B g 36>@AWo"oZ24BP[CR \K�h 36ij1 9fJfM Ks1,>ZoZoq>ZijBP^ M K ^hR�24QP^ M

OPRfACBPY.AC36Y T J+):] OfG+) T,�K0L M T4l 9+) > G+TC)6J

9 X�,.-0/ TV 9+):] Gf9+)69

g ACSPoZ2�TCr,O+/+1!1!AC365�i�h0^f/Pvv2^h^ h /PoH36ijS iCR�^EK R \ iC^�2 A ]C243hAW[C>@BP[!/8]�1xU(G�A4]b243�AW[C2!Q+A 5Ci�5;iW]C243eR \ 2ocAp^�RIT�] z:]f]f]?Rf3�AW>@BP>@BP[�R 36>@AWoZ^ Mz�h 36ij1 9(J�Y+>:5"243624BbR�L!ACBPY �Jvij1,SP>@B+AWR�>ZijBP^tRf3�AW>@BP2Y /P^h>cBP[,S+AWvyfe0AC36Y3624QPo@A45C)JXHiCo@/+1!BP^�^ \ i e BP/+1�S 243�i�h /+Q+Y.ApR�2^�1!ApY+2�iW]C243?R \ 2,Rf36>@AWoZ^4z"AbBPY R \ 2�A ]C243hAW[C2�BP/+1�S 243i�h ^hR�24QP^I362 �+/P>@362Y�R�i H BPY�R \ 2e[CiPAWo"SC5�R \ 2e24BPY")

g�\ 2Q,.-)h /+BPvR�>ZijB e0AW^ 3_24Q+362^�24BbR�2Y Sb5$J�BP24/+3�AWo�BP2R eHij3�yb^4z%ijBP27hsij3�24AWv \ A ] Ap>qo@ACSPoZ2�AWvR�>ZijB%)a�AWv \ BP2R eHij3�y \ AWY lfJ�>@B+Q+/PR�^ z�9 \ >ZY+Y+24B BPijY+2^4zHACBPY A�^�>@BP[CoZ2�iP/PRfQ+/PR4z�ACBPY;/P^�2Y ^�>Z[j1,iC>ZY.AWoAWvR�>Z] AWRh>qiPB h /+BPvR�>ZijBP^!i�h0R \ 2`hsij3�1���K��iM6� TD#�K6T@$�� -�� M2e \ >Zv \ 362^�Rf3_>qvRh2Y R \ 2�ij/PRfQ+/PRJi�hIR \ 2BP2R0eHij3hyC^ R�i�S+2R eH224B�]eACBPY�TC) g�\ 2�lfJ0>@B+Q+/PR�^meH24362HY./P20R�ie^ Q+3624AWY+>@BP[�R \ 2�Oe3624Apo+] AWo@/P2Y�^�24BP^�ij3^�RfAWR�2^�Apv436iC^�^J^�2]C243�AWot>@B+Q+/PR�BPiPY+2^,24AWv \ K)9 hsij3�24AWv \ i�h0R \ 2EG�3�ACBP[C2^ zkG hsij3�R \ 2!Y+>Z^�RfACBPv2�R�i[CijAWoszjAbBPYEJ�hsij3 R \ 2eACBP[CoZ2�R�i�R \ 2I[CiPAWoZMzj/P^�>@BP[ A h iP3�1 i�h"vijAb36^�2�vijY+>@BP[.)F�Nij3 2A;+AC1!QPoZ2Cz.AJ3�ACBP[C2] AWo@/P2ce0AW^�^fQ+3624AWY AWv43_iC^�^Q9�>@B+Q+/PR�BPijY+2^�AW^!>6h�>ZR�eH24362�AWvR�>Z] ApR�>@BP[ 9�^h>cBP[boq2 - >@B+Q+/PR�^�>Z[j1,iC>ZY.AWo/+BP>qRh^4z+24AWv \ e0>ZR \ AJY+>65"243624BbR SP>@AW^0]WAWo@/P2C) g.\ 2^�22eH24362ev \ ib^�24B�^�i!R \ ApR Ap^0R \ 2�3�ACBP[b2IY+2v43624Ap^�2Y"zR \ 2�>@B+Q+/PR�^�>@BPv43624AW^�2Y�ijBP2,A�h Rh243HR \ 2�ibR \ 2430/+BbR�>Zo AWR?]C24365�voqib^�2!3�ACBP[C2eR \ 25YeH24362�Apoqo�xijB�� ) g�\ >Z^362^�Rf36>ZvR�2Y�R \ 2e>@BPY+>Z]j>ZY./+AWo >@B+Q+/PR�] AWo@/P2^eR�i!A!3�AbBP[C2ei�h ],R�i�TC)/ B�R \ >q^^eHij3�y,R \ 2e^�>@1!QPoZ2�ktiCoZR�41!ACB+B�Q+36ijS+ACSP>ZoZ>ZR65�Y+>q^hRf36>@S+/PR�>ZijB e0AW^0/P^�2Y�R�i!Q+36iW]P>ZY+2�Q+36ijS(-ACSP>Zoq>ZR�>Z2^^hsij3H^�2oZ2vR�>@BP[�AWvRh>qiPBP^4z

� K2�&\ [N\)M�� �� ��� [�� % [������� %('*) � ��� [�� % ����� K6T�G(M

e \ 24362�� AWYWD�/P^�R�^!R \ 2�3hACBPY+ij1!BP2^�^,i�h�^�2oZ2vR�>ZijB%) g�\ >Z^ 1,24AbBP^!R \ AWR!AWvR�>ZijBP^`e0>ZR \_\ >Z[ \ 243�,.-] AWo@/P2^ \ A4]b2e[j3624AWR�243HQ+36iPS+ACSP>Zoq>ZR65�i�h S 2>@BP[ v \ iC^�24B%z.S+/PR?iCR \ 2430AWvRh>qiPBP^I1!A 5 S+2ev \ iC^�24B�>@BP^�Rh24AWY")*I^tR \ 2IACQ+Q+36i�;P>@1!AWR�>ZijB,iah�R \ 2 ,.-)h /+BPvRh>qiPB�>c1�Q+36iW]C2^4zjAbBPY!R \ 2IAC1�ij/+BCR iah�2A;+QPoZij3�AWRh>qiPB 362 �+/P>@362Y[Cij2^eY+i�eIB%zNR \ 2,] Apoc/P2�i�h�� >Z^�362Y./Pv2Y /+BbR�>Zo R \ 2J[j3622Y+5 ApvR�>ZijB \ AW^�AWo@1,iC^�ReQ+36ijS+AbSP>qoZ>ZR65 TJi�hS+2>@BP[�^�2oZ2vR�2Y AWRe24AWv \ ^�R�24Q%) / B�R \ 2 362^ /PoqRh^�Q+3_2^�24BCRh2Y"z�� e0AW^,362Y./Pv2Y oq>@BP24AC3_oq5;S+2R eH224B A] AWo@/P2�iah%]+)6]fG,ACBPY$]+)6]+T�i ]b243 l(]+z:]f]f]�Rf36>@AWoZ^4z.A h R�243e \ >Zv \ >qR.e Ap^mH�;j2Y�AWR�]+):]+Tb)

��KJ ��� ���E=CO �g�\ 24362!AC362J^�2]C243�AWo \ 24/+36>Z^�R�>Zv Q+Ab3�AC1,2R�243_^IR \ ApR 1,/P^�ReS+2!^h2RIY./+36>@BP[�Rf3�AW>@BP>@BP[ �%R \ 2,] Apoc/P2^,/P^�2Yh ij3?R \ 2,Y+>Z^�vij/+BbR^h ApvR�ij3 h ACBPY�R \ 2,2A;=QPoZij3hAWR�>ZijB�] AWo@/P2 � \ A ]C2!S+224B�Y+2^hv436>@S+2Y ACS iW]C2C) g�\ 2^�2e 243_2�v \ iC^�24B A�h Rh243IA�^f1�AWoZo�AC1,ij/+BbRIiah 2A;+Q+2436>@1,24BbRfAWR�>ZijB%z S+/PR�BPi�AWRhR�241!QPR2e0AW^e1!AWY+2,R�i H BPYijQPR�>@1!AWoN] AWo@/P2^ K 2C) [.) A2h AW^�Rh243�362Y./PvR�>ZijB�>@B!� v4ACB!^ Q+22Y�/+Q�vijBC]b2436[C24BPv2�R�i!Ae^�iCo@/PR�>ZijB�M ) g�\ >Z^oq24A ]C2^HR \ 2�Rf3�Ap>cBP>@BP[!3�AWRh2��!ACBPY!R \ 2 g d Q+AC3�AC1,2Rh243mL"zfe \ >Zv \ eH24362mhsij/+BPY Rhi \ A ]C2IAJ^�>Z[jBP>6H.v4ACBbR2 5�2vR iPB�R \ 2 AbSP>qoZ>ZR65,i�h.R \ 20BP24/+3�AWo.BP2R eHij3�yb^ RhiIoZ24AC3�B%zPACBPY,R \ 2 �=/+Apoq>ZR65�iah R \ 2H^�iCo@/PR�>ZijBP^HAC3�36>Z]C2YAWR4)

g�\ 2t[j3�ACQ \ ^">@B � >Z[.)V�^ \ i�e R \ 2t] AC36>@AWRh>qiPB�>@BJA4]b243�AW[C2�Q+A 5Ci�5"^"362v2>Z]C2Y!Sb5�36ijS+ibR�^ A�hsR�243"S 2>cBP[Rf3�AW>@BP2Y�ijB Gf]+z:](]f]e3�ACBPY+ij1�oq5�[C24BP243�ApR�2Y83_ijij1�^ /P^h>cBP[ /%>@B��w^IS+AWvyfe0AC3_Y 3624QPo@A 58AWoZ[CiP36>ZR \ 1�) g�\ 2[j3�ACQ \ ^0>@B � >Z[.)�G�^ \ i�e R \ 2,362^f/PoZR�^^e \ 24B�ijB(- oZ>@BP2 /+Q Y.AWR�2^�K ^�2vR�>ZijB�V'M0AC362,/P^�2Y�>@BP^�Rh24AWY") g�\ 2vijBCRhij/+3 QPoZiCR�^ Ab362HvijBP^�Rf3�/PvRh2Y7h 3_ij1 362^f/PoZR�^tijSPRfAW>@BP2Y7h 36ij1 ��� ]+) TCzf]+):G+zPTC):] zCl+):]+zf9+)6]+zWV.):]�ACBPY

TCT

0 0.2 0.4 0.6 0.8 1

0.5

1

1.5

2

2.5

3

3.5

4

+

0.950.960.970.98

λ

η

��� ���� � ������

� ��� � � �� ������ � � � ��� �� �

0 10 20 30 40 500

0.2

0.4

0.6

0.8

1

Trials (thousands)

Ave

rage

rew

ard

� g�� ������ ;g�� �

0 0.2 0.4 0.6 0.8 1

0.5

1

1.5

2

2.5

3

3.5

4

+

0.950.960.970.98

λ

η

� � � � �! ������ � � � ��� �� �

0 10 20 30 40 500

0.2

0.4

0.6

0.8

1

Trials (thousands)

Ave

rage

rew

ard

� g�� ������ ;g�� �

0 0.2 0.4 0.6 0.8 1

0.5

1

1.5

2

2.5

3

3.5

4

+

0.950.960.970.98

λ

η

"$# � �� �! ������ � � � %�

� &� �

0 10 20 30 40 500

0.2

0.4

0.6

0.8

1

Trials (thousands)

Ave

rage

rew

ard

� g�� ������ ;g�� �

� >q[P/+362!V.r��N� Xn��'JXHijBbR�ij/+3eQPoZiCR�^J^ \ i�e0>@BP[ \ i�e R \ 27H B+AWo�Q+A 5Ci�5 A�hsR�2432Gf]+z:](]f]!R 36>@AWoZ^�]WAC36>Z2^2hsij324AWv \ i�h R \ 2�R \ 3_22�/+Q+Y.ApR�2�3�/PoZ2^�ACQ+QPoZ>Z2Y /P^�>@BP[ 0 �&# 3 :;�&�8A ��� +4����C.h ij3 Y+>:5"243624BbR�] AWo@/P2^ei�h���ACBPYL�))($� �+*5��'�O+AC1!QPoZ2,Rf3�Ap>cBP>@BP[�v4/+36]b2^eRfACyW24BEh ij3?24AWv \ /+Q+Y.AWR�2!3�/PoZ2Cz%vij3h362^fQ+iPBPY+>cBP[�R�i�R \ 2�]WAWo@/P2i�hs�!ACBPYYL 1!Ab3�yW2Y Sb5 A $ ijB,24Apv \ vijBbR�ij/+3 QPoZiCR4) g.\ 2IY+iCRhR�2Y!oZ>@BP2e>q^HR \ 2�BPij3�1!AWoZ>Z^�2Y�A ]C243�Ap[C2Bj/+1,S+243?i�h ^hR�24QP^0RfACyp24B�>cB�24AWv \ Rf36>@AWo Ks1�A�;j>@1,/+1 Rf3_>cApo"oZ24BP[CR \ e0AW^Ilf](]�^hR�24QP^ M)

T4l

0 0.2 0.4 0.6 0.8 1

0.5

1

1.5

2

2.5

3

3.5

4

+

0.950.960.970.98

λ

η

��� ���� � � � �� � ��� � �

0 10 20 30 40 500

0.2

0.4

0.6

0.8

1

Trials (thousands)

Ave

rage

rew

ard

�Yg�� ���� 1 � g

0 0.2 0.4 0.6 0.8 1

0.5

1

1.5

2

2.5

3

3.5

4

+

0.950.960.970.98

λ

η

� � � �

0 10 20 30 40 500

0.2

0.4

0.6

0.8

1

Trials (thousands)

Ave

rage

rew

ard

�Yg�� ���� 1 � g

0 0.2 0.4 0.6 0.8 1

0.5

1

1.5

2

2.5

3

3.5

4

+

0.950.960.970.98

λ

η

"$# � ��

0 10 20 30 40 500

0.2

0.4

0.6

0.8

1

Trials (thousands)

Ave

rage

rew

ard

�Yg�� ���� 1 � g

� >q[P/+362QG+r��N� Xn��'JXHijBbR�ij/+3eQPoZiCR�^J^ \ i�e0>@BP[ \ i�e R \ 27H B+AWo�Q+A 5Ci�5 A�hsR�2432Gf]+z:](]f]!R 36>@AWoZ^�]WAC36>Z2^2hsij324AWv \ i�h+R \ 2HR \ 3622H/+Q+Y.AWRh2 3h/Poq2^HACQ+QPoZ>Z2YD!��-)����k�7�+hsij3"Y+>65"243624BbR ] AWo@/P2^ i�h^�JACBPY�L") (P� �+*���' O+AC1!QPoZ2Rf3�AW>@BP>@BP[ v4/+3_]C2^0RfACyp24B7hsij3H24AWv \ /+Q+Y.ApR�2�3�/PoZ2Cz.viP3�362^fQ ijBPY+>@BP[ R�i,R \ 2e]WAWo@/P2,i�h_��ACBPYNL�1!AC3�yW2YSC5�A $'ijB�24AWv \ vijBbR�ij/+3�QPoqibR4) g�\ 2,Y+iCRhR�2Y�oZ>@BP2!>Z^eR \ 2�BPiP3�1!AWoZ>Z^�2Y A ]C243�Ap[C2�Bj/+1,S 243�i�h�^�R�24QP^RfACyW24B�>@B�24Apv \ Rf3_>cApo Ks1!A�;P>@1,/+1 Rf36>@AWo%oZ24BP[CR \ e Ap^ l(]f],^�R�24QP^ M)

T�9

g 3�AW>@BP>@BP[81�2R \ ijY O+/Pvv2^h^ h /Po 36ijS iCR�^ \�Q+Y.AWR�2^�RfACyp24B g 36>@AWo"oZ24BP[CR \K�h 36ij1 9fJfM Ks1,>ZoZoq>ZijBP^ M K ^hR�24QP^ M

OPRfACBPY.AC36Y T�> G+)@T GfO+) >,�K0L M lCl V.):] GCl+)6J

9 X�,.-0/ lWV l+)wV VjU+)6J

g ACSPoZ2�l+r,O+/+1!1!AC365�i�h0^f/Pvv2^h^ h /PoH36ijS iCR�^EK R \ iC^�2 A ]C243hAW[C>@BP[!/8]�1xU(G�A4]b243�AW[C2!Q+A 5Ci�5;iW]C243eR \ 2ocAp^�R�T�]+z6]f]f]eR 3�AW>@BP>@BP[!Rf36>@AWoZ^ Mz>h 36iP1 9(J�Y+>65"243624BbR2L�ACBPY ��vij1,SP>cB+ApR�>ZijBP^I/P^�>@BP[�ijB(- oZ>cBP2!/+Q Y.AWR�2^4)XHiCo@/+1!BP^�^ \ i�e BP/+1,S+243?i�h /+Q Y.AWR�2^�1!ApY+2�iW]C243HR \ 2eR 36>@AWoZ^4z AbBPY�R \ 2,A4]b243�AW[C2�BP/+1,S+243?i�h�^�R�24QP^362 �=/P>@362Y�R�i7H BPY�R \ 2e[CijAWo"Sb5 R \ 2e24BPY")

0 0.2 0.4 0.6 0.8 1

0.5

1

1.5

2

2.5

3

3.5

4

0.950.960.970.98

λ

η

"$# � ��

0 1 2 3 4 5 60

0.2

0.4

0.6

0.8

1

Updates (millions)

Ave

rage

rew

ard

� � � �

��� � ������� ��� � �

��� ���� � �� � � �"$# � ��

� >q[P/+362�J+r �N� X ��' g�\ 2HvijBbR�ij/+3 QPoZiCR ^ \ i e?^ R \ 2HQ+A 5Ci�5!oZ2]C2oZ^ AWv \ >Z2]C2Y!SC5e9 X�,.-0/�Rf3hAW>@BP2Y�36ijS iCR�^A�h Rh243�TC)6G 1,>ZoZoZ>ZijB /+Q Y.AWR�2^4) (P� �+*���' g�\ 2,^fAC1,2JR \ 3622,2A;+AC1!QPoZ2![j3�AbQ \ ^�h 36ij1 � >Z[.)3G+zNR \ >Z^eR�>@1,2QPoqibR�R�2Y Ap[jAW>@BP^�R0/+Q+Y.AWRh2^ 3�ApR \ 243HR \ ACB�R 36>@AWoZ^4)

L8�I]+):] zf]+)xlfG+z�]+):G z ]+)6OfG+zf]+) >(G+zjTb):]mhsij3 24AWv \ i�h R \ 2 R \ 3622I/+Q+Y.ApR�203�/PoZ2^ /P^�2Y"zPACBPY!^ \ i�e;R \ 2 H B+AWoQ+A45bi�5�A ]C243�Ap[C2Y iW]C243tR \ 2Jo@AW^�R�T�] z:]f]f]�Rf36>@AWoZ^4) g�\ 2J[j3�ACQ \ ^?ijB�R \ 2�36>Z[ \ R0^ \ i�e R65+QP>qv4Apo oZ24AC3hBP>cBP[v4/+36]C2^.h ij3�36ijS iCR�^�R \ AWR0oZ24AC3hB�Rhi83624Apv \ R \ 2�[CiPAWo"vijBP^�>Z^�Rh24BCR�oZ5C) /sR�>Z^2eHij36R \ 36241�241�S 2436>@BP[�R \ AWRR \ 2e2A;=QPoZij3hAWR�>ZijB h AWvR�iP3 � \ AW^I3624AWv \ 2Y�>ZR�^�1,>@BP>c1,/+1 ]WAWo@/P2�i�h ]+):]+TeAWR0lf] z:]f]f]JRf36>@AWoZ^4)< 2�^�22 R \ AWR�R \ 2 Q 243!h iP3�1!ACBPv2�i�h,R \ 2 36ijS iCR�^�Rf3hAW>@BP2Y /P^�>@BP[ S+AWvy(e Ab36Y 3624QPo@A45 >Z^�]b24365^�24BP^�>ZR�>Z]C2�R�i R \ 2�v \ ib>qv2�i�heoZ24AC3�BP>@BP[ Q+AC3�Ab1,2R�2436^ �;AbBPY L"z e?>qR \ ^�RfAbBPY.AC36Y�,.- oZ24AC3hBP>cBP[;iPBPoq5Q+36ijY./Pv>@BP[�ijBP2,Rf3h/Poq5�^ /Pvv2^�^ h /Po 36iPS+iCR4) g.\ 2�362^f/PoZR�^^hsij3 � ^f/Pvv2^�^ h /Po �"36ijS+ibR�^ K R \ ib^�2�A ]C243�AW[C>@BP[/8]�1xUfG�Q+A 5Cia5 AWv436iC^�^eR \ 2�H B+AWo�T�]+z:](]f]!R 36>@AWoZ^ M,AC362!^f/+1�1!AC36>Z^�2Y >@B RfAbSPoq2�TCzie \ 24362�>qRJv4ACB S+2^�224B�R \ ApR 9 X�,.-0/ ACBPYc,�K!L�M0Q 243!hsij3�1 h AC3HS+2R�Rh243HR \ ACB�^�R ACBPY.AC36Yc,.- oZ24AC3�BP>@BP[.)/ B�viPBCRf3hAW^�R4zPR \ 2evijBbR�ij/+3?QPoqibR�^mhsij3HijB(- oZ>@BP2!/+Q+Y.AWR�>@BP[NKP� >Z[.)�GfMH^ \ i�e h AC3HoZ2^�^�^�24BP^�>ZR�>Z]j>ZR65�R�iR \ 2Iv \ iC>Zv2�i�h"oq24Ab3�BP>@BP[ Q+AC3�AC1�2R�2436^4) *I^Hv4ACB�S+2�^�224B h 36iP1 RfACSPoZ2el+zCR \ 2IBj/+1,S 243 AbBPYp�+/+AWoZ>ZR`5�i�hR \ 2e^f/Pvv2^�^ h /Po 36iPS+iCR�^H>Z^0[j3_24AWR�oZ5 >@BPv43624Ap^�2Y"z�e0>ZR \ R \ 2�S 2^�RI362^ /PoqRh^mh iP3�9 X�,.-0/�Rf3�AW>@BP2Y�36ijS iCR�^/P^�>@BP[ ijB(- oZ>@BP2!/+Q+Y.AWRh2^4)< \ 24B viP1!Q+AC36>@BP[�R \ 2�Q+243!hsij3�1!AbBPv2 i�h0R \ 2�ijB(- oZ>@BP2�Rf3hAW>@BP2Y 36iPS+iCR�^ z R \ 2 A ]C243�AW[C2�Q+A45bi�5"^362v2>Z]C2Y Sb5�R \ 2 36iPS+iCR�^eY+i�BPiCR�^ \ i e R \ 2�e \ iCoZ2 QP>ZvRf/+362C) g�\ 2�Bj/+1,S+243Ji�h ' +-A���� �.� R ACyW24B�>@BGf]+z:]f](]eRf36>@AWoZ^0]WAC36>Z2^0vijBP^h>qY+243hACSPoZ5�S+2R eH224B�R \ 2eY+>65�243_24BCR0R 3�AW>@BP>@BP[ 1,2R \ iPY+^4)F� >Z[.)�J,^ \ i�e0^HR \ 2^fAC1,2t[j3�ACQ \ ^�AW^ihsij3�� >Z[.)fG z S+/PR�e0>ZR \ R \ 2m;(-`A�;P>q^ ^hv4AWoZ2 >@B,Rh243�1,^ i�h /+Q+Y.AWRh2^ 3�AWR \ 243"R \ AbB�BP/+1�S 243

TV

9 A�;P>@1�/+1 Rf36>@AWo a�;+QPoZij3�AWR�>ZijB *I]b243�AW[C2 (eijApo X03�Ap^ \ O+A h 2oZ24BP[CR \ K ^�Rh24QP^ M ] AWo@/P2 � Q+A 5Ci�5 K R�>@1,2Y�ij/PR M

T�]f] BPijBP2 ]+)xU&>WV UfJCl G lf9]+):]+T ]+)xU&>+T UfJf] U l+T

lf]f] BPijBP2 ]+)xUbU+T U�>f] G T�G]+):]+T ]+)xUbUf9 U�>CU U l

Gf]f] BPijBP2 ]+)xUbU+T U�>f] G T�G]+):]+T ]+)xUbUf9 UCUf] U T

g ACSPoZ2Q9 re9 X�,.-0/;Rf3hAW>@BP2Y 36ijS iCReR�2^�R�2Y�ijB T�](]f]�3�ACBPY+ij1�oq5�[C24BP243hAWR�2Y 36iPij1,^4z+e0>ZR \ ] AC365P>@BP[1!A�;P>c1,/+1 R 36>@AWo"oZ24BP[CR \ ^4zNACBPYce0>ZR \ AbBPYce0>ZR \ ij/PR?2A;=QPoZij3�ApR�>ZijB%)

� >q[P/+3623O+r,�N� X ��'"* Rf3�Ap>cBP2Y�36ijS iCRH>@B�A�R65+QP>Zv4AWo%Rf3�AW>@BP>@BP[!24Bb]j>@36ijB+1�24BCR4) (P� �+*���' g�\ 2�^fAC1�2 36iPS+iCR>cB�A�BPiW]C2oN24BC]P>@36ijB+1,24BbR�viPBP^�>Z^�R�>@BP[!i�h"v>@36v4/Po@AC3tijSPD62vR�^�>@B�A�36iPij1'l+):G�R�>@1,2^Ho@AC36[C243 R \ ACB,>ZR \ AW^^�224B�Y./+36>@BP[�Rf3�AW>@BP>@BP[.)

i�h R 36>@AWoZ^4)�*�^�v4ACB�S 2�^�224B%zNR \ 2e9 X�,.-0/ Rf3�AW>@BP2Y 3_ijS+iCRh^ \ A ]C2evijBb]C2436[C2Y�R�i A,^�iboc/PRh>qiPB�>@B e 2oZo/+BPY+243eA 1,>ZoZoZ>ZijB /+Q Y.AWR�2^4zNvij1!Q+Ab362Y�R�i!iW]C243�l 1,>ZoZoZ>ZijB hsij3 ,�K0L M?ACBPY�V81,>ZoZoZ>ZijB hsij30^hRfACBPY.AC36Y,.- oq24Ab3�BP>@BP[.)

g i�Q+/PR�R \ >Z^,>@B Q+2436^ Q+2vR�>Z]C2Cz R \ 2!vijBbR�ij/+3e1!ACQ�>cB � >Z[.)�J�3_24Q+362^�24BbR�^eR \ 2 A ]C243�Ap[C2!Q+A45bi�5"^362v2>Z]C2Y Sb5�R \ 2!9 X�,.-0/ Rf3�AW>@BP2Y 36iPS+iCR�^�A h R�243,Tb):G�1,>ZoZoq>ZijB;AbQ+QPoq>Zv4AWRh>qiPBP^!i�h R \ 2 /+Q+Y.AWRh2 3�/PoZ2 �R \ 2![j3�AbQ \ ^^h ij3�R \ 2!iCR \ 243�R0eHi�1,2R \ iPY+^�AC3_2 BPiCRe^ \ i�eIB�AW^JR \ 25 AC362,]j>@36R /+AWoZoq5 SPocAbB+y�>s)w2C) BPi^�RfACBPY.AC3_YQ,.- oZ24AC3�BP>@BP[ R AC/P[ \ R�36ijS+ibR�^4zjAbBPY ijBPoZ5Q9�vij1,SP>@B+AWR�>ZijBP^0i�hs�!AbBPYcL7hsij3 ,�K0L M z \ A4]b2IoZ2YR�i A,36ijS iCR�e \ >Zv \ A ]C243�AW[b2^ A�Q+A45bi�5 [j3_24AWR�243tR \ ACBY]+) UfG4e0>ZR \ >@B Tb):G,1,>ZoqoZ>ZijB�/+Q+Y.ApR�2^4)

���� �� �IO ( 9;�NO���9;=�� 9N=���D��OPi.z�e \ AWR >Z^ R \ 20S+2^hR�36ijS+ibR vijBCR 36iCoZoZ243 R \ AWR v4ACB,S+2IAWv \ >Z2]C2Y�e0>ZR \ vijB+BP2vRh>qiPBP>q^hR 362>@B(hsij36v241,24BbR1,2R \ iPY+^�� g ACSPoZ2Q9�^f/+1!1!AC3_>q^h2^eR \ 2�362^ /PoqRh^^h ij3�A�36ijS+ibReRf3�AW>@BP2Y /P^�>@BP[�ijB(- oZ>@BP2!9 X�,.-0/ e0>ZR \A,Rf3�AW>@BP>@BP[�3�AWR�26��i�h�l+):] z.ACBPY L�2 �=/+Apo R�i ]+)xlfG+zPijBYG(]+z:]f]f],3�AbBPY+ij1,oZ5�[C24BP243�AWRh2Y�36ijiP1,^4);< >ZR \ijBPoZ5 T�]f]�^�R�24QP^eA ] AW>Zo@ACSPoZ2!R�i�3624AWv \ R \ 2�[CijApo Q+iC^h>qRh>qiPB%z"R \ 2,36ijS+ibR�h AW>ZoZ^�l iah�R \ 2,R�>@1,2�Y./P2,R�i

T�G

R�>@1,2 - ij/PR�^4) g�\ 2,Bj/+1,S+243?i�h�R�>@1,2 - iP/PR�^0Y.36ijQP^�R�i�Tb):G >6h lf]f]�^�R�24Q�Rf36>@AWoZ^eAC362,AWoZoqi�eH2Y"z#e0>ZR \ BPi3624AWo.>@1!Q+3_i ]b241,24BCR hsij3�ApoqoZi�e0>@BP[!>@BPv43624AW^h2Y�Bj/+1,S+243_^0i�h"^�R�24QP^4) <?iCR�2�R \ AWRtR \ 2I^h5j^�Rh241 Q 243!hsij3�1,^S+2R�R�243^e?>qR \ A�^ 1!AWoZo Ab1,ij/+BbRIi�hH2A;=QPoZij3hAWR�>ZijB%z%2]C24B e \ 24B h /PoZoZ5 R 3�AW>@BP2Y") g�\ >Z^e>Z^�S 2v4AC/P^�2!R \ 2oq>@1,>ZR�2Y�^�24BP^�ij365e>@B(hsij3�1!ApR�>ZijB,A4]WAW>Zo@ACSPoZ20R�i�R \ 2 36iPS+iCR 1!ACyW2^ R \ 20Q+36ijSPoZ241 BPijB(- 9 AC3�yWiW]P>@ACB%z4^hiI>@B^�ij1,20^h>qR /+AWR�>ZijBP^H>ZR >Z^0BPiCRtvoq24Ab3!- v4/PRme \ >Zv \ AWvR�>ZijB�R�ieRfACyp2C) / h R \ 2I3_ijS+iCRH1!ACyW2^HAeY+2R�243h1,>@BP>q^hR�>ZvY+2v>q^h>qiPB%z+e \ >Zv \ o@AWR�243HoZ24AWY+^�>ZR S+Apv y�R�i�R \ 2e^fAC1,2J^�RfAWRh2Czj>ZR^e0>ZoZo [C2R?v4AC/P[ \ R0>@B A�oqiPijQ%)H* oZ>qRhR�oZ22A;=QPoZij3�ApR�>ZijB%z \ i�eH2]C243zPv4ACB \ 2o@Q�R \ 2,36ijS+ibR iP/PR0i�h ^f/Pv \ ^�>ZRf/+AWR�>ZijBP^eSb5 [C>Z]P>@BP[8A!Q+3_ijS+ACSP>ZoZ>qR65�i�hQ+243!hsij3�1,>@BP[�A,Y+>65"243624BCR�AWvR�>ZijB%)� >Z[.)�O�^ \ i�e0^,R \ 2�Rf3�ApD`2vR�iP365�RfACyW24B SC5 R \ 2�36iPS+iCR,>@B ijB;A�R65=QP>Zv4AWoI3hACBPY+ij1,oZ5 [C24BP243�AWR�2YRf3�AW>@BP>@BP[�24Bb]j>@36iPB+1,24BCR z ACBPY >@B A�BPiW]C2o � v>c3_voq2 eHij36oZY��%24Bb]j>@36ijB+1�24BCR�h ij3^e \ >qv \ >ZR�3_2v2>q]b2Y BPiAWY+Y+>ZR�>ZijB+AWo Rf3�AW>@BP>@BP[.z+Y+241,iPBP^�Rf3�AWRh>cBP[�R \ 2e[C24BP243�AWoZ>ZR65�i�h >qRh^0vijBbRf36iCo"Q+iboq>Zv5C)

� � S��Y�3��S��� � L J � ]� � ������� � � �E����IOP�QD � ������58�.O��6� �g�\ 2 vijBbR�ij/+3�QPoZiCR�^�iah � >Z[.)HV ACBPY G ^ \ i�e \ i�e R \ 2 v \ iC>Zv2 i�h�R 3�AW>@BP>@BP[ 3�AWRh2 � ACBPY g d^-oq24Ab3�BP>@BP[83�ApR�27L v4ACB�2 5"2vR0R \ 2e^f/+SP^�2 �+/P24BCR�^f/Pvv2^�^0iP3 h Ap>qo@/+362Ji�h R \ 2e^h5j^�Rh241 R�i,vijBb]C2436[C2eR�i!A^f/Pvv2^�^ h /Po�^�iboc/PRh>qiPB%) OPij1,2,]WAWo@/P2^�^h>c1�QPoq5 362^f/PoZR�>@B�]C243_5�^�oZi�e vijBb]C2436[C24BPv2!Rh>c1�2^�� iCR \ 2436^e>@Bvij1!QPoZ2R�2.h AW>Zo@/+362�R�ieoZ24AC3�B!A�^f/Pvv2^�^ h /Po Q iCoZ>Zv5C) g�\ >Z^t>q^0S 2v4AC/P^�2�i�h R \ 2?[C24BP243�AWoZ>Z^fAWR�>ZijB�Q+36ijQ 2436R65i�h BP24/+3�AWo BP2R e iP3�yC^ z'e \ >qv \ 1,24ACBP^eR \ ApR0>@B(h ij3h1!AWR�>ZijB�v4ACB�S 2 � h ij3_[CiCR�R�24B��+AW^^eH2oZo AW^�oZ24AC3�BbR4)$/@hR \ 2 Q+Ab3�AC1,2R�243_^�v \ iC^�24B�Y./+36>@BP[!Rf3�AW>@BP>@BP[!AC362e/+BP^f/P>ZRfACSPoZ2Cz+R \ 2e36ijS iCRme0>ZoZo�hsij36[b2R�>@B(h iP3�1!AWR�>ZijB�AW^h AW^hRIAW^0>ZR�oq24Ab3�BP^I>ZR4z%ACBPY�^�i S+2,/+B+ACSPoZ2,R�i!vijBb]C2436[C2eiPB�A,^f/Pvv2^h^ h /Po ^�iCo@/PR�>ZijB%) g.\ >q^�>Z^ e \ 5�BPiQ+36ijiah ^ 5C2R 2A;P>q^hR 362[jAb36Y+>@BP[eR \ 2HvijBC]b2436[C24BPv20i�h�,.- oZ24AC3hBP>cBP[,ij3 g d^-`AWoZ[Cij36>ZR \ 1,^ >@B,vijB+BP2vR�>ZijBP>Z^�R^�5j^hR�241,^4)

XHijBP^h2 �=/P24BbR�oZ5CzW>ZR >q^ Y+2^�>@3�ACSPoZ20Rhi /P^�2HRf3hAW>@BP>cBP[e1,2R \ iPY+^ R \ AWR AC362�oZ2^�^ ^h24BP^�>ZR�>Z]C20R�i0R \ 2 v \ iC>Zv2i�h.Rf3�AW>@BP>@BP[�Q+AC3�Ab1,2R�2436^4z R�i A ]Cib>qY \ A ]j>@BP[�R�i Q 243!hsij3�1 3624Q+24AWRh2Y�2A;+Q+243_>c1�24BCR�^ Rhi02^�RfACSPoZ>Z^ \ e \ >qv \] AWo@/P2^7eHij3�y�S+2^hR4) g�\ 2 362^ /PoqRh^�Q+362^�24BbR�2Y >@B�R \ 2!o@AW^hRe^�2vR�>ZijB�^f/P[b[C2^�ReR \ AWR�!&�-)8���"���e/+Q+Y.ApR�2^ACBPY�R \ 2!/P^�2Ji�h�9 X�,.-0/ ij3 ,�K0L M z.AW^0ijQ+Q iC^�2Y�R�i�^�RfACBPY.Ab36Yc,.- oZ24AC3�BP>@BP[ /+Q Y.AWR�2^4z \ 2o@Q 362Y./Pv2R \ >Z^I^�24BP^h>qRh>q]P>ZR65C)

g�\ 2�] AWo@/P2Ji�h h /P^�2YYe0AW^%H�;j2Y�R \ 3_ij/P[ \ ij/PRHR \ 2�2A;=Q 2436>@1,24BbR�^IQ+362^�24BbR�2Y�AWR�]+) UCU+)N< >ZR \ BPiY+>q^hvij/+BCRh>cBP[Nz.R \ 2,36ijS iCRHv4ACB�AC3h36>Z]C2�AWR0^�iboc/PRh>qiPBP^IR \ ApR 3_24ACQ \ >Z[ \ H B+AWo Q+A 5Ci�5"^4z+S+/PR0Y+i BPibRI/P^�22�� v>Z24BCR,Rf3�ApD`2vRhij36>Z2^EKsAbBPY \ 24BPv2�R \ 2 36iPS+iCRJ>q^,i�hsR�24B�Rh>c1�2YB- ij/PR M) g i�>ZoZo@/P^�Rf3�ApR�2�R \ >Z^4z � >Z[.) >^ \ i�e0^HR \ 2eRf3�AW>@BP>@BP[�v4/+36]C2^mhsij3tR e i,36ijS iCR�^I/P^�>@BP[!9 X�,.-0/ e0>ZR \ ACBPYYe?>qR \ ij/PR0Y+>Z^�vij/+BbR�>@BP[.)t*I^v4ACB S 2�^�224B%ztR \ 28/+BPY+>Z^�viP/+BCR�2Y 36ijS iCR,Y+ij2^,vijBP^�>ZY+243�AbSPoq5_eHij3_^�2Cz 2^fQ+2v>@AWoZoZ5 >@B R \ 2�A ]C243�Ap[C2Bj/+1,S+243?i�h�^�Rh24QP^0RfACyW24B�Q+243?Rf36>@AWoszNY+2^fQP>ZR�2,R \ 2^h ApvRIR \ ApR0R \ 24362J>q^�ijBPoZ5�A�T Y+>65"243624BPv2,>cB�R \ 2/+Q+Y.AWR�2^eS+2>@BP[�1!AWY+2�AWR?24AWv \ Rh>c1�2�^�R�24Q%)� >@B+AWoZoZ5Czj^hij1,2HR�2^�R�^ \ A ]C2H^ \ i�eIBJR \ ApR R \ 2?vijBC]b2436[C24BPv2Hi�h R \ 2IBP24/+3�AWo.BP2R eHij3�yb^ 3_2oq>Z2^ \ 24A ]f->qoZ5 ijB�R \ 2�2A;+QPoqiP3�AWR�>ZijB /P^�2Y;AWRe24AWv \ ^�R AW[C2!i�h0oZ24AC3�BP>@BP[.)H/@hI>ZR,>Z^�Rhiji�oZi�e 24AC36oZ5�ijB R \ 24B R \ 236ijS+ibR0v4ACB+BPiCR.H BPY�>c1�Q+36iW]C2Y Q iCoZ>qv>Z2^4zie \ >ZoZ^�RI>6hH>qR�>Z^IRhiji \ >Z[ \ AWR�A!o@AWR�243?^�RfAp[C2eR \ 24B�R \ 2�3�ACB(-Y+ij1!BP2^�^0>@BbR�243!hs24362^�e0>ZR \ R \ 2^H BP2�Rf/+BP>@BP[ 362 �+/P>@362Y�Rhi \ A ]C2�3_2oq>@ACSPoZ2,Q+iCoZ>Zv>Z2^�R \ AWRH^f/Pvv2^h^ h /PoZoZ5oq24ApY�R�i�R \ 2�[CijApo )G< \ 24B�/P^�>@BP[ A�ktiCoZR�41!AbB+B!Y+>Z^�Rf3_>cS+/PRh>qiPB%z.R \ 243_2 h ij3_2CzCR \ 2e3�AWR�2?i�h"vijBC]b2436[C24BPv2>q^�Y+>@362vR�oZ5�oZ>@B+yW2Y e0>ZR \ R \ 2�3hAWR�2ei�h 3_2Y./PvR�>ZijB�i�h ��)

XHoZ24AC36oZ5JR \ 24362 hsij362Cz R \ 2�v \ iC>Zv20i�h.]WAWo@/P2^=h ij3 R \ 2 \ 24/+36>Z^�R�>ZvIQ+AC3�Ab1,2R�2436^ /P^h2Y�>@BJvijB+BP2vR�>ZijBP>Z^�R,.- oq24Ab3�BP>@BP[ >Z^Jv436>ZR�>Zv4AWo�>@B�ij3_Y+243eR�i�[j/+Ab3�ACBbR�22�^f/Pvv2^h^ h /PotvijBb]C2436[C24BPv2C) g�\ 3h/+B ACBPY OPv \ e0AC3_R�K6T4UCUf9(M Q+3_i ]P>ZY+2Y�oq>@1,>ZR�^�h iP3 h S+AW^�2Y�ijB�R \ 2�Rf36>@AWo oq24BP[bR \ ACBPY BP/+1,S+243�i�h�AWvR�>ZijBP^�A ] Ap>qo@ACSPoZ2,R�iA�^h5j^�Rh241�z+AW^�^f/+1,>@BP[!iPBP2 - ^�R�24QY,.- oZ24AC3�BP>@BP[�>Z^IS+2>@BP[�/P^�2Y"z.S+/PRI1�ij362�[C24BP243�AWo"362^f/PoZR�^�AC362�AW^H5C2R/+B+A4]WAW>Zo@ACSPoZ2C)

T�J

0 10 20 30 40 500

0.2

0.4

0.6

0.8

1

Trials (thousands)

Ave

rage

rew

ard

� g�� ���

0 10 20 30 40 500

0.2

0.4

0.6

0.8

1

Trials (thousands)

Ave

rage

rew

ard

�m � g

� >q[P/+362p>+re(�3hACQ \ ^�^ \ i�e0>@BP[�R \ 2�2 5�2vReiah R \ 2�Y+>Z^�viP/+BCR4h AWvR�ij3 h )�ktiCR \ 36ijS+ibR�^2eH24362,Rf3�AW>@BP2Y/P^�>@BP[!9 X�,.-0/ e0>ZR \ �.�'TC):]�AbBPY L � ]+):G+) g�\ 2IY+ibR�R�2Y�oq>@BP2^�^ \ i�e R \ 2�BPiP3�1!AWoZ>Z^�2Y�BP/+1�S 243ti�h^�R�24QP^IQ 2430Rf3_>cApo )

���2� � ���/=������ � ���D���� ���%+ ����7E=Q���g�\ 2 3_2^f/PoZR�^Hi�h R \ 2�R�2^�R�^%h iP3�/P^�>@BP[,ijB(- oZ>@BP2�/+Q+Y.ApR�>@BP[!vij1!Q+AC3_2Y R�i,S+AWvyfe0AC36Y�3624QPo@A45�AC3620>@BbR�243!-2^�R�>@BP[ �+ijB(- oZ>@BP2 /+Q Y.AWR�>@BP[ viPBP^�>Z^�R�24BbR�oZ5�Q+243!hsij3�1,^�1�/Pv \ 1,ij3_2e^f/Pvv2^�^ h /PoZoq5�iW]C243HA7e0>ZY+243�3�ACBP[C2i�h Rf3�Ap>cBP>@BP[�Q+AC3�AC1�2R�2436^ h iP3 Apoqo=9�/+Q Y.AWR�2,3�/PoZ2^4) g�\ >Z^0>Z^(�=/P>ZR�2e^f/+3hQ+36>Z^�>@BP[.z Ap^ S+Apv y(e0AC36Y�3624QPo@A45\ AW^!R \ 2�S 24BP2 H.R�i�h \ A ]P>@BP[ AWoZo0^�RfApR�2 -`AWvR�>ZijB;Q+AW>@36^�^�R�iP362YNhsij3,R \ 2�Rf36>@AWosz0ACBPY S+2>@BP[ /+Q Y.AWR�2Y/P^�>@BP[ ^f/+Q 2436]P>q^h2Y oZ24AC3hBP>cBP[�S+AW^�2Y�ijB�R \ 2^H B+AWo 362Ae0AC36Y")�b?i�e 2]b243zP>qR.e iP/PoqY�^�2241 R \ ApR0ijB(- oZ>@BP2oq24Ab3�BP>@BP[ \ AW^tR \ 20AWY+] ACBbRfAW[b2 R \ AWR R \ 2 2oZ>Z[C>@SP>Zo@>ZR�>@2^IApvR >cB�A�^�>@1,>ZocAb3�e0A 5eR�i�ARH !�H ����� ' H R�243�1�z�Q+36iW]j>ZY+>@BP[ /+Q Y.AWR�2^�R \ AWR 3_2Y./Pv2!R \ 2,243�36ij3�Rhi 2436iNz">@BP^�R�24AWY�i�hHvijBb]C2436[C>@BP[�AW^�5+1!QPR�ibR�>Zv4AWoZoq5�>@BQ+36ijQ+iP36R�>ZijB�R�i!R \ 2�1,24ACB�^2�=/+AC3_2Y�243�36ij3)tm�36iW]P>qY+>@BP[�A!1,ij1�24BCRf/+1'R�243h1 h iP3HR \ 2�/+Q+Y.ApR�2^ Q 243!-h ij3h1,2Y�Y./+36>@BP[�S+Apv y(e0AC36Y 3_24QPocA 5�vij/PoZY \ 2o@Q AWv \ >Z2]C2�R \ 2!^fAC1�2�2 5"2vRQKsAp^e>qRJY+ij2^e>@B BPij3�1!Apo^f/+Q+2436]P>Z^�2Y oZ24AC3�BP>@BP[ R AW^fyb^ Mz�S+/PR Apoq^hi >@BCRf3_ijY./Pv2^�ACBPiCR \ 243 \ 24/+36>Z^�Rh>qv Q+AC3hAC1,2R�243JR \ AWR7eHij/PoZYBP22Y�^�2R�Rh>cBP[�Y./+36>@BP[ Rf3hAW>@BP>cBP[N)

���KJ ( 9;587��>�<� �09;� 9� �A7l+���O�� � �E=Q� �g�\ 283_2^f/PoZR�^,^ \ i�e R \ 283_2ocApR�>Z]C28Q 243!hsij3�1!ACBPv2�i�h0R \ 2E9�Y+>65�243_24BCR4hsij3�1,^ei�hI/+Q Y.AWR�2�3�/PoZ2C) / R�>Z^>c1�Q+ij36R ACBCRtR�i�3_241,241,S+243 R \ AWR AWoZo+9ei�h"R \ 2^�2�/+Q+Y.AWR�2e3�/PoZ2^0AC36202A;+AWvR�oZ5!2 �+/P>Z] AWoZ24BbR�e \ 24B1+4'��8����C[j3622Y+5 ApvR�>ZijBP^�AC3_2�RfACyp24B�Y./+3_>cBP[�A�Rf36>@AWos) g�\ 2!Y+>65"243624BPv2!>@B�R \ 2!/+Q+Y.ApR�2^�iPvv4/+36^eijBPoZ5 e \ 24B2A;=QPoZij3�ApR�ij365�AWvR�>ZijBP^IAb362eRfACyW24B%)

\?^�>@BP[�^�RfAbBPY.AC36YQ,.- oZ24AC3�BP>@BP[�e?>qR \ L!^�2R�Rhi�2436i2hsij3�BPiPB(-`Q+iCoZ>Zv58ApvR�>ZijBP^4zfeH2>Z[ \ R�2oZ>Z[C>@SP>Zo@>ZR�>@2^AC362!ijBPoZ5;AWoZoZi eH2Y R�i S+/P>ZoZY /+Q e \ 24B R \ 2 36iPS+iCRJRfACyW2^,A�^h2 �=/P24BPv2�i�h0[j3_22Y+5 Q+iCoZ>Zv5;AWvR�>ZijBP^��R \ 25 AC362 2436ij2YYe \ 24B ACB�2A;=QPoZij3�ApR�ij365 ApvR�>ZijB,>Z^0RfACyp24B%) g.\ >q^H^�RhijQP^�R \ 2e362^f/PoZR�^Hi�h"2A;+QPoZij3�AWR�iP365AWvR�>ZijBP^�h 36ij1 S 2>@BP[ � ^�224B��jSb5,24AC36oZ>Z243�AWvR�>ZijBP^ zjS+/PR Apoq^hi�1,24ACB�R \ AWR ^�RfApR�2^ ^�22IA�vijBCRh>cBP/+AWo+iW]C243!-2^�R�>@1!AWR�>ZijB�i�h R \ 2�Q+A 5Ci�5"^0A ] AW>Zo@ACSPoZ2Cz"AW^0R \ 258AC3_2�AWo e0A 5j^HRf3�Ap>cBP2Y�ijB�R \ 2�1!A�;P>@1,/+1 +4���%A&�k#�� �%A,.- ] AWo@/P2 ApR�24Apv \ ^�R�24QIK g�\ 3�/+B ACBPY OPv \ e0AC3_R��T4UCU(9fM)cb?i�e 2]b243z >cB;A�vijB+BP2vRh>qiPBP>q^hR!^�5P^�R�241�z[C24BP243�AWoZ>Z^fAWR�>ZijB�iPvv4/+36^4z(e \ >Zv \ 1�24ACBP^�R \ ApR�R \ 202 5"2vR�^Hi�h S+AWY�2A;=QPoZij3�ApR�ij365!AWvR�>ZijBP^me0>ZoZo"S+2�^�224BSC5�BP24AC3hSC5�^�R AWR�2^02]C24B�>6h�L�>Z^I^�2R�R�i�243_i R�i�Rf365�R�i8Q+3_2]C24BCR?R \ >Z^4z.^hi R \ >Z^�>Z^ei�h oZ>@1,>ZR�2Y ]WAWo@/P2CzACBPY�^�>@1!QPoZ5�3_2^f/PoZR�^e>@B�R \ 2�>@B(hsij3�1!ApR�>ZijB�oq24Ab3�BCR�Sb5�[CiPijY�2A;+QPoZij3�AWR�iP365�AWvR�>ZijBP^�S 2>cBP[�/P^�2Y�oZ2^�^

���k@sJA<�KM<DE$CpmA@;JAI E$C;@;n KM<6J��':�� GS>7<DEP@;>AIMI2C�@7gT�O

2 5�2vRh>q]b2oq5C) g.\ 2�iW]C243�AWoZo%2 5"2vRI>Z^�R \ AWR0^hRfACBPY.AC36Yc,.- oZ24AC3hBP>cBP[�viPBC]C243_[C2^0oZ2^�^(�=/P>ZvyCoZ5Cz"ACBPY�i ]b243A�^f1!AWoZoZ243�3�AbBP[C2!i�hHRf3�AW>@BP>@BP[ Q+AC3hAC1,2R�2436^�K 2^fQ 2v>@AWoZoq5;BPiCR�>Zv4ACSPoZ2 e0>ZR \ S+AWvy(e Ab36Y 3624QPo@A 5�MeR \ ACB9�X.,.-0/ ij3m,�K!L�MHR65+Q+2�/+Q Y.AWR�2^4)

,�K!L�M >q^t>@B�2 5"2vR�A�vij1,SP>@B+AWR�>ZijB�i�h.^�RfACBPY.Ab36Y�,.- oq24Ab3�BP>@BP[�AbBPY�9 X�,.-0/ )fb0i�eH2]C243zC/+Q Y.AWR�>@BP[R \ 2!o@AW^�RJ[j3622Y+5 Q+3_2Y+>qvRh>qiPB;S+AW^�2Y ijB�R \ 2!BP2A;jR,Q+362Y+>ZvR�>ZijB%z Y+2^fQP>ZR�2�R \ 27h AWvReR \ AWReR \ 2!vij3�362 -^fQ+ijBPY+>@BP[�[j3622Y+5�AWvR�>ZijB e0AW^�BPibR�Q+243!hsij3�1,2Y"z >Z^�A�vijB(h /P^�>@BP[�vijBPv24QPR z S+/PR�AbQ+Q+24AC36^JR�iYeHij3�ye 2oZoH>@B Q+3hAWvR�>Zv2Cz�AWoZR \ ij/P[ \ >ZR�>Z^ BPibR�voZ24AC34e \ AWRJR \ 28Q+3_2Y+>qvRh>qiPBP^ 1!AWY+2 Sb5 >@BbR�243�1,2Y+>@AWR�2Y,.-h /+BPvR�>ZijBP^HAWvRf/+AWoZoZ5!3624Q+362^�24BbR4) g�\ 203�/PoZ2�>q^ ^hoq>Z[ \ R�oZ5 \ AC3_Y+243 R�ie>@1!QPoZ241,24BCRtR \ ACBJ2>ZR \ 243 ^hRfACBPY.AC36Y,.- oq24Ab3�BP>@BP[ ij3t9 X�,.-0/ zNACBPY�>@B�R \ 2^�2e2A;+Q+2436>@1,24BbR�^eACQ+Q+24AC3_^0R�i,i�5"243�BPi ApY+] ACBbRfAW[C2�iW]C243H/P^�>@BP[R \ 2e9 X�,.-0/ R65+Q+2ei�h�/+Q+Y.ApR�2^4)< >ZR \ 9�iPY+>6H.2Y XHijB+BP2vR�>ZijBP>Z^�RQ,.- oZ24AC3hBP>cBP[Nz�R \ 2�362^f/PoZR�^,i�h02A;+QPoZij3�AWR�iP365 AWvR�>ZijBP^!AC3_2!^�224BSC5�24AC36oZ>Z243e^hRfAWR�2^4zie \ >Zv \ R \ 24362 hsij362!oZ24AC3�B�R \ 2!2A;+Q+2vR�2Y;Q+A 5Ci�5 A ] Ap>qo@ACSPoZ2�>@B�24AWv \ ^�R AWR�2,[C>Z]C24BR \ 2!v4/+3�3624BbR,oZ2]C2o�i�h02A;+QPoZij3�AWR�>ZijB%)�a=5"2vR�>Z]C2oZ5Cz R \ 2 3_>q^ y�i�h A�Q+AC36R�>Zv4/Po@AC3Jvij/+36^h2 i�hIAWvRh>qiPBP^�>Z^S+/P>qoZR,>@B%z AW^e>6h ^hoq>Z[ \ R�2A;+QPoZij3�AWRh>qiPB�v4ACB�oZ24AWY R�i�Y+>Z^fAW^�Rh243z%R \ 24B�R \ 2�Q+362Y+>ZvR�2Y Q+A 5Cia5�^.hsij3�R \ AWR^�2 �=/P24BPv2�i�h AWvRh>qiPBP^3e0>ZoZo S 2!vij3�362^ Q+ijBPY+>@BP[CoZ5�oZi eH243z"/+BPoZ>@yW2`h iP3�^�RfACBPY.AC3_Y ,.- oZ24AC3hBP>cBP[Nzke \ >qv \AW>@1,^0ijBPoZ5�R�i!oZ24AC3hB�R \ 2�Y+2R�243h1,>@BP>q^hR�>Zv�[P3622Y+58Q iCoZ>Zv5C)

� �I�2�� ���3�S����/ B R \ >Z^83_24Q+ij36R zme 2 \ A ]C2�Q+362^�24BbR�2Y 1,2R \ iPY+^�hsij3,iPB(- oq>@BP2 /+Q Y.AWR�>@BP[ /P^�>@BP[ BP24/+3�AWoeBP2R eHij3�yb^h ij3?362>@B(h ij3_v241,24BCReoZ24AC3hBP>cBP[N) g�\ 2^�2,1,2R \ iPY+^ \ A ]C2,S+224B�Y+241,ijBP^hRf3�AWR�2Y�ijB�A�3624AWoZ>Z^�R�>Zv!1,ijSP>ZoZ236ijS+ibR�Q+36ijSPoZ241�ztACBPY \ A ]C2�^ \ i�eIB�R \ AWRJijB(- oZ>@BP2�oq24Ab3�BP>@BP[ >Z^�>@B h AWvR�A�1,ij362�2�� v>Z24BCR!1,2R \ iPYi�h Q+243!hsij3�1�>cBP[�/+Q+Y.AWRh2^eR \ ACB�S+AWvyfe0AC36Y�3624QPo@A 5 1,2R \ iPY+^QK)/%>@B;T UCUClfMz >cB�R�243�1,^eS+iCR \ iah�^�R�ij3!-AW[C2�362 �+/P>@36241,24BbR�^ ACBPY ^�24BP^�>ZR�>Z]j>ZR65;R�i�Rf3�Ap>cBP>@BP[;Q+AC3�AC1�2R�2436^4)_deB(- oZ>@BP2 oZ24AC3hBP>cBP[ Apoq^hi \ AW^!R \ 2AWY+] ACBbRfAW[b2�R \ AWR�>ZRevij/PoZY S+2!/P^�2Y >cB�vijBbR�>@BP/Pij/P^�oZ5�ijQ+243�ApR�>@BP[�^�5j^hR�241,^^e \ 24362!BPi�24BPY�i�h�Rf36>@AWovijBPY+>ZR�>ZijBP^IiPvv4/+3)/ B,AWY+Y+>ZR�>ZijB�R�iIR \ >q^ zC^�2]C243hAWojY+>65"243624BbR�/+Q+Y.AWRh2 3h/Poq2^ \ A ]C2 S 224B,vijBP^�>ZY+24362Y"zb>cBPvo@/PY+>@BP[ A�BP2Aeh ij3h1 K 9 X�,.-0/�M�S+Ap^�2Y81�ij362H^�Rf36iPBP[CoZ5�iPB g d^- oZ24AC3�BP>@BP[,R \ ACB,R \ 2 BPij3h1!AWo�,.- oZ24AC3�BP>@BP[!2 �+/+AWR�>ZijB%)g�\ >Z^ \ Ap^�S+224B�^ \ i�eIB,R�ievijBb]C2436[b2 Rhi�^�iCo@/PR�>ZijBP^t>@B!vijBP^h>qY+243hACSPoZ57h 2AeH243t/+Q+Y.AWR�2^tR \ ACB,^hRfACBPY.AC36Y,.- oq24Ab3�BP>@BP[ iP3!R \ 2 ,�K!L�M /+Q Y.AWR�2 3�/PoZ2CzeACBPY R�i S 2�1�ij362 36ijS+/P^�R�Rhi R \ 2�v \ iC>Zv2 i�h,Rf3�AW>@BP>@BP[Q+AC3�AC1,2Rh2436^4);/ B�vij1!Q+AC3_>q^hijB�e?>qR \ ,�K!L�Mzb9 X�,.-0/ �w^HQ+243!hsij3�1!AbBPv2I>@1!Q+36iW]C241�24BCRt>q^�BPiCR�^�iJvoZ24AC3v4/PR4z S+/PR�^hR�>Zoqo \ AW^,R \ 2 AWY+]WACBbRfAW[C2!iah?A�vij1!Q+/PRfApR�>ZijB+AWoZoZ5 ^�>@1!QPoZ243!/+Q+Y.ApR�283h/Poq2�362 �+/P>@36>@BP[ oZ2^�^^�R�ij3�Ap[C2Cz+AW^me 2oZo AW^0A,voZ24AC36oZ5�Y+2 H BP2Y�RfAC36[b2R,.-)h /+BPvR�>ZijB hsij3HACBC5�[C>Z]C24B�Q+iCoZ>Zv5C)

d.h"vij/+36^�2CzbR \ 2e362^f/PoZR�^ Ap^ AeviP1!Q+AC36>Z^�ijB�i�h"Y+>:5"243624BbR ,.- oZ24AC3hBP>cBP[�/+Q+Y.AWR�2e3�/PoZ2^0AC362mh AC3ih 36ij1vijBPvo@/P^�>Z]C2Cz AbBPYYh /+36R \ 243Hvij1�Q+AC3�AWR�>Z]C2�^�Rf/PY+>Z2^eBP22Y�R�i!S 2�1!AWY+2C) b0i�eH2]C243zPv4/+3�3624BbR�oZ5 e iP3�y,>Z^S+2>@BP[�v4AC3h36>Z2Y iP/PRIR�i�vij1!Q+AC362JR \ 2!Q+243!hsij3�1�ACBPv2�i�h�R \ 2�Y+>65"243624BbR /+Q Y.AWR�2!3�/PoZ2^eijB�A�Y+>q^hv4362R�2^�RfAWR�2 - ^ Q+AWv2 Q+36ijSPoZ241�z%e \ 24362�Q+362oZ>@1,>@B+AC365;362^f/PoZR�^,^f/+Q+Q ij36R,R \ 2`h AWvRJR \ AWRJ9�X.,.-0/ ACBPY ,�K!L�M/+Q+Y.AWR�2^eoZ24AWY�R�i`h AW^�R�243?vijBb]C2436[C24BPv2,R \ ACB�^�RfACBPY.Ab36Y$,.- oZ24AC3�BP>@BP[_KsACBPY h Ab3mh AW^�R�243 vijBC]b2436[C24BPv2R \ ACB�^�>@1!QPoZ2,ijBP2 - ^�R�24QY,.- oZ24AC3hBP>cBP[BM)

� ���7�3��� � �K� S �PO �����

g�\ ACB+yb^ 1,/P^�Rt[Ci,R�i�X \ 24B g�\ AC1 AbBPY8-H>Zv \ O+/PR�RhijB4hsij3tR \ 2>@3 \ 2o@Q(h /Po"vij1!1�24BCR�^HijB�R \ >Z^meHij3�yN)g�\ >Z^ eHij3�y�>q^.h /+BPY+2Y Sb58A,[P3�ACBbR h 36ij1 R \ 2�OPv>Z24BPv2�AbBPY�a�BP[C>@BP22436>@BP[�-H2^�24Ab36v \ XHij/+BPv>Zos)

T�>

� � R � �Y� � Rm�4 �MS���� 2S � �2S��� � � RT��� �.ij3HviP1!QPoZ2R�24BP2^�^4z+R \ 2�v4AWoZv4/Po@AWR�>ZijB�i�h_�8�; \�ACBPY \ 24BPv2�R \ 2e2oZ>Z[C>@SP>Zo@>ZR65 R 3�AWv2^0>Z^0[C>Z]C24B \ 24362C)< 2,Y+2 H BP2 A�BP24/+3�Apo�BP2R0eHij3hy�AW^eS+2>@BP[ A�viCoZoZ2vR�>ZijB iah >@BCRh2436vijB+BP2vR�2Y '����"�"� Ab3�3�ACBP[C2Y�>@B� �&C ��� �z=e \ >Zv \ eH2!o@ACS+2o�� !�� !�+1�1Z1Bh 36ij1#R \ 2 ij/PR Q+/PR�o@A 5C243eR�i�R \ 2�>cB+Q+/PR�ocA 5C243 ) * e 2>Z[ \ R�iPB AvijB+BP2vR�>ZijB h 36ij1 ocA 5C243� R�i���>Z^0o@ACS+2oZoZ2Y & ��� )�atAWv \ /+BP>qReQ+2430h ij3h1,^0R \ 2^hsiCoZoZi e?>cBP[`h /+BPvR�>ZijB%z

� � � � K����)M K6T�J(M��� � d

�&���� � � K6T�O(M

e \ 24362 � � >Z^0R \ 2�iP/PRfQ+/PRmh 36ij1'o@A45b243���ACBPY ��K 16MH>Z^IA � � � H?!&�kA^h /+BPvR�>ZijB%)g�\ 2eij/PR Q+/PR0[j3�AWY+>Z24BbR�� � \ >Z^IY+2 H BP2Y e�)x3 )wR4)"R \ 2eij/PRfQ+/PR0o@A 5C243meH2>Z[ \ R�^IAW^4z

" � �"'& ��� ��� 5 K����)M � � K6T�>(Me \ 24362 � 5 K 1:Mt>Z^�R \ 22H 36^hR0Y+>65�243_24BCR�>@AWo i�h R \ 2�^h>q[P1,iC>ZYYh /+BPvR�>ZijB%) g�\ 24362 hsij362Cz>h ij3 R \ 22H 36^hR \ >ZY+Y+24BocA 5C243e 2>Z[ \ R�^4z R \ 2e[j3�AWY+>Z24BbR0>Z^I^h>c1�QPoq5Cz

" � �"'&�� e � � 5 K���� MA& ��� � 5 K���� M � e K6T4U(M

g�\ 2^�2,] AWo@/P2^�AC3_2�AWY+Y+2Y�R�i!R \ 2�v4/+3�3624BbR�2oq>Z[C>@SP>Zo@>ZR�>@2^ )�(�24BP243�AWoZoZ5Cz%R \ 243623eHij/PoZY S+2,ijBP2Jij/PRfQ+/PR[j3�AWY+>Z24BbR7h iP3,24AWv \ ij/PRfQ+/PR��hz�ACBPY \ 24BPv2��e2oZ>Z[C>@SP>Zoq> R�>Z2^ceHij/PoZY S 2�362 �=/P>@362Y hsij3J24AWv \ e 2>Z[ \ R4z^�i�R \ ApR3e \ 24B 24AWv \ ij/PR Q+/PR��w^eR�241!Q ij3�AWotY+>65�243_24BPv2�243�36ij3zG_��6z AC3�36>Z]C2Y"z R \ 2`e 2>Z[ \ R�^Jvij/PoZY S+2/+Q+Y.AWR�2Y�AWvvij36Y+>@BP[�R�i.z �.& � e ^ d

�_ � � �� e Kslf](M

e \ 24362 � �� e >Z^ R \ 2�2oq>Z[C>@SP>ZoZ>@R65 ijB eH2>q[ \ R &�� e e \ >Zv \ vij3�362^ Q+ijBPY+^�R�i�ij/PRfQ+/PR��h)�b?i�eH2]C243z >@B,.- oq24Ab3�BP>@BP[.z"R \ 243_2�>Z^eijBPoZ5�A!^�>@BP[CoZ2!Rh241!Q+ij3hAWo"Y+>65"243624BPv2!243�36iP3�e \ >Zv \ >q^ev4Apoqv4/Po@AWRh2YNe�)x3) R4)0R \ 2ij/PRfQ+/PR e \ >Zv \ Q+36iPY./Pv2Y R \ 2�v4/+3�3624BbR8Q+362Y+>ZvR�>ZijB �\�) b?24BPv2 iPBPoq5 ijBP2�iP/PRfQ+/PR [P3�AWY+>Z24BCR�>Z^v4AWoZv4/PocApR�2Y AWRH24AWv \ R�>@1,2e^�R�24Q%zNACBPY�ijBPoZ5�ijBP2e2oZ>Z[C>@SP>qo >qR65�>Z^ 3_2 �=/P>@362Y�Q+243.e 2>Z[ \ R4)

J �KL�� ���m���� *Io@S+/P^4z��.)"O%) K_T4U�>+T�M )��$�����k�F����$��*5��W��k!&'5���&��A (9!�0 !�� �"# �z"k�� g a ktiPijyb^4z%9�v4(�3�A�em-0b?>Zoqosz%v \ ACQ(-

R�243�J z=Q+Q%) T�9CU! T�OCU+)d�A45PACB%zjm )�K_T4UCUClfM ) g�\ 2�vijBb]C2436[C24BPv2�i�h g dQK!L�Mih ij3 [C24BP243�AWo=L"z � ��#�*��k�7��� ���������"��� j r�9WV.T" >9(JCl+)/%>@B%zk/ )�K6T4UCUblfM)0OP2o6hT- >@1!Q+3_i ]P>@BP[ 3624AWvR�>Z]C2,AW[C24BbR�^ S+Ap^�2Y�ijB�362>@B(hsij36v241,24BbReoZ24AC3�BP>@BP[.z QPocAbB+BP>cBP[

ACBPY�R�24Apv \ >@BP[.zk� ��# *5�"����N���������"��� j rNlCUf9# >9bl+TC)/%>@B%z / ) K_T4UCUf9fM ) (9���"� X !���#��1H ���7���N���������"����Xn!�� (9!502!��"�%$N� �"���'& ��'5�����(& ��� :;!�� 3�� z m \ d R \ 2^�>Z^4z

X0AC3hBP2[C>Z2�9�2oZoqiPB�\�BP>q]b2436^�>ZR65Cz.m >ZR�R�^ S+/+36[ \ z.m 24B+BP^�5PoZ] ACBP>@A+)m 24BP[.z)�N)�ACBPY6< >ZoqoZ>@AC1,^ zI-e)*�N) K6T4UCUpV'M) / BPv436241,24BbRfAWoI1,/PoZR�>6- ^�R�24Q ,.- oZ24AC3�BP>@BP[.z �"�B< ) XHi \ 24B

ACBPY bJ) b?>@36^ \ K 2Y+^ Mz�� ��#�*��k�7� �N�%�������"��� ' ��!�#��%��A��"����� !�X � *5��+9����W����7� *-,���� �������&� �k!��7���.K!��.Xn��������#��0/ � �)132#4Czj9�ij3_[jACB65eAC/(h 1�ACB+B%z.<?2Ae kH3�/+BP^Se0>Zvy.z%<��Nz.\IOP*,z.Q+Q%)%lClfJ# +lf9Cl+)

T4U

-0/+1,2o \ AC36R4z d!)ja0) z'b?>cBbR�ijB%z+(�)=a?)jACBPY < >ZoqoZ>@AC1,^ z -e)��.)�K6T U�>fJfM)k9�&�8�&�k������� � � � �%� 0 '�� �%A89��!�#�� ���%)�"���jz�� iCos) TCzP9B/ g mt362^�^4)O+/PR�R�ijB%zP-e)CO%)�K6T4U�>&>fM)�/%24AC3�BP>@BP[,R�ieQ+362Y+>ZvR0SC5JR \ 2I1,2R \ iPY+^�iah R�241!Q ij3�AWoPY+>65"243624BPv2^4z � ��# *5�"����N�%�&�%�7�k�&� � r.U# jVCVN)O+/PR�R�ijB%zP-e)CO%)�K6T4U�>bUfM)-/ 1!QPoZ241,24BbRfAWRh>qiPB!Y+2RfAp>qoZ^ti�h R \ 2 g dQK!L�M Q+3_ijv2Y./+362h ij3 R \ 20v4AW^�2Hi�h%]C2vR�ij3

Q+362Y+>ZvR�>ZijBP^�ACBPY�S+Apv yPQ+36ijQ+AW[PAWR�>ZijB%z����%# *5���"#���� ( ��+U!&�%��� &����)� � 1����Wz.( g a /"AbS+ij3�ApR�ij36>Z2^4)

g�\ 3�/+B%z O%) K_T4UCUWV'M )I*eB ACQ+Q+3_ijAWv \ Rhi oZ24AC3�BP>@BP[ 36ijS iCReB+A4]P>Z[jAWR�>ZijB%z 9��!�# � , +�+)+ .Y!�� X �������7#%� !�X,%�7� ���"� � �5����� (9!502!��"����7A���C��n� �IH�zP9 /+BP>qv \ z%(e243�1!AbBC5C)

g�\ 3�/+B%z%O%) ACBPY�OPv \ e0AC36R�Cz *�)kK_T4UCUf9fM )K/s^�^ /P2^e>cB�/P^�>@BP[ h /+BPvRh>qiPB AbQ+Q+36i�;j>@1!AWRh>qiPB hsij30362>@B(hsij36v2 -1,24BbReoZ24AC3�BP>@BP[.zF ��!�#�� !�X�� *5��� !&'5��� *-.K!&������#�� �"!��7��� �F� !�A���� ���4' HRH?�����4#�*�!�!��Zz+/"A�eI3624BPv2a�3hSPocAb/+1�z�b?>qoZoZ^�Y.AWoZ2Cz <��.)

g�\ 3�/+B%z0O%)HkI)2K6T4UbUClfM) a � v>Z24BCR�2A;+QPoqiP3�AWR�>ZijB >@B 362>@B(h ij3_v241,24BCR�oZ24AC3�BP>@BP[.z����%# *5���"#%�&� ( ��+-!��%�.F� $N)".���) 1 �@)������Cz.X0Ab3�BP2[C>Z2 - 9�2oqoZijB�\�BP>Z]C2436^�>ZR65C)< AWRfyb>@BP^4z+Xe) �.)�bJ)+Xe)�K6T4U�>CU(M)��N���������"���YXn��!�H�� ������C@�%A (9��:;����A@�zjm \ d R \ 2^�>Z^4z 5�>cBP[ �w^0XHiCoZoZ2[C2CzX0AC1,S+36>ZY+[C2�\�BP>Z]C2436^�>ZR65Cz%\ 5,)

lf]