TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5....

97

Transcript of TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5....

Page 1: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

����������� ������������������������������! "�$#%����'&(�! )�*���!�,+)-��.�/�� #0�$�1�*�324���������5� 637����������8 �����/���$�9:,;=<>;�?!@*ACBEDEF

:HG.I�@*JLKNMPOQORBTSUAWVYX1Z�[�\]OQMP^/@/_]G*MPI*F`a@*b7ACB�D�JcOQId:UG�@*b5F

e @�fg[EMhAWbED*O eji9kml*njo ;

p%qsrhtvuQw�xytz|{T}L~R���.�R������{����7�T��}v�H�����h�R�/�R}v������}h���)}v}h���h�/�R�0�*����~Q��}Y�7�R��~y�U~.�������.���R���c�h~R�R�R����}v�]���R���R}v�H���U~�����~R�T��~R���

���*����}h��~R�T�>��{�}9�*}v��~y�T�g���.���������.�g~R�T�%�.}h���*�P�����,�R�*�����*��������{�}j��}v��}Y���h�R��}9��}v���.�N���*����}h��~R��}j�*}v���P������}Y�>�����}P��~R�����5���Q�.}h�*�C}Y~Q���T��}Y�$�y����{�}�¡ �z��P�R�������.�T���*����}v� ~R��}�}v�N�T{T~R������}v�7¢.�����T~y�����c�P�T��~R�5��{�}���}P��{T�/�T�!�T��}v�N����h�R����}Y�]�|�C�R��}v�����R�0�L���g��{�}H�*��£�}v��}v�.��}v�T�P�*�*���������/����}v���h¢*��{�}H�P�.�������R�E�y���*}h���y�0~Q�����.�>�.�*���c�h��~R�T�%��{�}H���y�0~Q���R�~R�T�¤~y¥v�����*��{g���������¦�h~y�c�P�T��~y�����R�T�v�

§ ¨7©�ªs«5¬,­¯®¤°Lª5±P¬�©

²�MhOyVQAW\]OaV³GTBT_]MPG�JUAW\(V³MhAc_PAWVQ@*J�_]G3_hX�Oµ´sG�ACBT_PACB�DEFj_]Mh@*VP¶�ACB�D·@�BEb¸ACf¯@/D�ACBED¡G*¹%fmG�bEOQMvBº_]OyJcOy\PV³G�´sOy\Q;¼»UX�OdV³GTBT_]MPG�J\]I�\]_]ORf½bEOQ^*OyJcG�´sOyb3¹�G*M%_hX�O(¾ AWJWJWAW@�fÀ¿�OQMh\PVYX�OyJ�»)OyJcOy\PV³G�´sO�Á�¾ ¿N»�Â,XE@*\>f¯OQ_%\]_]MhACB�D*ORBT_>´sOQMP¹�G*MvfÃ@�BEV³O¯_P@/MPD*OQ_P\@�BEb¸Ac_P\ÄV³GTBEV³Oy´E_hÅ7@*JH¹�Mh@�fmOQS¦G*MP¶ÆAW\(@*bEOyÇ�ÅE@/_]Oa¹ÈG*M(_hX�OdI*OQ_Äf¯G*MPOdbEORfÃ@�BEb7ACB�D�MPOyÇ�ÅEAcMPORf¯ORB�_P\¯G*¹N_hXEO1KNORf¯ACB7A´EMPG/É0OyV³_Q;Ê»UX�Oµ´�ÅEMh´sG�\]OËG*¹N_hXEOa´EMPOy\PORB�_ô�@*´�OQM(AW\¯_]G3bEOy\hV³MhAW[sOd_hX�Oµ@*JcD*G*MhAc_hX�f¯\(Å7\]Oyb¸ACBÌ_hXEOd¾ ¿N»ÍV³GTBT_]MPG�J\]I�\]_]ORfÎFsSUAc_hX�GTÅE_�f¤ÅEVYXdMPOQ¹�OQMPORBEV³Og_]GÎbEOQ_P@*AWJW\�G*¹ACfô7JcORfmORBT_P@/_PAcGTB�;�»UX�O¤@*ACf¯\N@/MPO>_]GÎbEG�VyÅ7f¯ORB�_�_hX�O>O³ÏEAW\]_PACB�DV³G�bEOU@�BEbm_]G>´EMPGR^�AWbEOU@%\]_P@/MP_PACB�D%´sG�ACBT_�¹�G*M\P´sOyVQAcÐ�VQ@/_PAcGTBÃG*¹�@>B�OQS'ACf¯´�JcORfmORBT_P@/_PAcGTB¯ÅE\PACB�D,b�A�ÑsOQMPORBT_�XE@/MvbES¦@/MhO*FJW@�B�DTÅE@/D*Og@�BEbÎG�´sOQMh@/_PACB�D¯\PI�\]_]ORfd;

»UXEO¯¾ ¿N»ÒAW\>@ÎÓE;�Ô.Õ�fmOQ_]MhOÃ_]OyJcOy\PV³G�´sOÄSUAc_hX¡@�B�@*Jc_P@/ÖyACf¤Å�_hX·fmGTÅ�B�_Q;(×�_>X7@*\,¹�GTÅ�M,¹�G�VQ@*J�\]_P@/_PAcGTBE\Qؤ²�MhACf¯O*Fe @*\P\POQD*Mh@*ACB%@�B7b,_�S¦G�Ù�@*\hf>I�_hX�;)»�X�O»)OyJcOy\PV³G�´sO e GTBT_]MPG�J�Ú�I�\P_]ORfÛÁÜ» e Ú�Â�AW\$_hXEO�\]G*¹�_�Sj@/MPO¦MPOyÇ�Å7AcMPOyb,_]GN´�G�ACBT_!_hXEO_]OyJcOy\PV³G�´sO,@/_H@�BË@*\]_]MPGTBEGTf¯AWVQ@*JsG�[�É0OyV³_QFE_]Gm_]Mh@*VP¶Ë@�BEbĹÈG�VyÅE\jAc_H@*VQVyÅ�Mh@/_]OyJcIË@�BEbÄ_]GÃf¯@/¶*O�@�BTIÃG/Ñ5\]OQ_P\UB�OyV³Oy\h\P@/MPIb�Å�MvACB�D(_hXEOgG�[�\]OQMP^/@/_PAcGTB�;g»�X�O¤f¯OyVvXE@�B7AW\hf¯\�_]Gd[sO¤V³GTBT_]MPG�JWJcOyb¡@/MhOm_hX�OQMPOQ¹�G*MPO*ØN@*Jc_PAc_hÅ7bEO¯@�BEb�@/ÖyACf¤Å�_hXÝbEMhAc^*Oy\yFACBE\]_]MYÅ7fmORBT_�MhG*_P@/_PAcGTB¡@/_,Oy@*VYX�G*¹_hXEOm¹ÈGTÅ�M�¹�G�VQ@*J�\]_P@/_PAcGTBE\QFL\]OyV³GTBEb7@/MhIÝfÃAcMPMPG*M�_PAWJc_QF)bEGTf¯O*F$\hX�Å�_]_]OQMh\QF!´7MhACf¯@/MPIf¯AcMhMPG*M%V³GR^*OQMm@�BEb¡¹ÈG�VyÅE\Q;Î<NVQÇ�ÅEAW\hAc_PAcGTB3VQ@�f¯OQMh@*\%@�BEbº@�Å�_]G*DTÅEAWbEOQMv\%@/MPOËB�G*_gÅ7B7bEOQM,_hX�OÃV³GTBT_]MPG�J�G*¹j_hX�O(» e ÚsF[�Å�_H´7MPGR^�AWbEO,b7@/_P@m_]G(Ac_Q;

»UXEOH» e ÚgAW\�ACfô7JcORfmORBT_]OybmACBmÞ)Z�:|»H:�<�ÙßÁ�SUAc_hX¯@,f¯ACBEACf¤Å7fàG*¹5`µ@*V³MPGg@�BEb e Â$GTBÃ@�á�@�Ï¤Ó l*l*l Õ�Ô l*l fÃACBEA�ÕV³GTf¯´�Å�_]OQMy;|×�_jAW\9ACBT_]OQMP¹�@*V³OybË_]G¤_hX�O�_]OyJcOy\PV³G�´sO%XE@/MvbES¦@/MhO�^�AW@ e @�f¯@*VN@�BEbÄ_]G¤_hX�ON@�ÅE_]G*DTÅEAWbEOQMh\9@�BEbË@*VQÇ�ÅEAW\PAc_PAcGTBVQ@�fmOQMv@*\ÅE\PACB�D,\POQMhAW@*J7JWACB�Oy\Q;|×�_f¯@RIg[sO9G�´sOQMh@/_]OybmOyAc_hX�OQM¦ACBm\]_P@�BEbEÕ�@*JcGTB�O�fmG�bEOjG*M�¹�MPGTfâ_hX�OH\PI�\]_]ORfÒV³GTf¯´�ÅE_]OQMyF_]G¯S�X7AWVvXÎAc_UAW\�ACB�_]OQMh¹�@*V³Oyb1ÅE\PACB�D¯ãNOyVyB�OQ_�¹ÈMPGTf�@�BÎ<�ãU<N`äã�Õ�_P@*\]¶s;

Ú�OyV³_PAcGTBµÔ¤\hÅ7fÃfÃ@/MhAW\]Oy\�_hX�O�[7@*\PAWV�D*OQGTf¯OQ_]MPI(¹�G*MH@�BË@*Jc_P@/ÖyACf¤Å�_hXË_]OyJcOy\PV³G�´sO%@�B7bÄb7OQMhAc^*Oy\9^*OyJcG�VQAc_PAcOy\�@�BEbÎ@*VYÕV³OyJcOQMh@/_PAcGTBE\yF7S�XEAWVYXË@/MPO,B�OQOybEOybËACBÄG*MhbEOQMj_]G¤Oy\]_PACf¯@/_]O�_hXEO�BEOyV³Oy\P\P@/MPIËÅE´�b7@/_]O�Mv@/_]Oy\j¹ÈG*MH´sG�ACBT_PACB�DmVQ@*JWVyÅEJW@/_PAcGTBE\Q;

å

Page 2: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

»UX�O%_P@�B�D*ORB�_0Õ�´�JW@�B�OgV³G�G*Mhb7ACB7@/_]O>\]I�\]_]ORf¯\NÅE\]OybdJW@/_]OQM�@/MPOg@*JW\]G(bEOQÐsB�Oyb5;HÚ�OyV³_PAcGTB k bEOy\PV³MhAW[sOy\9_hXEO%_]Mh@�BE\P¹ÈG*MvfÃ@�Õ_PAcGTBÆ[sOQ_�S¦OQORBÆ@*\]_]MPGTB�GTfÃAWVQ@*J9V³G�G*Mvb7ACBE@/_]Oy\m@�BEb·_hX�OdfmGTÅ�B�_¤@*Jc_P@/ÖyACf¤Å�_hXÆ\]I�\]_]ORfä@�BEbÆ\]OyV³_PAcGTBÆÓÝGTÅ�_PJWACB�Oy\¤_hXEO´EMPG�V³Oy\P\PACBED>G*¹)ORBEV³G�b7OQMj@�B7bÃ_]Mh@�B7\Pb�ÅEV³OQMjMPOy@*b7ACBED�\¦@�B7b(_hXEONVQ@*JWVyÅEJW@/_PAcGTBdG*¹!bEMhAc^*O�bEORfÃ@�BEb7\Q;|»UX�O�bEOQMhAc^/@/_PAcGTBÄG*¹_hX�O¯Ç�ÅE@�BT_PAc_PAcOy\%\hX�G.S�B1GTB1_hX�Om×]B�¹�G*Mvf¯@/_PAcGTB1ã�AW\P´7JW@RIÝAW\,_hX�Om\hÅE[�É0OyV³_�G*¹¦\POyV³_PAcGTB¡æ�ç)_hX7AW\�AW\%fmG�\]_PJcI1V³GTBEV³OQMvB�OybSUAc_hX�\PG*¹È_�S¦@/MPOÄJWACf¯Ac_P\Q;ËÚ�OyV³_PAcGTBºèÄGTÅE_PJWACB�Oy\>VQ@*JWAW[7Mh@/_PAcGTB¡@�BEb3b7AW@/DTB�G�\]_PAWV(´EMPG�V³Oyb�Å�MPOy\,@�B7b¡\]OyV³_PAcGTBºéÎ\hÅ�D*D*Oy\]_P\\]GTf¯O,b7AcMPOyV³_PAcGTBE\U¹ÈG*MH¹êÅ�_hÅ�MhO�b7OQ^*OyJcG�´�fmORBT_HG*¹|_hX�O,\]I�\]_]ORfÎ;

<ëD�JcG�\P\P@/MPI G*¹>_hXEOÝ\PI�fg[sG�JW\ÎÅE\]OybÊAW\ËD�Ac^*ORB¼ACBÊ<N´7´sORBEb7A�Ï'<>;H»UX�OÝ\]OyV³_PAcGTBE\dG*¹>_hX�Oݾ AWJWJWAW@�f�¿UOQMv\PVvX�OyJ»)OyJcOy\PV³G�´sO,ì�\]OQMv\Qí�`a@�B�ÅE@*J�bEOy\PV³MhAW[7ACBED>_hX�O�» e Ú¯@/MPO�@/_]_P@*VYX�Oybd@*\9<N´7´sORBEb7AWV³Oy\ iÌî¯n ;E»UX�Oy\PO�D�Ac^*O,@gV³GTf¯´7JcOQ_]O\P´sOyVQAcÐ�VQ@/_PAcGTB¯G*¹�_hX�OH\PI�\]_]ORfïV³GTfÃf¯@�B7b7\)@�B7bmb7AW\P´7JW@RI>GTÅ�_P´�Å�_Q;�»UX�OyAcM�V³GTBT_]ORB�_P\�@/MPO*Ø�VQJW@*\P\PAcÐ7Oyb¯V³GTf(f¯@�BEb¤\hÅ�f¤Õf¯@/MhI1ÁÜ<N´7´sORBEb7A�Ï i ÂPF�@*JW´�X7@*[�OQ_PAWVQ@*J$D�JcG�\P\P@/MPI�ÁÜ<�´�´�ORB7b7A�Ï e ÂPF7ACBT_]OQMh@*V³_PAc^*OgV³GTB�_]MPG�JLÅE\PACB�D¤_hX�O,» e ÚºðPXE@�BEb7\]OQ_PñÁÜ<N´7´sORBEb7A�ÏÄã>Â�@�B7bÎ_hX�O�×]B�¹ÈG*MYf¯@/_PAcGTBÎã�AW\P´7JW@RI¡ÁÜ<�´7´sORBEb�A�Ï n ÂP;

»UXEO�@*JcD*G*MhAc_hX7fÃ\�ÅE\POybù�G*M�@�Å�_]G*DTÅ7AWb7ACB�D¤@/MPO�bEOy\hV³MhAW[sOyb¯OyJW\]OQS�XEOQMPOgÁÜ?)@*ACB�D åyò*ò k ç�XEOQMPOy@/¹È_]OQMjó%ô�ÂP; n Ï�_]ORBE\PAc^*OMPOQ¹�OQMPORBEV³O9AW\|@*JW\]G,f¯@*bEO¦_]G�_hX�Ojõ�ö�÷søCù*ú7ù�û�ü.ý0þÃÿ��R÷7÷sø������³ú�û!û�ü%û���ó�yûÜýYü/ú�ü��� ��vù/ø�ó�ø��(ù*ú7ù��9Á�Ú�OyAWbEOyJCf¯@�B7B åyò*ò Ô�ÂPFX�OQMPOy@/¹�_]OQM,õ�ö�÷søCù*ú7ù�û�ü.ý]þ�ÿ��R÷7÷�ø������³ú�û0;�»UX�O¤\PAcDTB1V³GTBT^*ORB�_PAcGTBE\%¹ÈG*M�@*\]_]MhGTB�GTf¯AWVQ@*J|V³G�G*Mhb7ACBE@/_]Oy\�@/MPO¤_hX�G�\]O¯ÅE\POybACBË_hXEAW\HMPOQ¹ÈOQMhORBEV³O*Ø

å ;U<�ÖyACf¤Å�_hX Á��,¯AW\ÎfmOy@*\hÅEMPOyb¸¹�MPGTf4B�G*MP_hX _hX�MPGTÅ�DTX'Oy@*\]_ÎACB'_hX�O1´�JW@�B�OaG*¹%_hX�OÝXEG*MhAcÖQGTB @�BEb'OyJcOQ^/@/_PAcGTBÁ��¯Â,G*Mm@*Jc_PAc_hÅEbEOdAW\¯fmOy@*\vÅ�MPOyb3´sOQMh´sORBEb�AWVyÅEJW@/M>_]GÝ_hX�OdX�G*MvAcÖQGTB¼Á³ð0OyJcOQ^�@/_PAcGTBEñ3@�BEbâð]@*Jc_PAc_hÅEbEOyñ¡@/MPOdÅE\POybACBT_]OQMhVYXE@�B�D*Oy@*[7JcI*F$¹�G�JWJcGRS�ACB�DdV³GTB�^*ORBT_PAcGTBE@*J�ÅE\h@/D*O/ÂP; o ORBEAc_hXµb�AW\]_P@�BEV³O��������/Ô���� AW\�fmG*MPO>G*¹È_]ORBÝÅE\POybACBÃVQ@*JWVyÅEJW@/_PAcGTBE\QFE\PACB7V³O�Ac_AW\�@>BE@/_hÅ�Mv@*J7´sG�JW@/M�V³G�G*Mhb7ACBE@/_]O*;�Ù�G*_]OU_hXE@/_�¾¡@*JWJW@*V³O¯Á åyò*ò l Â�f¯Oy@*\hÅ�MPOy\�@/ÖyACf¤Å�_hX¹�MPGTf \PGTÅ�_hXË_hX�GTÅ�DTXÎOy@*\]_Q;

Ô�;U¿�GTÅ�M�@�B�D�JcOµÁ! 5Â9AW\,f¯Oy@*\hÅ�MPOybaS¦Oy\]_�Sj@/Mhb7\�ACBa_hX�Om´7JW@�B�O¤G*¹�_hXEOgOyÇ�ÅE@/_]G*M�¹�MPGTf _hX�O¯fmOQMhAWb�AW@�Bµ@�BEbÝbEOyVQJWA�ÕB7@/_PAcGTB3Á!"�¦AW\Uf¯Oy@*\hÅ�MPOybδsOQMh´sORBEb7AWVyÅ7JW@/M¦_]G(_hX�O�OyÇ�ÅE@/_]G*MyF�´sG�\PAc_PAc^*O>_]G¯_hX�O%B�G*MP_hX5;

k ;U:�AcDTX�_N@*\PV³ORBE\PAcGTBºÁ!#�¦AW\UfmOy@*\hÅEMPOyb˹ÈMhGTf _hX�O,OyÇ�ÅEACB�GRÏËOy@*\P_�Sj@/MhbµACBË_hXEO%´7JW@�B�O�G*¹|_hX�O�OyÇ�ÅE@/_]G*My;

ÓE;U?!GTB�D�Ac_hÅEbEOgAW\�f¯Oy@*\hÅ�MPOyb˹�MPGTf _hXEO,OyÇ�Å7ACB�GyÏdOy@*\]_�S¦@/MvbaACBd_hX�O%´7JW@�B�O>G*¹|_hX�O,OyVQJWAW´E_PAWVg@�BEbµJW@/_PAc_hÅ7bEOÄÁ�$$¦AW\f¯Oy@*\hÅ�MPOybδsOQMh´sORBEb�AWVyÅEJW@/Mj_]G¯_hX�O,OyVQJWAW´E_PAWV/Fs´sG�\PAc_PAc^*O%_]G¯_hXEO%B�G*MP_hX�;

æ�;NÚ�¶�IË´sG�\PAc_PAcGTBd@�B�D�JcOÄÁܲs<%ÂPF&%EF�AW\NfmOy@*\hÅEMPOybÎ@�B�_PAWVQJcG�VP¶�SUAW\]Og¹�MPGTf B�G*MP_hX�;

' (*),+s±h°.-0/�¬213/|ªs«54687:9 ;=<8> �s�*�$�T���5�U�*� �����/�5?7��� > ���â&Ä�! A@!7�T�/���) ×]B�_hXEAW\>\]OyV³_PAcGTB�F�S¦O(\hÅ7f(f¯@/MhAW\POg_hXEO(V³GTBT^*OQMh\PAcGTBE\¤[sOQ_�S¦OQORB¡OyÇ�ÅE@/_]G*MhAW@*J�Á! 5FB"TFC%�Â�@�BEbº@*Jc_P@/ÖyACf¤Å�_hX Á��>FB��FB$5ÂV³G�G*Mhb7ACBE@/_]Oy\N@�BEbÎ_hX�O>^*OyJcG�VQAc_�Iµ@�BEba@*VQV³OyJcOQMh@/_PAcGTB1GTBÎ_hX�O>\]¶�IÎACBd_hX�O%JW@/_]_]OQM�\]I�\P_]ORfÍb�ÅEMhACB�Dm\PAWbEOQMPOy@*J!_]Mh@*VP¶�ACB�DE;D AW\%_hX�O(´7@/Mh@*JWJW@*V³_PAWVÄ@�B�D�JcO*F,E�F�GHFL_hX�O(@�B�D�JcO([sOQ_�S¦OQORB3_hX�OôEMPG/É0OyV³_PAcGTBE\>GTB�_hX�OÃG*¹9_hX�OÃJcG�VQ@*J�^*OQMP_PAWVQ@*J¦@�BEb¡_hXEOfmOQMvAWb7AW@�B�;�»UX�O,V³GTBT^*OQMh\PAcGTBE\N@/MPO%V³GTBT_P@*ACB�OybaACBËOyÇ�Å7@/_PAcGTBÎÓE;�æ�; å é¯G*¹�`1Å�MPMv@yI�Á åyòJI k ÂPØ

V³G�\&� � V³G�\&"LV³G�\ HV³G�\5$LKÆ\PACBM"L\PACBN$\hACB,�a\hACBM� � �µ\PACBM HV³G�\&"V³G�\�a\hACBM� � \hACBM"LV³G�\&$��¡V³G�\"LV³G�\& H\PACBN$\PACB D \hACBM� � V³G�\5$�\PACBM V³G�\ D \hACBM� � V³G�\&"L\PACBN$��¡\PACBM"LV³G�\$�V³G�\5

»UXEO¯bEOQÐ�BEAc_PAcGTB¡G*¹j\P¶�I�²�< AW\%ACBE\]_]MYÅ7fmORBT_0Õ�bEOy´sORBEbEORBT_QF$@�BEb¡@a\P´sOyV³_]MPG*D*Mh@*´�X�\hJWAc_,G*M%GTB�OÃG*¹¦_hXEO(bEOQ_]OyV³_]G*M@�Ï�Oy\9AW\�D*ORBEOQMh@*JWJcIËÅ7\]Oyb(@*\j@gMPOQ¹�OQMPORBEV³O*;�»UXEO�f¯GTÅ7B�_¦´sG�\PAc_PAcGTBË@�B�D�JcO*FPO�FEfmOy@*\vÅ�MPOy\�_hX�O�MPG*_P@/_PAcGTBÄG*¹)@gb7AcMPOyV³_PAcGTB

Ô

Page 3: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

ÐEÏ�Oyb�ACBa_hX�OmMPG*_P@/_]G*M%@/MPGTÅ�BEb1_hX�OmG�´E_PAWVQ@*J�@�ÏEAW\�G*¹�_hXEOg_]OyJcOy\hV³G�´�O(@�B�_PAWVQJcG�VP¶�SUAW\]O(¹ÈMPGTf _hX�Om^*OQMh_PAWVQ@*J�b7AcMPOyV³_PAcGTB�;×]BmG*MhbEOQM¦_]Gmf¯@*ACBT_P@*ACBÃ@%ÐEÏ�Oyb(MPOyJW@/_PAcGTBÄ[sOQ_�S¦OQORBËfmGTÅ7BT_@�BEbÄ\]¶�I¯´�G�\hAc_PAcGTBÃ@�B�D�JcON¹�G*M¦b7A�Ñ�OQMPORBT_�V³GTB�Ð�DTÅ�Mh@/_PAcGTBE\QF_hX�O�¾Ê¿�»ÊV³GTBT_]MPG�J5\]I�\]_]ORf XE@*\j@�BÄG/Ñ�\POQ_j´�@/Mh@�fmOQ_]OQMyFQ%SR�F�SNXEAWVvXËAW\j@�BËACBE\]_]MYÅ7fmORBT_0Õ�bEOy´sORBEbEORBT_V³GTBE\]_P@�BT_Q;»UXEOMPOyJW@/_PAcGTBa[sOQ_�S¦OQORBd\]¶�IIJ�<>F�fmGTÅ�B�_9²�<â@�BEbd´7@/Mh@*JWJW@*V³_PAWV>@�B�D�JcO*F D AW\9_hX�ORB5Ø

O=�ßÁ!%T�U%SR.ÂA� D¹�G*M e @*\P\]OQD*Mv@*ACBd@�BEbd²MhACfmO�¹�G�VQA!@�BEb O=�ïÁ!%V�U%WR.ÂA� DYX �¹�G*MH_hX�O%ÙN@*\hf>I�_hXιÈG�VQA�Á�Kâ¹�G*MH_hX�O,ì n ÚË@�B7bZ�¼¹�G*MH_hX�OgK�¿N:H×0?¡¹�G�VQ@*J$\]_P@/_PAcGTBE\³ÂP;687[6 \ ������E�ê������(�5 C]ß�5�E�����7���s�����! ��»UX�ONÐ7Mh\P_¦bEOQMvAc^�@/_PAc^*Oy\9G*¹L@/ÖyACf¤Å�_hX�F�ÖQORBEAc_hXËb7AW\]_P@�BEV³O�@�BEbË´7@/Mv@*JWJW@*V³_PAWV,@�B�D�JcO,@/MPO�MPOyÇ�ÅEAcMPOybËACB(G*MhbEOQMj_]G¤Oy\]_PACf¯@/_]O_hX�O%ÅE´�b7@/_]O�Mv@/_]Oy\9MPOyÇ�ÅEAcMPOybι�G*MU´sG�ACB�_PACBED¯VQ@*JWVyÅEJW@/_PAcGTBE\Q;j²�MhACf¯Oy\9bEORB�G*_]O,b7A�Ñ�OQMPORBT_PAW@/_PAcGTBdS�Ac_hXËMPOy\P´sOyV³_9_]G(X�GTÅEM@�B�D�JcO*;�×]B(G*MhbEOQMj_]GmD*OQ_HbEOQMhAc^/@/_PAc^*Oy\9SUAc_hX(MPOy\h´�OyV³_j_]Gm\PAWbEOQMhOy@*J�_PACfmO*F�S�O,B�OQOybÄ_]GÃf¤ÅEJc_PAW´7JcI([TI�^ÝG*M_^�`�¹ÈG*M9Ð7Mv\]_@�BEbd\POyV³GTBEbdbEOQMhAc^/@/_PAc^*Oy\QF�MPOy\P´sOyV³_PAc^*OyJcI*F�SNX�OQMPOV^3AW\9_hX�O>\PAWbEOQMPOy@*J5_]Mv@*VP¶�ACB�D¯Mh@/_]O*F5é�;�Ô�é/ÔZa å lcbed Mh@*bµ\ bgf ;h5i�hgi�j kBlcm8n[oSprqsn�tuoWvm�wxl

�N��yQ\PACB,�z�{�dV³G�\&$�V³G�\"L\PACB, @�BEbÎ_hXEOQMPOQ¹ÈG*MhO,_hX�O�OyJcOQ^/@/_PAcGTBd^*OyJcG�VQAc_�IµAW\

� y �ÊV³G�\"LV³G�\5$U\hACBM �L\PACB2���|�d\hACB,�aV³G�\5$<à¹ÜÅ�Mh_hX�OQMUb7A�Ñ�OQMPORBT_PAW@/_PAcGTBdD�Ac^*Oy\

Á!�JyÈ ` V³G�\&�NK}��y yQ\PACBM�~� V³G�\&$�V³G�\5")V³G�\ @�BEbÎ_hXEO,@*VQV³OyJcOQMh@/_PAcGTBÝAW\ � y y �ÊV³G�\5$)ÁÜV³G�\&"LV³G�\ ��¡\PACB ` �1V³G�\&$�V³G�\��Â��L\hACBN�h5i�hgi�h ����n�����oSp

\PACBM��\hACB,���{�d\PACBM UV³G�\"� y V³G�\��\hACB,��K}� y V³G�\e�1\PACBM� � �dV³G�\ UV³G�\&"� \PACBM�V³G�\e�1\PACBN$��¡V³G�\&$�V³G�\&�

@�BEbÎ_hXEO,@/ÖyACfgÅE_hXË^*OyJcG�VQAc_�IµAW\H_hXEOQMPOQ¹ÈG*MhO

� y �ßÁÜ\PACB2$U\hACBM�T�¡V³G�\5$UV³G�\&��V³G�\�,Â��L\PACB2�»UX�O¡fÃ@�Ï�ACf¤Å7f ^*OyJcG�VQAc_�I"AW\ å bEOQD¸\ bgf F�\]GÆ_hX�O�Mv@*b7ACÅE\ËG*¹g_hX�O"ð][7JWACBEb¼\P´sG*_PñÌ@/_Î_hX�O�ÖQORB7Ac_hX¼AW\ l�� Ô åH� ; <V³GTBT^*ORBEAcORB�_US¦@RI(G*¹$SUMhAc_PACB�D=� y AW\9ACB(_]OQMvf¯\¦G*¹!_hXEO�´�@/Mh@*JWJW@*V³_PAWV,@�B�D�JcO*F D F�ÅE\PACB�Dg_hX�O�O³Ï�´7MPOy\P\PAcGTBËbEOQMvAc^*OybÄACBÄ_hXEOB�O³Ï�_U\hÅE[�\]OyV³_PAcGTB�Ø

\hACB D �{�d\PACB_�1V³G�\&$5�LV³G�\&"k

Page 4: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

V³G�\ DCD y�|�dV³G�\Q���2y³V³G�\5$5�LV³G�\&"DBy �|�dV³G�\$�V³G�\&�V�L\hACBM�� �Nye� V³G�\ D V³G�\&"��L\PACB2�e GTBE\POyÇ�Å�ORBT_PJcI*F

� y y � V³G�\&"~� �d\PACBM��\PACB DCD y �¡V³G�\ D V³G�\�x� y\hACB ` � �� V³G�\&"LV³G�\&$\PACB ` � ÁÜV³G�\ D V³G�\��\hACB,���3\PACB D V³G�\e�%Â

h5i�hgi�� �2v�Wv�!��vewJo�n�w�vemA�&��l\PACB,��V³G�\ D �Ê\PACB2$UV³G�\&"��¡V³G�\&$�\PACBM"LV³G�\&

¾�O>b�A�ÑsOQMPORBT_PAW@/_]O%_hX7AW\QF7@�BEbd\hÅ7[7\]_PAc_hÅ�_]O�¹�G*M�� y F�ÅE\hACB�Dm_hX�O�MPOy\hÅ7Jc_P\9G*¹|_hX�O,´EMPOQ^�AcGTÅE\H\hÅ7[7\]OyV³_PAcGTB�ØD y�� �µV³G�\&$

\hACBM��\PACB D ÁÜ\PACB,�1V³G�\&��V³G�\ D K·\PACBM"L\PACBM 5Â� �µV³G�\&$�V³G�\e�T�L\PACBM�¾�O%_hXEORBÎb7A�Ñ�OQMPORB�_PAW@/_]Og@/D�@*ACBd@�BEbµACBE\]OQMP_9_hX�O%O³Ï�´EMhOy\P\PAcGTBE\9¹�G*MN� y @�BEb�� y bEOQMhAc^*OybdOy@/MhJWAcOQMyØ

DCy y � � V³G�\&$\PACB ` � Á��µ\PACBM��\PACBM�2� y �¡V³G�\Q�1V³G�\&�x� y Â� \PACB,�1V³G�\&$\PACB ` � ÁÜV³G�\ D V³G�\"��¡V³G�\�aV³G�\&��V³G�\&$$Â

h5i�hgi�� ��lcwxv��w�����vPo�n��m}��MoSpAl��&l����gwcn[o¡ }q�lc�Uvem�q»UX�O,´sG�\PAc_PAcGTBÎOQMPMPG*MUVQ@�Bµ[�O�Oy\P_PACf¯@/_]Oybd[�IËO³Ï�´7@�B7b7ACB�D¤_hX�O%Ç�ÅE@�BT_PAc_�IdV³GTBEV³OQMvBEOybdACBÎ@¯»L@yI�JcG*MN\POQMhAcOy\QØ

¢ Á! LK�£� �/Ô�ÂB� ¢ Á! 5Â5K ¢ y Á! �ÂvÁ!£¤ �/Ô�ÂAK ¢ y y Á! �ÂvÁ å �/Ô�ÂvÁ!£� &�/Ô� ` K �������×�¹5_hX�O�^*OyJcG�VQAc_�IÄbEORfÃ@�BEbÃAW\ ¢ y Á! 5ÂPF�E�F�GHF�_hXE@/_j@*´7´EMPG�´EMvAW@/_]O�_]G¤_hX�O�f¯AWb7b�JcOUG*¹$_hX�O�´sOQMhAcG�b� ��¥£� &�/Ô î VK¦£� �/Ô�F_hX�ORBË_hXEO,OQMPMPG*MU@/_U_hX�O�ORBEbÎG*¹|_hX�O,´sOQMhAcG�bÎAW\HD�Ac^*ORBd_]GÃ@mÐ7Mh\P_j@*´�´EMPGyÏEACf¯@/_PAcGTBµ[TIsØ

¢ Á! LK}£� �/Ô�Â��¨§ ¢ Á! 5ÂgK ¢ y Á! 5ÂvÁ!£� �/Ô�Â!©�ª ¢ y y Á! �ÂvÁ!"� ` � I ¾�O�SUAW\hXÃ_]G¤ORBE\hÅ�MPO�_hXE@/_QFESUAc_hXEACBÃ_hX�O�@*JWJcGRS¦OybÎMh@/_]O�G*¹$_hX�ON_]OyJcOy\PV³G�´sOÃÁ l�� Ô �~« � « I l � ÂPF�_hX�ONMh@/_]O�G*¹$MPOyV³GTf¯´�Å�Õ_P@/_PAcGTBËG*¹)^*OyJcG�VQAc_�IËAW\HBEG*_¦_hXEO�fÃ@*ACB(¹�@*V³_]G*MH@�Ñ�OyV³_PACB�D¯_hX�O�_PACfÃACB�D>G*¹)_hX�O�\]OQMP^*G¯JcG�G�´�ÁÜ@�BÎÅE´�b7@/_]O�Mv@/_]O�G*¹LÔ l ¿UÖAW\�ÉPÅE\]_PAcÐ�Oybd[TIË_hX�OgfmOyVvX7@�BEAWVQ\9G*¹|_hX�O%_]OyJcOy\hV³G�´�O/ÂP;j¾�O¤ÅE\]O�_hX�O,O³ÏE´EMPOy\h\PAcGTBE\H¹�G*MH_hX�O>\]OyV³GTBEbµb7OQMhAc^�@/_PAc^*Oy\NG*¹s�>F�¯@�B7b D VQ@*JWVyÅEJW@/_]OybÝ@*[sGR^*O*;H»UX�O%S�G*Mh\P_UVQ@*\]Oy\�G�VQVyÅ�M�B�Oy@/MN_hX�O,ÖQORBEAc_hX�Fs@�BEbµ@/MhO>@*´7´EMhGyÏEACf¯@/_]O%[�I�^�`u�L\hACBN�¯ACB� @�BEb��µ@�BEbº[TI�^ `�¬ �L\PACB ` �µ¹ÈG*M D F|S�X�OQMhO ¬ AW\%_hXEOÃÐ7OyJWb3Mh@*b7ACÅE\Q;Ë»UX�OÄf¯@�ÏEACfgÅ�f ´sG�\PAc_PAcGTBE@*J�OQMhMPG*M>¹�G*M>@�BÅE´�b7@/_]O�Mh@/_]O%G*¹�Ô l ¿UÖ%AW\U_hX�ORBËMPGTÅEDTXEJcI l ; l*l Ô(@/MhVQ\]OyV,¹ÈG*M��à@�BEb¥�¯@�BEb l ; l*l ÓÄ@/MhVQ\]OyV%¹ÈG*M D ÁÜ@/_�@¯Ð7OyJWbÎMh@*b7ACÅ7\G*¹ k/l @/MhVyfÃACBsÂP;�»UX�Oy\]O%B�Å7fg[sOQMh\j@/MPO>B�OQD�JWAcD�AW[�JcO>V³GTf¯´�@/MPOybË_]G¯G*_hX�OQMN\]GTÅ�MhV³Oy\9G*¹|OQMPMhG*MUACBË_hX�O,´EMhOy\]ORB�_�VQ@*\]O*;

Ó

Page 5: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

687[­ &(�|�$�®]��� ���*��a�� �����·�*�� C¯$� )�µ�¦���5 �<ÊV³GTfÃf¯GTB¤MPOyÇ�ÅEAcMPORfmORBT_AW\_]GgfmG.^*OU_hX�OU_]OyJcOy\PV³G�´sONACBÃ\hÅEVvXÃ@,Sj@yIm_hXE@/_¦@�BÃACfÃ@/D*O�fmG.^*Oy\�[�Im@,D�Ac^*ORB(b7AW\]_P@�BEV³OGTBÝ_hX�O(bEOQ_]OyV³_]G*My;(»�X�O¯@*´7´EMPG�´7MhAW@/_]Om¹ÈG*MYfgÅ7JW@/OµÁÜ@*\P\hÅ7fÃACB�DÎ@dV³GTBE\]_P@�BT_%´7JW@/_]OÄ\PVQ@*JcO/ÂN@/MPOm_hXEG�\]O¯¹�G*M,DTB�GTfmGTB7AWV´EMPG/É0OyV³_PAcGTBµGTB�_]GÄ@m_P@�B�D*ORBT_N´7JW@�BEO(Á°GHF�±xF$`1Å�MPMv@yI åyòJI k ÂP;9<ß\PACf¯AWJW@/MU@*´�´7JWAWVQ@/_PAcGTBµAW\U_]GÃG/Ñ5\]OQ_U_hXEO%_]OyJcOy\PV³G�´sO>[�I@(D�Ac^*ORBÝ@�B�DTÅEJW@/M�b7AW\]_P@�BEV³O¤GTBa_hX�O¤\]¶�I*;,ÚEACBEV³O>_hXEOL#�"¯@�BEbY�V�ËV³G�G*Mhb�ACBE@/_]Og\PI�\]_]ORfÃ\�@/MhO¤[sG*_hXa´sG�JW@/MyF5@ÃD�Ac^*ORBG/Ñ5\]OQ_%ACBZ# G*M�� bEG�Oy\%B�G*_QF!G*¹9V³GTÅ�Mv\]O*F)V³G*MPMhOy\P´sGTBEbÝ_]Gd_hX�O¯\P@�f¯O¯@�B�DTÅEJW@/M%b�AW\]_P@�BEV³O¯OQ^*OQMPI�S�X�OQMhO¯GTBÝ_hX�O¯\]¶�IÁ°GHF�±xF�Ac_¦VQ@�Å7\]Oy\¦BEGgfmG.^*ORfmORBT_GTB¯_hX�O�@�ÏEAW\¦G*¹5_hX�O�V³G�G*Mhb7ACBE@/_]O�\]I�\]_]ORfËÂP;�»UXEOH_P@�B�D*ORBT_0Õ�´7JW@�B�O�@*´7´EMPGRÏ�ACfÃ@/_PAcGTBÃAW\@*JW\]GË\hÅEAc_P@*[7JcO>¹ÈG*M�_hXEAW\U@*´�´7JWAWVQ@/_PAcGTB1@�BEbµAW\�S�OyJWJ�Õ�[sORXE@R^*Oyb�B�Oy@/MU_hX�Og´sG�JcO>@�BEbµÖQORBEAc_hX�;9»UX�O%» e ÚdÅE\POy\U@�B�DTÅEJW@/MÅ7BEAc_P\_hX�MPGTÅ�DTXEGTÅ�_QF�@�B7b¯_hX�ONV³GTB�^*OQMh\hAcGTB([sOQ_�S�OQORB(JWACB�Oy@/M9Å7BEAc_P\�GTBÃ_hX�ONbEOQ_]OyV³_]G*M9@�BEbÃ@�B�DTÅ7JW@/MjÅ7B7Ac_P\GTB¯_hX�O�\]¶�IAW\HACfô7JWAWVQAc_UACBË_hX�Oy\PO,OyÇ�Å7@/_PAcGTBE\Q;»UXEMPOQO,\]I�\]_]ORf¯\9@/MPOgÅE\]Oyb5Ø

²V³ ��vQoW���n�v� e @/MP_]Oy\PAW@�B3V³G�G*Mhb�ACBE@/_]Oy\�´Î@�BEbUµ1@/MhO(bEOQÐ�BEOyb�@*JcGTB�Dµ_hX�O(´EMPG/É0OyV³_]Oyb�KT# @�BEb¶K·"(b�AcMPOyV³_PAcGTBE\%@/__hXEO,_P@�B�D*ORBT_�´sG�ACB�_%Á!#AR/F"�R.ÂPØ

_P@�B)Á!#Y�U#�R.¸� ´|\POyV�"�RW��Á å �Zµ¦_P@�BM"�R�Â#Y�U#�R¹ª ´|\POyV�"�R_P@�B2" � Á�µTKÆ_P@�BN"�R.ÂTV³G�\�Á!#Y�U#AR.Â���Á å �Zµ�_P@�BN"�R�Â� Á�µTKÆ_P@�BN"�R.Â���§WÁ å �Zµ¦_P@�BM"�R� ` K�´ ` \POyV ` "�Rº© f¼» `"��U"�R¹ª µ

SNX�OQMPO�_hX�O�@*´7´EMPGRÏ�ACfÃ@/_PAcGTBE\j@/MPO�_hX�O,ÅE\hÅ7@*J�GTB�Oy\j¹�G*MH\hfÃ@*JWJ�b7AW\h´7JW@*V³ORfmORBT_P\9@/_H´sG�\PAc_PAcGTBE\jS¦OyJWJ5@ySj@yIĹÈMPGTf_hXEO%´sG�JcO*;

�½�[oWvQ��n�����oSp <�BËOyÇ�ÅEAc^/@*JcORB�_U´�@*AcMHG*¹�V³G�G*Mhb�ACBE@/_]Oy\2¾LFe¿ÎAW\�bEOQÐ�B�OybÎACBÎ_hX�O,@*Jc_P@/ÖyACf¤Å�_hXµ\PI�\]_]ORfdF�SUAc_hXÀ¾�@*JcGTB�D_hXEO½KV� b�AcMPOyV³_PAcGTB·@�BEbU¿·@*JcGTB�DZKV� @/_>_hX�OÄ_P@�B�D*ORBT_g´sG�ACBT_ÄÁ�� R FB� R ¯ÁêB�G*_]O(_hX7@/_>_hX�OËXE@�BEbEOyb�B�Oy\P\%AW\G�´�´�G�\hAc_]O,_]G¯_hXE@/_HG*¹|_hX�O�OyÇ�ÅE@/_]G*MhAW@*J)\]I�\]_]ORfËÂP;

_P@�B$Á����Z��R�ÂÁ� ¾�\]OyV��NRH��Á å �Z¿j_P@�BN�NR.Â�Â�Z� R ª ¾�\]OyV�� R_P@�BM� � Á�¿�K·_P@�BN�NR.ÂTV³G�\.Á����Z��R�Â���Á å �¦¿H_P@�B,�NR�Â� Á�¿�K·_P@�BN� R Â���§WÁ å �U¿j_P@�BM� R  ` K}¾ ` \POyV ` � R © f¼» `�Ã�¦�2R¹ª ¿

¢Ä Þ|ACBE@*JWJcI*F ¢ @�BEb Ä @/MhOgbEOQÐsB�Oybµ@*JcGTB�DË@�Ï�Oy\�Ð7Ï�OybaSUAc_hXµMPOy\P´sOyV³_U_]GË@(\P_P@/_PAcGTBE@/MPIµACBE\P_]MvÅ7fmORBT_HMPG*_P@/_]G*M�¹�G*M�@^�AcMP_hÅE@*J|_]OyJcOy\hV³G�´�O1Á�E�F�GHFLACB1_hX�O¯@*[7\PORBEV³OmG*¹D*OQGTf¯OQ_]MhAWVQ@*J�G*M·Å7O³Ï7Å�MPO¤OQMPMhG*Mh\�@�BEb1MPOQ¹�Mh@*V³_PAcGTBsÂP;m»UX�Oy\]O¯@/MhOÅ7\]Oybm_]G,D�Ac^*OU@%V³GTB�^*ORBEAcORBT_�\PI�\]_]ORfß¹ÈG*M�G/Ñ5\]OQ_]_PACB�D>_hX�O9_]OyJcOy\PV³G�´sO�ACBT_]OQMh@*V³_PAc^*OyJcIÃ@�B7bm_hX�O ¢ @�B7b Ä @�Ï�Oy\@/MhO_hXEOQMPOQ¹ÈG*MhOg@*JWAcDTB�OybÝ@*´7´7MPGyÏEACf¯@/_]OyJcIÎSUAc_hXµG�[�^�AcGTÅE\Nb7AcMPOyV³_PAcGTB7\N\vÅEVvXµ@*\Nb7OQ_]OyV³_]G*M�@�Ï�Oy\NG*MN@(\P´sOyV³_]MPG*D*Mh@*´�X\hJWAc_Q;à»UXEAW\ÄAW\QFUX�G.S�OQ^*OQMRF�@�B @*´7´EMPGRÏ�ACfÃ@/_PAcGTB¸_]G·_hX�O1¹ÈG�VQ@*J�Õ�´7JW@�B�OÝV³G�G*Mvb7ACBE@/_]OÝ\]I�\P_]ORf ¢&Æ F ÄJÆ F9S�XEAWVvXAW\ÃÐEÏ�Oyb¸SUAc_hX¸MPOy\P´sOyV³_¯_]G3_hXEOµ\]_]MvÅEV³_hÅEMPOµ@�BEbÌ_hXEOQMPOQ¹ÈG*MhOaACBEVQJCÅEb7Oy\¯O³Ñ�OyV³_P\(\hÅ7VvX¸@*\ÃÐ7OyJWb¸MhG*_P@/_PAcGTB b�Å�O_]G�b7A�Ñ�OQMPORBT_PAW@*J¦MPOQ¹ÈMv@*V³_PAcGTBº@�B7b3_hX�OÄO³Ñ�OyV³_P\¤G*¹H´�G�ACBT_PACB�D1OQMPMPG*Mh\y;a»UX�O ¢Ä \PI�\]_]ORf½AW\gMPG*_P@/_]Oybƹ�MPGTf _hXEO@*Jc_P@/ÖyACf¤Å�_hXÄ\]I�\]_]ORfÛ[TIÃ_hX�ONf¯GTÅ7B�_�´�G�\hAc_PAcGTBÃ@�B�D�JcO*F�O�F�¹�G*M¦@g´sOQMP¹�OyV³__]OyJcOy\PV³G�´sO�@�BEb¯¹�MPGTfÒ_hX�ON´Jµ¯\PI�\]_]ORf[�IË_hX�O,\]¶�IÄ´sG�\PAc_PAcGTBµ@�B�D�JcOz%�F7V³G*MhMPOyV³_]Oybd¹�G*MH_hX�O%ACB7\]_]MvÅ7f¯ORB�_P@*J�G/Ñ5\]OQ_2%SR�;

»UX�O,V³GTBT^*OQMh\PAcGTB7\U[sOQ_�S¦OQORBÎ_hX�Oy\PO%V³G�G*Mvb7ACBE@/_]O%\]I�\]_]ORfÃ\H@/MPO%\PACfô7JcO�MPG*_P@/_PAcGTBE\QØ

¢ � �,´�V³G�\RÁ!%T�U%SR.Â5K�µ¦\PACB$Á!%T�Z%SR�Âæ

Page 6: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Ä � K�´�\PACB5Á!%T�U%SR.Â5K�µjV³G�\.Á!%T�Z%SR�¢ � KT¾�V³G�\QOTK�¿9\PACB_OÄ � �N¾�\PACB_OTK�¿9V³G�\QO´ � �N¾�V³G�\ D K�¿H\PACB Dµ � KT¾�\PACB D K�¿9V³G�\ D¹�G*M e @*\P\]OQD*Mh@*ACB @�BEb ²�MhACf¯Od¹�G�VQAÜF�fmG�b7AcÐ7Oyb¸[�I'@�B @*b7b7Ac_PAcGTBE@*J�MPG*_P@/_PAcGTBÊG*¹ X �ä@/_ËÙN@*\hf>I�_hXàÁ�Ú�OyV³_PAcGTB¼Ô�ÂP;e GTfô7JWAWVQ@/_PAcGTBE\,ACBT_]MPG�b�ÅEV³Oyb¡[�IaÐ�OyJWb¡b7AW\]_]G*MP_PAcGTB7\(Á°GHF�±xFL_hXEOmMh@*b7AW@*J�OQMPMhG*M,_�I�´7AWVQ@*JWJcI¡ACBT_]MPG�b�ÅEV³Oyb¡[�IaMPOQ¹�Mh@*V³_PACB�DÐ7OyJWbgV³G*MPMPOyV³_]G*Mh\|@�BEb%¹ÈG�VQ@*J�MPOyb�ÅEV³OQMh\QÂs@/MPOjb7AW\PVyÅE\h\]Oyb%ACB>ó%ôN;/»UX�O» e Ú�bEG�Oy\LBEG*_)VyÅ�MPMhORB�_PJcI>fÃ@/¶*O�@�BTI,@*JWJcGRSj@�BEV³O¹�G*MH_hX�ORfÎ;

Ç È·¬�±v©Nª�±v©LÉÁÊ�)MËP°�®=ËÌ)¦ª�±P¬N©L+­87:9 Í � �7�T���»UX�Od´�XEAWJcG�\]G�´�XTIÌ@*bEG�´E_]Oyb¸¹�G*M¯_hX�Oa´�G�ACBT_PACB�D3VQ@*JWVyÅ7JW@/_PAcGTBE\ËACBÌ_hX�Oµ» e Ú·AW\¯_hXE@/_ÃG*¹N_hXEO'ð0^�AcMh_hÅE@*JH_]OyJcOy\PV³G�´sOyñÁ�Ú�_]Mh@/Oyb7O¤ÎÒ¾¡@*JWJW@*V³O åyò é/è�ÂPF!SNX�G�\]OmACf¯´sOQMP¹�OyV³_PAcGTBE\�\hÅEVYXÝ@*\TÅ7O³Ï7Å�MPO¤@�BEbÝMPOQ¹�Mh@*V³_PAcGTB�@/MPOmV³GTBEV³Oy@*JcOyb3¹ÈMPGTf _hXEOÅE\]OQMR;L<NJWJ�G*¹�_hX�O9V³GTBT_]MPG�J7AW\�\P´sOyVQAcÐ7Oyb¤ACBg_]OQMvfÃ\LG*¹s\]_P@�B7b7@/Mhb¤@*\]_]MPGTB�GTfÃAWVQ@*JEV³G�G*Mvb7ACBE@/_]OH\]I�\]_]ORf¯\9Á�¹�G*M�_P@/MPD*OQ_P\³Â!G*MbEOQ_]OyV³_]G*MjV³G�G*Mvb7ACBE@/_]Oy\�Á�¹�G*M�ACfÃ@/D*Oy\³Â)»UXEOUf¯@�É0G*MhAc_�IgG*¹�_hXEAW\\]OyV³_PAcGTBÃAW\V³GTBEV³OQMYB�Oyb¯SUAc_hXm_hX�OHV³GTB�^*OQMv\PAcGTBÃ[sOQ_�S�OQORBACBE´�ÅE_´sG�\PAc_PAcGTBE\@�B7b¯_hX�O¤ÁêB�OyV³Oy\P\P@/MhAWJcI(ACf¯´sOQMP¹�OyV³_³ÂLfmOy@*\hÅEMPOyb¯V³G�G*Mhb7ACBE@/_]Oy\�G*¹5_hX�ONf¯GTÅ7BT_Q;|`µOyVvXE@�B7AW\hfÒV³GTBT_]MPG�J@�BEbµ_hX�O>fmG�bEOyJWJWACB�DÃG*¹|ACfôsOQMP¹ÈOyV³_PAcGTB7\UACBÎ_hXEO,ORBEV³G�bEOQMh\U@/MhO%_]MPOy@/_]Oyb1ACBÎ_hX�O>¹ÈG�JWJcG.SUACB�DÄ\]OyV³_PAcGTB�;�Ú�OyV³_PAcGTBE\ k ;�Ô îk ; å*å b7Oy\PV³MhAW[sO,@*\P´sOyV³_P\9G*¹|_hX�O,VQ@*JWVyÅEJW@/_PAcGTBE\�ACBÎb7OQ_P@*AWJÜF�S�XEAWJW\P_�Ú�OyV³_PAcGTB k ; å ÔÃ\hÅ7fÃfÃ@/MhAW\]Oy\¦_hX�O�S�XEG�JcO%\]OyÇ�Å�ORBEV³O*;

×]BdSNXE@/_U¹�G�JWJcGRSU\yF5S�OgMPOQ¹�OQM�_]GË_hX�OgACBE´�Å�_NV³G�G*Mhb�ACBE@/_]Og\PI�\]_]ORfäÁ!#F�"¯@�BEb�%¯@*\�\P´sOyVQAcÐ7Oyb1[TIµ_hX�OgÅE\POQMQÂj@�B7b_]G(f¯GTÅ7B�_9V³G�G*Mhb7ACBE@/_]Oy\>Á�_hX�O%bEORfÃ@�BEbÄ^�@*JCÅ�Oy\HG*¹��>FQ� Á�G*M���Â@�BEb½O(¹ÈG*M9_hX�O,b7MhAc^*Oy\³ÂP;»UXEO�_]OyJcOy\PV³G�´sO%AW\HbEMhAc^*ORB\]GË@*\�_]Gdf¯@/¶*Og_hX�O>ORB7V³G�bEOQM�MPOy@*b�ACB�D�\N¹ÈG*M�_hX�Oy\]O¯f¯OyVvXE@�BEAW\vf¯\>ÁÜV³G*MhMPOyV³_]Oyb¡@*\�bEOy\PV³MhAW[sOyb1ACBa_hX�O¤BEO³Ï�_�\]OyV³_PAcGTBsÂAWbEORBT_PAWVQ@*J$_]G¯_hXEOy\]O%bEORfÃ@�BEbË^�@*JCÅEOy\Q;

­87[6 8 ��� »UX�O9_PACf¯OUVQ@*JWVyÅEJW@/_PAcGTBE\j´sOQMP¹�G*MvfmOyb¤[�I¤_hX�OU» e ÚmVQJcG�\]OyJcIm¹ÈG�JWJcG.S _hXEG�\]OUD�Ac^*ORBÃACB e XE@*´7_]OQM�Ô�G*¹5_hX�OUõ�öT÷�øCù*ú7ù�û�ü.ý0þÿ��R÷�÷sø������³ú�û)@�B7bÎ_hXEAW\U\POyV³_PAcGTBdV³GTBEV³OQMvB7\H\P´sOyVQAcÐ�V,bEOQ_P@*AWJW\y;»UX�O�_PACf¯Oy\UÅE\]OybÎS�Ac_hXEACBË_hX�O,» e ÚÄ@/MPO*ØÏÀÐ�Ñ e G�G*Mhb7ACBE@/_]Oybdì�BEAc^*OQMh\h@*J$»HACfmO*;�»�XEAW\HAW\9D�Ac^*ORBµb7AcMPOyV³_PJcId[�I(_hX�O>Z�[7\]OQMP^/@/_]G*MPIλHACfmO%Ú�OQMh^�AWV³O*;Ð ��Ò ×0BT_]OQMvBE@/_PAcGTBE@*J�<j_]GTf¯AWV�»HACfmO*;|»UXEAW\�AW\�VQ@*JWVyÅEJW@/_]OybĹÈMhGTfßì�» e F�¹�MPGTfâS�XEAWVYX¯Ac_b�A�ÑsOQMh\¹ÈMhGTfß[TIm@�^/@/MhAW@*[7JcO

ACBT_]OQD*OQM�B�Å7fg[sOQMjG*¹�\]OyV³GTBEb7\%ÁÜ\POQO%[sOyJcGRS�ÂP;ÐzÓÀÐ »)OQMPMPOy\]_]MvAW@*J�ãNIEBE@�f¯AWVQ@*J�»HACf¯O*;)»UXEAW\LAW\)_hX�O�_hXEOQG*MPOQ_PAWVQ@*J�_PACfmOy\PVQ@*JcOjG*¹�@*´�´7@/MPORBT_)D*OQG�V³ORB�_]MvAWV�Oy´�X�ORfmOQMhAWb7Oy\G*¹�\]G�JW@/MPÕ�\]I�\P_]ORf�[sG�b�AcOy\H@�BEbÎAW\U\h´�OyVQAcÐ�OybË_]G([sO�»)<�×NK k Ô�; åHI ÓÄ\y;ÐzÓ½Ô i @/MhI�V³ORBT_]MhAWVUãNIEBE@�f¯AWVQ@*J�»HACfmO9AW\�_hXEOUACBEbEOy´sORBEbEORBT_|^�@/MvAW@*[7JcOHG*¹�_hX�OHOyÇ�ÅE@/_PAcGTBE\G*¹5f¯G*_PAcGTB¤SUAc_hX¤MhOy\P´sOyV³__]G¤_hX�O�\]G�JW@/MH\PI�\]_]ORf [�@/MPI�V³ORBT_]MPO*;�×�_9AW\9bEOQ_]OQMvf¯ACBEOybù�MPGTf »Hã�»¼ÅE\PACB�Dg_hX�ONO³Ï�´EMhOy\P\PAcGTBE\¦D�Ac^*ORBÎ[�I(`µGRI*OQMÁ åyòJI�å ÂP;ÏÀÐ j ì�BEAc^*OQMh\P@*J¦»HACf¯O*;d»UXEAW\gAW\>´EMhG�´�G*Mh_PAcGTBE@*J�_]G1_hX�O(@�BED�JcOÄG*¹9MhG*_P@/_PAcGTB3G*¹U_hX�O n @/MP_hX3ACBº\P´7@*V³O*F�MhOyVP¶*GTB�Oyb@/MhGTÅ7BEbÆ_hX�OÎ_]MvÅEOd´�G�\hAc_PAcGTBÆG*¹�_hX�OÎMPG*_P@/_PAcGTB¸@�ÏEAW\Q;¸»UXEOÎ^�@*JCÅ�OÎG*¹�ìN» å ��ìN» e AW\ÃB�G*MYf¯@*JWJcI3ORBT_]OQMPOybb�AcMPOyV³_PJcI�@/_�_hX�O¯\]_P@/MP_,G*¹¦@µBEAcDTXT_Qí=\�G�[7\]OQMh^�ACB�DEF)[�Å�_�[TIÝbEOQ¹Ü@�ÅEJc_,AW\,VQ@*JWVyÅEJW@/_]Oyb·ÅE\PACB�DË_hX�OmO³Ï�_]Mh@*´sG�JW@/_PAcGTB¹�G*Mvf¤ÅEJW@¤D�Ac^*ORBµACBË× n :NÚ i ÅEJWJcOQ_PACBa<%;7»�X�O,V³G�OuÕ(VQAcORB�_P\N@/MPO%\]_]G*MhOybdACBË_hX�O%ACB7Ac_PAW@*JWAcÖy@/_PAcGTBµÐ�JcO,@�BEbd\hX�GTÅ7JWb[sO%ÅE´�b7@/_]OybËMhOQDTÅEJW@/MhJcI¡ÁÜ´EMPOQ¹�OQMh@*[7JcIÄGTBEV³O%´sOQM9S¦OQOQ¶�ÂP;

è

Page 7: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Ö_×ÙØ�Ð ?$G�VQ@*J)`µOy@�BaÚ�AWbEOQMhOy@*J5»HACfmOÃÁ�_hX�OgX�GTÅ�MH@�B�D�JcO,G*¹|_hX�O%f¯Oy@�BËOyÇ�ÅEACB�GyÏÎG*¹|b7@/_]O/ÂP;Ö � Ø�Ð ?$G�VQ@*Js<N´7´7@/MhORB�_HÚ�AWbEOQMPOy@*Js»HACf¯OgÁ�_hX�O�X�GTÅ�Mj@�B�D�JcO�G*¹$_hX�ON_]MvÅ�O�OyÇ�ÅEACBEGyÏ(G*¹)b7@/_]O/ÂP;�»UXEAW\¦AW\jbEOQ_]OQMvf¯ACBEOyb¹�MPGTfÒì�» å ÅE\PACB�D%_hX�OU¹�G*Mvf¤ÅEJW@/OHG*¹)Ú�OyV³_PAcGTBËÔ�;�Ô�ÓTÔ%G*¹5_hX�O�õ�öT÷�øCù*ú7ù�û�ü.ý0þËÿ��R÷�÷sø������³ú�û0;)»UXEOH^�@*JCÅEOy\¹�G*M�_hXEO´sG�\PAc_PAcGTBaG*¹�_hX�O¤²LG�JcO¤MPOyÇ�Å7AcMPOybµACBµ_hX�O¤V³GTB�^*OQMh\hAcGTBÝ@/MPO%OyAc_hX�OQM�ORBT_]OQMPOybÝb7AcMPOyV³_PJcIdG*M�VQ@*JWVyÅEJW@/_]Oyb¡Å7\PACB�D(@�BO³Ï�_]Mh@*´sG�JW@/_PAcGTBµ¹ÈG*Mvf¤ÅEJW@�F7@*\U¹ÈG*M�ì�» å ��ì�» e ;

ã�@/_]Oy\NfÃ@yIÎ[sO,\P´sOyVQAcÐ7Oybd@*\�ACBÀÚTÅEJWAW@�BÎG*M i Oy\P\]OyJWAW@�BµI*Oy@/Mh\QF�SUAc_hXÎ_hX�O,V³GTBT^*ORBT_PAcGTBE@*J|´EMPOQÐEÏ�Oy\¯ð°Ú�ñÃ@�BEb¸ð i ñ�Fs@*\@*´7´EMhG�´EMhAW@/_]O¯¹�G*M%_hX�O(Þ�Û>æÎ@�BEb¡Þ8Û�Ó1V³G�G*Mhb�ACBE@/_]OÃ\]I�\]_]ORf¯\(ÁÜ\]OQO([sOyJcGRS,ÂP;Ä»UXEO¯\]_P@�BEb7@/Mhb¡Oy´�G�VvX7\,¹�G*M,_hX�OÃ_�S�G\]I�\]_]ORf¯\9@/MhOzÚTÔ l*l*l ; l @�BEb i åyò æ l ; l F�MPOy\P´sOyV³_PAc^*OyJcI*;

ìN» e AW\!¶*Oy´E_!S�Ac_hXEACB l ; ò \$G*¹EìNB7Ac^*OQMh\P@*JT»UACfmOUÁÜìN» å Âs[�I�_hX�O�ACBE\POQMP_PAcGTB�G*¹�GTB�O³Õ�\]OyV³GTB7b>\]_]Oy´�\�ÁÜJcOy@*´g\]OyV³GTBEb7\³ÂP;»UX�O,´7MPG�V³Oyb�Å�MPO�¹ÈG*M�ACBE\]OQMP_PACB�D(@mJcOy@*´µ\]OyV³GTBEbaAW\H@*\H¹�G�JWJcGRS�\QØå ;U»�X�O>b7@/_]Om@/_NS�XEAWVYXd_hX�O¤JcOy@*´Ý\]OyV³GTBEbÝAW\�_]GË[sOgACBE\]OQMP_]Oyb1AW\�\]_]G*MPOybÆÁÜ@*\N@ËfmG�b7AcÐ7OybYÚTÅEJWAW@�Baã�@/_]O/ÂHACBµ_hXEOACB7Ac_PAW@*JWAcÖy@/_PAcGTB1Ð�JcO�¹ÈG*MU_hX�O%V³GTBT_]MPG�J!\]I�\]_]ORfd;

Ô�;U»�X�O�_PACfmO,\]OQMh^�AWV³O%AW\�@/MvfmOybË_]G(´�Å�_HACBÎ@mJcOy@*´a\]OyV³GTBEbdGTBÎ_hXE@/_Ub7@/_]O*;k ;U»�X�O%V³GTBT_]MPG�J!\]I�\]_]ORf�_hX�ORBÎV³GTf¯´sORBE\h@/_]Oy\H¹�G*MH_hX�O,O³Ñ�OyV³_P\NG*¹L_hXEO%JcOy@*´µ\]OyV³GTB7baÅ7BT_PAWJ$Ac_UAW\NB�O³Ï�_UMPOy\]_P@/MP_]Oyb5;»�X�O,ACBEAc_PAW@*JWAcÖy@/_PAcGTBaÐ�JcO%\hXEGTÅEJWbË_hX�ORBdXE@R^*O%_hX�OgB�OQS¼^�@*JCÅEO,G*¹�ì�» e Õ»)<�×9ACBEVQJCÅEbEOyb5;

ÓE; e @/MPO�AW\jBEOQOybEOybÄ_]GgORB7\hÅ�MPO�_hXE@/_j_hX�O n :U²jÚÃV³G�OuÕÃVQAcORBT_P\UÅE\]Oyb(_]G¤O³Ï�_]Mv@*´�G�JW@/_]O,ìN» å �Êì�» e ACBEVQJCÅ7bEO�_hXEOO³Ñ�OyV³_P\�G*¹L_hXEO,JcOy@*´µ\]OyV³GTBEb$;

­87[­ ���.�*���! ��)� �����5��&(�|�$�®]��� ���*'+)-��.�*��Ê��gi���i�j Ü�l�m�l��Sv�»UX�O,» e ÚÄ@*VQV³Oy´E_P\NACBE´�Å�_9ACBËGTB�O%G*¹)_hX�MhOQO,OyÇ�Å7@/_]G*MhAW@*J!V³G�G*Mhb7ACBE@/_]O>\]I�\P_]ORf¯\QØå ;NK�OQG�V³ORBT_]MhAWVg@*´7´7@/MPORBT_HV³G�G*Mvb7ACBE@/_]Oy\HG*¹|_hX�O,VyÅEMPMPORBT_Ub7@/_]O*;Ô�;�`µOy@�BdV³G�G*Mhb7ACB7@/_]Oy\UACBË_hX�O>´�G�\P_0Õ�×�<9ì åyò é/èaÁÜÞ8Û%æ�¦\]I�\P_]ORfÎ;k ;�`µOy@�BdV³G�G*Mhb7ACB7@/_]Oy\UACBË_hX�O>´EMPO³Õ�×0<9ì åyò é/è1ÁÜÞ8Û�Ó�Â�\]I�\]_]ORfÎ;

»UX�O�´EMhG�V³Oyb�ÅEMPOÝÅ7\]OybÊ_]G¸V³GTB�^*OQMh_µ[sOQ_�S¦OQORB"\]I�\]_]ORf¯\ËAW\Î_hX7@/_dbEOy\PV³MhAW[sOybÊACB _hX�O¡õ�ö�÷søCù*ú7ù�û�ü.ý]þ�ÿ��.÷7÷sø������³ú�û@�BEb�ACBݾ¡@*JWJW@*V³O�Á åyò*ò l ÂP;Ë»UX�OmVyÅ�MPMPORBT_PJcI�Õ�@y^/@*AWJW@*[7JcO(MhOQ¹ÈOQMPORB7V³OÃ\]I�\]_]ORf AW\,[7@*\POyb�GTBÝ_hX�O¯Þ8Û%æÎ\P_P@/M%VQ@/_P@*JcG*DTÅ�O*F_hX�OË×0<9ì åyò é/è�\]OQ_¤G*¹NV³GTBE\]_P@�BT_P\QF_hX�OË×0<9ì åyòJI l _hX�OQG*MhI3G*¹NB�Å�_P@/_PAcGTBÆ@�BEb·_hX�OÎ\]OQ_mG*¹�´EMPG�V³Oyb�Å�MPOy\gGTÅ�_PJWACB�Oyb[sOyJcGRS,;�×�_�AW\NACBdD*G�G�b1@/D*MPOQORf¯ORB�_�SUAc_hXµ_hX�O%MhOQ¹ÈOQMPORB7V³O>¹�Mh@�fmOgbEOQÐ�B�Oyba[TIÎá�? i ×HG�[�\]OQMP^/@/_PAcGTBE\mÁÜ@*Jc_hX�GTÅ�DTX1Ac_NAW\O³ÏE´�OyV³_]Oyb¡_hXE@/_�¹ÜÅEMP_hX�OQM�Mh@*b7AcGÎG�[�\]OQMP^/@/_PAcGTBE\,@�BEb�b7@/_P@d¹ÈMPGTf _hXEO¯¿�AW´7´�@/MhV³G�\,\P@/_]OyJWJWAc_]O(SUAWJWJ|MPOQÐ�B�O¤_hX�O¯\PI�\]_]ORf\]_PAWJWJE¹êÅ�MP_hXEOQMQÂP;L<ÊV³GTBE\hAWbEOQMh@*[7JcOUB�Å7fg[sOQMLG*¹5´sG�\PAc_PAcGTBE\@/MPOH\]_PAWJWJED�Ac^*ORB(ACB¤_hX�O9G�JWbEOQMNÁÜÞ�Û,Ó�ÂL\]I�\]_]ORfÎF�@�B7bmMPGTÅ�_PACB�Oy\@/MPOÄ´EMPGR^�AWbEOybºACB�_hX�Oû e Ú1_]Ga´sOQMP¹�G*Mvf _hXEOÃV³GTB�^*OQMv\PAcGTB�;d»UX�O(\]OyÇ�ÅEORBEV³O¯G*¹HV³GTBT^*OQMh\PAcGTBE\gAW\>Þ8Û�Ó � Þ8Û%æ �@*´7´7@/MhORB�_Q;µ»�X�OôEMPG�V³Oyb�Å�MhOy\%@/MPOÎÅ7B7B�OyV³Oy\h\P@/MhAWJcIÝMhAcD*G*MPGTÅE\g¹�G*M%_hX�OË@*´7´7JWAWVQ@/_PAcGTB5F�[�Å�_%bEGÝB�G*_%_P@/¶*OÎ\PAcDTB7AcÐ�VQ@�B�_e ²�ìâ_PACfmO*ØH´sOQMP¹�G*Mvf¯ACB�D¯VQ@*JWVyÅ7JW@/_PAcGTBE\�_]G˹ÜÅEJWJ)@*VQVyÅ�Mh@*V³IafÃ@/¶*Oy\�V³GTf¯´7@/MhAW\PGTBÎSUAc_hX1\]_P@�BEb�@/Mhbd_]Oy\]_�VQ@*\]Oy\�f¤ÅEVYXfmG*MhO,\]_]Mh@*AcDTXT_]¹ÈG*MPSj@/Mhb5;

�gi���i�h ÝMÞ��UoW�UÝNÞYߦw®�m&�l��StSn��m»UXEAW\g´EMPG�V³Oyb�Å�MhO(AW\¤´sOQMP¹ÈG*MYfmOyb�GTBEV³O*F�@/_g_hXEOÄ\]_P@/Mh_>G*¹U@�B�OQS G�[7\]OQMh^�@/_PAcGTB�F�@�BEbº´7MPG�b�ÅEV³Oy\>@�BºÞ8Û%æ�ÚTÔ l*l*l ; l´sG�\PAc_PAcGTB˹�G*MU_hX�O,VyÅEMPMPORBT_9Oy´�G�VvX5;<NBdACB�_]OQMvf¯Oyb7AW@/_]O%\]_P@/D*OgAW\9_]GÃVQ@*JWVyÅEJW@/_]Og_hX�O%Þ8Û�ÓEF i åyò æ l ; l ´sG�\PAc_PAcGTB�Øå ; e G*MPMPOyV³_H¹�G*MU\P´7@*V³OgfmG*_PAcGTBË_]G¯_hXEO,Oy´sG�VYXËG*¹|G�[7\]OQMP^/@/_PAcGTB�;Ô�;U:UORfmG.^*O n Õ�_]OQMvfÃ\9G*¹|@*[�OQMhMh@/_PAcGTB�;

é

Page 8: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

k ;U²MPOyV³Oy\P\U_]G i åyò æ l ; l ÅE\hACB�D¯Þ8Û�ÓÃV³GTBE\]_P@�BT_P\Q;ÓE;U<Nb7b n Õ�_]OQMvf¯\y;

»UX�O i åyò æ l ; l ´sG�\PAc_PAcGTBÃAW\j@R^�@*AWJW@*[7JcO�¹�G*Mjb7AW\P´7JW@RIô�Å�Mh´sG�\]Oy\NÁÜ\]OQO�[�OyJcG.S�ÂP;»UXEO�´sG�\PAc_PAcGTB(AW\�_hXEORB¯_]Mh@�B7\]¹ÈG*MYfmOyb¯_]GÚTÔ l*l*l ; l Øå ;U:UORfmG.^*O n Õ�_]OQMvfÃ\Q;

Ô�;U<N´7´7JcIË\P´7@*V³OgfmG*_PAcGTBE\9_]G åyòJI Ó�Ú�@�B�ÅE@/MPI å ; l ;k ;U²MPOyV³Oy\P\U¹ÈMPGTf i åyò æ l ; l _]G åyòJI Ó�Ú�@�B�ÅE@/MPI å ; l ÅE\PACBEDm_hX�O,Þ8Û�ÓôEMPOyV³Oy\h\PAcGTBdV³GTBE\P_P@�B�_P\Q;ÓE;U<N´7´7JcIÄ_hX�O,OyÇ�ÅEACB�GRÏËV³G*MhMPOyV³_PAcGTBµÞ8Û�ÓÃ_]GÃÞ8Û%æ¤_]G¯MhAcDTXT_U@*\PV³ORB7\PAcGTBd@�BEbµAc_P\H´EMPG�´sOQM]Õ�f¯G*_PAcGTBËV³GTf¯´sGTB�ORBT_Q;æ�; e GTB�^*OQMP_U_hX�O>Å7BEAc_P\HG*¹L´EMhG�´�OQMUf¯G*_PAcGTB¡Á�_]MPG�´7AWVQ@*J!_]G�ÚTÅ7JWAW@�BÎV³ORB�_hÅEMhAcOy\³ÂP;è�;U²MPOyV³Oy\P\U¹ÈMPGTf åyòJI Ó�Ú�@�B�ÅE@/MPI å ; l _]G�ÚTÔ l*l*l ; lé�;U<N´7´7JcIË\P´7@*V³OgfmG*_PAcGTBE\9_]G�ÚTÔ l*l*l ; l

×�¹¦B�GδEMPG�´sOQM�fmG*_PAcGTBE\�@/MhO¤\h´�OyVQAcÐ�OybݹÈG*M�_hX�OmÞ8Û�ÓÎ\]I�\]_]ORfÎF5_hXEORB1_hX�OQIa@/MPOm@*\P\vÅ7fmOyb1_]Gd[sO>ÖQOQMhGZE[à¶á�â�Gzã8äLåæºçSæ á:Guèg;�»UX�ONb7AW\]_PACBEV³_PAcGTBÄAW\jB�OyV³Oy\P\P@/MPI([�OyVQ@�Å7\]OU_hX�O�Þ8Û�Ó%¹�Mh@�f¯OUMPG*_P@/_]Oy\j\PJWAcDTXT_PJcIÃSUAc_hXÃMPOy\P´sOyV³_�_]GgÞ8Û%æ>@�BEbÃAc_f¯@/¶*Oy\�f¯G*MPO¦\PORBE\]O¦_]G�@*\h\hÅ7fmO¦_hXE@/_|O³Ï�_]Mh@/D�@*JW@*V³_PAWVHG�[�É0OyV³_P\�XE@R^*OUB�GN\h´7@*V³OHfmG*_PAcGTBE\|ACB>GTÅ�M�[sOy\]_L@*´�´EMPGyÏEACf¯@/_PAcGTB_]GÃ@�BÎACBEOQMP_PAW@*J$¹�Mh@�fmO*;

�gi���i�� ÝMÞYߦoW�U�l��gw®lcm&oS��n�wÀveé�éAve�Wl�m&o¤wx�&m&�l��Wt�n��m»UX�O%Ð7Mh\]_H\]_P@/D*O¤AW\�_]G(V³G*MPMPOyV³_�¹ÈG*MN\P´7@*V³O¤fmG*_PAcGTBE\�@�BEbd_]GÄbEOQMhAc^*O>@�ÚTÔ l*l*l ; l ´sG�\PAc_PAcGTBd¹�G*MU_hXEO,Oy´sG�VYXÎG*¹�G�[7\]OQMPÕ^/@/_PAcGTB�;�»UX7AW\9AW\UbEGTB�O�GTB7V³O*F7GTBÎVvX7@�B�D*O%G*¹L_P@/MPD*OQ_QØ

å ; e G*MPMPOyV³_H¹�G*MU\P´7@*V³OgfmG*_PAcGTBE\9_]GÃ_hX�O,Oy´sG�VYXËG*¹LG�[7\]OQMP^/@/_PAcGTB�;

Ô�;U²MPOyV³Oy\P\U_]G�ÚTÔ l*l*l ; l ;k ; e G*MPMPOyV³_H¹�G*MU´7@/Mh@*JWJW@�Ï�;

e GTBT^*OQMh\PAcGTBË_]G¤D*OQG�V³ORB�_]MvAWV,@*´7´7@/MPORBT_HV³G�G*Mhb7ACBE@/_]Oy\9AW\9´sOQMP¹�G*MvfmOybÄV³GTBT_PACB�Å�GTÅ7\PJcIÄb�Å�MhACB�D>_]Mh@*VP¶�ACB�DE;�»�X�ONV³GTBT^*OQM]Õ\PAcGTBdfÃ@/_]MhAWV³Oy\U@/MhO>ÅE´�b7@/_]OybËGTBEV³O,OQ^*OQMhIÎæÃf¯ACB�Å�_]Oy\QFE[�Å�_H@/MPO>@*´7´7JWAcOybd@/_�Ô l ¿UÖ*;»�X�O,\]_]Oy´7\�@/MPO*Ø

å ; e G*MPMPOyV³_H¹�G*MHD*Mh@R^�Ac_P@/_PAcGTBE@*J|JWAcDTXT_UbEOuÅ7OyV³_PAcGTBºÁêB�OQD�AcD�AW[7JcO¤ACBδEMh@*V³_PAWV³O/ÂP;Ô�;U<N´7´7JcIË@�B7B�ÅE@*J5@*[sOQMPMh@/_PAcGTB�;k ; e G*MPMPOyV³_H¹�G*MU´EMPOyV³Oy\h\PAcGTBd@�BEbaB�Å�_P@/_PAcGTB5;

­87�ê ë½ì ��E���<ÊB�Å7fg[sOQM|G*¹$fmOQ_hX�G�b7\�@/MPOH´EMhGR^�AWbEOybm_]G%@*JWJcG.S G/Ñ5\]OQ_]_PACB�DE;»�X�Oy\]OH@/MPO�Å7\]Oyb¤_]G>fmG.^*OH_hX�O9_]OyJcOy\PV³G�´sON\]G,_hXE@/_�_hXEOACf¯@/D*ONG*¹!@½íJE î�GuïðGuàeá�G�[�É0OyV³_9@*´7´sOy@/Mh\¦@/_¦_hXEO æuñ è�Gj´7JW@*V³O�GTB¯_hXEO�b7OQ_]OyV³_]G*MH@�BEbÃ_hXEOQMPOQ¹ÈG*MhO�VQ@�Å7\]O�_hXEONb7AW\h´7JW@yI*OybMhAcDTXT_�@*\PV³ORBE\PAcGTBm@�B7bgb7OyVQJWACBE@/_PAcGTB¤_]G,VvX7@�B�D*O*;�»UX�O¦G�´7´sG�\PAc_]O9@*´7´EMPG�@*VYXÎÁêfmG.^�ACB�D�_hX�O9ACfÃ@/D*O¦G*¹�_hX�O æ�ñ è�G�G�[�É�OyV³__]GÃ@�íxE î�GHï�GHàQá$´7JW@*V³O%GTBË_hX�O%bEOQ_]OyV³_]G*M�AW\HbEOy\hV³MhAW[sOybdACBÎ\]OyV³_PAcGTB k ;�é�;

I

Page 9: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

�gi���i�j ���¤ò Ó lcw��eóCtHl�oWt<ïD*MhGTÅE´1G*¹�» e ÚµV³GTfÃfÃ@�BEb7\�bEOy@*JW\�SUAc_hXÝb7A�Ñ�OQMPORBT_PAW@*J|G/Ñ�\]OQ_P\�\h´�OyVQAcÐ�Oyb1ACB1MvAcDTX�_�@*\PV³ORBE\hAcGTBÝ@�BEbÝbEOyVQJWACBE@/_PAcGTB�;»UX�Oy\POd@/MPOd@*´7´7JWAcOybÌACBÆ_hXEOdACBE´�Å�_¤V³G�G*Mvb7ACBE@/_]Oµ\]I�\]_]ORfd;·»UXEOÄÐ�Mh\]_QF�@�B7bÌ\PACf¯´7JcOy\P_QFG�´E_PAcGTBÌ@*JWJcG.SU\¯_hXEOÎG/Ñ�\]OQ__]Gd[sO¤D�Ac^*ORB�b7AcMPOyV³_PJcIÝ@*\�£�#F�£�"TF!ACB1S�XEAWVYXÝVQ@*\]O¯_hX�Oy\]O¯@/MhOmf¯OQMPOyJcIa@*b�bEOyb1_]Gd_hX�O¤_P@/MPD*OQ_%´sG�\PAc_PAcGTBÌÁ�ôxõ�õQö®÷®øø5ùHúP÷7ÂP;5<NJc_]OQMvBE@/_PAc^*OyJcI*F|G/Ñ5\]OQ_P\z£L´�F�£=µ1ACBÝ_hX�Om_P@�BED*ORB�_%´�JW@�B�OµÁÜ@*JcGTB�Dd_hX�O¤# @�BEbZ"Äb7AcMPOyV³_PAcGTB7\,@/_�_hX�Om_P@/MPD*OQ_´sG�\PAc_PAcGTBsÂ�fÃ@yIÃ[sO�D�Ac^*ORB�F7ACBÄS�XEAWVYXËVQ@*\]O�_hX�Oy\]O,@/MhO�V³GTBT^*OQMP_]Oybµ_]G¤£�#�Fe£¤"%ÅE\PACBEDg_hXEON_P@�BED*ORB�_0Õ�´7JW@�BEO,¹ÈG*MYfgÅ7JW@/OACB¯Ú�OyV³_PAcGTBmÔ�; k @�BEb¤@/D�@*ACBm@*b�bEOybg_]G�_hX�Oj_P@/MPD*OQ_�´sG�\PAc_PAcGTBÎÁ�ôJõcõQöx÷�øüû�ýPþ7ÂP;�»L@�B�D*ORBT_0Õ�´7JW@�B�OHG/Ñ5\]OQ_P\fÃ@yI%[sO¦_�I�´�OybACB�F�\]_]G*MhOyb5FTJWAW\]_]Oyb¯@�B7bm@*´7´7JWAcOybmJW@/_]OQM�ÁÜ\]OQOM÷�ÿcøc÷�ý���ôcöeùWø5ù�ôxÿsF�ö��Pô�����ôcöQùSø5ù�ôxÿ,@�BEb��Pô�öeùWø5ùJôJÿ�ÂPç._hXEOQIgf¯@RI>@*JW\]G[sO,bEOQÐ�B�OybÎACBT_]OQMh@*V³_PAc^*OyJcIºÁÜ\POQO>[sOyJcGRS�ÂP;

�gi���i�h Ð pAl�p�vemAq�tHl®o»UX�Og» e Ú'ðPXE@�BEb7\POQ_PñÝÁÜ\POQO¤<N´7´sORBEb7A�Ïdã>ÂH@*JWJcGRSU\�G/Ñ5\]OQ_P\�_]GË[sOgACBT_]MPG�b�ÅEV³Oyb1ACB�_]OQMh@*V³_PAc^*OyJcI¡ÅE\hACB�DÄVyÅEMh\]G*MN¶*OQI�\Q;ÞEGTÅ�M%f¯G�b7Oy\�@/MPO¤@*\P\]G�VQAW@/_]Oyb�SUAc_hX1G/Ñ5\]OQ_P\QØ�_hX�MPOQO¤_]GÎACf¯´7JcORf¯ORB�_�_hX�ORf ACB1b7A�Ñ�OQMPORB�_�V³G�G*Mhb7ACBE@/_]Om\]I�\]_]ORfÃ\N@�B7b_hX�Og¹ÈGTÅEMP_hXd_]GÎ\]OQ_N_hX�ORf ÅE´1ACB�_]OQMv@*V³_PAc^*OyJcI1¹�G*M�\]_]G*Mh@/D*Om@�BEb1JW@/_]OQM%ÅE\]O*;,Z�Ñ5\]OQ_P\�f¯@yIa[�Og@*´7´7JWAcOybÝACB�´�µ�F ¢Ä G*M¾5¿·\]I�\P_]ORf¯\%@*\¤bEOQÐsB�Oyb3ACBÆÚ�OyV³_PAcGTBÌÔ�; k ;Ý»UX�Oy\]OÄ@/MPOÄ@*JWJ�_P@�B�D*ORBT_0Õ�´7JW@�B�OÎG/Ñ5\]OQ_P\QF�\]G1_hXE@/_¤@µD�Ac^*ORB·ACBEV³MhORfmORBT_VQ@�ÅE\]Oy\H_hX�O,ACf¯@/D*O�_]G(f¯GR^*O,[�IÄ@¤D�Ac^*ORBµ@�fmGTÅ7BT_jGTBË_hX�O,\]¶�I(@/_�@�B�IË´sG�\PAc_PAcGTB�;»UXEOQI(@/MPO,@*´7´�JWAcOybd[TIÄMPG*_P@/_PACB�D_]GÎ_hX�O=´Jµµ\PI�\]_]ORfdF$V³GTB�^*OQMh_PACB�Dd_]G¥£�#F�£�"ÄÅE\PACB�DË_hX�Om¹�G*Mvf¤ÅEJW@ÄD�Ac^*ORB�ACB¡Ú�OyV³_PAcGTB3Ô�; k @�BEb�ACBEV³MPORf¯ORB�_PACBEDÄ_hXEO_P@/MPD*OQ_�´sG�\PAc_PAcGTB�;U»UXEO%@*VQVyÅ7f¤ÅEJW@/_]OybaG/Ñ�\]OQ_P\�@/MPOgb7AW\P´7JW@RI*OybÝACBÎ_hX�OgV³G�G*Mhb�ACBE@/_]Og\PI�\]_]ORfÍG*¹�_hX�O¤fmG�bEO,\]OyJcOyV³_]Oyb5;»UX�O,\PI�\]_]ORfÃ\HÅE\]Oybd[�IË_hX�O%XE@�BEb�\]OQ_H@/MPO%@*JWJ)bEOQÐ�B�OybËSUAc_hXÎMPOy\P´sOyV³_9_]GÃ_hX�O,ACB7´�Å�_HV³G�G*Mhb7ACBE@/_]O%\PI�\]_]ORfdF7ACBËG*MhbEOQM_]G¯´sOQMvf¯Ac_¦Oy@*\]IËV³GTB�^*OQMv\PAcGTB¡ÁÜ@¤¹�MPOyÇ�ÅEORB�_UÅE\PONG*¹)_hX�O,\]I�\]_]ORf AW\j_]GÃfmG.^*O�_hX�O�_]OyJcOy\PV³G�´sO,ACB ¢Ä V³G�G*Mhb7ACBE@/_]Oy\H@�B7b_hX�ORB1_]GÎ\]SUAc_PVYXÝ_]G½´JµµACB1G*Mhb7OQMN_]GÎMhOy@*bÝG/Ѻ_hX�Om@*VQVyÅ7f¤ÅEJW@/_]Oyb�G/Ñ5\]OQ_�GTB1_hX�Om\]¶�I�ÂP;><ï¹�GTÅ�MP_hXÝXE@�B7b7\]OQ_�fmG�bEOAW\�ÅE\]OybÎ_]GÄ\]OQ_NÅE´µG/Ñ�\POQ_�´sG�\PAc_PAcGTBE\�¹ÈG*MNJW@/_]OQM�Å7\]O*;9<NBµACf¯@/D*O>AW\�´7JW@*V³Oyb1@/_N\]GTf¯O�MPOQ¹�OQMPORBEV³O>´sG�ACBT_�@�BEbaAW\H_hX�ORBfmG.^*Oyb�_]GÎ_hX�OmG/Ñ5\]OQ_,´sG�\PAc_PAcGTBÝSUAc_hX1_hXEOÃXE@�BEb7\]OQ_Q;g»UX�O¯fmG*_PAcGTB¡AW\�ACB1_hX�O ¢Ä \]I�\P_]ORfÎF5¹�G*M%V³GTB�^*ORB7AcORBEV³O*FL[�Å�__hX�O,G/Ñ5\]OQ_UAW\U\]_]G*MPOybµACB½´�µ�F�\]G¯@*\U_]GÃ[sO,ACBEbEOy´sORBEbEORBT_jG*¹�\]¶�IË´sG�\PAc_PAcGTBÎ@�B�D�JcO*;�gi���i�� Ð pAl����!n�mAq�òÌ�eóCtHl�o�éA�S�gwxlcq����Wl< ¹ÈMPOyÇ�Å�ORBT_m@*´7´7JWAWVQ@/_PAcGTBÌG*¹�_hX�Od» e ÚºAW\¤_]G¡@*VQÇ�ÅEAcMPOιÜ@*ACB�_Ã_P@/MPD*OQ_P\mGTBT_]G3@�BÆACBE\]_]MvÅ�fmORBT_>ORBT_]Mh@�BEV³Oµ@*´sOQMP_hÅEMPOÁêÅE\hÅ7@*JWJcIg_hXEOU\PJWAc_G*¹5@>\P´sOyV³_]MPG*D*Mh@*´�XsÂP;�»UXEOH\]_P@�BEb7@/MhbôEMPG�V³Oyb�Å�MPOHAW\_]G>JcG�VQ@/_]ON@�MhOQ¹ÈOQMPORB7V³O�\]_P@/M�S�X�G�\]OU´sG�\PAc_PAcGTBMPOyJW@/_PAc^*OÝ_]G·_hX�Oµ_P@/MPD*OQ_ÎAW\(¶�BEGRS�B¸^*OQMPI'@*VQVyÅ�Mh@/_]OyJcI*FNV³ORB�_]MhO1Ac_ÄGTB¸_hXEOaACBE\]_]MYÅ7fmORBT_Ã@�BEb'_hX�ORB¸G/Ñ5\]OQ_Ä_]Gº_hXEO¹Ü@*ACB�_�_P@/MPD*OQ_Q;g<�Jc_hX�GTÅEDTX1_hX�Om:U<UÕ�ã�OyV¤G/Ñ5\]OQ_P\,b7Oy\PV³MhAW[sOyba@*[sG.^*O¯VQ@�BÝ[�OmÅE\]Oyb1¹�G*M�_hXEAW\�´�Å�Mh´sG�\]O*F�@Ë\]GTfmOQSNXE@/_b7A�Ñ�OQMPORBT_UfmOQ_hX�G�bËAW\HB�Oy@/_]OQMU@�BEbdf¯G*MPO2Å�O³Ï�AW[7JcO*;�»UX�O�MPOQ¹�OQMPORBEV³O,\]_P@/MHAW\9Ð�Mh\]_jV³ORB�_]MPOybdGTBË_hX�O�ACBE\]_]MvÅ�fmORBT_QF�@�B7b_hX�ON@*VQVyÅ7f¤ÅEJW@/_]Oyb(XE@�B7b7\]OQ_V³G*MPMhOyV³_PAcGTB(AW\¦V³GTBT^*OQMP_]OybÃ_]Gg_P@�B�D*ORBT_0Õ�´7JW@�B�O�V³G�G*Mvb7ACBE@/_]Oy\¦ACBm_hX�O�fmGTÅ7BT_�\]I�\]_]ORfÒ@�B7b@*´7´7JWAcOybÃ@*\�@�_]ORf¯´sG*Mh@/MhI%@*b7b7Ac_PAcGTB¯_]G�_hX�OUV³G�JWJWACf¯@/_PAcGTB¯OQMPMPG*Mh\�ACBmOyJcOQ^�@/_PAcGTB(@�BEb¯@/ÖyACf¤Å�_hXÎÁ�Ú�OyV³_PAcGTB k ;�è�; å ÂP;»UX7AW\AW\N@(JcG�VQ@*JLf¯G�b�AcÐ�VQ@/_PAcGTBd_]GÄ_hX�Og´�G�ACBT_PACB�DËfmG�bEOyJ5S�XEAWVYXµAW\NO³ÏE´sOyV³_]Oybµ_]GË[sO%^/@*JWAWbaVQJcG�\]O¤_]G(_hX�O>MhOQ¹ÈOQMPORB7V³O>\]_P@/MyF@�BEbÎAW\UÅ7\]OybĹÈG*MU\vÅE[7\]OyÇ�Å�ORBT_¦G�[�\]OQMP^/@/_PAcGTBE\9G*¹L¹�@*ACBT_9_P@/MPD*OQ_P\Q;¦»UX�O�@*bE^/@�B�_P@/D*Oy\UG*¹)_hXEAW\9´7MPG�V³Oyb�Å�MPO¯Á�_hX�O��ùSÿ� ôxõ�õQöx÷�øÎV³GTfÃfÃ@�BEbµbEOy\hV³MhAW[sOybaACB1<N´7´sORBEb7A�Ï e ; å l ;cµ@/MPOg_hXE@/_�_hX�Og_P@/MPD*OQ_�´�G�\hAc_PAcGTB1BEOQOybÝBEG*_N[sO¤ACBd_hX�Om\P@�f¯OV³G�G*Mhb7ACBE@/_]O,\]I�\]_]ORf @*\j_hX7@/_9G*¹)_hX�O�MPOQ¹�OQMPORBEV³O,\P_P@/MU@�BEbË_hXE@/_9_hX�O�b7AW\h´7JW@yI*OybÎ_]OyJcOy\hV³G�´�O>´�G�\hAc_PAcGTBËAW\H@*\9@*VQVyÅ�Mh@/_]O@*\U´sG�\P\hAW[7JcO*FEMh@/_hX�OQMH_hX7@�BÎACBEVQJCÅEb7ACBEDmMPOy\PAWb�ÅE@*J5´sG�ACBT_PACB�DÃV³G*MPMhOyV³_PAcGTBE\Q;

­87�� � 7#0���5�������! �gi�ßgi�j ��lc�¼�SvQwJo�n��m��:���������vel:HOQ¹�Mh@*V³_PAcGTB1AW\N_]MPOy@/_]OybÝ\]Oy´7@/Mh@/_]OyJcIµ¹ÈMPGTfÍ_hX�O>G*_hX�OQM�´�G�ACBT_PACB�DÄV³G*MPMPOyV³_PAcGTBE\�[sOyVQ@�ÅE\]OgAc_NAW\�¶EB�GRS�B1ùm÷�ýÌ ü.ýÌ Ü;H»UXEO@*JcD*G*MhAc_hX7f ÅE\]OybmAW\�bEOQMhAc^*Oybm¹�MPGTfï_hX�O9O³Ï�´7MPOy\P\PAcGTBE\ACBÃ`1Å�MPMh@RIËÁ åyòJI k Â|¹ÈG*MMPOQ¹ÈMv@*V³_PAc^*ONACBEb7O³Ï��Î@�BEb¯_hX�O9¹ÈG*MYfgÅ7JW@/OD�Ac^*ORB¡[�IÝÚE@*@*\]_P@�fmG�ACB�ORB'Á åyò é/Ô/@�FL[�ÂP;¯`1Å�MPMh@RI�í=\,OyÇ�ÅE@/_PAcGTBºé�; ÓE; å l AW\%ÅE\POybÝ_]GdVQ@*JWVyÅEJW@/_]OÃ_hX�OmMhOQ¹ÈMh@*V³_PAc^*O(ACBEbEO³Ï@*\�@˹êÅ7BEV³_PAcGTB1G*¹_hXEO¯´7@/MP_PAW@*J�´EMPOy\h\hÅ�MPOy\�G*¹¦b7MPIµ@�BEbÝS¦OQ_,@*AcMÃÁÜACB1_hÅ�MvB1bEOQMhAc^*Oyb¡¹ÈMPGTf _hX�Om_]G*_P@*J´EMPOy\P\hÅEMPOg@�B7b

ò

Page 10: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

MPOyJW@/_PAc^*O¤X�Å7fÃAWb7Ac_�I�ÂPFE_]ORf¯´sOQMh@/_hÅEMPO,@�BEbËSj@y^*OyJcORB�D*_hX�;9`1Å�MPMh@RI�í=\UOyÇ�ÅE@/_PAcGTB1é�;�è�; I D�Ac^*Oy\�_hX�O,MPOQ¹�Mh@*V³_PAcGTBµ@*\QØ���N�U� � �¯Á!����Â8��� Æ _P@�BM��� K���¤_P@�B������� Æ � �½� å ������ � ��§ ��� Á �½� å  ` �/ÔS©S�X�OQMhO�_hX�O�@*´7´7@/MhORB�_9@�BEbÄ_]MvÅ�ONÖQORBEAc_hXËb7AW\P_P@�BEV³Oy\9@/MPOT� � @�BEb���F�MPOy\P´sOyV³_PAc^*OyJcIË@�BEb!�mAW\j_hX�O�ACB�_]OQD*Mh@*J�G*¹LJCB$Á �LÂ��#"GR^*OQM�´7@/_hXµJcORB�D*_hX$"T;HÚ�@*@*\]_P@�fmG�ACBEORB3Á åyò é/Ô/@�F$[�ÂD�Ac^*Oy\N\PACfô7JcO%@*´7´EMhGyÏEACf¯@/_PAcGTBE\U_]G%�(S�XEAWVvXµVQ@�Bµ[sO,@*[7\PG*Mh[sOybACBT_]G¯_hX�O%V³G�OuÕÃVQAcORBT_P\&��jF��'�F(�) @�BEb*��+Æ_]G¯D�Ac^*O>@¯¹ÈG*Mvf¤ÅEJW@�Ø� � �U�����¯Á!� � Â8�,� Æ _P@�BN� � K�� � _P@�B��g� � K�� ' _P@�B d � � K�� ) _P@�B�-g� � K�� + _P@�B�.g� �»UXEAW\�@*JcD*G*MvAc_hX7f D�Ac^*Oy\>MPOy\hÅEJc_P\�S�Ac_hXEACB l ; å @/MhVQ\POyVmG*¹�_hXEOÃB�Å7f¯OQMhAWVQ@*J�ACBT_]OQD*Mh@/_PAcGTB3´7MPOy\]ORBT_]Oyb¡ACB1_hX�OÃõ�öT÷søCù*ú�ù�/û�ü.ý0þºÿ��R÷7÷�ø������³ú�û�¹�G*M�� « I l � ;¯»UXEOgMhOQ¹ÈMh@*V³_PAcGTB¡¹ÈG*MYfgÅ7JW@Ä@*\>Ç�ÅEG*_]Oyb¡AW\%B�G*_,ACB�@µ\hÅEAc_P@*[7JcOm¹�G*Mvf ¹�G*M%´sG�ACB�_PACBEDVQ@*JWVyÅEJW@/_PAcGTBE\yFs\PACB7V³O,_hX�O,MPOQ¹�Mh@*V³_PAcGTBµAW\HMPOyÇ�ÅEAcMPOybdACBÎ_]OQMvf¯\9G*¹L_hX�O,_]MYÅ�O,ÖQORBEAc_hXµb7AW\]_P@�BEV³Oz�E;¾�O%_hXEOQ¹ÈG*MPO%O³Ï�´7@�B7b�¯Á!����Â�ACBÎ@m»L@yI�JcG*MN\POQMhAcOy\H_]G¯Ð�Mh\]_jG*MhbEOQMyØ�zª ��� K0�¯Á!��Â5K¼Á!���N�U��Â1�Vy�Á!��Â@�BEbdb7OQMhAc^*O,_hX�O,@*´7´7MPGyÏEACf¯@/_]O,¹�G*Mvf¤ÅEJW@�T�U��� ª �¯Á!��Â���§ å K�� y Á!��Â!©

� � Æ _P@�BN�NK���¤_P@�B � �NK��'>_P@�B d �2K��)(_P@�B - �NK0�2+¤_P@�B . �å KÆ\]OyV ` �7Á � Æ K k ��¤_P@�B ` �2K¸æ#��'g_P@�B43g��K¸é5�)(_P@�B�6g�2K ò ��+¤_P@�B47���Â

Þ�Å�Mh_hX�OQMHOyJW@*[sG*Mh@/_PAcGTBdAW\�B�G*_|É]Å7\]_PAcÐ�@*[7JcO*F�\hACBEV³O,@*VQVyÅ�Mh@/_]O¤fmOy@*\hÅ�MhORfmORBT_P\�G*¹LMPOQ¹�Mh@*V³_PAcGTBd@/_U_hX�O e <�` e Áê`µG*MPMhA�Õ\]GTB�F�÷sýÌ 98Yù�û:�~�Yü��¤�½�*úP ��vù�û! ü/úsÂ\vX�GRSâÅ7BE´EMPOyb�AWV³_P@*[7JcO%BEAcDTXT_0Õ�_]G/Õ�BEAcDTX�_�^�@/MvAW@/_PAcGTBE\UG*¹�ÅE´Î_]G l ; Ó*_P@�BN�¯@/MvVQ\]OyV/;�gi�ßgi�h Ó n[óCl��Wl�m&o�n�v�C�Wlc�¼�SvQwJo�n��&m×]B,@*b7b7Ac_PAcGTB,_]GU_hX�O�O³ÑsOyV³_P\)G*¹EMPOQ¹�Mh@*V³_PAcGTB%GTB�_hX�O�_P@/MPD*OQ_)´sG�\PAc_PAcGTB�F/_hX�OÐ7OyJWb%AW\)MPG*_P@/_]Oybg@�BEb%b7AW\P_]G*MP_]Oyb5;|»UX�OJW@/_]_]OQMO³Ñ�OyV³_HVQ@�BËGTBEJcI([sO�V³G*MPMPOyV³_]OybµÅ7\PACB�Dm@*b7b7Ac_PAcGTBE@*JsG�´E_PAWVQ\>ÁÜ@*\HAW\9bEGTB�O�@/_H²�MhACf¯O�¹�G�VyÅE\³ÂPFE[�Å�_¦_hX�O�¹�G*MvfmOQM9f¯@RI([sO_P@/¶*ORBµGTÅ�_�ÅE\PACBEDm_hX�O%ACBE\]_]MYÅ7fmORBT_jMPG*_P@/_]G*My;j»UXEAW\HAW\�bEGTB�O%@�Å�_]GTfÃ@/_PAWVQ@*JWJcId@*\U´7@/Mh_HG*¹|_hX�O%´sG�ACB�_PACBEDÃVQ@*JWVyÅEJW@/_PAcGTBbEOy\PV³MvAW[�Oyb¤ACBmÚ�OyV³_PAcGTB k ; å Ô�F�[�Å�_L_hX�O9@�BE@*JcI�_PAWVQ@*JE_]MPOy@/_hfmORBT_P\�ACB>_hX�O9JWAc_]OQMh@/_hÅ�MPO%ÁÜ¿NACB�¶�\ åHI*òJI FT¾¡@*JWJW@*V³OVÎ »)MhAc_]_]GTBåyò é ò ÂjÅ7\]O,G�[7\PVyÅEMPO%B�G*_P@/_PAcGTBd@�B7bd@¯´7@/Mh@*´�X�Mh@*\]O�AW\HD�Ac^*ORBaX�OQMPO%ÅE\hACB�Dm_hX�O,_]ORfÃACB�G�JcG*D*IËG*¹L_hXEO,´EMPOy\]ORBT_U´7@*´sOQMy;

e GTB7\PAWbEOQMU@¤_P@�B�D*ORBT_0Õ�´7JW@�B�O¤´EMPG/É0OyV³_PAcGTB3Á!¾;:°¿s¦@*\UbEOQÐ�BEOybËOy@/MhJWAcOQMy;�»�X�ORB�ؾ��Ê\PACB5Á����Z��R.ÂTVQ\PVA�WRW��§ V³G*_&��V³G*_�WRCKÆV³G�\.Á����Z��R.Â!©¿��Ù§ V³G*_�·�¡V³G*_&� R V³G�\.Á��Â�Z� R Â!©���§ V³G*_&�V³G*_� R KÆV³G�\�Á����¦� R Â!©»UX�OUO³ÑsOyV³_¦G*¹5MPOQ¹�Mh@*V³_PAcGTBÄAW\�_]G¤bEOyV³MPOy@*\]O�_hX�OU^/@*JCÅ�ONG*¹g�EF�JcOy@R^�ACB�D=�¼Å7BEVYXE@�B�D*Oyb5;�»�X�OUVvX7@�B�D*Oy\�ACB�¾d@�B7b¤¿ÃfÃ@yI[sO,VQ@*JWVyÅEJW@/_]Oyba¹ÈMPGTfdØ£�¾ ª Á9<&¾��#<&��¼£��� § VQ\hV��HR5V³G*_�WR5VQ\PV ` ��\hACB$Á����U�2R�Â!©���§ V³G*_5��V³G*_�WRCKÆV³G�\.Á����¦��R�Â!©� V³G�\&�HR5VQ\PVA�x¾�Á å K}¾ ` K�¿ `  f¼» `£=¿ ª Á9<¿e�#<&��¼£��� �z§ VQ\PV ` ��VQ\PV ` �WR5V³G�\.Á��Â�Z��R�Â!©���§ V³G*_&��V³G*_&�HRCKÆV³G�\�Á��Â�¦��R�Â!©� �>Á å K}¾ ` K�¿ ` ÂTV³G*_&��_P@�BN� R K�¿$Á å K�¾ ` K�¿ `  f¼» ` \]OyV�� R V³G�\�

å l

Page 11: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

×]BÃ_hXEO,JWACB�Oy@/MU@*´7´EMhGyÏEACf¯@/_PAcGTB�F�S�XEAWVYXËAW\jORB�_PAcMhOyJcIË@*b7OyÇ�ÅE@/_]O%XEOQMPO*FES�O�_P@/¶*Oz£¤��ª|�=� Æ _P@�B2�¤@�BEbdB�OQD�JcOyV³_U@�BTI_]OQMvfÃ\j_hXE@/_U@/MPO%\POyV³GTBEbÎG*MhbEOQM�ACBÀ¾�@�BEbÀ¿�;�»�X�ORB�Ø

£�¾�ª|�>� Æ ¾£=¿¤ª*K�� Æ Á�_P@�BN� R �Z¿9\]OyV ` � R ¾�O¯B�GRSâMPG*_P@/_]O¤_hX�O¤V³G�G*Mhb7ACBE@/_]Om\]I�\]_]ORf [TId_hXEOg´7@/Mv@*JWJW@*V³_PAWVm@�B�D�JcO D ;�»UXEAW\NJcOy@*b7\N_]GÄ_hXEO%MPOyJW@/_PAcGTBE\�D�Ac^*ORBÝ[�I¿NACB�¶�\>Á åHI*òJI ÂPØ £�¾Àª�� Æ § ? �'Á å K�? ` ¼¾���?A@L¿c©£�¿¤ª�� Æ § @���?$@=¾��'Á å K0@ ` Â:¿c©S�X�OQMhOB? @�BEb�@ @/MPO9_hX�OHÇ�ÅE@�B�_PAc_PAcOy\�bEOQÐ�B�Oybm[�I>¿NACB�¶�\UÁÜ[�Å�_�ACBg_]OQMvfÃ\|G*¹5 Ã@�BEb�"TF�\]G%XEAW\|¹�G*Mvf¤ÅEJW@/O9@/MPO�f¯Oy\P\]I�ÂPØ? �Ê\hACB D _P@�B2� R@|�ÊV³G�\ D _P@�BN� R»UX�O1Ð7Mh\P_(_]OQMvfÃ\ËACB _hX�OÝO³Ï�´EMhOy\P\PAcGTBE\Ĺ�G*M�£�¾�@�B7b £=¿ @/MhO(ÉPÅE\]_Ë_hX�O�\hX7Ac¹È_P\ÄG*¹%_hXEO1_P@�BED*ORB�_d´sG�ACBT_Ëb�Å�Oa_]GMPOQ¹�Mh@*V³_PAcGTB�FLS�XEAWVYX¡AW\�OyJWACfÃACBE@/_]Oyb3[�I¡fmGR^�ACB�DÎ_hX�OÃ_]OyJcOy\PV³G�´sO*F|@*\>b7AW\PVyÅE\h\]Oyb�Oy@/MhJWAcOQMyF|@�BEb�_hXEOÃACB�_]MhG�b�Å7V³_PAcGTB�G*¹D fÃ@/¶*Oy\�Ac_�G�[T^�AcGTÅE\�_hXE@/_C? @�BEbD@Í@/MPO¯V³GTfôsGTB�ORB�_P\NG*¹¦@Ë^*OQMP_PAWVQ@*J�b7AW\P´�JW@*V³ORfmORBT_NMhOy\]G�Jc^*Oyb3@*JcGTB�D� ¡@�BEbZ"�FMPOy\P´sOyV³_PAc^*OyJcI*;< MPG*_P@/_PAcGTB¯G*¹�_hX�OUÐ7OyJWb¤MPOy\hÅEJc_P\�¹ÈMPGTf _hXEOH¹�@*V³__hXE@/_�_hX�OH´EMPG/É0OyV³_]Oyb(BEG*MP_hX�Õ�\]GTÅ�_hX¤JWACBEOHAW\B�G,JcGTB�D*OQM@/_9´sG�\PAc_PAcGTBË@�B�D�JcO l ;�»UX�O�´sG�JcO�AW\9@/_%Á l :PV³G*_&"�R�Â�ACB(_hX�O�_P@�B�D*ORB�_H´�JW@�B�O*F7[�Å�_¦_hX�ONG*MhAcD�ACBÎAW\jb7AW\P´7JW@*V³OybË_]GµÁ ?$:E@(Â[�I(MPOQ¹�Mh@*V³_PAcGTB�Fs\]Gm_hX�O>BEOyV³Oy\P\P@/MPIËMPG*_P@/_]G*M�G/Ñ�\]OQ_V£�%¤\P@/_PAW\]Ð�Oy\QØ

£�%·ª,� Æ ��ÁÜV³G*_&" R ��@ÃÂ8ª�� Æ \PACB D _P@�B2� R _P@�BM" RO³ÏEV³Oy´E_d^*OQMPIÊVQJcG�\]O¡_]G¸_hXEO¡´�G�JcO'ÁÜ¿NACB�¶�\ åHI*òJI ÂP;Í»UXEOÝACfô7JWAWVQ@/_PAcGTBE\ÎG*¹¤b7A�Ñ�OQMPORBT_PAW@*J�MPOQ¹�Mh@*V³_PAcGTB¼¹�G*MdG/ÑsÕ�@�Ï�AW\@�Å�_]G*DTÅEAWb�ACB�DÃ@/MPO%b�AW\PVyÅE\P\]OybÎACBdó%ôN;

­87�F 8 ��·2 6 8 �9�!�� )���� C¯ � �s]���<"´sG�ACBT_PACB�Dgf¯G�bEOyJ�AW\¦@g\]OQ_¦G*¹$@�BE@*JcI�_PAWVQ@*J�¹ÜÅ7B7V³_PAcGTBE\�@�B7b(JcG�G*¶TÕ�Å7´Ã_P@*[7JcOy\9ÅE\POybÃ_]G¤V³G*MPMPOyV³_j¹�G*M¦bEOy´�@/MP_hÅ�MPOy\¹ÈMPGTf@�BaAWbEOy@*J!@*Jc_P@/ÖyACf¤Å�_hXµ_]OyJcOy\PV³G�´sO*;U»UX�O>´�G�ACBT_PACB�DËfmG�bEOyJ5¹�G*MU_hX�O>¾ ¿N» Å7\]Oy\�ÅE´d_]GËÔ å ¹ÜÅ7B7V³_PAcGTBE\QF�b�Ac^�AWbEOybaACB�_]Gk D*MPGTÅE´7\QØ�@ÃD*OQGTf¯OQ_]MhAWVQ@*J�fmG�bEOyJ$G*¹_hX�O¤_]OyJcOy\PV³G�´sO*F5OyJcOQ^�@/_PAcGTB�Å�O³ÏEÅ�MhO>@�BEb�XE@/Mvf¯GTBEAWVQ\�G*¹@/ÖyACf¤Å�_hX�;�?$G�G*¶TÕ�ÅE´_P@*[7JcOy\,ACB1@*Jc_PAc_hÅEb7O¯@�BEbÝ@/ÖyACfgÅE_hXa@/MhO¤ACfô7JcORfmORBT_]Oyb5F5[�Å�_�@/MPO¯B�G*_�VyÅ�MPMhORB�_PJcIÝÅE\]Oyb5;,»UXEO>MPOy\hAWb�ÅE@*JW\�¹�MPGTf @(Ð�__]G(@(´sG�ACB�_PACB�D(_]Oy\]_mÁÜ\]OQO>JW@/_]OQMQÂj_�I�´7AWVQ@*JWJcIÝXE@y^*O¤@�BÎMy;�fd;=\Q;j[�OQ_�S�OQORB l ; I @�BEb å ;�æ(@/MhVQ\]OyV/F�bEOy´sORBEb7ACB�DÃGTBd\]OQOyACB�DV³GTBEb7Ac_PAcGTB7\QF7¹�G�VQ@*J5\]_P@/_PAcGTBµ@�BEbµf¯Oy@*\hÅ�MPORf¯ORB�_¦_]OyVvX7B7AWÇ�Å�O*;�<NBËO³ÏE@�f¯´�JcO�AW\U\hX�GRSNBÎACBËÞ|AcDTÅ�MPO å @�BEbË_hXEO%fmG�bEOyJ_]OQMvfÃ\¦@/MhO�JWAW\P_]OybdACBÄ»)@*[7JcO å SUAc_hXÄ_hXEOyAcMUBE@�fmOy\¦ACBÄ_hX�O,B�G*_P@/_PAcGTBËG*¹)_hX�O�»H²¦ZN×0ÙN» @�B7@*JcI�\PAW\U´7@*VP¶/@/D*O(Á�¾¡@*JWJW@*V³OåyòJI*ò ÂPFs_hX�OyAcMH¹êÅ7BEV³_PAcGTBE@*J5¹�G*MvfÃ\QFE@�BEbÎ_�I�´7AWVQ@*J!^�@*JCÅ�Oy\H¹ÈG*M�_hX�O e @*\P\]OQD*Mv@*ACBι�G�VyÅE\>Á�_hX�O%\PAcDTBÎV³GTBT^*ORBT_PAcGTBa@*´�´�Oy@/Mv\\]_]Mh@�BED*O¯[�OyVQ@�Å7\]O¤_hX�O¯»H²¦Z�×�ÙN»â\]G*¹È_�S¦@/MhO(ÅE\]Oy\�@Îb7A�Ñ�OQMPORBT_�bEOQÐ�BEAc_PAcGTB1G*¹j@/ÖyACf¤Å�_hXsÂP;¤ÙUG*_]Om_hXE@/_,\PGTfmO¤G*¹�_hXEO_]OQMvfÃ\�@/MPO�B�G.SÊB�G*_j\PAcDTBEAcÐ�VQ@�B�_PJcIÄb7A�ÑsOQMhORB�_¦¹ÈMhGTf l FE[�Å�_¦@/MPONMPOQ_P@*ACB�OybË[sOyVQ@�ÅE\]ON_hX�OQIÃXE@y^*O�[sOQORBÄB�OQOybEOybÄACBÃ_hXEO´7@*\]_Q;

�giHG�i�j Ü�lc��Ul®oS��n�wxv� vemAqün�m�q�l�I ² ���W�&�Wt»UXEAW\UD*MPGTÅE´1XE@*\�è¯_]OQMvf¯\QF�@*JWJ!SUAc_hXµ\]GTfmO%D*OQGTfmOQ_]MhAWVQ@*J|ACBT_]OQMh´EMPOQ_P@/_PAcGTB�;�»UX�O%@�B�D�JcOy\N[sOQ_�S¦OQORBa_hX�O%ACBE\]_]MYÅ7fmORBT_MPG*_P@/_]G*MÃ@�ÏEAW\dÁ�S�XEAWVYX·bEOQÐ�B�Oy\g_hX�O˹êÅ7BEb7@�f¯ORB�_P@*J�´�G�ACBT_PACB�D�b7AcMPOyV³_PAcGTB�Â�@�B7bº_hXEOÎBEG*Mvf¯@*J_]G�_hX�OÄ@/ÖyACf¤Å�_hXÆ@�B7bOyJcOQ^/@/_PAcGTB3@�Ï�Oy\%@/MPOö�B�G.S�B�@*\>V³G�JWJWACf¯@/_PAcGTB�OQMhMPG*Mh\,@�BEb¡_hX�OmMPOy\PAWb�Å7@*J�ÖQOQMPG/Õ�´sG�ACB�_>V³G*MPMPOyV³_PAcGTBE\g@/MPO¯MPOQ¹�OQMPMPOybÝ_]G@*\�ACBEbEO³ÏdOQMPMhG*Mh\Q;U»UXEO>ACBEbEO³Ïµ@�B7baV³G�JWJWACfÃ@/_PAcGTB1OQMPMPG*Mh\NACBdOyJcOQ^/@/_PAcGTB�@/MPO¤B�G*_�\]Oy´7@/Mh@*[7JcO*F5@�BEb1@/MPO¤V³GTfg[7ACB�OybµACBGTB�O�V³G�OuÕ(VQAcORB�_Q;¦ÞEG*M9_hXEAW\¦MPOy@*\]GTB�FE@�BEb(¹�G*MjV³GTBT^*ORBEAcORBEV³O,ACBËÅE´�b7@/_PACBED%_hX�O�fmG�bEOyJ�@/_j_hX�O�\]_P@/MP_jG*¹!@�B(G�[7\POQMP^�ACBED\]Oy\P\hAcGTB�F�ACBEbEO³ÏÄOQMPMPG*Mh\UACBÎ[sG*_hXËV³G�G*Mhb�ACBE@/_]Oy\U@/MPO>ACBEVQJCÅEbEOybÎACBË_hXEO,´�G�ACBT_PACB�DÃV³G*MhMPOyV³_PAcGTBE\QF�b7Oy\P´7Ac_]O,_hX�O�¹Ü@*V³_H_hXE@/_

å*å

Page 12: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

»L@*[7JcO å Ø�»UX�O,²LG�ACB�_PACBEDÄ`µG�bEOyJ$¹ÈG*MH_hXEO�¾ ¿N»�;

»!OQMYf ãNOy\PV³MhAW´E_PAcGTB £=� £�� á�@*JCÅ�OÁÜ»H²¦Z�×�ÙN»� ÁÜ@/MhVQ\]OyV�Â

×�< <�ÖyACfgÅE_hXËACBEbEO³Ï � å l l ;�æ× n n JcOQ^/@/_PAcGTBdACB7bEO³Ï l � å è�;�ée < <�ÖyACfgÅE_hXËV³G�JWJWACf¯@/_PAcGTB �dVQ\PVA� l é k ; òÙ�²�< n Ù�GTB�Õ�´sOQMh´sORBEb7AWVyÅEJW@/MhAc_�I �dV³G*_&� l � å Ô�;�Ô<>J Ù�ÚË@�Ï�AW\H_PAWJc_ �d\hACB_�aV³G*_5� V³G�\e� k ÓE; å<LK n ¾ @�ÏEAW\H_PAWJc_ V³G�\�aV³G*_5� �d\PACB,� å é�;�Ô»HÞ ¿�G�G*¶*O*í=\�?!@ySÃÅ7O³Ï7Å�MPO l �d\hACBM� � åHI ; l»MJ l �d_P@�BM� l ; l¿ o Ú o Ó l \hACB¦Ó®� l ; l¿�Ú e < å V³G�\e� � å ;�æ¿�Ú�Ú�< å �d\PACB,� � k ; k¿ o!e < å �dV³G�\e� k ; l¿ o Ú�< å \PACB,� � å ;�è¿�Ú e <NÔ �dV³G�\�Ô�� å ;�æ¿�Ú�Ú�<NÔ \PACBHÔ�� l ; k¿ o!e <NÔ V³G�\�Ô�� � l ; I¿ o Ú�<NÔ �d\PACBHÔ�� l ; k¿�Ú e < k V³G�\ k � l ; l¿�Ú�Ú�< k �d\PACB k � Ô�;�é¿ o!e < k �dV³G�\ k � ��Ô�; å¿ o Ú�< k \PACB k � l ; ò

å Ô

Page 13: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO å Ø�:UOy\PAWb�ÅE@*JW\�¹�MPGTfß@%´�G�ACBT_PACB�D�_]Oy\]_¦@/_�_hX�O e @*\P\]OQD*Mh@*ACB¤¹�G�VyÅE\Q;HÁÜ@� î Á�¹³ÂPF5ÁêXsÂPØLMPOy\PAWb�ÅE@*JW\ACBONZ���1\PACBM��F��Fe�â@�BEb$��Á�_]G*_P@*J!OQMPMhG*MQÂ�´7JcG*_]_]Oyba@/D�@*ACBE\]_2�â@�BEb¥��;�ì�BEAc_P\U@/MhO%bEOQD*MPOQOy\UGTBÎ_hX�O�ÏÎ@�Ï�Oy\�@�BEbµ@/MhVQ\]OyV,GTBÎ_hX�O,I@�Ï�Oy\Q;�Á�D�Â�Ú�VQ@/_]_]OQMH´7JcG*_jG*¹$MPOy\hAWb�ÅE@*JW\�ÁÜì�� ÅE´5ç�?U�àJcOQ¹È_³ÂP;NÁÜA�Â�¿NAW\]_]G*D*Mh@�f G*¹)OQMPMPG*Mh\¦ACBP? � HV³G�\"TF�Q �ü"�FRNjF�¯@�B7bS�¤;

å k

Page 14: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPOÃÔ�Ø�»UX�O¤OyJcOQ^/@/_PAcGTB¡V³GTf¯´sGTB�ORBT_�G*¹_hX�Om´sG�ACBT_PACB�DµfmG�bEOyJ)¹ÈG*M�_hX�O¤¾Ê¿�» e @*\P\]OQD*Mh@*ACBݹ�G�VyÅE\QF$bEOQMhAc^*Oyb�[�IÐ7_]_PACB�D,@,f¯G�b7OyJ�_]G%_hX�OHb7@/_P@�F�\POQ_]_PACB�D,_hX�OH\PACBN��F�_P@�BM��@�B7b¯\PACBjÓ®��_]OQMYf¯\�ACB=£���_]G l @�BEbm´7JcG*_]_PACB�D,_hXEO9MPOy\PAWb�ÅE@*JW\@/D�@*ACBE\]_�ÖQORBEAc_hXÎb7AW\P_P@�BEV³O*;

_hX�OQId@/MPO¤JcG*D�AWVQ@*JWJcIa´�@/MP_UG*¹�_hX�OgORBEV³G�bEOQMNf¯G�b7OyJÁÜ\]OQO¤[�OyJcG.S�ÂP;U»UXEOQId@/MPO%¶*Oy´E_�VQJcG�\]Og_]G(ÖQOQMhGÄ[�IdVvXE@�BED�ACB�D(_hXEOORBEV³G�bEOQM9fmG�bEOyJ7V³G�OuÕÃVQAcORB�_P\y;»UX�O�_hX�MPOQO�\hACf¯´7JcOy\]_�_]OQMvf¯\NÁ�OyJcOQ^�@/_PAcGTBË@�B7b(@/ÖyACf¤Å�_hXÃACBEbEO³Ï¯OQMPMPG*Mv\�@�BEb(JcOQ¹È_0Õ�MvAcDTX�_V³G�JWJWACf¯@/_PAcGTB�ÂHfÃ@yId[sOgÅ7´sb�@/_]OybaÅE\PACBEDÃ_hX�OLþxû��ùTcý�ûcøc÷Ä´EMPG�V³Oyb�Å�MhO(ÁÜ\]OQOm[sOyJcGRS�ÂP;N»UX�O%MhORf¯@*ACBEACB�DÃD*OQGTfmOQ_]MhAWVQ@*J_]OQMvfÃ\�@/MPOg_hX�OmB�GTB�Õ�´sOQMh´sORBEb7AWVyÅ7JW@/MhAc_�IËG*¹@/ÖyACf¤Å�_hXa@�BEbaOyJcOQ^�@/_PAcGTB�@�Ï�Oy\�@�BEba_hX�O>_PAWJc_P\�G*¹_hX�Og@/ÖyACf¤Å�_hXa@�ÏEAW\NACB_hX�O>BEG*MP_hX�Õ�\]GTÅ�_hXË@�B7bÎOy@*\]_0Õ�S¦Oy\]_�b7AcMhOyV³_PAcGTBE\Q;

×�_¯AW\mS¦G*MP_hX¸B�G*_PACB�D�_hX7@/_Ã@�VQJcG�Vh¶ÆOQMPMPG*MÃAW\mOyÇ�ÅEAc^/@*JcORB�_Ã_]G3@Ý_PAWJc_¯G*¹N_hX�Od@/ÖyACf¤Å�_hXÌ@�ÏEAW\¯ACBÆ_hX�OÎOy@*\]_0Õ�S¦Oy\]_b7AcMPOyV³_PAcGTB5F7_]G*D*OQ_hX�OQMNSUAc_hXÎ@�BÎ@/ÖyACf¤Å�_hXÎACB7bEO³Ï(OQMPMhG*My;< å \HVQJcG�Vh¶ÎOQMPMPG*MUAW\HOyÇ�ÅEAc^/@*JcORBT_U_]G¯@¯VYXE@�B�D*O%ACBÎ@�ÏEAW\H_PAWJc_[�I å æ/V³G�\g$Ä@/MhVQ\]OyVN@�BEb¯@�BÃ@/ÖyACf¤Å�_hXmG/Ñ5\]OQ_G*¹B� å æ/\PACBN$Ë@/MhVQ\POyV/;�×�¹5@�BmOQMhMPG*M�AW\¦f¯@*bEOHACB¯_hX�OU_PACf¯O%Á°GHF�±xF7[sOyVQ@�ÅE\POìN» å �HìN» e AW\,B�G*_,ÅE´�b7@/_]Oyb1¹ÈMPOyÇ�Å�ORBT_PJcIµORB�GTÅEDTX�F5G*M�@*\,@ÄMPOy\hÅEJc_�G*¹_PACf¯Og\POQMP^�AWV³O¯b7MhAc¹È_³Â9S�XEORBd_hX�O¤_]OyJcOy\PV³G�´sO´sG�ACB�_PACBEDÃAW\HbEOQ_]OQMvfÃACB�Oyb5F�_hX�ORBÎAc_Nf¯@yIË[sOyV³GTfmO,@*[7\PG*Mh[sOybÎACBË_hX�Oy\]O%V³G�OuÕÃVQAcORBT_P\QF�VQ@�Å7\PACB�DÃV³GTB�¹êÅE\PAcGTBdJW@/_]OQMy;�giHG�i�h ² ��l®�PvPo�n��&m}Ý2��lUI��A�Sl»UX�Oa´�G�ACBT_PACB�DÆfmG�bEOyJ9ACBEVQJCÅEbEOy\(@ºB�Å7fg[sOQM¯G*¹�_]OQMvf¯\ÃS�XEAWVvX fmG�bEOyJj_hX�Oa_PAWJc_Ä@�BEb¨Å7O³Ï7Å�MPOdG*¹�_hX�O1\]_]MvÅEV³_hÅ�MhO*;»UX�MhOQO%G*¹�_hX�Oy\POgbEOy\hV³MhAW[sO%_hX�OgO³ÑsOyV³_P\�G*¹D*Mh@y^�Ac_P@/_PAcGTBE@*J�bEOuÅ7OyV³_PAcGTB1GTBµ_hX�Og_]OyJcOy\PV³G�´sO¤_hÅE[sO>@�BEbÝf¯@*ACB1f¯AcMPMhG*Mh\Q;»UX�OÎ[7AcD*D*Oy\P_¯O³ÑsOyV³_(AW\¯b�Å�OË_]G¡MPOyJW@/_PAc^*Oa_]Mh@�BE\PJW@/_PAcGTBÌG*¹�_hX�OÎ_]G�´'@�BEbÌ[sG*_]_]GTfäORBEb7\Q;Æ»UX�Od´sG�ACBT_PACB�D�OQMPMPG*M¯AW\D�Ac^*ORB'_]G3@¡\hÅ�Mv´EMhAW\PACB�D�JcI·D*G�G�b¸@*´�´EMPGyÏEACf¯@/_PAcGTB'[TIÆ_hX�OY£��WV½\PACB,� ÁÜ¿UG�G*¶*O*í=\Ë?!@RS�Â%MPOyJW@/_PAcGTB'¹ÈG*MÄ@¡\PACfô7JcO[sOy@�fÎ;¯»UXEOg¹�G*Mvf G*¹j_hX�O(bEOuÅ7OyV³_PAcGTB¡AW\%´7JcG*_]_]OybºACB¡ÞLAcDTÅEMPO(Ô�ç|Ac_%AW\>f¯G�bEOyJWJcOyb�[�I�@�BÝO³ÏE´EMPOy\P\PAcGTB�G*¹¦_hXEOm¹ÈG*Mvf£�����X f \PACB,�2K0X ` _P@�B2�NK0X � \PACBjÓ®��;

å Ó

Page 15: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO k د»UX�O(OyJcOQ^�@/_PAcGTB¸X7@/MvfmGTBEAWVÃV³GTf¯´sGTB�ORBT_%G*¹H_hX�OÄ´sG�ACB�_PACB�D�fmG�bEOyJ¹ÈG*Mg_hX�Oľ ¿N» e @*\P\]OQD*Mh@*ACBº¹�G�VyÅE\yFbEOQMhAc^*Oyb3[TIaÐ7_]_PACB�Dd@dfmG�bEOyJL_]GÎ_hX�O¯b7@/_P@�F)\]OQ_]_PACB�Dd_hX�OÃX7@/MvfmGTBEAWVg_]OQMvfÃ\N_]G l @�BEb�´7JcG*_]_PACB�Dd_hXEOmMPOy\PAWb�ÅE@*JW\�ACBÖQORBEAc_hXµb7AW\]_P@�BEV³O%@/D�@*ACB7\]_U<�ÖyACfgÅE_hX�;

�giHG�i�� ����n�����oSpZY�v�S�U�m8n�wxt»UX�O�MhORf¯@*ACBEACB�D¤_]OQMvfÃ\HACBË_hX�O,´sG�ACBT_PACB�D(f¯G�bEOyJ�@/MPOgXE@/MvfmGTB7AWVQ\jG*¹L@/ÖyACf¤Å�_hXËG*¹|_hX�O%¹ÈG*MvfdØ

£��[V¼\PACBM�g�£��[V¼V³G�\(�g�£=�1\PACBM�[V¼\PACBM�g�£=�1\PACBM�[V¼V³G�\(�g�

S�X�OQMhOÄB�� å FÔµG*M k Á!£��a\PACBN�aAW\g_hX�OÄJcOQ¹È_0Õ�MvAcDTX�_mOQMPMhG*M>GTBº_hX�OË\]¶�I�ÂP;1»UX�Oy\]OÄMPOy´EMPOy\PORB�_g_PAWJc_P\gG*¹H_hX�OÄORB�_PAcMPO_]OyJcOy\PV³G�´sO*F$b�Å�O¤´EMhACfÃ@/MhAWJcIÎ_]GËbEOQ^�AW@/_PAcGTB7\�G*¹_hX�O¤@/ÖyACf¤Å�_hXa_]Mh@*VP¶a¹ÈMPGTf @Ä´7JW@�B�O*;�»UX�OyAcMNO³Ñ�OyV³_P\,@/MPO¤AWJWJCÅE\]_]Mh@/_]OybACBÎÞ|AcDTÅ�MPOy\ k @�BEbËÓE;

­87 \ 8 ��Æ#0�|���5�9]Y�����5 �Ì���|�$�®]�� ��s�*·�.-��.�*��×�_>AW\>G*¹È_]ORB·B�OyV³Oy\P\P@/MhI�_]GaG/Ñ5\]OQ_g_hX�OÃ_]OyJcOy\PV³G�´sOËACB3\vÅEVvX3@µSj@yI�_hXE@/_¤@�BºACf¯@/D*OÄf¯GR^*Oy\g[TI¡@µD�Ac^*ORBº^*OyV³_]G*M¤ACB_hX�Od¹�G�VQ@*JH´7JW@�B�O*F¦MPOQD�@/Mhb7JcOy\h\¯G*¹NMPG*_P@/_]G*MÄ´sG�\PAc_PAcGTB¸@�B�D�JcO*; »UXEOdV³GTB�^*ORBT_PAcGTBE@*J�ÅE\P@/D*Od¹�G*MÃ\hÅEVYXÌ@�BÆG�´sOQMh@/_PAcGTBÁ³ð][sOy@�f¯\]S�Ac_PVvXEACB�D�ñdG*Mað]@*´sOQMP_hÅ�MPOÃG/Ñ�\]OQ_]_PACBED�ñ�Â�V³GTf¯Oy\�¹ÈMhGTf _�S¦G/Õ�VvXE@�B�B�OyJ�´�X�G*_]GTfmOQ_]MPI*;Ä»UX�O¯» e ÚÝbEOQÐ�B�Oy\%@e @/MP_]Oy\hAW@�BÝV³G�G*Mhb�ACBE@/_]Om\]I�\P_]ORf ÁÈÏ Æ F5I Æ Â9ACBa_hX�O¤¹�G�VQ@*J|´7JW@�BEOg¹�G*M�_hXEAW\�´�Å�Mh´sG�\]O*;�×�¹�_hX�Om´sG�\PAc_PAcGTB1@�B�D�JcOmG*¹_hXEOMPG*_P@/_]G*M%ACB1_hXEOmf¯GTÅ7BT_NV³G�G*Mhb7ACBE@/_]Om\]I�\]_]ORf AW\VO�^µF5_hXEORB1_hX�O¤I Æ @�ÏEAW\�AW\�@*JWAcDTB�Oyb�S�Ac_hXµ_hXEOg^*OQMh_PAWVQ@*J�b7AcMPOyV³_PAcGTB¹�G*MNO_^.� l ;H»�X�O,G*MhAcD�ACBaG*¹|_hX�O>\PI�\]_]ORf AW\�ÐEÏ�Oyba[TIË_hX�OgACB�_]OQMv\]OyV³_PAcGTB1G*¹�_hX�O>ACB7\]_]MvÅ7f¯ORB�_9MPG*_P@/_]G*M�@�ÏEAW\UG*¹�_hXEO

å æ

Page 16: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPOÎÓEØλUX�Od@/ÖyACf¤Å�_hXÌX7@/MvfmGTBEAWVÄV³GTf¯´sGTB�ORBT_¤G*¹�_hXEOË´sG�ACBT_PACB�D3fmG�bEOyJ�¹ÈG*MÃ_hX�Oξ ¿N» e @*\P\POQD*Mh@*ACBƹ�G�VyÅE\yFbEOQMhAc^*Oyb3[TIaÐ7_]_PACB�Dd@dfmG�bEOyJL_]GÎ_hX�O¯b7@/_P@�F)\]OQ_]_PACB�Dd_hX�OÃX7@/MvfmGTBEAWVg_]OQMvfÃ\N_]G l @�BEb�´7JcG*_]_PACB�Dd_hXEOmMPOy\PAWb�ÅE@*JW\�ACB£ONZ� £=�a\hACBM��@/D�@*ACBE\]_�@/ÖyACf¤Å�_hX�;|»UX�O9fmOy@�B>G*¹�_hXEO�¹�GTÅ�M|_P@*´sO¦ORB7V³G�bEOQM�X�Oy@*b�\)Sj@*\�ÅE\]Oybg_]G,fmOy@*\vÅ�MPO�@/ÖyACf¤Å�_hX¹�G*MH_hXEAW\9_]Oy\]_Q;

å è

Page 17: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

¹�G�VQ@*J¦\]_P@/_PAcGTBÆACB·ÅE\]OÃS�Ac_hX¡_hX�O(¹ÈG�VQ@*Jj´7JW@�B�O*;µ²LG�\PAc_PAcGTB7\mACB¡_hXEAW\g\]I�\]_]ORfÀ@/MPOÃMhOQ¹ÈOQMPMhOyb3_]GÝ@*\Ýð]@*´�OQMh_hÅ�MPOy\Pñ�;d×�¹@ËD�Ac^*ORB¸ÁÈÏ Æ F5I Æ ÂHG/Ñ5\]OQ_,AW\�ACBT_]MPG�b�ÅEV³Oyb5F$@�BÝACf¯@/D*O¯V³G�ACB7VQAWbEORB�_�S�Ac_hX1_hX�OmMPG*_P@/_]G*M%V³ORBT_]MPOmSUAWJWJ�[sOmfmGR^*Oyb¡_]Gd@´sG�\PAc_PAcGTBËÐEÏ�OybËACBË_hX�O�¹�G�VQ@*J$´�JW@�B�O*F7ACBEbEOy´sORBEbEORBT_¦G*¹L\]¶�I(´sG�\PAc_PAcGTBË@�BED�JcO*F%�; e GTBE\POyÇ�Å�ORBT_PJcI*F7@�BTIËf¯GR^*ORfmORBT_9G*¹_hX�OgMPG*_P@/_]G*M�VQ@�ÅE\]Oy\N_hX�O>_]OyJcOy\PV³G�´sOg_]GË[sO%G/Ñ5\]OQ_�ACBµ\hÅ7VvXa@ÃSj@yId_hX7@/_�_hX�OgÐ7OyJWb1@*´7´sOy@/Mh\H_]GÄMPG*_P@/_]Om@*[sGTÅ�_gÁÈÏ Æ FI Æ ÂP;,<N´�OQMh_hÅ�MPOy\N@/MPO¤B�Å7fg[sOQMPOybd¹�MPGTf lÃî å l F$@*´sOQMP_hÅEMPO l Á�_hX�O�ð0MPOQ¹�OQMPORBEV³Om´sG�\PAc_PAcGTBEñ�ÂH[sOyACB�DË@Ä\h´�OyVQAW@*J|VQ@*\]O*;<N´�OQMh_hÅ�MPO l AW\_hXEO�bEOQ¹Ü@�ÅEJc_¦GTBÃVYXE@�B�D*ONG*¹!\]GTÅ�MhV³ON@�BEbÄVQ@�BÃ[sO�\POQ__]G¤\]GTfmO�ÅE\]OQ¹êÅEJ7´sG�\PAc_PAcGTB(GTB¯_hXEO�ACBE\]_]MYÅ7fmORBT_QF\hÅEVYXÌ@*\m_hX�OdV³ORBT_]MPOdG*¹�@�\P´sOyV³_]MPG*D*Mh@*´�XÌ\PJWAc_mG*MôsG�JW@/MhACf¯OQ_]MhAWVÎbEOQ¶�¶*OQMy;Æ×�_¯AW\¯´�@/MP_PAWVyÅEJW@/MhJcIÌACf¯´sG*MP_P@�BT_mAc¹�_hXEOACBE\]_]MYÅ7fmORBT_�AW\%\PAcDTBEAcÐ�VQ@�B�_PJcI¡b7AW\h´7JW@*V³Oyb¡¹�MPGTf _hXEOÃ@�Ï�AW\%G*¹jMPG*_P@/_PAcGTB�;λUX�OmMPORfÃ@*ACBEACB�Dd@*´sOQMP_hÅ�MhOôsG�\PAc_PAcGTBE\%@/MhO\]OyJcOyV³_P@*[7JcO�[�Im_hX�O�ÅE\]OQMyF�@*\�bEOy\hV³MhAW[sOybÃACB(<�´7´sORBEb�A�Ï e Å7BEbEOQM_hX�O�÷�ÿcøc÷�ý�F�öJøQôJý�÷�FJû_�c÷®ýcøU`cý�÷>@�B7bO�÷®û�úeö#�gùWøPþ��V³GTfÃfÃ@�BEb7\Q;

×�_9AW\¦´sG�\P\hAW[7JcO�_]GmbEOQÐsB�ON@�BÄ@*´sOQMP_hÅ�MhONACBT_]OQMh@*V³_PAc^*OyJcIµÅE\PACBEDg@¤fmG�bEONG*¹$_hX�O,XE@�BEb7\POQ_�ÁÜ\]OQO�<N´7´sORBEb7A�ÏÃã>ÂP;E<NBACf¯@/D*OmAW\�V³ORBT_]MPOybÝGTB1_hX�O¤MPOQ¹�OQMPORBEV³Om´sG�\PAc_PAcGTBÝÅE\PACB�DÄGTB�O¤G*¹_hX�O ¢&Ä F�#�"¯G*M·¾5¿�fmG�bEOy\Q;�»UX�OmXE@�BEb�\]OQ_NAW\N_hX�ORB\]SUAc_PVYX�Oybd_]G(_hX�O ¢&Æ�ÄJÆ \PI�\]_]ORfÍ@�BEbÎ_hX�O>ACf¯@/D*O%AW\NfmGR^*Oybµ_]GÃ_hX�O>bEOy\PAcMPOybd´sG�\PAc_PAcGTBµACBË_hX�O,¹�G�VQ@*J!´7JW@�B�O*F�S�XEAWVvXAW\�_hX�ORBd¶*Oy´7_U¹�G*MNJW@/_]_]OQM%ÅE\PO*;H»UX�O ¢&Æ�ÄJÆ fmG�bEO>fÃ@yIÎ[sOgÅE\]OybµS�XEAWJW\]_N@�Å�_]G*DTÅEAWb7ACBEDEFs\PACB7V³O%_hX�Og´�G�\hAc_PAcGTBµG*¹�_hXEODTÅEAWbEO,\P_P@/MUGTBË_hX�O>@�Å�_]G*DTÅEAWbEOQM eHe ãâAW\9_hX�ORBÎ@�ÅE_]GTf¯@/_PAWVQ@*JWJcIdV³GTf¯´sORBE\h@/_]OybιÈG*MNfmG*_PAcGTBÎACBË_hXEO,¹ÈG�VQ@*J$´7JW@�BEO*;

<¼MhG*_P@/_PAcGTBE@*JsG/Ñ�\]OQ__O Æ f¯@yI¯[sONACB�_]MPG�b�ÅEV³OybÄACB(@�BÃ@�BE@*JcG*D*GTÅ7\jS¦@RI*;»UXEAW\¦AW\jV³GTBEV³Oy´E_hÅE@*JWJcIÄ@>VYXE@�B�D*O�ACBÃ_hXEOV³GTBT^*OQMh\PAcGTB1[sOQ_�S¦OQORBµ^�AcMP_hÅE@*JL\]¶�Id²�<ß@�BEba@*V³_hÅ7@*JLf¯GTÅ7B�_�²s<>;s×0Bµ_hX�O>@*VQÇ�ÅEAW\PAc_PAcGTBaG*¹@ÃÐ7OyJWbaGTB�_]GË@Äf¤ÅEJc_PAW\hJWAc_f¯@*\P¶¯G*MHJcGTB�D¯\PJWAc_QF7¹�G*MHACBE\]_P@�B7V³O*F7Ac_HAW\HB�OyV³Oy\P\P@/MPIÄ_]G¯V³G*MPMPOyV³_9¹�G*M9MPG*_P@/_PAcGTBE@*J!OQMPMPG*Mh\�Á°GWF ±®F�ACB7V³G*MPMPOyV³_U´sG�\PAc_PAcGTBEACBEDG*¹¦_hX�O¯f¯@*\]¶µACB�_hX�OmACBE\]_]MvÅ7f¯ORB�_³Â9@*\�S¦OyJWJ�@*\�_]Mh@�BE\hJW@/_PAcGTBE@*J�GTB�Oy\Q;g×]Ba@*b�b7Ac_PAcGTB�F!\]GTf¯OmACBE\]_]MvÅ7f¯ORB�_P\mÁ°GWF ±®F!_hXEOì�_]MPOyVvXT_ n VYX�OyJWJcO>Ú�´sOyV³_]MPG*D*Mh@*´�XsÂ�X7@y^*O,@¤MPG*_P@/_PACB�D¯\hJWAc_9Å�BEAc_jS�XEAWVvXÄVYXE@�B�D*Oy\9_hX�O�MPOyJW@/_PAcGTBd[�OQ_�S�OQORBµfmGTÅ7BT_¦@�B7b\]¶�Id²�<%;s»UX�O·øU��÷�û_aËV³GTf(f¯@�BEb¡ÁÜ<N´7´sORBEb7A�Ï e ;�é k Â9ACf¯´�JcORfmORBT_P\H@�B ¢&Æ�ÄJÆ O Æ G/Ñ�\]OQ_NS�XEAWVYXµ@*JW\PGÃS¦G*MP¶�\�S�XEAWJW\P_@�Å�_]G*DTÅEAWb�ACB�DE;à»UXEO ¢Ä V³G�G*Mhb7ACB7@/_]Oy\(¹�G*MÄ_hXEAW\ËV³GTfÃf¯@�B7b'f¯@RI¸[�OaACB @ºb7A�Ñ�OQMPORB�_Ë\]I�\]_]ORf ¹ÈMhGTf ¢ÆAÄJÆ FU@�B7b\PVQ@*JcO*F�MPG*_P@/_PAcGTBÄ@�BEbÃXE@�B7bEOyb�B�Oy\P\�V³GTBT^*OQMh\PAcGTB7\�@/MPONbEGTB�OUÅE\hACB�D%ACBE\]_]MYÅ7fmORBT_0Õ�bEOy´sORBEbEORBT_�´7@/Mh@�fmOQ_]OQMv\Q;L»�X�ÅE\yF�¹ÈG*MO³ÏE@�f¯´7JcO*FL_hX�O(» e Ú1SUAWJWJ�@*VQV³Oy´E_¤_hX�OÃb7AW\P´�JW@*V³ORfmORBT_>@�BEb3MPG*_P@/_PAcGTBºGTÅ�_P´�Å�_g[TIÝ_hX�OÄ? n J�»Ò\PG*¹È_�S¦@/MPOÎÅE\]Oyb3¹ÈG*M@*JWAcDTBEACB�DÄfgÅ7Jc_PAW\PJWAc_HÐ7OyJWb7\y;

�gicb&i�j ���eoWvPo�n��&mrvemAqÂ�:�gw®�At»UX�O%X7@�BEb7\]OQ_H@*JWJcG.SU\H_hX�O>\]¶�I˲�<â@�BEbι�G�VyÅE\H^�@*JCÅ�Oy\H_]GÃ[sO,@*b/É]Å7\]_]OybdACBT_]OQMh@*V³_PAc^*OyJcI*;

­87�d 8 ���ê�Î�5 C]ß�/�T�� ��/���s�����! à�$#%�!���������5�N� > ��#0�5����»HAWJc_P\j@�BEbÄMPOyJW@/_PAc^*O�_]Mh@�B7\PJW@/_PAcGTBE\jG*¹$_hX�O�´EMvACf¯@/MPI*F�\]OyV³GTBEb7@/MPI(@�BEbÄ_]OQMP_PAW@/MPIÄfÃAcMPMPG*Mh\�VQ@�ÅE\]O�\PAcDTBEAcÐ�VQ@�B�_9´sG�ACB�_PACBEDOQMPMPG*Mv\Q;Ì»UX�OËMPOy´EMPG�b�ÅEVQAW[�JcOË´�@/MP_P\¤G*¹�_hXEOy\]OdOQMPMPG*Mv\m@/MPOÎ_P@/¶*ORBÌGTÅ�_([TIº_hX�Od´sG�ACB�_PACB�D3f¯G�b7OyJÜF�[�Å�_m\PAcDTB7AcÐ�VQ@�B�_MPOy\PAWb�ÅE@*JW\MhORf¯@*ACB�;�»UX�ON\]OyV³GTBEb7@/MhI(f¯AcMPMhG*M_PAWJc_P\j[TI(\hf¯@*JWJ�@�fmGTÅ7BT_P\S�Ac_hXEACBÃAc_P\jV³OyJWJ�@*\¦_hX�ON_]OyJcOy\PV³G�´sONOyJcOQ^/@/_PAcGTBVvX7@�B�D*Oy\NÁÜÞ|AcDTÅ�MhOy\�æ�@�BEb(è�ÂP;�Ú�ACBEV³OH_hX�O9_PAWJc_¦\hX�G.SU\\]GTf¯OUX�I�\]_]OQMPOy\hAW\QF�Ac_AW\¦fmOy@*\hÅEMPOyb¯ÅE\PACB�D�_hXEMPOQOUb7AW\P´�JW@*V³ORfmORBT__]Mh@�BE\hb�ÅEV³OQMh\N@�BEbµV³G*MhMPOyV³_]Oyb�@*\�@(V³G�JWJWACfÃ@/_PAcGTB1OQMPMPG*MNMh@/_hX�OQMN_hXE@�Bµ[sOyACB�DÄACBEVQJCÅEbEOyb1ACBµ_hX�Og´sG�ACBT_PACB�DÎfmG�bEOyJÜ;U<\PACfÃAWJW@/M_]OyVvX�BEAWÇ�ÅEONf¯@RIm[�O�@*´7´7JWAcOybÃACB¯_hX�OH¹êÅ�_hÅ�MPOU_]G>V³GTf¯´sORBE\h@/_]OH¹ÈG*M¦\hf¯@*JWJ7_PAWJc_OQMPMPG*Mv\�G*¹5_hX�OU´7MhACf¯@/MPImf¯AcMhMPG*MfmOy@*\vÅ�MPOyb3ÅE\hACB�Dd_hX�OÃ\vÅE´7´sG*MP_,JcG�@*b·V³OyJWJW\Q;d:HOyJW@/_PAc^*OÄ_]Mh@�BE\PJW@/_PAcGTBºG*¹j_hX�OÄ´EMhACf¯@/MhIa@�BEbº\]OyV³GTBEb7@/MPI¡fÃAcMPMPG*Mh\,AW\VyÅ�MPMhORB�_PJcIËACBEVQJCÅEbEOybµACBË_hX�O%´sG�ACBT_PACB�DÃfmG�bEOyJÜF7´EMhACfÃ@/MhAWJcI(ACBÎ_hX�O�_]OQMvf�´7MPG�´sG*MP_PAcGTBE@*J�_]GÃ\PACBN��;

»UXEON´sG�ACBT_PACB�DgV³G*MhMPOyV³_PAcGTBE\9MPOyÇ�ÅEAcMPOyb(¹�G*Mj´7MhACf¯@/MPIm@�BEbË\]OyV³GTB7b7@/MPI¯_PAWJc_P\>egf>@�BEbSeEhj@�B7b(MhOyJW@/_PAc^*O�_]Mh@�BE\PJW@/_PAcGTBX¤@/MPOND�Ac^*ORBË[TIÃ_hX�O�¹ÈG�JWJcG.SUACB�D¤¹ÈG*MYfgÅ7JW@/O*F�ACBÃ_hX�O,B�G*_P@/_PAcGTBÄG*¹�Ú�VvX�MhG�OybEOQM�Á åyòJI éTÂP;�<�MPG*_P@/_PAcGTBÄG*¹$_hX�O�\]OyV³GTB7b7@/MPI[�IieEhNVQ@�ÅE\]Oy\�@Äb7AW\P´7JW@*V³ORf¯ORB�_�G*¹�_hX�O¤ACf¯@/D*O¤ACBd_hXEO>¹�G�VQ@*JL´7JW@�B�OgG*¹�Ô�ejhRÁ9kTKml fEn ÂPF�S�XEOQMPOokËAW\�_hX�O¤\]Oy´7@/Mh@/_PAcGTBG*¹_hXEOg´EMvACf¯@/MPId@�BEb1\]OyV³GTBEb�@/MPI1fÃAcMPMPG*Mh\QFpl f AW\�_hX�Og¹�G�VQ@*J�JcORB�D*_hXaG*¹�_hX�Og´7MhACf¯@/MPId@�B7b�l fEn AW\N_hX�Om[7@*VP¶�Õ�¹�G�VQ@*Jb7AW\]_P@�B7V³O*;d»UXEAW\%V³G*MhMPOy\P´sGTBEb7\�_]G1@µ´sG�ACBT_PACB�DµOQMPMhG*M%G*¹N£ h ��Ô�e h Á9kzK�l f n Â��#l¨��Ô�q�e h F|S�XEOQMPO%lÌAW\%_hX�Où�G�VQ@*JJcORB�D*_hX¤G*¹�_hX�O9_�S�G/Õ�fÃAcMPMPG*M\PI�\]_]ORfï@�BEbOq¤AW\�_hX�O9Mv@/_PAcG,G*¹�_hX�OUX�OyAcDTXT_P\�G*¹sMh@yI�\�@/_�_hX�OUfÃ@/MPD�ACBE\|G*¹�\]OyV³GTBEb7@/MhI¤@�B7b´EMhACfÃ@/MPI*;)Þ7G*M�_hX�Oj¾ ¿N»�F®£rh � l�� ÓTè l é�eEh¦Ac¹�_hXEO¦_�S�G,Ç�ÅE@�BT_PAc_PAcOy\@/MPO9ACBg_hX�O9\P@�f¯OHÅ7BEAc_P\Q;|<¸MPOyJW@/_PAc^*OU_]Mh@�BE\PJW@/_PAcGTBG*¹L_hX�O,_�S¦G(fÃAcMPMPG*Mh\9[�I!XôsOQMh´sORBEb7AWVyÅEJW@/Mj_]G¯_hX�O�G�´7_PAWVQ@*J!@�ÏEAW\HMPOy\hÅ7Jc_P\HACBÎ@�BÎACfÃ@/D*O%fmG*_PAcGTBÎACBË_hXEO,¹ÈG�VQ@*J$´7JW@�BEOG*¹_�>X�Á9k�K0l fEn Â��#l ` Á�S�X�OQMPO[l ` F7_hXEO�¹ÈG�VQ@*J$JcORB�D*_hXdG*¹)_hX�O>\]OyV³GTBEb7@/MPIÎf¯AcMhMPG*MyFEAW\ « l ÂPFs\]Gm_hX�O%´sG�ACBT_PACB�DmOQMPMPG*MUAW\

å é

Page 18: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO�æ�Ø�»UXEO9^�@/MhAW@/_PAcGTBÃG*¹5\]OyV³GTBEb7@/MhIg_PAWJc_¦ACB¤OyJcOQ^/@/_PAcGTBÃS�Ac_hX¤OyJcOQ^�@/_PAcGTB(¹�G*M�_hX�OH¾ÊAWJWJWAW@�f ¿UOQMv\PVvX�OyJ�»!OyJcOy\PV³G�´sO*;»UX�O�_]OyJcOy\hV³G�´�O>S¦@*\UbEMhAc^*ORBι�MPGTf _hX�O%ÖQORBEAc_hXÎ_]GÃ@�BÎOyJcOQ^�@/_PAcGTBµG*¹ å l � @�BEbÎ[7@*Vh¶�;¦ÙUG*_]O>_hX�O%X�I�\]_]OQMPOy\hAW\HO³Ñ�OyV³_Q;£�sC� �>X�Á9kTKml fEn Â��#l ` l¦� �>qP"��#l ` ;·£�sC�ÙK å æ � Ô*æ�Xd¹ÈG*MT£�sjACBa@/MvVQ\]OyV¤@�BEbDX(ACBÝf(fÎ;�Þ|ACBE@*JWJcI*F!_hX�O>O³Ñ�OyV³_�G*¹_PAWJc_PACB�D(_hX�O,´EMhACfÃ@/MPIÄfÃAcMPMPG*M9[TIÎ@�BÎ@�BED�JcOoe9fmAW\�@�BÎACf¯@/D*O%f¯GR^*ORfmORBT_UACBË_hXEO�¹ÈG�VQ@*J!´7JW@�BEO�G*¹

Ô�e f k�K¸Ô�e f Á9kVK0l f n Â5KÌÔ�e f k�Á9k�Ktl f n Â��#l ` �¼Ô�e f l»UX�O,V³G*MhMPOy\P´sGTBEb7ACB�Dm´sG�ACBT_PACB�D¯OQMPMPG*M�AW\N£ f �¼Ô�e f F7@*\HO³ÏE´�OyV³_]Oybµ¹ÈG*M�@¯\PACB�D�JcO³Õ�fÃAcMPMPG*M9_]OyJcOy\PV³G�´sO*;­87�u ��7�T�5�*�������! ë ������E�×]B¤G*MhbEOQM�_]G>V³G*MPMPOyV³_Ð�OyJWbmMPG*_P@/_PAcGTBùÈG*M¦\]_P@/_PAcGTBE@/MPI¯ACBE\P_]MvÅ7fmORBT_P\�fmGTÅ�B�_]Oyb¤GTB¯_hX�OHÙ�@*\vf%I�_hX¯´�JW@/_]¹ÈG*MvfÃ\QF*G�´E_PAWVQ@*JbEOQMPG*_P@/_]G*Mv\�V³GTBE\PAW\]_PACB�D�G*¹�_�S¦G�ãNG.^*OU´EMhAW\hfÃ\!@�BEbg@�Å�@/_�f¯AcMPMhG*M)@/MPOHÅE\]OybËÁ i ACB�DTXE@�f åyòJI Ó�ÂP;�»UXEOy\]O¦@/MhO9f¯GTÅ7BT_]OybGTB1_hX�OmACBE\]_]MYÅ7fmORBT_UMPG*_P@/_]G*Mv\,@�BEb�@/MPOmbEMhAc^*ORB1[�Iµ_hX�Om» e Ús;s»�X�OmbEOQMPG*_P@/_]G*Mh\�@/MPO¯@*JWAcDTBEOyb¡ÅE\PACB�DË_hX�Om@*Jc_PAc_hÅEbEO@�ÏEAW\(@*\(@�MPOQ¹�OQMPORBEV³O*FH[�Å�_¯\vf¯@*JWJ9MPOy\hAWb�ÅE@*JjOQMPMPG*Mv\¯MPORfÃ@*ACBÆ_]Gº[sOdV³G*MPMPOyV³_]Oyb [�I·_hXEOµ» e Ús;�< Ð7Mv\]_0Õ�XE@/Mvf¯GTBEAWV_]OQMvf AW\UACB�_]MPG�b�ÅEV³OybµAc¹)_hX�O>V³GTf¯´sGTB�ORBT_P\jG*¹)_hX�O>bEOQMPG*_P@/_PAcGTBÎG�´7_PAWVQ\U@/MPO%B�G*_�ACBÎ@*VQVyÅ�Mh@/_]O,MhOyJW@/_PAc^*Og@*JWAcDTB7f¯ORB�_Qç�@\]OyV³GTBEbEÕ�XE@/MvfmGTB7AWV�_]OQMYf V³G*MPMPOy\P´sGTBEb�\j_]GÃ@¤_PAWJc_UG*¹L_hX�O�S�X�G�JcO,@*\h\]ORfg[7JcI(S�Ac_hXËMPOy\P´sOyV³_9_]Gm_hX�O%@�ÏEAW\9G*¹LMPG*_P@/_PAcGTB�;ÞEG*Mm@�BºACBE´�Å�_%[sOy@�f½@*JcGTB�D1_hXEAW\>@�ÏEAW\QF|_hX�OÄ´7@/_hX¡G*¹H@�BºACf¯@/D*OËACB3_hX�Où�G�VQ@*J¦´7JW@�B�O(G*¹9_hX�OÃ_]OyJcOy\hV³G�´�OdfÃ@yI¡[sO

åHI

Page 19: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO¯è�ØU»UXEO>^/@/MhAW@/_PAcGTB1G*¹JcOQ¹�_0Õ�MhAcDTXT_,\]OyV³GTBEb7@/MPIµ_PAWJc_�SUAc_hXdOyJcOQ^/@/_PAcGTBݹ�G*M�_hX�O¤¾ AWJWJWAW@�f ¿�OQMh\PVYX�OyJ|»!OyJcOy\PV³G�´sO*;»UX�OU_]OyJcOy\PV³G�´sONSj@*\¦bEMhAc^*ORBm¹�MPGTfï_hX�OUÖQORBEAc_hX(_]Gg@�B¯OyJcOQ^/@/_PAcGTB(G*¹ å l � @�BEbÄ[7@*VP¶s;�¿�I�\]_]OQMhOy\PAW\�@*JW\PG>G�VQVyÅ�Mh\¦ACBm_hXEAW\b7AcMPOyV³_PAcGTB5F�@*Jc_hX�GTÅ�DTXafgÅ7VvXÎJcOy\P\H_hXE@�BÎACBËOyJcOQ^/@/_PAcGTB�;

åyò

Page 20: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

bEOy\PV³MvAW[�OybÎ@*\U¹ÈG�JWJcG.SU\QØ ¢&Æ � ¢ RCK0vV³G�\�Á�Oz�¦O f Â&K0wsV³G�\.ÁêÔ�OL�¦O ` ÂÄJÆ � Ä RCK0v�\PACB5Á�OL�¦O f Â5Ktw�\hACB$ÁêÔ�O~�ZO ` ÂS�X�OQMhO¥O¸AW\Ä_hX�O¡fmGTÅ�B�_Ä´�G�\hAc_PAcGTBÊ@�B�D�JcOÝG*¹%_hX�OÝACBE\]_]MvÅ�fmORBT_ÃMPG*_P@/_]G*Md@�BEb,v�F2w.FNO f @�BEbÂO ` @/MPO�V³GTBE\P_P@�B�_P\Q;»UXEAW\>AW\%_hXEO(\hÅ7f G*¹j_�S¦GÝVQAcMvVyÅEJW@/M¤f¯G*_PAcGTBE\QFLSUAc_hX¡´sOQMhAcG�b7\%G*¹ åHI l � @�BEb k è l � ACBºfmGTÅ7BT_%´sG�\PAc_PAcGTBº@�B�D�JcO*;d×]B´EMh@*V³_PAWV³O*FEX�G.S�OQ^*OQMyF�_hX�OUfmOy@*\vÅ�MPOybm\]OyV³GTBEbEÕ�XE@/MvfmGTB7AWV�_]OQMYfßAW\�@,f¯A�Ï�_hÅ�MPOjG*¹s_�S¦G,O³Ñ�OyV³_P\QØ�_hX�O9_PAWJc_�G*¹s_hX�O9G�´E_PAWVQ@*J@*\P\]ORfg[7JcI�S�Ac_hX%MhOy\P´sOyV³_)_]GN_hX�O¦MPG*_P@/_PAcGTBm@�ÏEAW\L@�B7b%_hX�O9f¯AW\h@*JWAcDTB7fmORBT_!G*¹7_hXEO¦ACBE´�Å�_)[sOy@�fàSUAc_hX%_hXE@/_�@�Ï�AW\Q;�»UXEOyAcM\hÅE´sOQMh´sG�\PAc_PAcGTBÄAW\H\P_PAWJWJ5@mVQAcMhVQJcO*F�@�BEbÎAc_HAW\H@*JcSj@yI�\U´sG�\P\hAW[7JcO�_]GmÐ�BEbË@m´sG�\PAc_PAcGTBÎACBÄ_hX�O�Ð7OyJWbËSNX�OQMPO�_hX�O,ACf¯@/D*O,AW\\]_P@/_PAcGTBE@/MhI3Á�_hX�Odð0MPG*_P@/_]G*M�V³ORB�_]MhOyñ�¦´EMPG.^�AWb7OybÎ_hXE@/_H_hX�O�Ð�Mh\]_0Õ�XE@/Mvf¯GTBEAWVN_]OQMvf�AW\HÖQOQMPGE;

»UXEOy\]O,OQMPMPG*Mv\U@/MPO>f¯Oy@*\hÅ�MPOybµ[TIÎACf¯@/D�ACBEDÃ@Ã\]_P@/M�GTB�_]GË@�Bd@�ÅE_]G*DTÅEAWbEOQMUG*M�@*VQÇ�ÅEAW\PAc_PAcGTBaVQ@�fmOQMh@mSNX�G�\]O,Ð7OyJWbACBEVQJCÅEb7Oy\9_hX�O,V³ORBT_]MPO,G*¹LMPG*_P@/_PAcGTBd@�BEbÎJcG*D*D�ACBED(Ac_P\H´sG�\PAc_PAcGTBδsOQMhAcG�b7AWVQ@*JWJcIÎ@*\9_hX�O,b7OQMPG*_P@/_PAcGTBÎG�´E_PAWVQ\�@/MPO�_hÅ�MvBEOyb_hX�MPGTÅEDTX¸@º¹ÜÅEJWJHMPOQ^*G�JCÅ�_PAcGTB�; <NB¸O³Ï�@�fô7JcOµG*¹,@·fmOy@*\hÅ�MhOybÌ_]Mh@*VP¶ AW\(\vX�GRS�B'ACB¸Þ|AcDTÅ�MPO¡é�;�< V³G*MPMhOyV³_PAcGTB AW\ACf¯´�JcORfmORBT_]OybÎ@*\H@�BÎG/Ñ5\]OQ_UACBË_hXEO,¹ÈG�VQ@*J�Õ�´7JW@�B�O>V³G�G*Mhb�ACBE@/_]O>\]I�\]_]ORfdØLMhOy\PAWb�ÅE@*JW\H@/MhO%´7JcG*_]_]OybµACBdÞLAcDTÅEMPO I ;­87:9(x y ��� > �»UX�O%¹ÈG�VyÅE\9G*¹�_hX�O%_]OyJcOy\PV³G�´sOgbEOy´sORBEb�\jGTBÎ_]ORf¯´sOQMh@/_hÅEMPOÃÁ�_hX�MPGTÅ�DTXdO³Ï�´�@�BE\PAcGTBÎG*¹|_hX�O>\]_]MvÅEV³_hÅ�MhO/ÂPF�GTBÎOyJcOQ^/@/_PAcGTB@�BEb1GTB1_hX�OmG�´E_PAWVQ@*J|_hX7AWVP¶EB�Oy\P\�G*¹�Ð�Jc_]OQMh\�@�BEbÝG*_hX�OQM,V³GTfôsGTB�ORB�_P\�ACB1_hX�Om[sOy@�f @*[sGR^*Om_hX�Om¹�G�VQ@*J�´7JW@�B�O*;%»UXEO¹�G�VyÅE\�^/@*JCÅ�OmACBE´�Å�_N[TIÎ_hX�OmÅE\]OQM�AW\�@(^�AcMP_hÅ7@*J)´sG�\PAc_PAcGTB�F�S�XEG�\]O>^/@*JCÅ�O¤bEG�Oy\�BEG*_NVYXE@�B�D*O¤SUAc_hXµ_hX�Oy\]OmÇ�Å7@�B�_PAc_PAcOy\@�BEbmSNXEAWVvXm\vX�GTÅEJWbmbEOy´sORBEb¤GTBEJcIgGTB¤_hX�OU¹ÈG�VQ@*J7\]_P@/_PAcGTB�;�×�_�AW\V³GTfôsORBE\P@/_]Oyb¤¹�G*M�O³Ï�´�@�BE\PAcGTB¯ÅE\hACB�D�_]ORf¯´sOQMh@/_hÅ�MhOy\fmOy@*\vÅ�MPOyb [TI'@Æ´7@*AcMËG*¹g´7JW@/_PACB�Å�f MhOy\PAW\]_P@�BEV³O�_hX�OQMYfmGTfmOQ_]OQMv\¯GTB _hX�O�ÅE´7´sOQMdÚ�OQMPMvÅ�MvAcOQM(_]MvÅ7\P\]Oy\(S�XEAWVvXÊ@/MhOV³GTB7B�OyV³_]OybÄ_]Gg@ e @�fÃ@*VH<Nã e fmG�b�ÅEJcO*;|<¼JWACB�Oy@/M9fmG�bEOyJ7AW\�_hX�ORBÄÅE\]Oyb¯_]GgV³G*MPMPOyV³_¦_hX�O�b7ORf¯@�BEbm¹�G�VyÅE\�´sG�\PAc_PAcGTB5;Ù�G,\PAcDTBEAcÐ�VQ@�BT_�^�@/MvAW@/_PAcGTB¤G*¹�¹�G�VyÅ7\)S�Ac_hXgOyJcOQ^�@/_PAcGTB(XE@*\|I*OQ_�[sOQORB>b7OQ_]OyV³_]Oyb5F�@*Jc_hX�GTÅEDTXm´EMPG.^�AW\PAcGTBmX7@*\�[�OQORB¤fÃ@*bEO¹�G*M�@�Bd@*´�´EMPG�´EMhAW@/_]OgfmG�bEOyJÜ;�Þ|ACBE@*JWJcI*Fs_hX�O,¹�G�VyÅ7\UV³G*MPMPOyV³_PAcGTBa¹�G*M�@*[sGR^*O³Õ�\hJWAc_�Ð�Jc_]OQMv\QF�´sG�JW@/MhAcÖy@/_PAcGTBaOyJcORfmORBT_P\�@�B7b\PACfÃAWJW@/MUV³GTf¯´sGTB�ORBT_P\9@/MPO,ACBE´�ÅE_UÅE\PACB�D¤_hX�O �õQô®þ�`QömV³GTfÃf¯@�B7b5;�»UXEAW\Hf¯@RIÄ[sO�AW\P\hÅEOybd@�Å�_]GTf¯@/_PAWVQ@*JWJcIι�MPGTf _hXEO\]I�\]_]ORf�V³GTfô�Å�_]OQM9S�XEORBÄ_hX�O%V³GTf¯´sGTB�ORBT_9AW\UACBE\POQMP_]OybdACBT_]G¯_hX�O%[sOy@�fÎ;

­87:9�9 � > �/��¯ > �¼]�� C¯×]B3G*MvbEOQM¤_]GÝV³G*MhMPOyV³_m¹ÈG*MmAcMPMhOy´EMPG�b�ÅEVQAW[7JcOÄ_]Mh@*VP¶�ACB�D�OQMPMhG*Mh\QF�_�S¦G�_�I�´sOy\¤G*¹UbEOQ_]OyV³_]G*MËf¯@yIº[�OÎÅE\]Oybº_]G¡´EMPG.^�AWb7O@�Å�_]G*DTÅEAWb�ACB�D3\PAcDTBE@*JW\yØdG/Ñ�Õ�@�ÏEAW\Ã@�ÅE_]G*DTÅEAWbEOQMh\(@�BEb¸@*VQÇ�ÅEAW\PAc_PAcGTB¸VQ@�f¯OQMh@*\µÁ�S�X7AWVvXÌ^�AcOQS�_hX�Od\h´�OyV³_]MhG*D*Mh@*´�XÌ\PJWAc_É]@ySU\³ÂP; »UX�O¡f¯OQ_hX�G�b�\ËÅ7\]OybÊ_]G¸@�Å�_]G*DTÅEAWbEO�_hXEO�¾ ¿N» @/MPO¡bEOy\PV³MvAW[�OybÊACBÊbEOQ_P@*AWJ%ACBÊó%ô @�BEbÊGTBEJcIÊ@Æ[EMhAcOQ¹\hÅ7f(f¯@/MPI¯AW\UD�Ac^*ORBµX�OQMhO*;

i G*_hX3_�I�´�Oy\>G*¹HbEOQ_]OyV³_]G*M¯fmOy@*\vÅ�MPOÃACfÃ@/D*OÃV³ORB�_]MhG�AWb·´sG�\PAc_PAcGTB7\QF)SNXEAWVvXº@/MPO(\PORB�_>_]Gµ_hX�OÄ» e Ú�@/_gACB�_]OQMh^�@*JW\[sOQ_�S¦OQORB l ; å @�BEb å l \Q;Ê»UX�Oy\]O1@/MPOµV³GTBT^*OQMP_]Oyb ¹ÈMPGTf ´7A�Ï�OyJHV³G�G*Mvb7ACBE@/_]Oy\(_]G3_hX�O1» e Ú·¹�G�VQ@*J�Õ�´�JW@�B�O1\PI�\]_]ORfdFV³G*MPMPOyV³_PACBED�¹ÈG*M¤_hX�OËG*MhAcORBT_P@/_PAcGTBÌG*¹�_hX�OËDTÅEAWbEOË´EMPG�[sOÄAc¹NB�OyV³Oy\P\P@/MPI*F¦@�BEb·Ð�BE@*JWJcIºMPG*_P@/_]OybÆ_]G3fmGTÅ7BT_z���ë@�B7b@*b7bEOyb _]GÌ_hX�O�´sG�\PAc_PAcGTBÊbEORfÃ@�BEb5;ß»UX�OÝ@*VQVyÅ7f¤ÅEJW@/_]Oyb¼@�Å�_]G*DTÅ7AWb7ACB�D¸V³G*MPMPOyV³_PAcGTB7\d@/MPO�\]_]G*MPOyb¼\]Oy´�@/Mh@/_]OyJcI @*\_P@�B�D*ORBT_0Õ�´7JW@�B�O�V³G�G*Mhb7ACBE@/_]Oy\ÄACB¸_hXEO1fmGTÅ�B�_Ã\PI�\]_]ORfdFjMh@/_hX�OQMÃ_hX7@�B'[sOyACB�DºÅ7\]Oyb¸_]GÌÅE´�b7@/_]Od_hX�Oa_P@/MPD*OQ_ÄMhAcDTX�_@*\PV³ORBE\hAcGTBÎ@�BEbËbEOyVQJWACBE@/_PAcGTB�;¦»UXEAW\¦MPOuÅ7OyV³_P\H_hX�O�¹�@*V³_H_hX7@/_QF7ACBÎB�G*Mvf¯@*J�ÅE\]O*F�_hX�O,@�ÅE_]G*DTÅEAWbEOQMHAW\Hf¯@*ACBT_P@*ACBEACB�Dm_hXEOACf¯@/D*O%G*¹L@mD�Ac^*ORBµ´sG�\PAc_PAcGTBd@/_U@¯ÐEÏ�OybδsG�ACBT_HGTBË_hX�O>ACBE\]_]MvÅ7f¯ORB�_Q;

­87:96 z �!�� !���� B¯Ê&(�5��� > ���s�����) �»UXEAW\Ã\]OyV³_PAcGTB GTÅ�_PJWACB�Oy\¯_hXEOa\]OyÇ�Å�ORBEV³OdG*¹�VQ@*JWVyÅEJW@/_PAcGTB7\ËS�XEAWVvX¸´�OQMh¹ÈG*Mvf _hX�Oµ´sG�ACB�_PACBEDºV³G*MPMPOyV³_PAcGTB7\(bEOy\hV³MhAW[sOybOy@/MhJWAcOQMy;j»UX�O%_]MPOy@/_hfmORBT_U[�Iľ¡@*JWJW@*V³OdÁ åyò*ò l Â9AW\H¹�G�JWJcGRS¦OybÝVQJcG�\]OyJcI*;9»UX�O%´sG�ACBT_PACB�DÃVQ@*JWVyÅEJW@/_PAcGTBE\�VQ@�Bµ[�O>b7Ac^�AWb7OybACBT_]G¡_hX�G�\]OdbEGTBEOÄGTB7V³OºÁ�GTBÌ\]_P@/MP_hÅ7´5F�AcMPMhOQDTÅEJW@/MhJcI·S�X�ORBº_hX�Od´7@/Mh@�f¯OQ_]OQMh\m@�Ñ�OyV³_PACB�D3_hX�ORf @/MPOd@*Jc_]OQMPOybÌG*M¯GTBVvX7@�B�D*O,G*¹!_P@/MhD*OQ_³Â¦@�BEbË_hX�G�\PO,´�OQMh¹ÈG*Mvf¯Oyb(ACBÄ_hXEMPOQO,JcG�G�´�\9MvÅ7B7B7ACB�Dg@/_ å�{ k/l*l F å @�BEbdÔ l ¿�Ö*;ì�BEAc_j^*OyV³_]G*Mh\�@�B7bf¯@/_]MvAWV³Oy\H@/MPO>ÅE\POybÎ_hX�MPGTÅ�DTXEGTÅ�_9¹ÈG*MUOuÕÃVQAcORB�_N@�BEbÎMhAcD*G*MhGTÅE\HV³GTf¯´�Å�_P@/_PAcGTB�;

Ô l

Page 21: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPOdé�ØûUX�OÄ_]Mh@*Vh¶3G*¹U@�B·ACf¯@/D*OÄGTB3_hX�OÄ@�ÅE_]G*DTÅEAWbEOQM¯@/_g_hX�OÄì n ÚºÙN@*\hf>I�_hX3¹�G�VQ@*Jj\]_P@/_PAcGTB·G*¹H_hXEO(¾Ê¿�»b�Å�MvACB�Dµ@a¹ÜÅEJWJMPOQ^*G�JCÅ�_PAcGTBºG*¹H_hX�OËbEOQMPG*_P@/_PAcGTBºG�´E_PAWVQ\yF�SUAc_hX�GTÅ�_g_hX�O(V³G*MhMPOyV³_PAcGTBE\mbEOy\PV³MvAW[�OybºACB¡_hXEO(_]O³Ï�_Q;a»UXEO@�Å�_]G*DTÅEAWb7OQM%Sj@*\>´7JW@*V³Oybº@/_%_hX�O(@*´7´EMPGRÏ�ACfÃ@/_]O(V³ORBT_]MPOÃG*¹jMPG*_P@/_PAcGTB3¹ÈG*M>_hXEAW\,_]Oy\P_Q;ËÙ�G*_]OÃ_hXEO¯Ð7Mh\]_,@�B7b3\]OyV³GTBEbXE@/Mvf¯GTBEAWV�V³GTf¯´sGTB�ORBT_P\Q;�»UX�O,[sOy\]_9Ð�_9_]G¯_hX�O>f¯G�bEOyJ�ACBË_hXEO,_]O³Ï�_�AW\H@*JW\]G(\vX�GRS�B5;

Ô å

Page 22: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO I Ø)»UXEO_]Mh@*Vh¶%G*¹7@�BgACf¯@/D*O¦GTB,_hXEO¦@�Å�_]G*DTÅ7AWbEOQML@/_|_hX�O¦ì n Ú,ÙN@*\hf>I�_hX,¹�G�VQ@*J�\]_P@/_PAcGTB>G*¹7_hXEO¾Ê¿�»Æb�Å�MvACB�D@N¹ÜÅ7JWJ�MhOQ^*G�JCÅ�_PAcGTB¤G*¹s_hX�O9bEOQMPG*_P@/_PAcGTB¤G�´E_PAWVQ\yFTSUAc_hX>_hX�OHV³G*MPMhOyV³_PAcGTBE\�bEOy\PV³MvAW[�Oyb¤ACBg_hX�Oj_]O³Ï�_Q;�»UX�O9\]I�\]_]ORf¯@/_PAWVjÐ7Mv\]_@�BEb�\]OyV³GTB7b¡XE@/MvfmGTB7AWV%OQMPMhG*Mh\�@/MPOÃB�OQD�JWAcD�AW[7JcO*FL[�Å�_N_hX�OQMPO¯AW\�\]GTf¯O>Mh@�B7bEGTf \PVQ@/_]_]OQM%b�ÅEOg_]GÎMhOy\PAWb�ÅE@*JL_]Mh@*Vh¶�ACB�DbEMhAc¹�_Hb�Å�MvACB�D¤_hX�O�_]Oy\]_QF�@�B7bÎ_]GôsG�G*MH\POQOyACB�DE;

Ô*Ô

Page 23: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

�gi!j�h5i!j Ø oWve�WoS��é¾¼X�ORB1_hX�Om» e Úa\]_P@/MP_P\>ÅE´5F�_hX�OmbEOQ¹Ü@�ÅEJc_�^�@*JCÅ�Oy\,G*¹�ìN» å �HìN» e @�BEb�´sG�JW@/M%fmG*_PAcGTBÝ@/MPOmVQ@*JWVyÅEJW@/_]Oyb3¹ÈMPGTf _hXEOO³Ï�_]Mh@*´sG�JW@/_PAcGTBd¹�G*Mvf¤ÅEJW@/O�D�Ac^*ORBdACBÎ× n :NÚ i ÅEJWJcOQ_PACBµ<%;�»�X�OQIËfÃ@yIÄ[�O�G.^*OQMPMhAWb7b7ORBd@/_U@�BTIË_PACfmO�_hX�OQMPOy@/¹�_]OQMy;

�gi!j�h5i�h Ø oWve�WoS��érvemAqÂ�m�w�pAvemA�el��e�Vn�mAé���o�éAve�Sve�Zl�oWl��Wt< \]OQ_HG*¹�VQ@*JWVyÅEJW@/_PAcGTBE\NAW\UbEGTBEO,@/_U\]_P@/MP_hÅE´µ@�BEbÎ_hX�OQMPOy@/¹�_]OQMUGTB7JcI(S�XEORBËMPOyJcOQ^/@�B�_N´7@/Mh@�fmOQ_]OQMv\9@/MPO%VvX7@�B�D*Oyb5Ø| n ^�@*JCÅ7@/_PAcGTB¡G*¹j_hX�O¯MhOQ¹ÈMh@*V³_PAcGTB3V³G�OuÕ(VQAcORB�_P\�� Æ î �2+¦FLS�XEAWVYX�bEOy´sORBEbÝGTB¡´7MPOy\P\hÅ�MhO*F$_]ORf¯´sOQMh@/_hÅ�MhO*F)X�Å�Õ

fÃAWb7Ac_�IË@�BEbÎSj@y^*OyJcORBED*_hX�;| e G*MPMPOyV³_PAcGTBÎG*¹�JW@/_PAc_hÅEb7O%@�BEbdJcGTB�D�Ac_hÅ7bEO,¹�G*MU´sG�JW@/M�fmG*_PAcGTB�;| ãNOQMhAc^/@/_PAcGTBµG*¹L_hXEO�MPG*_P@/_PAcGTBafÃ@/_]MhA�ÏËS�XEAWVvXdV³G*MPMPOyV³_P\H¹�G*MU@/ÖyACf¤Å�_hXÎ@�ÏEAW\H_PAWJc_Q;| e @*JWVyÅEJW@/_PAcGTBdG*¹|_hX�O,V³GTB7\]_P@�B�_�G*¹Lb�ACÅ�MvBE@*J5@*[sOQMPMh@/_PAcGTB5;

�gi!j�h5i�� Ø ����Swxl¥w�pAvem��l»UX�O�G�´sOQMh@/_PAcGTB7\UbEGTB�O�GTB7V³O*F7GTBÎVvX7@�B�D*O%G*¹L_P@/MPD*OQ_QF�@/MPO*Ø| e G*MPMPOyV³_PAcGTBÎG*¹�\P´�@*V³O>fmG*_PAcGTBE\H_]G¯_hX�O,VyÅ�MPMhORB�_HOy´sG�VvX�;| Þ7G*Mvf¯@/_PAcGTB'G*¹�_hX�Oa´7MPOyV³Oy\P\PAcGTB f¯@/_]MhAWV³Oy\ËB�OQOybEOyb'_]GºV³GTBT^*OQMP_˹ÈMhGTf Þ8Û�ÓºACB7´�Å�_¯V³G�G*Mhb7ACBE@/_]Oy\Ä_]GºÞ8Û�ÓEF

i åyò æ l ; l G*M�Þ8Û%æmACB7´�Å�_9V³G�G*Mvb7ACBE@/_]Oy\H_]G(Þ�Û>æ�FÚTÔ l*l*l ; l F�@*\U@*´7´7MPG�´EMhAW@/_]O*;| Þ7G*M�@¯[7JWACB7bËG/Ñ�\]OQ_UGTBEJcI*F�V³GTBT^*OQMh\PAcGTBÎG*¹�@*VQVyÅ7f¤ÅEJW@/_]OybaXE@�BEb7\]OQ_HV³G*MhMPOyV³_PAcGTBE\H_]G(V³G�JWJWACf¯@/_PAcGTBdV³G*MhMPOyV³_PAcGTBE\Q;

�gi!j�h5i�� Ø ���_} ���g�é�~ToWve�S�el�o�n�m�q�l�éslcmAq�lcm&o�wxv&��w®����vQo�n��mAt< B�Å7fg[sOQM)G*¹�Ç�ÅE@�B�_PAc_PAcOy\S�XEAWVYX¤VvXE@�B�D*OH\hJcGRSUJcI¤@�BEb¤S�XEAWVYX¤@/MPOHACBEbEOy´sORBEb7ORB�_LG*¹�_hXEO¦_P@/MhD*OQ_[sOyACB�D�G�[7\]OQMP^*Oyb¯@/MhOVQ@*JWVyÅEJW@/_]OybaGTBEV³O�OQ^*OQMPI k/l*l \Q;�»�X�Oy\]O�@/MPO*Ø»Hã�»"@�B7bλHã i FeÚ�ÅEJWAW@�BÎ@�BEb i Oy\P\POyJWAW@�BÎOy´sG�VYXE\9@�BEbË_hX�O�OyÇ�ÅE@/_PAcGTBG*¹|_hX�O�OyÇ�ÅEACB�GyÏ�Oy\Q;

�gi!j�h5i�ß Ø ���_} ���g�é�~ToWve�S�el�ouòÌq�lcésl�mAqAl�m&o�wxv��w®�8��vPo�n��&m�t»UX�O�G*_hX�OQMH´sG*MP_PAcGTBÃG*¹$_hX�O�\PJcGRS"JcG�G�´ËVQ@*JWVyÅEJW@/_]Oy\9_hX�O�´7@/Mh@�f¯OQ_]OQMh\9B�OQOybEOyb(_]G¤V³GTBT^*OQMP_9¹�MPGTf fmOy@�BÃ_]G¤@*´�´7@/MPORBT_´7JW@*V³O¯ÁÜ´EMPOyV³Oy\h\PAcGTBË@�BEbÎB�ÅE_P@/_PAcGTBÎf¯@/_]MhAWV³Oy\j@�BEbÄ@*[sOQMPMh@/_PAcGTBÄ^*OyV³_]G*MQÂP;¦»UX�Oy\]O�bEOy´sORBEb¯GTB(_hX�O�ACBE´�Å�_�V³G�G*Mhb7ACBE@/_]O\]I�\]_]ORf4@�BEb _hX�OÝVyÅ�MPMPORBT_(_PACf¯O*F�[�ÅE_ÄB�G*_ËGTB _hX�O1_P@/MPD*OQ_d´sG�\PAc_PAcGTB�FU_]G·S�XEAWVYX _hX�OQI @/MPOÝ@*´7´7JWAcOybÊ@/_dXEAcDTX�OQM¹�MPOyÇ�ÅEORBEV³I*;

�gi!j�h5iHG × lcq8n�����òÌ���Wl ³ �AlcmAwJ ����g�é»UX�O�¹êÅ7BEV³_PAcGTBÎG*¹L_hXEO%fmOyb7ACÅ7fmÕ�¹ÈMhOyÇ�Å�ORB7V³IaÁ å ¿�Ö/Â�JcG�G�´aAW\9Oy\P\]ORBT_PAW@*JWJcId_]GÃb7OQMhAc^*O%@¯´7@*AcMUG*¹�fÃ@/_]MhAWV³Oy\>��� Æ @�B7b� Æ ^ S�XEAWVvXa´sOQMP¹�G*Mvf _hX�Og_]Mh@�BE\P¹ÈG*MvfÃ@/_PAcGTBdG*¹�@ÄÅ7B7Ac_U^*OyV³_]G*M,´sG�ACB�_PACBEDÄ@/_N_hX�Og_P@/MPD*OQ_�¹ÈMPGTf ÅE\]OQM�V³G�G*Mhb7ACBE@/_]Oy\ÁÜì%Â�_]G¤@*´�´7@/MPORBT_jV³G�G*Mhb7ACB7@/_]Oy\,ÁÜ<,Â@�BEbĹ�MPGTf @*´7´7@/MPORBT_j_]GÃfmGTÅ7BT_jV³G�G*Mhb�ACBE@/_]Oy\,Áê`�ÂPFEMhOy\P´sOyV³_PAc^*OyJcI*;�»UX�Oy\PO�@/MhO_hX�ORBÃ@*´7´7JWAcOyb¯@/_�_hX�OH¹êÅEJWJ7JcG�G�´¯Mh@/_]O*;�»UX7AW\�@y^*G�AWb7\�_hX�O�BEOQOyb¯_]G,MPO³Õ�OQ^/@*JCÅE@/_]O�´sG�ACB�_PACB�D>V³G*MPMPOyV³_PAcGTBE\�S�XEAWVYX¯bEG>BEG*_VvX7@�B�D*O>@*[EMYÅE´E_PJcI*F�[�Å�_9MPOQ_P@*ACBE\�_hX�O>@*[�AWJWAc_�IÎ_]GÃG/Ñ5\]OQ_N_hX�O,_]OyJcOy\PV³G�´sOgMh@*´7AWb7JcIÎ[�IÎVvXE@�B�D�ACBEDÃ_hX�O>_P@/MPD*OQ_N´sG�\PAc_PAcGTBG*MËV³G�JWJWACf¯@/_PAcGTB V³G*MPMPOyV³_PAcGTBE\Q;�×0B'@*b7b7Ac_PAcGTB�F9_hX�O1fmOyb7ACÅ7fmÕ�¹ÈMhOyÇ�Å�ORB7V³IºJcG�G�´ AW\ÄÅE\]Oyb¸_]G·bEOQMhAc^*O1_hX�Oµb7AW\h´7JW@yI*Oyb_]OyJcOy\PV³G�´sO>´sG�\PAc_PAcGTBdACBÎ@m^/@/MhAcOQ_�IÎG*¹|V³G�G*Mvb7ACBE@/_]Oy\N\]I�\P_]ORf¯\Q;� � Æ @�BEbi� Æ ^µFsVQ@*JWJcOyb¼ð0G�\PVyÅEJW@/_PACB�DË_]Mh@�B7\]¹ÈG*MYf¯@/_PAcGTBµfÃ@/_]MhAWV³Oy\PñÄ[TIξ¡@*JWJW@*V³OµÁ åyò*ò l ÂH@/MPO¤bEOQ_]OQMvfÃACB�Oybµ@*\¹�G�JWJcGRSU\QØ

Ô k

Page 24: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

å ;NK�ORB�OQMh@/_]O%_hXEMPOQO>Å7BEAc_9^*OyV³_]G*Mv\U@/MPGTÅ7B7bÎ_hX�O�_P@/MPD*OQ_N´�G�\hAc_PAcGTB�;

Ô�;U»)Mh@�BE\P¹ÈG*Mvf _hX�ORf _hX�MPGTÅEDTXË_hX�O�MPOyJcOQ^/@�B�_N´sG*MP_PAcGTBËG*¹L_hX�O%´sG�ACB�_PACBED�Å7GRS%;k ;NÚ�G�Jc^*O%¹�G*MH_hX�O%f¯@/_]MvA�ÏÄ_hXE@/_�´EMPOyVQAW\]OyJcIË_]Mh@�BE\P¹ÈG*MvfÃ\j_hX�O,ACBE´�ÅE_9_]G¯_hX�O�GTÅ�_P´�ÅE_9^*OyV³_]G*Mh\Q;

»UX�Ojf¯@/_]MhA�Ï,S¦GTÅEJWbg[sO�G*MP_hX�G*D*GTBE@*J�¹�G*ML´�Å�MPOMhG*_P@/_PAcGTBE\QF�[�Å�_L\]GTfmO�G*¹E_hX�Oj´�G�ACBT_PACB�DNV³G*MPMPOyV³_PAcGTBE\HÁ°GWF ±®F�MPOQ¹�Mh@*V³_PAcGTBsÂVQ@�B7B�G*_,[sO¯fmG�bEOyJWJcOybÝACB1_hXEAW\�Sj@yI*;m»UXEOmfÃ@/_]MhA�ÏaD�Ac^*Oy\%@Î\hfmG�G*_hXEJcIaVYXE@�B�D�ACB�DÎ_]Mv@�BE\]¹�G*Mvf¯@/_PAcGTB1S�X7AWVvXÝ\hX�GTÅ7JWb[sO,@*VQVyÅ�Mh@/_]O>¹ÈG*MU@�BTIÄ^*OyV³_]G*MNVQJcG�\]O>_]G¯_hX�O,_P@/MhD*OQ_Q;

»UXEO,V³GTf¯´�Å�_P@/_PAcGTB7\HACBEVQJCÅEbEOybµACB*�W� Æ @/MPO*Ø| Þ8Û�ÓÃ_]GÃÞ8Û�Ó i åyò æ l ; l F�Å7\PACB�Dm_hX�O%´7MPOyV³Oy\P\PAcGTBdfÃ@/_]MhA�ÏÎVQ@*JWVyÅEJW@/_]OybµGTBµ\]GTÅ�MhV³O,VYXE@�B�D*O*;| Þ8Û�Ó i åyò æ l ; l _]GÃÞ8Û%æ�Ú�Ô l*l*l ; l F�G*M| Þ8Û%æm_]GÃÞ8Û%æ�ÚTÔ l*l*l ; l ;| Þ8Û%æ¤ÚTÔ l*l*l ; l _]G¯D*OQG�V³ORBT_]MhAWV>@*´7´7@/MPORBT_Q;»UX�OQMhOQ¹ÈG*MPO*F ��Æ �,� � Æ�� �S�X�OQMhO ��Æ @�BEb � � @/MPO>Å7B7Ac_9^*OyV³_]G*Mh\�ACBµÅE\]OQMU@�BEbÎ@*´�´7@/MPORBT_2#A"¤V³G�G*Mhb7ACB7@/_]Oy\Q;

»UXEO�_]OQMvf¯\9ACB*� Æ ^ @/MPO*Ø| :UG*_P@/_PAcGTBd¹�MPGTf Á!#�:Ì"�¦_]GaÁ��2 �:Ì"�Â�ÁÜ[�IÄ_hXEO%JcG�VQ@*J!@*´7´7@/MPORBT_U\PAWbEOQMhOy@*J5_PACfmO/ÂP;| ã�ACÅ�MYBE@*J$@*[sOQMPMh@/_PAcGTB�;| :UG*_P@/_PAcGTBd_]G1Á��[:°�¯Â�ÁÜ[�I����/Ô·�¶$1@*[sGTÅ�_9_hX�O�OyJcOQ^/@/_PAcGTBa@�ÏEAW\³ÂP;| :UOQ¹ÈMv@*V³_PAcGTB�;| e G*MPMPOyV³_PAcGTBι�G*MU@/ÖyACf¤Å�_hXÎ@�ÏEAW\H_PAWJc_Q;

@�BEb5F � ^ ��� Æ ^ ��ÆS�X�OQMhO ��Æ AW\U@¯Å7B7Ac_9^*OyV³_]G*MNACBË_hXEO>fmGTÅ7BT_9V³G�G*Mvb7ACBE@/_]O>\PI�\]_]ORfd;

×]B¯@*b7b�Ac_PAcGTBm_]G%_]Mv@�BE\]¹�G*Mvf¯ACB�D�_hXEOU_hX�MPOQO�´EMPG�[sO9^*OyV³_]G*Mh\jACBmG*Mhb7OQM_]G>b7OQMhAc^*O2� � Æ @�B7b%� Æ ^aFT_hXEONfmOyb�ACÅ7f¤Õ¹�MPOyÇ�ÅEORBEV³IÄJcG�G�´µb7G�Oy\U_hX�O%\P@�f¯O�¹ÈG*M�_hX�O%´EMPOyVQAW\PO,_P@/MPD*OQ_�´�G�\hAc_PAcGTB�;�»UXEO,MPOy\hÅEJc_P\HG*¹|ACBT_]OQMvf¯Oyb7AW@/_]O>\]_P@/D*Oy\NACBÎ_hXEOV³GTf¯´�Å�_P@/_PAcGTBÎ@/MPO>Å7\]OybÎ_]G¯D*ORB�OQMv@/_]O%_hX�O,b7AW\h´7JW@yI*Oybµ_]OyJcOy\PV³G�´sO>´sG�\PAc_PAcGTBdACBÎ^�@/MhAcGTÅ7\HV³G�G*Mvb7ACBE@/_]O%\]I�\]_]ORfÃ\Q;

�gi!j�h5icb ÝAvQtuo����g�&é»UX�O�¹Ü@*\]_>ÁêÔ l ¿UÖ/Â�JcG�G�´µ´sOQMP¹�G*MvfÃ\�_hXEO�¹ÈG�JWJcG.SUACB�DÃG�´sOQMh@/_PAcGTB7\QØ

å ;NK�OQ_�ìN» e @�BEbdVQ@*JWVyÅEJW@/_]O¤ìN» å @�BEbÎJcG�VQ@*J!@*´7´�@/MPORB�_�\PAWbEOQMPOy@*J5_PACf¯O*;

Ô�;H¾�G*Mh¶ÄGTÅE_H_hX�O%ìN» e ACBT_]OQMP^�@*J)\PACBEV³O,_hXEO,\]_P@/MP_HG*¹|_hX�O�_]Mh@*Vh¶�;

k ;U<N´7´7JcIÎXE@�BEb�\]OQ_ ¢Ä Fe#A"gG*M�¾5¿dACBEV³MPORf¯ORB�_P\H@*VQVyÅ�fgÅ7JW@/_]Oybd\PACBEV³O,_hXEO%JW@*\]_UV³I�VQJcO%_]G¯_hXEO�MvÅ7B7BEACBEDg_]G*_P@*JÜ;ÓE;U<Nb7b(G/Ñ�\POQ_P\QF�XE@�BEb7\POQ_¦V³G*MPMhOyV³_PAcGTBE\9@�BEbËB�GTB�Õ�\PAWbEOQMhOy@*J�_]Mv@*VP¶�ACB�DmV³G*MPMPOyV³_PAcGTBE\9_]G¤_hX�ON_P@/MPD*OQ_9´sG�\PAc_PAcGTB�;@�B7bD*ORBEOQMh@/_]O>@ÃÅ�BEAc_9^*OyV³_]G*M � �ºACBË_hX�OgÅE\]OQMHV³G�G*Mhb7ACBE@/_]Og\]I�\P_]ORfÎ;

æ�; e G*MPMPOyV³_H_hX�O>@�Å�_]G*DTÅEAWbEOQMHMhOQ¹ÈOQMPORB7V³O%´sG�\PAc_PAcGTBι�G*M ¢ÆAÄJÆ G*MHMhG*_P@/_PAcGTBE@*J!G/Ñ5\]OQ_P\�\PACBEV³O�_hX�O%JW@*\P_UV³I�VQJcO*;Ô�Ó

Page 25: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

è�;UÞ7G*MU_hX�O%VyÅEMPMPORBT_H@�BEbµB�O³Ï�_HV³I�VQJcOy\yØÁÜ@�Â(<N´7´7JcIS��� Æ @�BEb$� Æ ^ _]G(D*ORB�OQMh@/_]O%@(Å7BEAc_9^*OyV³_]G*M�ACBË_hX�O>f¯GTÅ7B�_9V³G�G*Mhb7ACBE@/_]O>\]I�\P_]ORfÎF � ^ ;ÁÜ[�¯¾�G*Mh¶dGTÅ�_U_hXEO>V³G�JWJWACf¯@/_PAcGTB1V³G*MPMhOyV³_PAcGTBE\�S�XEAWVYXd@/MPOg\P´sOyVQAcÐ7OybaACBd_hX�O%¹�G�VQ@*J�Õ�´7JW@�B�OÎÁ ¢Æ : ÄJÆ Â¦\PI�\]_]ORf

@�B7b3MPG*_P@/_]OÄ_hX�ORfë_]GÝf¯GTÅ7BT_(Á��[:°�¯ÂP;a»UXEOy\]OÃ@/MPOË@*´sOQMP_hÅ�MPO¯G/Ñ5\]OQ_P\QF�@�Å�_]G*DTÅ7AWb7ACB�D1OQMPMPG*Mh\>@�BEb3_hXEOV³G*MhMPOyV³_PAcGTBE\�¹ÈG*M�fÃAW\P@*JWAcDTB7f¯ORB�_9G*¹L_hX�O%bEOQMhG*_P@/_PAcGTBÎG�´E_PAWVQ\Q;

ÁÜV�Â(<Nb7b1_hX�O¯V³G�JWJWACfÃ@/_PAcGTB�V³G*MPMPOyV³_PAcGTBE\,S�XEAWVvXÝ@/MhO¤\h´�OyVQAcÐ�Oyb�ACB·Á���:°�mÂPF)_hXE@/_,AW\�_hX�Om@/ÖyACf¤Å�_hXÝV³G�JWJWACf¯@�Õ_PAcGTB3OQMPMPG*MRF�BEGTB�Õ�´sOQMh´sORBEb7AWVyÅEJW@/MhAc_�IaG*¹H@/ÖyACf¤Å�_hX3@�BEb¡OyJcOQ^/@/_PAcGTBÆ@�Ï�Oy\QF�XE@/MvfmGTB7AWV¤_]OQMvf¯\>@�BEb3[7JWACB7bG/Ñ5\]OQ_mfmG�bEOyJÜ;(»�X�OÃV³G�JWJWACf¯@/_PAcGTB3OQMPMPG*Mv\%@/MPOÄ@*´7´7JWAcOyb3[�I�VQ@*JWVyÅEJW@/_PACB�DÝ_hX�OÃ@/ÖyACf¤Å�_hX3@�BEb¡OyJcOQ^/@/_PAcGTBV³G*MhMPOyV³_PAcGTBE\M£=�>Fc£=� ¹�MPGTfÒ_hX�OU_P@�B�D*ORBT_0Õ�´7JW@�B�O�G/Ñ5\]OQ_P\,¾LFc¿ÄÅE\PACB�D>_hX�OU¹�G*Mvf¤ÅEJW@/O�D�Ac^*ORBÃOy@/MvJWAcOQMj@�B7bMhG*_P@/_PACB�DÃ_hX�OgÅ7BEAc_j^*OyV³_]G*MN[�IË_hX�Oy\]O%@�f¯GTÅ7BT_P\Q;

ÁÜb� e G*MPMPOyV³_H¹�G*MHOyJcOQ^/@/_PAcGTB�Å�O³ÏEÅ�MhO*;Á�O/ e @*JWVyÅEJW@/_]O>bEORfÃ@�BEb½� @�BEbÀ�Û¹ÈMPGTf _hX�O%Å7BEAc_9^*OyV³_]G*M�@�BEbd@*´7´�JcIÄACBEb7O³ÏÄOQMPMhG*Mh\Q;

é�;U»�X�O,bEORf¯@�B7bÄ´sG�\PAc_PAcGTB7\9¹ÈG*MU_hX�O%B�O³Ï�_U@�BEbÎVyÅ�MPMhORB�_HV³I�VQJcOy\�@/MhO,b7A�ÑsOQMhORBEV³OybÎ_]GÃbEOQMvAc^*O%@¤^*OyJcG�VQAc_�Iµ´EMPOyb�AWVYÕ_PAcGTB5;I ;U»�X�ObEORfÃ@�BEb�fmGTÅ7BT_$´sG�\PAc_PAcGTB,@�B�D�JcO¦AW\!bEOQMvAc^*Oyb%[�INV³GTBE\P_]MvÅEV³_PACB�DN@9^*OyV³_]G*MLACB,_hX�O�ÅE\POQM!V³G�G*Mvb7ACBE@/_]O�\PI�\]_]ORfSNXEAWVvX%AW\!G*MP_hXEG*D*GTBE@*JT_]G�_hX�O_P@/MhD*OQ_)^*OyV³_]G*M�@�BEb>´7@/Mh@*JWJcOyJ�_]G�_hX�O�´7MPG/É�OyV³_]Oyb¤B�G*MP_hX�Õ�\]GTÅ�_hX,b�AcMPOyV³_PAcGTB�;|»UXEAW\!AW\_]Mv@�BE\]¹�G*MvfmOyb¤ACBT_]G>fmGTÅ7BT_|V³G�G*Mhb�ACBE@/_]Oy\�[�I¤f¤ÅEJc_PAW´7JcI�ACB�D�[�I%_hX�OUfÃ@/_]MhAWV³Oy\�� � Æ @�BEbr� Æ ^Û@�BEb¤_hX�OH@�B�D�JcO[sOQ_�S�OQORBµAc_U@�BEbd@m^*OyV³_]G*M�@*JcGTB�D¯_hXEO%b7AcMPOyV³_PAcGTBdG*¹)_hX�O>JcG�VQ@*J5^*OQMh_PAWVQ@*J)ACBË_hXEO,¹ÈG�VQ@*J$´7JW@�BEO,AW\HD*ORB�OQMh@/_]Oyb$;

ò ;U<âV³G*MPMhOyV³_PAcGTBµAW\9_hXEORBdf¯@*bEO�¹�G*M�V³G�JWJWACfÃ@/_PAcGTBÎOQMPMPG*Mv\QFES�XEAWVYXÎ@/MPO>B�G*_�ACBEVQJCÅEbEOybÎACBd_hX�O%f¯@/_]MhAWV³Oy\y;å l ;U»�X�O,VQ@*JWVyÅEJW@/_PAcGTB1AW\H@*JW\]GÃb7GTB�O,¹�G*MH_hX�O,VyÅ�MPMhORB�_U@�B7bdB�O³Ï�_�V³I�VQJcOy\QFsACBËG*MhbEOQMU_]GÃbEOQMhAc^*O%@¤^*OyJcG�VQAc_�I*;

:HG*_P@/_]G*M�ACBEbEO³ÏËOQMPMPG*Mv\H@/MPO,ACBEVQJCÅEb7OybdACBË_hX�O,ORB7V³G�bEOQMNfmG�bEOyJÜ;

�gi!j�h5iH� Ø l ³ ��l�m�w®l¥��N�éBlc�SvPo�n��&m�t=�&m�w�pAvem��l¥��NtH�&�A�Swxl»UX�OÎÅE\]OÄG*¹UVQ@*\PVQ@*b7Oyb¸JcG�G�´�\>MhOyÇ�ÅEAcMhOy\g\PGTfmOËVQ@/MPOËGTBºVYXE@�B�D*OÎG*¹U\PGTÅ�MhV³O*FACBºG*MhbEOQM¤_]G�@y^*G�AWb ÅE\PACB�D�f¯@/_]MhAWV³Oy\bEOQMhAc^*Oybº¹�G*M%GTB�O(G�[�É�OyV³_¤ACB¡VQ@*JWVyÅ7JW@/_PAcGTBE\¤¹ÈG*M¤@�B�G*_hX�OQMRF)Oy\P´sOyVQAW@*JWJcI3@*\>GTBEJcI�_hX�O(¹�@*\P_>JcG�G�´ºAW\¤Å7BEACBT_]OQMPMvÅE´7_PAW[7JcO*;»UX�O�G*MvbEOQMHG*¹LG�´�OQMv@/_PAcGTBE\UAW\H@*\U¹ÈG�JWJcG.SU\QØå ;NZ,B�O³Õ�G/Ñ¡VQ@*JWVyÅEJW@/_PAcGTBE\N@/MPO%bEGTB�O,[�IË_hX�O%ÅE\]OQM�ACB�_]OQMP¹Ü@*V³O>V³GTf(f¯@�BEbÄMPGTÅE_PACB�O*;Ô�;U»�X�O�\PJcG.S"JcG�G�´ÄAW\¦_hX�ORBÃ_]MhAcD*D*OQMPOybÎACfÃf¯Oyb7AW@/_]OyJcI*;Ú�ACBEV³O�Ac_¦VQ@�BÄ[sO�ACBT_]OQMPMvÅ7´E_]Oyb5F�Ac_P\�MhOy\hÅEJc_P\¦@/MPO�BEG*_jfÃ@*bEO@*VQV³Oy\h\PAW[7JcOÄ_]Gd_hX�O¯MPOy\P_�G*¹¦_hXEOû e ÚÝÅ7BT_PAWJ�_hX�O(VQ@*JWVyÅEJW@/_PAcGTBE\¤@/MPOÃV³GTfô7JcOQ_]OaÁêfmOy@�BTS�XEAWJcO*F)_hX�OmMPOy\hÅ7Jc_P\,G*¹_hXEO%JW@*\]_UV³I�VQJcO>@/MPOgÅE\]Oyb�ÂP;

k ;U»�X�Ojf¯Oyb7ACÅ7fmÕ�¹ÈMPOyÇ�Å�ORBEV³I�JcG�G�´mAW\)_hXEORB%_]MvAcD*D*OQMPOybmACBg@N\hACf¯AWJW@/M|S¦@RI*;�¾ÊXEORB>Ac_�XE@*\�V³GTfô7JcOQ_]Oyb5F*Ac_�ACBE\]_]MvÅEV³_P\_hXEO,MPOyJcOQ^/@�B�_�fmOyVvX7@�BEAW\hf¯\¦_]G(f¯GR^*O%[�IÎfmG�b7Ac¹ÈI�ACB�D¤_hX�OyAcMUV³GTf(f¯@�BEbËÐ�OyJWb7\,ÁÜ\]OQO>[sOyJcG.S�ÂP;

ÓE;UÞ|ACBE@*JWJcI*Fs_hX�O%B�O³Ï�_UV³I�VQJcO%G*¹|_hX�O�¹Ü@*\]_UJcG�G�´µbEOQ_]OyV³_P\�_hXE@/_U@Ã\]GTÅ�MhV³O,VYXE@�B�D*OgX7@*\UXE@*´7´sORB�Oyb5F7@�B7bδ�OQMh¹ÈG*MvfÃ\@(B�Å7fg[sOQMjG*¹�\P´sOyVQAW@*J5G�´sOQMh@/_PAcGTBE\QØÁÜ@�ÂËÚ�OQ_H_hX�O%B�OQS"_P@/MhD*OQ_�´sG�\PAc_PAcGTB�;ÁÜ[� e JcOy@/M�´sG�\PAc_PAcGTBE@*JÜF�@*´sOQMP_hÅEMPO,@�BEbÎMPG*_P@/_]G*M�G/Ñ�\POQ_P\�@�BEbdX7@�BEb7\]OQ_HV³G*MPMhOyV³_PAcGTBE\Q;ÁÜV�ÂËÚ�_]G*MPO,_hX�O,ìN» e @/_H_hXEO%\]_P@/MP_HG*¹L_hX�O,_]Mv@*VP¶dACBËG*Mhb7OQM9_]G(@*´7´7JcIÎB�GTB�Õ�\hAWbEOQMPOy@*J�_]Mh@*Vh¶�ACB�DÄV³G*MPMPOyV³_PAcGTBE\y;ÁÜb�ÂÄÚ�_]G�´d@�Å�_]G*DTÅEAWb7ACBEDE;Á�O/Â(:UOyVQ@*JWVyÅEJW@/_]O¯_hX�O¤\]¶�Iµ´sG�\PAc_PAcGTB1@�B�D�JcOmAc¹�_hX�OgMPG*_P@/_]G*M,AW\�[sOyACB�DÄb7MhAc^*ORB1\]GÄ@*\N_]Gdf¯ACB7ACf¯AW\]O,_hXEOg\PJcOQS

_PACf¯O�G*MU_]GÃ\POQ_H_hX�O,\P´sOyV³_]MPG*D*Mh@*´�XÎ\PJWAc_H^*OQMP_PAWVQ@*JL@/_H_hX�O,\P_P@/MP_HG*¹�@�BËG�[7\]OQMh^�@/_PAcGTB�;Á�¹³Â(ãNOyVQAWbEO>S�XEAWVYXËS¦@RIË_]G(fmG.^*O,_hX�O,@/ÖyACf¤Å�_hXÎ@�BEbËMhG*_P@/_]G*MNAc¹L_hX�OQMPO,AW\NfmG*MPO�_hXE@�B k è l � G*¹)_]Mh@R^*OyJ)@�B7b

_hXEO%bEORf¯@�B7bÄ´sG�\PAc_PAcGTBµAW\H@�fg[7AcDTÅ�GTÅE\>Á�_hX�O%VQJcG�\]Oy\]_�´�G�\hAc_PAcGTBdAW\H@*JcSj@yI�\�\POyJcOyV³_]Oyb�ÂP;

Ô*æ

Page 26: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

� � «$±���/B+|)H©¤­��·©¤°�¬,­=/«g+êB7:9 � ������5 ���/� ���! )�*���!���i!jei�j Ü�l�m�l��Sv�n @*VYXµf¯OyVvXE@�BEAW\vf AW\HbEOy\PV³MvAW[�OybËS�Ac_hXEACBË_hX�O%» e ÚÄ[TIË@mMPOyV³G*MvbdV³GTB�_P@*ACB7ACB�DÃ_hX�O%¹ÈG�JWJcG.SUACB�DÃÐ�OyJWb7\QØÓ l��ZvemAqÂéB�etSn[o�n��&m »UXEO(bEOy\PAcMhOybº´sG�\PAc_PAcGTBº¹�G*M>_hX�OÎfmOyVYXE@�BEAW\hf½ACBº_hX�OÄf¯GTÅ7BT_>V³G�G*Mhb7ACBE@/_]OÎ\]I�\]_]ORfÎFLOyAc_hX�OQM

Å7´sb�@/_]Oyb1V³GTBT_PACB�Å�GTÅE\PJcIÝb�Å�MhACBEDÄ@Ë\PAWbEOQMhOy@*J|_]Mh@*VP¶1G*M,\]OQ_�_]Gd@ËV³GTBE\]_P@�BT_,^�@*JCÅEO¤Ac¹¦@dfmOyVYXE@�BEAW\hf AW\�_]Gd[sOf¯GR^*Oybµ_]GÃ@¤D�Ac^*ORBµ´sG�\PAc_PAcGTBd@�BEbd\]_]G�´7´sOyb5;

��wJoS�Av� és�et�n[o�n��m »UX�Om´sG�\PAc_PAcGTB1G*¹�_hXEOmf¯OyVvXE@�B7AW\hf ACB1_hX�O¯fmGTÅ7BT_�V³G�G*Mhb�ACBE@/_]O¯\]I�\]_]ORf ÁÜV³G*MPMPOyV³_]Oyb3¹ÈG*M,@�BTIOQMhMPG*Mh\ôsOyVyÅEJWAW@/M(_]G3_hX�OµORBEV³G�b�ACB�D3\]I�\]_]ORfËÂP;Ê»UXEAW\Ã\hX�GTÅEJWb¸[sOÎOyÇ�ÅE@*JH_]Gº_hX�OµbEORfÃ@�BEbÌ´sG�\PAc_PAcGTB Ac¹N_hXEO_]OyJcOy\hV³G�´�OgAW\H_]Mh@*Vh¶�ACBED¯G*M�\]_]G�´�´�OybÎACBd´�G�\hAc_PAcGTB�;Ñ �&�U�Zvm�qZ��lP��q »�X�O�Ð7OyJWbd\]OQ_�[TIË_hX�O>Å7\]OQM]Õ�ACBT_]OQMP¹�@*V³O>V³GTfÃf¯@�B7bËMPGTÅ�_PACB�Oy\HACBÎG*MhbEOQMH_]GÃACB7\]_]MvÅEV³_9_hX�OgfmOyVvX�Õ@�B7AW\hf _]GÄf¯GR^*O*F�\P_]G�´ÎG*MHÖQOQMPG�\]OQ_Q;Ø oWvPoS�At���lP��q »UX�O,Ð7OyJWbaS�XEAWVYXÎMPOyV³G*Mvb7\USNX�OQ_hX�OQMU_hXEOgfmOyVYXE@�BEAW\hfÍAW\QØ9fmGR^�ACB�D(G*M�\]_]G�´7´sOyb5F�¹ÈG�JWJcG.SUACB�DÄG*M�BEG*_¹�G�JWJcGRS�ACB�DEF�ACBδsG�\PAc_PAcGTBdG*M�B�G*_U@�B7bÎÖQOQMPG�\]OQ_HG*M�B�G*_Q;Ø lc�W��¶wx�mAtuoWvem&oSt <àD*ORB�OQMh@*J$\POQMP^*GÃ@*JcD*G*MhAc_hX7f AW\UÅE\POybιÈG*MU_hX�O>f¯@*ACBÎf¯OyVvXE@�B7AW\hf¯\Q;�»UX7AW\9@*JWJcGRSU\�¹ÈG*MRØ

å ;U<Û^*OyJcG�VQAc_�I3bEORfÃ@�BEbÝ´EMPG�´sG*MP_PAcGTBE@*JL_]Gd_hXEO¯\PÇ�Å7@/MPOmMPG�G*_�G*¹�_hX�O¯´sG�\PAc_PAcGTB�OQMPMPG*M%@/_,JW@/MPD*O(b7AW\]_P@�BEV³Oy\¹�MPGTf _hXEO,_P@/MPD*OQ_Q;

Ô�;U< ²×�ã V³GTBT_]MPG�JWJcOQM¤¹�G*M>\hfÃ@*JWJ�OQMPMPG*Mh\y;Ë»�X�Om^*OyJcG�VQAc_�IºbEORfÃ@�BEb�¹�G*M>@a\PAWbEOQMPOy@*J_]Mh@*VP¶¡AW\>_hX�OÃ\hÅ�f G*¹_hX7@/_U´EMPOyb7AWV³_]Oybµ[TIË_hX�O,´sG�ACBT_PACB�DÃJcG�G�´d@�BEbÎ_hX�O%GTÅ�_P´�Å�_9G*¹L_hX�O%²×�ãâ@*JcD*G*MhAc_hX7fd;Ö n��¶n[oWt Ú�G*¹�_�Sj@/MPOÎJWACf¯Ac_P\%GTB3´sG�\PAc_PAcGTBÊÁÜ´sG�\PAc_PAc^*OË@�BEb·BEOQD�@/_PAc^*O/ÂPF�^*OyJcG�VQAc_�I·@�B7b3@*VQV³OyJcOQMh@/_PAcGTBÌVQ@�B·[sOÃ\]OQ_QF�@*J�Õ

_hXEGTÅ�DTX¸\]GTf¯O3Á°GHF�±xFj_hXEOdMPG*_P@/_PAcGTB JWACf¯Ac_P\¯¹�G*MÃ_hXEOµÙ�@*\vf%I�_hXÆ_hÅ�MYB�_P@*[7JcOy\QÂg@/MPOaBEG*_ÃG*¹�_]ORB'ÅE\]Oyb$;'×�¹N_hXEOb7ORf¯@�BEb¸´sG�\PAc_PAcGTB AW\(GTÅ�_P\PAWbEO1@º\PG*¹È_�S¦@/MPOÝJWACf¯Ac_QFU_hX�ORBÌ_hX�O�fmOyVYXE@�BEAW\hf AW\(\P_]G�´7´sOyb @�BEb @�B'@*JW@/MYf AW\_]MvAcD*D*OQMPOyb5ç�O³ÏEV³Oy\P\PAc^*O>^*OyJcG�VQAc_PAcOy\�@�BEbµ@*VQV³OyJcOQMh@/_PAcGTBE\�@/MPO%VQJWAW´7´sOyb5;Ø oW�é�é�n�mA�U�SvQqsn���t »�XEAW\9AW\H_hX�O�_]G�JcOQMv@�BEV³O%SUAc_hX7ACBÄS�XEAWVvXd@¯fmOyVvX7@�BEAW\hf SUAWJWJ5[sO,\]OQ_H[�IË@¯V³GTfÃfÃ@�BEbÄ_]GÃfmGR^*O_]G(´�G�\hAc_PAcGTBd@�BEbd\P_]G�´5;

ÒHm�ò¡és�etSn[o�n��mr�SvQqsn���t »�X�OUACB�Õ�´sG�\PAc_PAcGTB¯Mh@*b7ACÅE\�bEOQÐ�B�Oy\�_hXEOU_]G�JcOQMh@�BEV³ONSUAc_hXEACB¯S�XEAWVYXmG�[7\]OQMh^�ACB�DgAW\´sG�\P\PAW[�JcOH¹ÈG*M@ÄfmG.^�ACB�DËfmOyVYXE@�BEAW\hfd;×�¹L_hXEO>´sG�\PAc_PAcGTBÎOQMhMPG*MNAW\�JcOy\P\�_hXE@�BÎ_hXEAW\�^/@*JCÅ�O*F�_hX�ORBµ_hX�O>f¯OyVvXE@�B7AW\hf�AW\N\P@*AWbd_]G[sOdð0_]Mh@*Vh¶�ACBED�ñ�;

ð]ÞEG�JWJcG.SUACB�D�ñ3f¯Oy@�BE\%_hX7@/_g_hXEOÄ´sG�\PAc_PAcGTBºG*¹H_hX�OÎfmOyVYXE@�BEAW\hf½AW\¤[sOyACB�DÝÅ7´sb�@/_]Oyb3V³GTBT_PACB�Å�GTÅ7\PJcI*;¡ÞEG*M¯@*Jc_PAc_hÅEbEO*F@/ÖyACf¤Å�_hX�FEÐ7OyJWbµ@�BEbÎbEGTfmO�MPG*_P@/_PAcGTBµ_hXEAW\HAW\UbEGTB�O�b�Å�MhACBED¤@Ã\PAWbEOQMPOy@*J�_]Mh@*Vh¶�ç�_hX�O�¹�G�VyÅE\UAW\H@*b/ÉPÅE\]_]OybÎACBËMPOy\h´�GTB7\]O_]GÃVYXE@�B�D*Oy\UACBd_]ORf¯´sOQMh@/_hÅ�MhO*;

»UXEO,» e ÚÄ´sOQMP¹�G*Mvf¯\9fmOyVYXE@�BEAW\hf�V³GTB�_]MPG�J!ACBË_hX�MPOQO%JcG*D�AWVQ@*JL\]_P@/D*Oy\QØ

å ;U»�X�O¤Å7\]OQM]Õ�ACBT_]OQMP¹�@*V³OmMhGTÅ�_PACB�Oy\¯Á�GTB�O¤¹�G*MNOy@*VYXÝG*¹_hXEOgV³GTf(f¯@�BEb7\�JWAW\]_]Oyb¡ACB1<N´7´sORBEb7A�Ï e ÂjOyAc_hX�OQM,ACBEAc_PAW@/_]O_hXEOgV³GTBT_PACB�GTÅE\�ÅE´�b7@/_PACB�D(G*¹bEORfÃ@�BEbd´sG�\PAc_PAcGTBE\NMPOyÇ�ÅEAcMPOyb1Ac¹�_hX�OmfmOyVvX7@�BEAW\hf¯\�V³GTBEV³OQMvB�Oyb1@/MPOg¹ÈG�JWJcG.SUACB�DG*MN\]OQ_U@mV³GTBE\P_P@�B�_�^�@*JCÅ�O>Ac¹|B�G*_Q;�»UX�OQIÄ_hX�ORBdfmG�b7Ac¹�IÃ_hX�O,@*´�´EMPG�´EMhAW@/_]O>V³GTfÃf¯@�B7bÄ@�B7bÎ\]_P@/_hÅE\HÐ�OyJWb7\Q;

Ô�;U»�X�Om´�G�ACBT_PACB�DÎVQ@*JWVyÅEJW@/_PAcGTBºAW\�O³Ï�OyVyÅE_]Oyb¡ACBa¹ÈGTÅ�M,JcG�G�´7\¯Á�GTBEV³O { \PGTÅ�MhV³OÃVYXE@�B�D*O*F å�{ k/l*l F å @�BEb¡Ô l ¿UÖ/ÂU@*\b7Oy\PV³MhAW[sOyb¡ACBºÚ�OyV³_PAcGTB k Ac¹j@µ\PAWbEOQMPOy@*J_]Mh@*VP¶3AW\>ACB¡´EMhG*D*MPOy\P\Q;Ä<�JWJ_hXEAW\%bEG�Oy\%AW\%_]G1ÅE´�b7@/_]OÃ_hX�OÃbEORfÃ@�BEb´sG�\PAc_PAcGTB5;

Ô*è

Page 27: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

k ;U< \]OyV³GTBEbÆ\]OQ_¤G*¹HMPGTÅE_PACB�Oy\¤MvÅ7B7B7ACB�Dµ@/_¯Ô l ¿UÖËMPOy@*b7\¤@�BEbÆbEOyV³G�bEOy\g_hX�OË_PACfmOË@�BEbºORBEV³G�bEOQMh\QF�JcG�G*¶�\m@/__hXEOdV³GTfÃf¯@�B7b·@�B7bÌ\]_P@/_hÅE\mÐ7OyJWb�\m¹ÈG*MmOy@*VYX'f¯OyVvXE@�BEAW\vfÎF@�BEb'@/_m_hX�OdbEORf¯@�B7b·@�B7bÌ@*V³_hÅE@*JU´sG�\PAc_PAcGTBE\yFVQ@*JWVyÅ7JW@/_]Oy\9^*OyJcG�VQAc_�I(bEORfÃ@�BEb7\QF�VvX�OyVh¶�\j¹�G*M¦\PG*¹È_�S¦@/MPO�JWACfÃAc_P\�@�BEbÃGTÅ�_P´�Å�_P\¦@*´7´EMhG�´EMhAW@/_]O�V³GTf(f¯@�BEb�\�_]G>_hXEOb7MhAc^*Oy\Q;

��i!jei�h ���eoWvPoW�&���U�gqAlct<âB�Å7fg[sOQM9G*¹|b7A�ÑsOQMhORB�_HSj@yI�\HG*¹�V³GTBT_]MPG�JWJWACB�D(_hX�O�Ð7OyJWbÎMPG*_P@/_PAcGTB1XE@R^*O>´EMPG.^*Oybd_]GÃ[sO,ÅE\]OQ¹êÅEJ5ACBδ7Mh@*V³_PAWV³O*Ø

å ;U»�X�O,\]¶�IÄ´sG�\PAc_PAcGTBµ@�B�D�JcO%AW\U\h´�OyVQAcÐ�OybËO³Ï�´7JWAWVQAc_PJcI*F�@*\Hb7AW\hVyÅE\P\]OybÎOy@/MvJWAcOQMy;

Ô�;NZ,B¤VvXE@�B�D*O9G*¹�_P@/MPD*OQ_QF�_hX�O9bEORf¯@�BEbg\]¶�I>´sG�\PAc_PAcGTB¤@�B�D�JcO�AW\|MPOyVQ@*JWVyÅEJW@/_]Oyb¯_]G,VQ@�Å7\]O9_hX�OHf¯ACBEACf¤Å7f�MPG*_P@/_PAcGTB¹�MPGTf _hXEO%´EMPOy\]ORBT_H´sG�\PAc_PAcGTB�;»�X�OQMPOy@/¹�_]OQMyF�\PAWbEOQMhOy@*J5_]Mh@*VP¶�ACB�DÄV³GTB�_PACB�Å�Oy\U@*\�ACBË_hX�O�Ð7Mv\]_9G�´E_PAcGTB�;

k ;U»�X�OÄf¯GTÅ7B�_g´sG�\PAc_PAcGTB3@�BED�JcOËAW\g\P´sOyVQAcÐ7Oyb5;a»UX�OÄfÃ@*ACB¡@*´7´�JWAWVQ@/_PAcGTBE\m@/MPO*Øm_]G1¶*OQOy´·@1\P´sOyV³_]MPG*D*Mh@*´�X3\PJWAc_^*OQMh_PAWVQ@*JN\PG3_hXE@/_Äb7A�ÑsOQMhORB�_PAW@*J�MPOQ¹�Mh@*V³_PAcGTB'b7G�Oy\ÄB�G*_(VQ@�ÅE\POa\PAcDTBEAcÐ�VQ@�B�_ÄJWAcDTX�_ËJcG�\P\Ä@�BEbÌG�´E_PAWVQ@*JN_]Oy\]_PACB�DEFSNX�OQMPO%_hXEO>_]Oy\]_�OyÇ�ÅEAW´�f¯ORB�_U\vX�GTÅEJWbÝB�G*_�MhG*_P@/_]OgS�Ac_hXdMPOy\h´�OyV³_N_]GÄ_hX�O¤fÃAcMPMPG*Mh\y;NZ�ÑsÕ�@�Ï�AW\�@�Å�_]G*DTÅEAWb�ACB�DÄAW\BEG*_gVyÅ�MhMPORB�_PJcIº´�G�\h\PAW[7JcOËACB3_hX7AW\gf¯G�bEO*F�@*Jc_hX�GTÅEDTX·f¯G�b�AcÐ�VQ@/_PAcGTBE\g_]G1@*JWJcG.SÍAc_gGR^*OQM¯@ÝJWACf¯Ac_]OybºMh@�B�D*OËG*¹MhG*_P@/_PAcGTBµ@/MPO>bEOy\PV³MhAW[sOybÎACBÎó%ôN;

ÓE;U»�X�OÄ\P¶�I¡´sG�\PAc_PAcGTB·@�B�D�JcOÎAW\gMPOy\]OQ_¤GTBºVvXE@�B�D*OËG*¹�_P@/MPD*OQ_¤_]GÝ´�JW@*V³O(_hX�OÎ\PJWAc_g^*OQMP_PAWVQ@*JÜF¦[�Å�_%_hXEOQMPOy@/¹È_]OQMm_]G_]Mv@*VP¶d@/_U\PAWb7OQMPOy@*J5Mh@/_]O*;»�XEAW\H@*JWJcGRS�\�@�Å�_]G*DTÅ7AWb7ACB�D¯S�X7AWJW\]_Uf¯ACBEACfÃAW\PACB�Dg_hX�O,O³Ñ�OyV³_P\HG*¹|MPOQ¹�Mh@*V³_PAcGTB�;

<j_H_hX�O>Ù�@*\hf>I�_hX˹�G�VQAÜF7_hXEMPOQO%fmG�bEOy\9@/MPO%´sG�\P\hAW[7JcO*Ø

å ;U»�X�O9ACBE\]_]MvÅ7f¯ORB�_|AW\�\]_P@/_PAcGTB7@/MPIm@�BEbmbEOQMPG*_P@/_PAcGTB¯G�´E_PAWVQ\�@/MPOUÅE\POyb¤_]G%f¯@*ACBT_P@*ACB¤_hX�OjÐ7OyJWbmG*MhAcORBT_P@/_PAcGTB�;�»UXEOÐ�OyJWbÎ_hX�ORBËMPG*_P@/_]Oy\N[�I(_�SUAWV³O%_hX�O>VvXE@�B�D*O>ACBdfmGTÅ7BT_H´sG�\PAc_PAcGTBÎ@�B�D�JcO*;

Ô�;U»�X�O¯ACBE\]_]MvÅ�fmORBT_NAW\,\P_P@/_PAcGTBE@/MPI�@�BEbÝ_hX�O¯bEOQMhG*_P@/_PAcGTB�G�´E_PAWVQ\,@/MhO(B�G*_�Ð7_]_]Oyb¸Á�_hX�O(\PAc_hÅE@/_PAcGTBÝS�XEOQMPOm_hX�OQI@/MhO,Ð7_]_]Oyb5F�[�Å�_9\]_]G�´7´sOyb5F7AW\UB�G*_�AWbEORB�_PAWVQ@*JÜFs\PACBEV³O,_hXEOQMPO%AW\H@¯V³GTB7\]_P@�B�_�MPG*_P@/_PAcGTBE@*J!G/Ñ�\]OQ_³ÂP;

k ;U»�X�O%ACBE\]_]MYÅ7fmORBT_HAW\�f¯GTÅ7B�_]Oybµb7AcMPOyV³_PJcIÎGTBµ_hX�O,MPG*_P@/_]G*MyF�@*\N@/_U_hX�O,G*_hXEOQM�¹�G�VQ@*J)\]_P@/_PAcGTBE\QF�@�BEbaAW\HMPG*_P@/_]Oyb_]GÃ_]Mh@*VP¶Î_hX�O>\]¶�I*;

ÓE;U»�X�O%ACBE\]_]MYÅ7fmORBT_HAW\Nf¯GTÅ7BT_]Oybdb7AcMPOyV³_PJcI*F5[�Å�_�AW\HMPG*_P@/_]Oyb1_]GÃ_]Mv@*VP¶d_hX�OgÙ�@*\vf%I�_hX½Å�@/_>Á�O�� X �Ò_]GË@¯Ð7Mv\]_@*´�´EMPGyÏEACf¯@/_PAcGTB�ÂP;>»UXEAW\�fÃ@*ACB�_P@*ACBE\�_hXEOgG*MvAcORB�_P@/_PAcGTB¡G*¹_hX�OmACBE\]_]MYÅ7fmORBT_USUAc_hX1MhOy\P´sOyV³_N_]GË_hX�O¤_]OyJcOy\PV³G�´sOG�´7_PAWVQ\U@�BEbdAW\�@*´7´EMPG�´7MhAW@/_]O�¹ÈG*MUG�´E_PAWVQ@*J$_]Oy\]_PACBED(@�BEbÎ\]GTf¯O,ACB�_]OQMh¹ÈOQMPGTf¯OQ_]MhAWV,@*´7´�JWAWVQ@/_PAcGTBE\Q;

»UX�O(» e Ú1_]MPOy@/_P\¤@dÙN@*\hf>I�_hX�¹�G�VyÅE\%SUAc_hX¡@�B7b¡SUAc_hX�GTÅE_>bEOQMPG*_P@/_PAcGTB3G�´E_PAWVQ\¤@*\,_�S�GÝ\]Oy´7@/Mv@/_]Où�G�VQ@*J¦\]_P@/_PAcGTBE\QF@*Jc_hX�GTÅ�DTXÎ_hX�O�\P@�fmO�´�XTI�\hAWVQ@*J5bEMhAc^*O,@�BEbËORBEV³G�bEOQMh\9@/MhO%ÅE\]OybĹÈG*MH[sG*_hX�;�ã�A�Ñ�OQMPORBT_U\PVQ@*JWACB�Dm¹Ü@*V³_]G*Mh\U@/MhO%ÅE\]OybĹÈG*M´sG�\PAc_PAcGTBg@�BEbgMh@/_]O9@�BEb>_hX�O¦´sG�ACBT_PACB�D,fmG�bEOyJW\L@/MPO¦ACB7bEOy´sORBEbEORBT_Q;)<'\P_P@/_PAcGTBE@/MPI>ACB7\]_]MvÅ7f¯ORB�_)SUAc_hX�GTÅ�_|bEOQMPG*_P@/_PAcGTBG�´E_PAWVQ\gAW\%VyÅ�MhMPORB�_PJcI1_]MPOy@/_]Oyb·@*\%@a\P´sOyVQAW@*J�VQ@*\]OÃG*¹9@ÎMhG*_P@/_PACB�D1ACB7\]_]MvÅ7f¯ORB�_�SUAc_hX3@dV³GTBE\]_P@�BT_gf¯GTÅ7B�_,´sG�\PAc_PAcGTB@�B�D�JcO�[�Å�_�_hX7AW\�AW\9Å7BE\h@/_PAW\]¹�@*V³_]G*MhI¯ACBôEMvACBEVQAW´7JcOgÁ°GWF ±®FPÅ7O³Ï7Å�MPO�G*¹5_hX�OUMhG*_P@/_]G*MjAW\�MPOyJcOQ^/@�B�_jGTBEJcI¯Ac¹5_hXEO�ACBE\]_]MYÅ7fmORBT_AW\H@/_]_P@*VYX�Oyb1_]GÃAc_³ÂP;

��i!jei�� �Ù�Wveé�é��W�;����l��Zt<�ÖyACfgÅE_hXÌ@�BEb e @*\h\]OQD*Mh@*ACBÆÐ7OyJWb'MPG*_P@/_PAcGTB'X7@y^*O1f¯G*MPOÎ_hXE@�B k è l � G*¹�_]Mh@R^*OyJ�@�B7b¸´7@/MP_P\mG*¹N_hX�OyAcM(Mh@�B�D*Oy\Ã@/MhO@�fg[7AcDTÅ�GTÅE\y;¦Z�BÎVYXE@�B�D*O,G*¹|_P@/MPD*OQ_QFs_hX�O%» e ÚÄ\]OyJcOyV³_P\U_hXEO>B�Oy@/MPOy\]_�G�´E_PAcGTBd[�IËbEOQ¹�@�Å7Jc_QF7MPOQD�@/Mhb7JcOy\h\HG*¹|_hX�O,_PACf¯OMPORfÃ@*ACBEACB�DÎ[sOQ¹ÈG*MPOm@ÎJWACfÃAc_�AW\>XEAc_¯Á�Ú�OyV³_PAcGTB3æ�;�Ô�ÂP;m×�_�AW\�_hX�OQMPOQ¹�G*MPOmG�VQVQ@*\PAcGTBE@*JWJcI3B�OyV³Oy\P\h@/MPIµ_]GdMhG*_P@/_]OÃ[TI1@˹ÜÅ7JWJ_hÅ�MvB¡ACB�G*MhbEOQM>_]Ga@R^*G�AWbº_]Mv@*VP¶�ACB�DaACBT_]G1@µJWACf¯Ac_,G*Mg_]GµMPOy\POQ_,_hX�OÄf¯OyVvXE@�B7AW\hf Ac¹H@dJWACfÃAc_>XE@*\%[sOQORBºXEAc_%b�Å�MvACB�DG�[7\]OQMh^�ACB�DE;�»�XEAW\jAW\¦b7GTB�O�Å7\PACB�Dg_hX�O2`cÿU�cýcû��mV³GTfÃf¯@�B7baÁÜ<N´7´sORBEb7A�Ï e ÂPF�S�XEAWVYXËXE@*\¦¹ÈGTÅ�MHf¯G�bEOy\�G*¹$G�´sOQMh@/_PAcGTB�FbEOy´sORBEb7ACBEDgGTBÎ_hX�O%ACBEAc_PAW@*J$\P_P@/_]O%G*¹|_hX�O%fmOyVYXE@�BEAW\hfdØ

Ô�é

Page 28: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

å ;H×�¹�_hX�O¤fmOyVvX7@�BEAW\hf AW\U_]Mh@*Vh¶�ACBEDËB�G*MYf¯@*JWJcI*F�@�BEbµAW\NACBµAc_P\N@�fg[7AcDTÅ�GTÅE\�Mh@�B�D*O*Fs_hX�ORBd_hX�Ogb7ORf¯@�BEbd´sG�\PAc_PAcGTBAW\�VvXE@�BED*Oybµ[�I k è l � ;

Ô�;H×�¹�@¡\]G*¹�_�Sj@/MPOÝJWACf¯Ac_ÃAW\ÃORBEV³GTÅ7BT_]OQMPOyb'b�ÅEMhACB�D�_]Mh@*Vh¶�ACB�DEF9_hXEORBÌ_hX�Oµb7ORf¯@�BEbÌ´sG�\PAc_PAcGTB AW\¯MPOy\POQ_Ã@�BEb¸_hXEOf¯OyVvXE@�B7AW\hf AW\ÃV³GTf(f¯@�BEb7Oybº_]GÆfmG.^*O*;ÊZ�Ñ5\]OQ_P\Ã@�B7bÌG*_hX�OQM(@*VQVyÅ�fgÅ7JW@/_]Oyb'V³G*MPMPOyV³_PAcGTB7\(@/MPOa´EMPOy\]OQMP^*Oyb$çG*_hXEOQMPSUAW\]O,_hXEO,O³ÑsOyV³_NAW\9_hX�O%\h@�fmO�@*\U\PJcOQS�ACB�D¯_]G¯_hX�O�_P@/MhD*OQ_�@/D�@*ACB�;

k ;H×�¹j_hX�OÄf¯OyVvXE@�B7AW\hf AW\g\]_]G�´7´sOyb¡ACB¡@�B3@�fg[7AcDTÅ�GTÅE\>´7@/MP_,G*¹9Ac_P\>_]Mh@y^*OyJÜF�_hX�ORB3Ac_>AW\%MPG*_P@/_]Oybº[�I k è l � @�B7b\P_]G�´7´sOybd@/D�@*ACB�;

ÓE;H×�¹5_hX�O�fmOyVYXE@�BEAW\hfÛAW\jACB¯_hX�ON´EMPG�V³Oy\P\¦G*¹$[sOyACB�D>bEMvAc^*ORBÃ_]G¤@>ÐEÏ�OybÄ´sG�\PAc_PAcGTB�F�_hX�ORBÃ_hXEAW\j´�G�\hAc_PAcGTBÃAW\j@*Jc_]OQMPOyb[�I k è l � ÁÜAc¹|´�G�\h\PAW[7JcO/Â�@�BEbË_hXEO>fmG.^*O%V³GTB�_PACB�Å�Oy\Q;

êB7[6 ; ���s]���T���i�hgi�j Ü�l�m�l��Sv�`1ÅEJc_PAW´7JcOÃORB7V³G�b7ACBEDµ\]I�\]_]ORf¯\,@/MhOÄÅE\]Oyb¡GTB�_hX�OÃ@/ÖyACf¤Å�_hX5F)OyJcOQ^/@/_PAcGTB·@�BEb�MPG*_P@/_]G*Mm@�Ï�Oy\Q;Ä»�X�Oô�Å�Mv´�G�\POgG*¹9_hXEOORBEV³G�bEOQM¦f¯G�b7OyJW\�ÅE\]Oyb¯[�I¤_hX�OU» e ÚgAW\_]G%´EMPG�b�ÅEV³O9Oy\P_PACf¯@/_]Oy\�G*¹�_hX�O�´�G�\hAc_PAcGTBmG*¹�Oy@*VvX(@�Ï�AW\S�XEAWVYX¯@/MPOUACB7bEOy´sORB�ÕbEORBT_�G*¹_hX�OmbEOQ_P@*AWJW\�G*¹�_hX�O¤ORBEV³G�b�ACB�DdXE@/MhbESj@/MPO*F5\]GË_hXE@/_�^/@*JCÅ�Oy\�¹ÈMhGTf b�A�ÑsOQMPORBT_�ORBEV³G�bEOQMh\�VQ@�BÝ[sOgV³GTfg[7ACBEOybG*MUV³GTfô7@/MPOyb5;�ÞEGTÅEMU_�I�´sOy\9G*¹|ORBEV³G�bEOQMU@/MPO>Å7\]Oyb5Ø

�!��tW�&����oWl »�X�Oy\]Oa@/MhOaG�´E_PAWVQ@*J�@*[7\PG�JCÅ�_]OÝORBEV³G�b7OQMh\ÃG*¹�MhOyJW@/_PAc^*OyJcI V³G�@/Mh\PO1MhOy\]G�JCÅ�_PAcGTBÊÅE\]Oyb ´EMhACfÃ@/MhAWJcIÆ_]G·\]OQ_ACB7Ac_PAW@*J$ÖQOQMPG/Õ�´sG�ACBT_P\U@�BEbÎ_hXEOQMPOy@/¹È_]OQMN@*\U@¯VYX�OyVP¶s;�»�X�OQIÄ@/MhO,D*Oy@/M]Õ�bEMhAc^*ORBµ@�BEbd@/MPO%Å7\]OybÎGTBÎ@*JWJ$@�Ï�Oy\Q;Ü�lcve� »UX�Od´EMvACf¯@/MPIºORBEV³G�b7OQMh\ÃÅE\]OybÌACB'B�G*Mvf¯@*J¦G�´sOQMh@/_PAcGTB'@/MPOdD*Oy@/M]Õ�bEMvAc^*ORBÌG�´E_PAWVQ@*J�ACBEV³MPORfmORBT_P@*JH\]I�\]_]ORfÃ\Q;»�X�OQIÄ@/MhO,ÖQOQMPG�\]OQ_N@/D�@*ACBE\]_H_hX�O>@*[7\]G�JCÅ�_]O,ORB7V³G�bEOQMv\9S�X�ORBÄ_hX�O>» e ÚÄ\]_P@/MP_P\NÅE´5;Ð veésl »UX�O�@/ÖyACf¤Å�_hXË@�ÏEAW\HAW\9OyÇ�ÅEAW´7´sOybÄSUAc_hXË@�BËACBEb�ÅEV³_PAc^*O�_P@*´sO�ORBEV³G�bEOQM9SUAc_hXĹ�GTÅ�M9MPOy@*b�ACB�DÃX�Oy@*b7\,ÁÜ<�fmG�\�GHáñ�� F åyò*ò Ô�ÂP;�»UXEAW\�XE@*\�XEAcDTXEOQM�´sOQMP¹�G*Mvf¯@�BEV³Oj_hXE@�B¯_hX�OHD*Oy@/M¦ORBEV³G�bEOQM�@�BEb(AW\JWAc¶*OyJcIm_]Gg[�OyV³GTf¯OH_hX�OU´7MhACf¯@/MPI\PI�\]_]ORf�¹ÈG*M�@/ÖyACfgÅE_hXËGTBEV³O%Ac_P\�\]_P@*[7AWJWAc_�Id@�B7bÎMPG�[�ÅE\P_hB�Oy\P\HXE@R^*O%[sOQORBË^*OQMhAcÐ7Oyb5;���&�!��l�� »UX�ON@*Jc_PAc_hÅEbEO�@�BEbÄ@/ÖyACfgÅE_hXÃ@�Ï�Oy\j@/MPO�@*JW\]G¤Ð7_]_]Oyb(SUAc_hXùÈMvAWV³_PAcGTB�Õ�bEMhAc^*ORB(ORBEV³G�bEOQMh\Q;�»UXEOy\]ONXE@R^*O�´EMPGR^*Oyb_]G([�O%Å�BE\P@/_PAW\]¹Ü@*V³_]G*MPIÎ@�BEbd@/MPOgB�G*_HVyÅ�MPMPORBT_PJcIdÅE\]Oyb5;

»UXEOdMh@yS ^�@*JCÅEOy\ÃMPOy@*b'¹ÈMhGTf _hX�OdORB7V³G�bEOQMv\Ã@/MPOµ´7MPG�V³Oy\h\]Oyb¸_hX�MhGTÅ�DTX¸@3f¯G�b7OyJjS�XEAWVvX XE@*\¯_hXEOd¹ÈG�JWJcG.SUACB�DV³GTf¯´sGTB�ORBT_P\%ÁêB�G*_H@*JWJ!G*¹)SNXEAWVvXÎ@/MhO>ÅE\]Oybι�G*MHOQ^*OQMPIËORBEV³G�bEOQMQÂPØ

å ;NÚEVQ@*JcO>@�BEbËÖQOQMPG/Õ�´sG�ACBT_Q;

Ô�;U<âJcG�G*¶TÕ�Å7´Î_P@*[7JcO*F�SNXEAWVvXÎAW\UbEOQMhAc^*Oybd¹�MPGTf \hf¯G�G*_hXEOybÎ_]Mh@*VP¶�ACB�DÃb�@/_P@�;

k ;NÚEACB�ÅE\PG�AWb7@*J$@�BEbË_]MhAW@�BEDTÅEJW@/MU¹êÅ7BEV³_PAcGTBE\HG*¹|@/Mv[7Ac_]Mh@/MPIË´sOQMhAcG�bÎ@�B7bd´�XE@*\]O*;

ÓE;U<âV³G*MPMhOyV³_PAcGTBµbEOQMvAc^*OybιÈMhGTf b7AW\P´7JW@*V³ORf¯ORB�_Uf¯Oy@*\hÅ�MPORf¯ORB�_P\,ÁÜ\POQO%[sOyJcGRS�ÂP;

»UXEOdÖQOQMPG/Õ�´sG�ACB�_P\ÄG*¹�_hX�O1ACBEV³MPORf¯ORB�_P@*JUORBEV³G�b7OQMh\(fÃ@yIÌ[sOabEOQ_]OQMvfÃACB�Oyb¸ACB'@ºB�Å7fg[�OQMÃG*¹,b7A�ÑsOQMhORB�_(S¦@RI�\QØ[�IµV³GTf¯´7@/MvAW\]GTBaSUAc_hXa_hX�Og@*[�\]G�JCÅ�_]O¤ORBEV³G�bEOQMh\Qç$[�IµbEMhAc^�ACB�DÄ_hX�O¤_]OyJcOy\PV³G�´sOm´7@*\]_�@ÄMPOQ¹ÈOQMhORBEV³Og´sG�\PAc_PAcGTB1SNX�OQMPO¤@´EMPGRÏ�ACfÃAc_�IdbEOQ_]OyV³_]G*M,´7MPG�b�ÅEV³Oy\U@ËXE@/MhbESj@/MPOg\PAcDTBE@*J)_]GÄVQJcOy@/M�_hX�O¤V³GTÅ7BT_]OQMNG*M�[�IdbEMhAc^�ACB�DÃ_hX�Og_]OyJcOy\PV³G�´sO¤_]G(GTBEOG*¹�Ac_P\UXE@/Mhb7S¦@/MPO,´�@/MP¶Ä´sG�\PAc_PAcGTB5F7S�XEAWVYXÎ@/MPO%bEOQÐsB�OybÎ[TIËACBEbEOy´sORBEb7ORB�_Hf¯AWV³MhG�\]SUAc_PVvXEOy\Q;

Ô I

Page 29: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MhO ò Ø»UX�O,@/ÖyACf¤Å�_hXdbEMhAc^*O,@�BEbÎORB7V³G�bEOQMUD*Oy@/M�_]Mh@*ACB3Á�¹ÈMPGTf�<Nf¯G�\zGuá ñ#� F åyò*ò Ô�ÂP;��i�hgi�h ����n�����oSp��elcve��lcmAwx�gq�lc�ÞEGTÅ�MvAcOQM%@�BE@*JcI�\PAW\,G*¹¦_]Mh@*VP¶�ACB�Dµ@�B7bÝORBEV³G�b7OQM%b7A�Ñ�OQMPORBEV³O¯b7@/_P@dVQ@�B¡[�O¯ÅE\POyb�_]GdAWbEORBT_PAc¹ÈI�´sOQMhAcG�b7AWV¤V³GTf¯´sGTB�ORBT_P\@�BEb¤_hXEAW\�XE@*\�[sOQORB¤bEGTB�OHACBmb7OQ_P@*AWJE¹ÈG*M_hX�OH@/ÖyACf¤Å�_hX¤@�Ï�AW\�@*\�´7@/MP_�G*¹s_hX�O9_]Oy\]_�´EMPG*D*Mh@�f(fmO¦¹ÈG*M�_hXEO9_P@*´�O9ORB7V³G�bEOQMÁÜ<�fmG�\¤Guá ñ#� F åyò*ò Ô�ÂP;ÄÚ�OQ^*OQMh@*J�G�[�^�AcGTÅE\%\P´�@/_PAW@*J|¹ÈMPOyÇ�Å�ORBEVQAcOy\,MPOy\hÅEJc_�¹�MPGTf _hX�O¯JW@RI*GTÅ�_%G*¹¦_hX�O¯bEMhAc^*O¯VYXE@*ACB¡@�B7bORBEV³G�bEOQMUD*Oy@/MvACB�D1ÁÜÞ|AcDTÅ�MPO ò ÂPØ�_hX�Oy\PO%@/MPO>JWAW\P_]OybµACBd»L@*[7JcOy\NÔ¯@�BEb k F�MPOy\P´sOyV³_PAc^*OyJcI*;9»UX�O%f¯G�\]_U\]ORBE\hAc_PAc^*O%Sj@yIÎG*¹bEOQ_]OyV³_PACB�D(\hX�G*MP_0Õ�´sOQMhAcG�bÄOQMPMPG*Mh\9AW\9_]G¯b�A�ÑsOQMPORB7V³O�_hX�O�D*Oy@/MU@�BEbË_P@*´sO�ORBEV³G�bEOQMh\jS�X7AWJW\]_j_hX�O�_]OyJcOy\PV³G�´sO%AW\HfmG.^�ACBED^*OQMPIÎ\PJcG.SUJcIÎ@�BEbÎ_hX�ORBË_]GÃ_P@/¶*O>@¯ÞEGTÅEMhAcOQM�»)Mh@�BE\]¹�G*Mvf ÁÜÞ|AcDTÅ�MPO å l ÂP;

»UXEOÃJW@/MPD*Oy\]_¤\]I�\]_]ORf¯@/_PAWVÃOQMPMPG*M>@�Ñ�OyV³_P\g_hX�O¯D*Oy@/M]Õ�b7MhAc^*ORBºORBEV³G�b7OQM%GTB�_hXEO(@/ÖyACf¤Å�_hX¡@�ÏEAW\Q;λUX�OÃMh@*b7AW@*J�XTI�ÕbEMPG�\P_P@/_PAWVm\hÅE´7´sG*MP_NG*¹_hX�Om_]OyJcOy\hV³G�´�O(AW\�ACBE\hÅ�ÕÃVQAcORBT_PJcIÝ\]_PA�Ñ·_]Gd´7MPOQ^*ORB�_�\PAWb7OQS¦@RI�\gfmGR^*ORf¯ORB�_Q;g»UX�OQMPOm@/MPOm_�S�Gf¯@*ACB¡O³ÑsOyV³_P\y;ÝÞ|AcMh\P_PJcI*F�_hX�O(G�´�´�G�\hACB�Da@�BT_PA�Õ�[7@*VP¶�JW@*\hX·_]G*MhÇ�Å�Oy\gG*¹H_hX�O(_�S¦G�@/ÖyACfgÅE_hX3bEMvAc^*OËf¯G*_]G*Mh\>VQ@�Å7\]O(_hXEO_]OyJcOy\PV³G�´sOm_]GÎb7AW\P´7JW@*V³Om\PAWb7OQS¦@RI�\�[�Ia@*[sGTÅ�_�æ l ^!f @*JcGTBEDÄ_hXEO¤´sOQMh´sORBEb�AWVyÅEJW@/MU_]GÎ_hX�O¤JWACB�ONÉ0G�ACBEACB�DÄ_hX�ORfÎ;�:HG/Õ_P@/_PAcGTBºACB�@/ÖyACf¤Å�_hXÝ_hX�ORB3JcOy@*b7\�_]Ga@dÐ7Mh\]_0Õ�XE@/MYfmGTBEAWVgOQMPMPG*MR;ÄÚ�OyV³GTBEb7JcI*F)_hX�OQMPOÃAW\%@d\PAWbEOQSj@yI�\gf¯GR^*ORf¯ORB�_�SUAc_hX_hX�O¯_]G�G*_hXº´�OQMvAcG�b�G*¹j_hX�OÄf¯@*ACB�bEMvAc^*O¯D*Oy@/MËÁ l�� Ó l åHI � ÂP;Ä»�X�O¯ORBEV³G�bEOQM%\]OQOy\g@dV³GTfô�GTBEORB�_,G*¹j_hX�OÃ_]Mh@�BE\PJW@/_PAcGTB@*\�@�B1@*´7´7@/MPORBT_N@/ÖyACf¤Å�_hXµOQMPMPG*M�G*¹@�fô7JWAc_hÅEbEO¤Ô îµk @/MhVQ\]OyVÎÁÜÞ|AcDTÅ�MPO å*å ÂP;�×0BµG*MhbEOQMN_]GËMPORfmG.^*O>_hXEOy\]O>O³Ñ�OyV³_P\QF@ô�@*AcM�G*¹�b7AW\h´7JW@*V³ORfmORBT_U_]Mh@�B7\Pb�ÅEV³OQMh\�AW\NÅ7\]Oybd_]GÎfmOy@*\hÅEMPO,_hX�O>_]Mh@�BE\PJW@/_PAcGTB1@*JcGTB�DÄ_hX�O>@*´�´EMPG�´EMhAW@/_]Ogb7AcMPOyV³_PAcGTB�;»UX�Oy\PO�@/MhO%fmGTÅ7BT_]OybËGTBË@¤ÐEÏ�Oybδ7@/MP_jG*¹)_hXEO,\]_]MvÅEV³_hÅ�MhO*F�@�B7bÎACf¯´7ACB�D*O�GTBË@¯B�GTfÃACBE@*JWJcI(V³I�JWACBEbEMvAWVQ@*JÜF7´EMPOyVQAW\PAcGTB�ÕD*MPGTÅ7B7bÄ\vÅ�MP¹Ü@*V³ONGTBÄ_hXEO�_]OyJcOy\PV³G�´sO*;»UX�OyAcM9MPOy@*b�ACB�D�\9@/MPO,\PVQ@*JcOyb5F7@R^*OQMh@/D*OybºÁ�_]GÃMPORfmG.^*ON_hXEO�O³ÑsOyV³_P\9G*¹LOyJWJWAW´E_PAWVQ@*Jb7AW\]_]G*Mh_PAcGTB·G*¹U_hX�OÎ\hÅ�Mh¹�@*V³OËGTB·S�XEAWVYXº_hX�OQIº[sOy@/MQÂ,@�BEbÆ\hÅE[7_]Mh@*V³_]OybƹÈMhGTfë_hXEOÄORB7V³G�bEOQMmMhOy@*b7ACB�D�\Q;3Þ|AcDTÅ�MhO å Ô\hX�G.SU\�_hXEOU\PVQ@*JcOybÄb7AW\P´7JW@*V³ORf¯ORB�_V³G*MhMPOy\P´sGTBEb7ACB�D�_]G>_hX�OU_]Mv@*VP¶�ACB�D>b7@/_P@>ACB¯Þ|AcDTÅ�MPO å*å ;�»UX�OUV³G*MPMhOyV³_PAcGTBÃMhORfmGR^*Oy\@*´7´EMhGyÏEACf¯@/_]OyJcI ò é��ÛG*¹)_hX�O l�� Ó l åHI � OQMPMPG*MRF�[�ÅE_¦AW\9\]_PAWJWJ$BEG*_¦ORBT_PAcMPOyJcIÄ\P@/_PAW\]¹Ü@*V³_]G*MPI*F�\PACB7V³O�@*b�b7Ac_PAcGTBE@*JsOQMPMPG*Mh\9@/MhO

Ô ò

Page 30: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO å l د< ÞLÞ|» G*¹9_hX�OÄb7A�ÑsOQMhORBEV³O([sOQ_�S¦OQORBºGTB�OÃG*¹9_hXEO(_P@*´sOÃORB7V³G�bEOQM¤X�Oy@*b7\g@�BEb¡_hXEO(D*Oy@/M¤ORBEV³G�bEOQM>ACB@/ÖyACf¤Å�_hXaGR^*OQMg@Ä´sOQMhAcG�baS�X�ORBa_hX�O¤_]OyJcOy\PV³G�´sOmS¦@*\�[sOyACB�DÎbEMvAc^*ORBa@/_,@Ä^*OQMPI1\PJcGRS%F!V³GTBE\]_P@�BT_�Mh@/_]O*;gÚ�AcDTB7AcÐ�VQ@�B�_´sOQMhAcG�b7\$@*\P\]G�VQAW@/_]Oyb>SUAc_hX,[sG*_hX�ORB7V³G�b7ACBEDU\]I�\]_]ORf¯\$@/MhO�f¯@/MP¶*Oyb$;)»UX�O¦Å7BEAc_P\5G*¹E\P´7@/_PAW@*J�¹�MPOyÇ�ÅEORBEV³IN@/MhO�bEOQD*MPOQOy\ bgf ;

k/l

Page 31: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

»L@*[7JcO>Ô�Ø e XE@/Mh@*V³_]OQMhAW\P_PAWV%\P´7@/_PAW@*J$¹ÈMPOyÇ�Å�ORBEVQAcOy\H¹ÈG*M�_hX�O,@/ÖyACf¤Å�_hXÎbEMhAc^*O>@�BEbËD*Oy@/MNVYXE@*ACB�;

e GTfô�GTBEORB�_ e @*JWVyÅEJW@/_PAcGTB ²LOQMhAcG�b3ÁÜbEOQD� ã�OQ_]OyV³_]Oyb;�Ú�´�ÅEM¦_]G�G*_hX { [�ÅEJWJ�D*Oy@/M k è l {�I*ò è l ; Ó l åHI K�Oy\Ú�´�ÅEM¦D*Oy@/MNMPG*_P@/_PAcGTB k I a l ; Ó l åHI å æ�;�Ô�é/è ÙUGÞ|AcMh\]_U\P_P@/D*O,D*Oy@/M�_]G�G*_hX å æ�;�Ô�é/è {Îå ÓTÔ l ; å l é/è ÙUGÞ|AcMh\]_U\P_P@/D*O,D*Oy@/M�MhG*_P@/_PAcGTB k I a l ; å l é/è ÓE; l IJI ÙUGÚ�OyV³GTBEbµ\]_P@/D*O%D*Oy@/M�_]G�G*_hX ÓE; l IJI%{�å Ó�é l ; l Ô�é I K�Oy\`µG*_]G*M�\hXE@/¹�_HMPG*_P@/_PAcGTB Ô*è¦a l ; l Ô�é I l ;�é/Ô*Ô I ÙUGÞ|AcMh\]_�f¯G*_]G*MUV³G*D*D�ACB�D(¹ÈMPOyÇ�Å�ORBEV³I l ;�é/Ô*Ô I�{ Á åyò l { Ô� é�;�è l I a å l b � K�Oy\Þ|AcMh\]_H_P@*VYX�GÃMvAW´7´7JcO�¹ÈMhOyÇ�Å�ORB7V³I l ;�é/Ô*Ô I�{ Á å k ò�{ Ô� l ; l å l Ó �

»L@*[7JcO k Ø e XE@/Mh@*V³_]OQMhAW\]_PAWV>\P´7@/_PAW@*J5¹�MPOyÇ�Å�ORBEVQAcOy\9¹�G*MU_hXEO,@/ÖyACfgÅE_hXËD*Oy@/MUORBEV³G�bEOQMNVvXE@*ACB�;

e GTf¯´sGTB�ORBT_ e @*JWVyÅEJW@/_PAcGTB ²)OQMvAcG�b·ÁÜbEOQD� ãNOQ_]OyV³_]OybR�²ACBEAcGTBË_]G�G*_hX k è l {�I*ò è l ; Ó l åHI K�Oy\²ACBEAcGTBËMhG*_P@/_PAcGTB Ô*Ô¦a l ; Ó l åHI I ; I k ò Ô �×0BT_]OQMvfmOyb�AW@/_]O,D*Oy@/MU_]G�G*_hX I ; I k ò Ô {�å é l l ; l æ*Ô l K�Oy\×0BT_]OQMvfmOyb�AW@/_]O,D*Oy@/MUMPG*_P@/_PAcGTB Ô å a l ; l æ*Ô l å ; l ò Ô K�Oy\

k å

Page 32: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO å*å Ø�»UX�OH@/ÖyACf¤Å�_hX¤V³GTfôsGTB�ORB�_�G*¹�ACf¯@/D*OUf¯G*_PAcGTB¯fmOy@*\vÅ�MPOybgSUAc_hXm@�B¤GTB�Õ�@�Ï�AW\�@*VQÇ�ÅEAW\PAc_PAcGTBÃVQ@�fmOQMh@�;�»UXEOD*Oy@/MORB7V³G�bEOQM�Sj@*\ÅE\POyb¤SUAc_hX�GTÅ�_�V³G*MPMhOyV³_PAcGTBE\QF�ACBgG*MhbEOQM�_]G%\hXEGRS¸_hX�O l�� Ó � OQMhMPG*Mb�Å�Oj_]G%X�G*MvAcÖQGTB�_P@*J�_]Mh@�BE\PJW@/_PAcGTB�;ACBT_]MPG�b�ÅEV³Oybd[sOyVQ@�ÅE\]O�_hX�O%D*MPGTÅ7BEbÎ\hÅEMP¹�@*V³O,AW\NB�G*_H@¯´sOQMP¹�OyV³_HV³I�JWACB7bEOQMy;

Þ|AcDTÅ�MPO å k \hX�G.SU\%_hXEO(MPOy\hAWb�ÅE@*J�OQMPMPG*M¤ACB3@/ÖyACf¤Å�_hX·@/¹�_]OQM¤\vÅE[E_]Mh@*V³_PACB�D1_hX�O l�� Ó � V³GTfôsGTB�ORB�_Q;1»UX�OËf¯@�É0G*MMPORfÃ@*ACBEACB�D¤\]I�\P_]ORf¯@/_PAWVNOQMPMPG*M9AW\9@¤\]IEfÃfmOQ_]MvAWVQ@*J�\P@RSH_]G�G*_hXÎSUAc_hX(_hX�O�´�OQMvAcG�bÝÁ å �=l ò � Â�G*¹$MPG*_P@/_PAcGTBÎG*¹!_hX�O�\]OyV³GTBEbD*Oy@/M9ACB(_hX�OUORBEV³G�bEOQMjD*Oy@/Mh[sGyÏÄ@�BEb(@�B(@�f¯´�JWAc_hÅEbEOUG*¹ l ; IJI @/MvVQ\]OyV/;�×�_�AW\9fmG�bEOyJWJcOyb(Å7\PACB�D>@>_]MhAW@�B�DTÅ7JW@/M¦¹êÅ7BEV³_PAcGTBbEOQMhAc^*Oyb3¹ÈMhGTf _]Mh@*Vh¶�ACB�DÝb7@/_P@�;Î<�B�O³ÏE@�f¯´7JcO¯G*¹H@µ_]Mh@*VP¶�ACB�Da_]Oy\]_>S�Ac_hX¡@*JWJ�ORB7V³G�bEOQMgV³G*MPMPOyV³_PAcGTBE\>_hÅ�MvBEOyb¡GTB¡AW\\hX�G.S�BÝACBÝÞ|AcDTÅ�MPO å ÓE;¯Ù�G*_]Om_hXE@/_,_hX�O¤OQMPMhG*M>fmOy@*\hÅEMPOyb1GTB1_hX�O¯\]¶�IaAW\%f¤ÅEJc_PAW´7JWAcOyb�[�IaV³G�\�½Á�ª l ;�è*ÔιÈG*M�_hXEAW\_]Oy\]_³ÂP;

Þ|AcDTÅ�MPO å æ�F*\hX�GRS�\!@�B,Þ|Þ|»ºG*¹EG�´�ORB�Õ�JcG�G�´%_]Mh@*VP¶�ACB�DUOQMhMPG*Mh\)Å7\PACB�DH_hX�O�D*Oy@/M)ORB7V³G�bEOQMR;)»UX�O_]Mh@*V³O�AW\LbEGTf¯ACB7@/_]Oyb[�IÌ_hX�MPOQOaV³GTfôsGTB�ORB�_P\yØa_hX�Oa_]Mh@�BE\PJW@/_PAcGTB'OQMPMPG*MË@/_ l�� Ó l åHIJ� @�BEb'_hX�OµMhG*_P@/_PAcGTBßÁ å �=l òJ� Âg@�BEb'_]G�G*_hXâÁ l��=l æ*Ô � ´sOQMhAcG�b7\G*¹!_hX�ON\POyV³GTBEbÄORBEV³G�b7OQM¦D*Oy@/MR;»UX�ONÐ7Mh\]_�_�S¦GmG*¹$_hX�Oy\]O�@/MPO�_hX�ONMPOy\PAWb�Å7@*JW\�G*¹!_hX�O�V³G*MPMPOyV³_PAcGTBE\9bEOy\hV³MhAW[sOybOy@/MhJWAcOQMyFs@�BEbËMPOy´EMhOy\]ORB�_UMPGTÅ�DTXEJcI k � @�BEb å*å � G*¹|_hX�O�G*MhAcD�ACBE@*JLÅ7BEV³G*MPMPOyV³_]OybdOQMPMPG*MyFEMPOy\h´�OyV³_PAc^*OyJcI*;

��i�hgi�� Ð pAlYvQ��n�����o�p}oWveéBl�l�m�wx�gq�l��»UX�O¤_P@*´sO¤ORBEV³G�bEOQM,bEOy@*JW\�SUAc_hX1_hX�O¯´7MPG�[7JcORf G*¹�_]Mv@�BE\PJW@/_PAcGTB�[�Ia@R^*OQMh@/D�ACB�Dd_hX�OmMhOy@*b7ACB�D�\�¹�MPGTf X�Oy@*b7\�´7JW@*V³OybåHI l � @*´7@/MP_QF�SNXEAWVvX·\]OQOËOyÇ�ÅE@*Jj@�BEb3G�´�´�G�\hAc_]OÄO³Ñ�OyV³_P\Q;3»�X�OÃMPOy\hAWb�ÅE@*JW\g¹ÈG*Mm@Ý\PACB�D�JcOË_P@*´sOÎX�Oy@*bÌ\hX�G.S @aÐ7Mh\P_0ÕXE@/Mvf¯GTBEAWVNV³GTf¯´sGTB�ORBT_�G*¹|@�f¯´7JWAc_hÅ7bEO k @/MhVQ\POyV�b�Å�O�_]Gm_hX�O�S¦@�B7bEOQMjG*¹)_hX�O�@�ÏEAW\9G*¹!MhG*_P@/_PAcGTBdfmORBT_PAcGTB�OybËOy@/MhJWAcOQM@�BEbÎ_hXEO l�� Ó l åHI � _]Mh@�B7\PJW@/_PAcGTBE@*J$OQMhMPG*MyF7[�Å�_UBEOyAc_hX�OQMHG*¹L_hX�Oy\]O,O³Ñ�OyV³_P\�AW\U\PAcDTBEAcÐ�VQ@�BT_�ACBË_hXEO%fmOy@�B�;

»UXEOU_P@*´sO�AW\jf¯@�B�Å�¹Ü@*V³_hÅ�MPOybmSUAc_hX(@%´�Ac_PVvXÃG*¹!Ô>f(fÎF�@�BEbÃOQMPMPG*Mh\¦@/__hX�O�Ð7Mh\]_NÁ l��=l�k IJ� Â�@�BEbÃ\]OyV³GTB7b1Á l��=l åyòJ� Âk Ô

Page 33: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO å Ô�Ø�»UXEO>V³G*MPMPOyV³_PAcGTB�_]G(_hX�O¤@/ÖyACf¤Å�_hXaD*Oy@/M�ORBEV³G�bEOQM�MhOy@*b7ACB�DËbEOQMhAc^*Oyb1¹ÈMhGTf b�AW\P´7JW@*V³ORfmORBT_N_]Mh@�BE\Pb�Å7V³OQMMPOy@*b7ACBED�\9¹ÈG*MU_hX�O%b7@/_P@¯ACBÎ_hX�O%´EMPOQ^�AcGTÅE\9Ð�DTÅ�MPO*;

k*k

Page 34: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO å k Ø1»UXEOµ@/ÖyACf¤Å�_hX¸V³GTfô�GTBEORB�_mG*¹,ACfÃ@/D*OafmG*_PAcGTB fmOy@*\hÅ�MhOybÌSUAc_hX¸@�B¸GTB�Õ�@�ÏEAW\(@*VQÇ�ÅEAW\PAc_PAcGTB VQ@�fmOQMv@@/¹�_]OQM,\hÅE[E_]Mh@*V³_PACBED(_hX�O l�� Ó � _]Mh@�BE\hJW@/_PAcGTBE@*J|OQMPMPG*M�¹�MPGTf _hX�O>D*Oy@/M%ORBEV³G�b7OQMNMhOy@*b7ACB�DE;,»UX�O å �=l ò � \P@ySU_]G�G*_hXÝV³G*M]ÕMPOy\P´sGTBEb�ACB�D(_]GÎ_hXEOmMPG*_P@/_PAcGTB¡´sOQMhAcG�b1G*¹_hX�O¯\]OyV³GTB7bÝD*Oy@/M>ACB1_hX�O¤ORBEV³G�bEOQM,D*Oy@/Mh[sGRÏÝAW\�VQJcOy@/MgACB1_hXEAW\�b7AW@/D*Mh@�fd;

k Ó

Page 35: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO å ÓEئ»UXEO%@/ÖyACf¤Å�_hXdV³GTfô�GTBEORB�_9G*¹�ACfÃ@/D*O>fmG*_PAcGTBafmOy@*\hÅ�MhOybÎSUAc_hXd@�BdGTB�Õ�@�ÏEAW\�@*VQÇ�ÅEAW\PAc_PAcGTB1VQ@�fmOQMv@m¹ÈG*M@Î_]Mh@*Vh¶�[�OQ_�S�OQORB¡OyJcOQ^�@/_PAcGTB7\%G*¹jÓ òJ� @�BEb3æ*è � ;(»UX�OmD*Oy@/M%ORB7V³G�bEOQM%S¦@*\gÅE\]OybÝ_]Gaf¯Oy@*\hÅ�MPO¯@/ÖyACf¤Å�_hX�´sG�\PAc_PAcGTB5F@/¹�_]OQM%V³G*MPMPOyV³_PAcGTB¡¹ÈG*M l�� Ó � @�B7b å �=l ò � OQMPMPG*Mh\Q;¤Ù�G*_]O¯_hXE@/_,_hX�O¤OQMPMhG*M>fmOy@*\hÅEMPOyb1GTB1_hX�O¯\]¶�I1AW\�V³G�\� ª l ;�è*ÔËG*¹_hXE@/_Ub�AW\P´7JW@yI*Oyb1X�OQMPO*;

k æ

Page 36: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO å æ�Ø(Þ|Þ|» G*¹HG�´sORB�Õ�JcG�G�´º_]Mh@*Vh¶�ACB�D�OQMhMPG*Mh\gACB3@/ÖyACf¤Å�_hX�Ff¯Oy@*\hÅ�MPOyb·ÅE\PACB�DÝ@�B3GTB�Õ�@�Ï�AW\m»Há�VQ@�fmOQMh@a¹ÈG*M_hX�O>D*Oy@/M�ORBEV³G�bEOQMy;9»UXEOgÅ7BEAc_P\UG*¹�\P´7@/_PAW@*J)¹ÈMPOyÇ�Å�ORBEV³IÎ@/MPOgbEOQD*MPOQOy\ bgf ;H»�X�O,_hX�MPOQOg´EMPGTfÃACB�ORB�_H´sOQMhAcG�b7\H@/MhO*ئ_hXEOMPOy\PAWb�ÅE@*JL¹ÈMPGTf _hX�Om\]OyV³GTB7bÝORBEV³G�b7OQM�D*Oy@/M,MPG*_P@/_PAcGTB�´sOQMhAcG�bÌÁ l ; ò bEOQD bgf G*M å �=l òJ� ÂPF5_hX�O¤MPOy\PAWb�Å7@*J)_]Mv@�BE\PJW@/_PAcGTBE@*JOQMPMPG*M9@/_¦_hX�O�f¯@*ACB(bEMhAc^*O�_]G�G*_hXÄ´sOQMhAcG�b1ÁêÔ�;�ægbEOQD bgf G*M l�� Ó l åHI � Â�@�BEb(_hX�O�_]G�G*_hXÄ´sOQMhAcG�bÃG*¹$_hXEON\]OyV³GTB7b(ORB7V³G�bEOQMD*Oy@/MgÁ åyò ;�ÔÃbEOQD bgf G*M l��=l æ*Ô � ÂP;XE@/Mvf¯GTBEAWVQ\gG*¹U_hXEAW\m´sOQMhAcG�bÆ@/MPOÎO³ÏE´�OyV³_]Oyb$;º»UX�OËMy;�fd;=\Q;3´7Ac_PVYX·OQMPMPG*Mh\¤¹�G*M¯@�\PACB�D�JcOdX�Oy@*bÌ@/MhO « l ; l Ô*æ�@/MhVQ\]OyVÁ�Ð7Mh\P_>XE@/Mvf¯GTBEAWV�Â�@�BEb l ; l�k è1@/MhVQ\]OyVaÁÜ\POyV³GTBEbÌXE@/MvfmGTB7AWV�ÂUGTB¡@R^*OQMh@/D*O*FSUAc_hX3\PAcDTBEAcÐ�VQ@�BT_¤b7A�ÑsOQMhORBEV³Oy\>[sOQ_�S�OQORBACBEb7Ac^�AWb�ÅE@*J�XEOy@*b7\Q;!¾¼X�ORB�@*JWJ�¹ÈGTÅ�MLX�Oy@*b7\$@/MPO�@y^*OQMh@/D*Oyb5FTXEGRS¦OQ^*OQMyF/_hX�Oy\]O�OQMPMhG*Mh\$@/MPOÅ7B7bEOQ_]OyV³_P@*[7JcONÁ « l ; l å @/MhVQ\]OyV@�BEb « l ; l Ô*æ¤@/MhVQ\POyV�MR;�fÎ;=\Q;WF�¹ÈG*M9Ð�Mh\]_�@�B7bÄ\POyV³GTBEbdXE@/Mvf¯GTBEAWVQ\QFTMhOy\P´sOyV³_PAc^*OyJcI�ÂP;¦?!@/MPD*O³Õ�\PVQ@*JcO%OQMPMPG*Mh\j@/MPO�O³ÏE´�OyV³_]Oyb¹�MPGTf _hX�O%f¯@�B�Å�¹Ü@*V³_hÅ�MhACB�D¤´EMPG�V³Oy\P\,Á�_hX�Oy\PO,S�OQMhO,VQ@*JWAW[EMh@/_]Oybd[sOQ¹�G*MPO�_hX�O�_P@*´sO�S¦@*\9Ð�_]_]Oyb�ÂPFE¹ÈMhGTf Å7B�OQ^*ORBËÐ7_]_PACBEDG*¹�_hX�Og_P@*´sO>_]GÄ_hX�Og_]OyJcOy\PV³G�´sO¯@�BEba¹ÈMPGTfÍ_hX�Og_P@*´sOUÉ0G�ACB�;N¾ Ac_hXÝB�GËVQ@*JWAW[EMh@/_PAcGTB�F5_hXEO¤fÃ@�Ï�ACf¤Å7f b�AW\PV³GTB�_PACB�ÅEAc_�IGTB1_hX�O¤¾Ê¿�»âS¦GTÅEJWb�[sOg@R^*OQMh@/D*Oyb¡_]G l ; k @/MvVQ\]OyVm@�BEbÝ\PVQ@*JcO(B�GTB�Õ�JWACB�Oy@/MhAc_PAcOy\,@/MPO¯B�GËS¦G*Mh\]O¤_hXE@�B1GTB�Om´7@/Mh_�ACBÔ l*l*l*l ;λUX�OÃÅE\PO¯G*¹jORf¯´7AcMhAWVQ@*J�JcG�G*¶�Õ�ÅE´¡_P@*[7JcOy\ÄÁÜACf¯´7JcORf¯ORB�_]Oyb3ACBÝ_hX�Oû e ÚÝ[�Å�_%B�G*_%I*OQ_>VQ@*JWAW[EMh@/_]Oyb5ÂN\hX�GTÅ7JWbJcOy@*bd_]Gm¹êÅ�MP_hXEOQMHACf¯´EMPG.^*ORfmORBT_P\Q;`µG�bEOyJW\H¹ÈG*MUACB7b7Ac^�AWb�ÅE@*J$X�Oy@*b7\9\hXEGTÅEJWbÎ@*JW\]GÃ[sO,ACBT_]MPG�b�ÅEV³OybÎACBËG*MhbEOQMU_]G¯@*JWJcGRS@/Mh[7Ac_]Mv@/MPIÄV³GTfg[7ACB7@/_PAcGTBE\H_]GÃ[sO%ÅE\POybÎACBÎVQ@*\]O%G*¹L¹Ü@*AWJCÅ�MPO*;

»UXEO%\hÅE´sOQMhAcG*MH_]Mv@*VP¶�ACB�D(´sOQMP¹�G*Mvf¯@�B7V³O�G*¹L_hXEO>@/ÖyACf¤Å�_hXË_P@*´sO%ORB7V³G�bEOQMNAW\UAWJWJCÅE\P_]Mh@/_]OybaACBµÞ|AcDTÅ�MPOy\ å èÃ@�BEb å éÁÜV³GTf¯´�@/MPO�ÞLAcDTÅEMPOy\ å Ó¯@�BEb å æ�F�BEG*_PACB�Dm_hX�O�VvXE@�BED*Oy\HG*¹)\hVQ@*JcO/ÂP;�»UX�O�_P@*´sO�ORBEV³G�bEOQMHAW\9¹�MPOQO�G*¹)G�[�^�AcGTÅE\H´sOQMhAcG�b7AWVV³GTf¯´sGTB�ORBT_P\HÁ�OQ^*ORB¤_P@*´sOH´7Ac_PVYX¤OQMPMPG*Mh\QÂ5@�B7b¤_hXEAW\|_]Oy\]_�D�Ac^*Oy\@�D*G�G�bmAWJWJCÅE\]_]Mh@/_PAcGTB¯G*¹�VyÅ�MPMhORB�_�´sOQMP¹�G*Mvf¯@�BEV³OjJWACf¯Ac_P\Å7BEb7OQM�G�´E_PACf¤Å7fßV³GTBEb�Ac_PAcGTBE\Q;�»UX�OUMy;�fÎ;=\Q;LOQMPMPG*M¦AW\ l ; å*å @/MhVQ\]OyV/FE\hÅ7´�OQMvACf¯´sG�\]OybgGTB¯@gfmOy@�BmbEMvAc¹È_�G*¹ l ; å Ô>@/MhVQ\]OyVACB k èÎf¯ACB�Å�_]Oy\Q;,ã�Å�MhACBED(_hXEAW\�´sOQMhAcG�b5Fs_hX�Om\]OQMP^*Gd´sG�\PAc_PAcGTBaOQMPMPG*M�Sj@*\ l ; l Ó ò @/MhVQ\]OyV¤MR;�fÎ;=\Q;�×]B1@*b7b7Ac_PAcGTB�F$\]GTf¯OV³GTBT_]MhAW[�Å�_PAcGTBa_]GËACf¯@/D*OmfmG*_PAcGTB·Á�^*OQMPIdMPGTÅ�DTX7JcI l ; l æ(@/MvVQ\]OyVgMy;�fÎ;=\Q;cÂÄV³GTfmOy\�¹ÈMPGTfÍ_hX�Og@/_hfmG�\P´�XEOQMPO*Fs\PGÄ@([�Oy\P_Oy\]_PACfÃ@/_]O(G*¹9_hX�OÄV³GTB�_]MvAW[�Å�_PAcGTBº¹ÈMhGTf \]I�\]_]ORf¯@/_PAWV(ORBEV³G�b7ACB�DdOQMhMPG*Mh\gAW\ l ; l ò @/MhVQ\]OyV(My;�fÎ;=\y;d»UX�O¯_P@*´sOÃORB7V³G�bEOQMAW\�@*JW\]GË\hÅE´sOQMhAcG*MNGTBaJW@/MhD*Og\PVQ@*JcOy\yØU_hX�OgMy;�fÎ;=\y;HMPOy\PAWb�Å7@*JW\NACB¥�1V³G�\e� ¹�MPGTf @(´sG�ACBT_PACB�DËf¯G�b7OyJ5Ð7_�@/MPO>_�I�´�AWVQ@*JWJcIl ; I @/MhVQ\POyV%@�BEb l ;�è¯@/MhVQ\]OyV/F�MhOy\P´sOyV³_PAc^*OyJcI*F�¹�G*MH_hX�O,D*Oy@/MN@�BEbµfmOy@�BÄ_P@*´sO,ORB7V³G�bEOQMv\Q;

»UXEO�_P@*´sONORBEV³G�b7OQMjAW\jVQJcOy@/MhJcIÄ\hÅE´sOQMhAcG*Mj@�BEbÄSUAWJWJs[�OyV³GTf¯O�_hXEON´EMvACf¯@/MPI¤ORBEV³G�b7ACB�D¤\]I�\]_]ORf ACBÃ@/ÖyACf¤Å�_hX(GTBEV³OAc_P\%\P_P@*[7JWAc_�I3@�B7b�MPOyJWAW@*[7AWJWAc_�IºXE@y^*OÄ[sOQORBݹÜÅ7JWJcI1_]Oy\P_]Oyb5;Ä<N\%@dMPOy\hÅEJc_P\%G*¹¦_hXEOÃ\]_hÅEbEIÝbEOy\PV³MvAW[�Oyb3ACB¡<�fmG�\�GHá ñ#� FÁ åyò*ò Ô�Â9@�BEbd\hÅ7f(f¯@/MhAW\POybÄX�OQMhO*FEORBEV³G�b7OQMh\9G*¹|_hXEAW\9_�I�´sO>XE@R^*O%[sOQORBÎ\]OyJcOyV³_]Oyba¹ÈG*MU_hX�O>KNORf¯ACB7A�_]OyJcOy\PV³G�´sOy\Q;

��i�hgi�� ² ��l®�PvPo�n��&m}l�m�wx�gqsn�mA�»UX�O9OyJcOQ^/@/_PAcGTBÄ@�Ï�AW\jXE@*\BEG*_[sOQORBm\hÅE[�É0OyV³_]Oyb¯_]Gg@*\bEOQ_P@*AWJcOybÄ@�Bm@�BE@*JcI�\PAW\¦@*\�_hX�O�@/ÖyACfgÅE_hXm@�Ï�AW\yF�´7@/Mh_PJcI¤[sOyVQ@�ÅE\POGTBEJcIÎGTB�O%ORBEV³G�b7OQM�AW\�Ð7_]_]Oyb5F�[�Å�_H@*JW\]GË[�OyVQ@�Å7\]O%Ac_P\N\]I�\P_]ORf¯@/_PAWV,OQMhMPG*Mh\U@/MhOgf¤ÅEVvXd\hf¯@*JWJcOQMy;j²|@/MP_NG*¹L_hXEO%MPOy@*\]GTB¹�G*MN_hX7AW\NAW\N_hXE@/_N_]Mh@�BE\hJW@/_PAcGTBE@*J|OQMPMPG*Mh\N@*V³_�@/D�@*ACBE\]_�D*Mh@R^�Ac_�I*F!@�BEb1@/MPOg_hX�OQMPOQ¹�G*MPO¯fgÅ7VvXaJcOy\P\�JWAc¶*OyJcIa_]GÎfmG.^*Og_hXEO

k è

Page 37: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO å è�Ø�»UX�OH@/ÖyACf¤Å�_hX¤V³GTfôsGTB�ORB�_�G*¹�ACf¯@/D*OUf¯G*_PAcGTB¯fmOy@*\vÅ�MPOybgSUAc_hXm@�B¤GTB�Õ�@�Ï�AW\�@*VQÇ�ÅEAW\PAc_PAcGTBÃVQ@�fmOQMh@�;�»UXEOfmOy@�B1G*¹¦_hX�O¤¹�GTÅ�M�_P@*´sOmORBEV³G�b7OQM,MPOy@*b7ACB�DdX�Oy@*b�\�S¦@*\>ÅE\]OybÝ_]GdbEOQMhAc^*Om_hXEO¯@/ÖyACfgÅE_hXÝ´�G�\hAc_PAcGTB�;m»UX�Omb�Å�Mh@/_PAcGTBG*¹�_hX�OÎ_]Mh@*Vh¶ÌS¦@*\ k è¡f¯ACB�Å�_]Oy\m@�BEbÌ_hXEOµACBEAc_PAW@*J9OyJcOQ^/@/_PAcGTB S¦@*\mÓTæ � F¦\]G�_hXEOdOQMPMPG*M(f¯Oy@*\hÅ�MPOybÆGTBÌ_hX�Oµ\]¶�I·AW\V³G�\e�|ª l ;�é¤G*¹L_hXE@/_Ub�AW\P´7JW@yI*Oyb1X�OQMPO*;

Þ|AcDTÅ�MPO å é�Ø�Þ|Þ|» G*¹!G�´�ORB�Õ�JcG�G�´Ä_]Mh@*Vh¶�ACB�DmOQMhMPG*Mh\¦ACB(@/ÖyACf¤Å�_hX5F�f¯Oy@*\hÅ�MPOybËÅE\PACB�Dg@�B(GTB�Õ�@�Ï�AW\9»Há�VQ@�fmOQMh@>¹�G*M¦_hXEOfmOy@�BÃG*¹!_hXEO�¹�GTÅ�Mj_P@*´sO�ORBEV³G�bEOQMUX�Oy@*b�\Q;�»UX�O�Å7BEAc_P\¦G*¹!\P´7@/_PAW@*J�¹�MPOyÇ�Å�ORBEV³I¯@/MPO�bEOQD*MhOQOy\ bgf ;�ÙUG*_]O�_hXEONVYXE@�B�D*O�G*¹\PVQ@*JcO>¹ÈMPGTf _hX�O�OyÇ�Å7Ac^�@*JcORBT_�´7JcG*_U¹ÈG*MH_hXEO,D*Oy@/MUORBEV³G�bEOQMy;

k é

Page 38: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO åHI Ø»�X�O�OyJcOQ^�@/_PAcGTBaV³GTf¯´sGTB�ORBT_jG*¹)ACf¯@/D*O%f¯G*_PAcGTB˹�G*MH@¤_]Mh@*VP¶�ACB�D¯_]Oy\]_H[sOQ_�S�OQORBdOyJcOQ^�@/_PAcGTBE\UG*¹)Ó òJ� @�B7bæ*è � ;_]OyJcOy\PV³G�´sO*;'»UXEOÄORB7V³G�bEOQMÃD*Oy@/Mh[sGyϸAW\¯@*JW\]G¡\PAcDTB7AcÐ�VQ@�B�_PJcI¸[sOQ_]_]OQM¯_hX7@�B·_hX�Od@/ÖyACf¤Å�_hXÆOyÇ�ÅEAc^�@*JcORBT_Q;'Þ|AcDTÅ�MPO åHI\hX�G.SU\9_hX�O%OyJcOQ^�@/_PAcGTBaV³GTf¯´sGTB�ORBT_9G*¹)_hXEO,_]Mh@*VP¶�ACB�D(_]Oy\]_UACBÎÞ|AcDTÅ�MPO å ÓE;

� � ±°+p�=Ë°)B4 ÊÂ)MËh°�®=Ë°)¦ª5±P¬�©L+�87:9 8 ����. #��!�T� �������! à�3���������E-ß5i!jei�j Ü�l�m�l��Sv�»UX�Om×]B�¹�G*Mvf¯@/_PAcGTB¡ãNAW\h´7JW@yI¡AW\>@µ\]OQ_,G*¹j_]O³Ï�_>´7@/D*Oy\¤ÅE´�b7@/_]Oyb�@/_ å ¿UÖ(S�XEAWVYX�bEOy\PV³MhAW[sOy\%_hX�OÃVyÅ�MPMhORB�_,\]_P@/_]OÄG*¹_hX�O�_]OyJcOy\PV³G�´sO*;�×�_P\9JW@yI*GTÅ�_HAW\9b7Oy\PV³MhAW[sOyb(ACBÄbEOQ_P@*AWJ5ACBÄ<N´7´sORBEb7A�Ï n @�BEbÄ_hX�O�´EMhOy\]ORB�_j\]OyV³_PAcGTBÎAW\jV³GTBEV³OQMYB�OybËGTBEJcISUAc_hX¡BEGTB�Õ�_]MhAc^�AW@*J�VQ@*JWVyÅEJW@/_PAcGTBE\QF�´7@/Mh_PAWVyÅEJW@/MhJcIÝ_hX�G�\]OÃACBT^*G�Jc^�ACB�DaJWACfÃAc_P\ÃÁÜ\]OyV³_PAcGTB·æ�;�Ô�ÂP;(»UX�OmG*_hXEOQM>@/MPOy@*\%S�G*MP_hXB�G*_PACB�D(@/MPO,_hX�O,VQ@*JWVyÅEJW@/_PAcGTBaG*¹L_]OyJcOy\PV³G�´sO~#·@�BEb�"g@�BEbµ@*AcM�f¯@*\P\y;

»UXEOU_]OyJcOy\PV³G�´sONMhAcDTX�_j@*\PV³ORBE\hAcGTB(@�B7bÃbEOyVQJWACBE@/_PAcGTBË@/MhOUGTBEJcIÃb�AW\P´7JW@yI*Oyb(S�X�ORB¯_hX�O�´�G�\hAc_PAcGTB¯OQMPMhG*Mh\�@/MhO�\hfÃ@*JWJÜ;»UX�O�MPOy@*\PGTBĹÈG*MH_hX7AW\9AW\j_hXE@/_9_hX�OQIË@/MPO,bEOQMhAc^*Oyb¡ÁÜACBÄ_hX�O%f¯Oyb7ACÅ7fÛ¹�MPOyÇ�ÅEORBEV³IôsG�ACB�_PACBED¯JcG�G�´�Â�¹�MPGTf _hX�O�í®GHè ñ àeí´sG�\PAc_PAcGTBE\QF�@/¹�_]OQM�fÃ@/¶�ACB�DÄ@Ã\hfÃ@*JWJ$V³G*MPMPOyV³_PAcGTB1¹�G*MN_hX�O>\]OQMh^*GÃOQMPMPG*MRFsACBdG*MhbEOQMN_]GÄ@R^*G�AWb1@(¹êÅEJWJ5MPOQ^*OQMh\PO>_]Mh@�B7\]¹ÈG*MPÕf¯@/_PAcGTB5;�Ú�ACBEV³ON_hX�O�OQMhMPG*Mh\¦@/MPO�ACB1ÁÜ\hJWAcDTX�_PJcI�Âb7A�Ñ�OQMPORB�_jV³G�G*Mhb7ACBE@/_]O�\]I�\]_]ORf¯\yF�_hXEAW\j@*´7´7MPGyÏEACf¯@/_PAcGTBÄ[EMPOy@/¶�\¦bEGRS�B¹Ü@/MH¹ÈMhGTf _hX�O,_]Mh@*Vh¶�ACB�D(V³GTBEb7Ac_PAcGTB�;Þ7G*M�\PACfÃAWJW@/M9MPOy@*\]GTBE\QF�_hX�OQMPO,@/MPO�MPOy\P_]MhAWV³_PAcGTBE\HGTBÎ_hX�O,V³G�G*Mvb7ACBE@/_]O%\]I�\]_]ORf ACBS�XEAWVYXË_hX�O�_]OyJcOy\PV³G�´sOg´�G�\hAc_PAcGTBµf¯@RI([sO,b7AW\P´�JW@yI*Oyb5F�@*\�bEOy\PV³MhAW[sOybÎACBÎ<N´7´sORBEb7A�Ï e ; åHI ;�»UXEO,´�G�ACBT_PACB�Dm_]Mh@�B7\]¹ÈG*MPÕf¯@/_PAcGTB7\U@/MPOgVQ@/MPMhAcOybdGTÅE_�ACBÎ_hXEO,G*MhbEOQMyØjfmOy@�BÎÞ8Û�ÓEF5fmOy@�BdÞ�Û>æ�F�D*OQG�V³ORB�_]MhAWV¤@*´7´�@/MPORB�_QF�_]G�´sG�V³ORBT_]MhAWVz $F&"TFs@*\bEOy\PV³MvAW[�OybaOy@/MhJWAcOQMy;�»UXEO>´sG�\PAc_PAcGTBÝf¯@RIµ[sO>b7AW\P´�JW@yI*OybÝACB1@�B�Iµ\PI�\]_]ORf bEG.S�BE\]_]MhOy@�fÍG*¹_hX�OgACB7´�Å�_�\PI�\]_]ORfdFs[�Å�_

k I

Page 39: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

B�G*_UACBÎGTB�O�MPOyÇ�ÅEAcMhACB�D¯@mMhOQ^*OQMh\]O%V³GTBT^*OQMh\PAcGTB�;»UXEOH¹ÈG*MYfgÅ7JW@%ÅE\]OybùÈG*Mj@*AcMjfÃ@*\P\�MPOyJW@/_PAc^*O�_]GgÖQORBEAc_hX(AW\�OyÇ�ÅE@/_PAcGTBÎé�;�æ�; k ÓgG*¹!`1Å�MPMv@yIdÁ åyòJI k Â�Mh@/_hX�OQM�_hXE@�B¯_hXEO

V³GTfÃf¯GTBEJcI�Õ�ÅE\]OybË\]OyV���;�87[6 � ���Ê�ê�1&(�5��� > ���s�����! ��»UX�O¤OuÕÃVQAcORBT_%´7JW@�B�BEACB�DËG*¹¦@Î\POyÇ�Å�ORB7V³OmG*¹�G�[7\POQMP^�@/_PAcGTB7\,bEOy´sORBEb7\NGTB1_hX�O¯@*[7AWJWAc_�IÝ_]GµVQ@*JWVyÅEJW@/_]OÃ_hXEO¤´sOQMhAcG�bÝG*¹_PACfmON@g_P@/MPD*OQ_9VQ@�B([sO�G�[7\]OQMP^*Oyb5FE\]_P@/Mh_PACB�D>¹�MPGTfÛ@%D�Ac^*ORBÄ_]OyJcOy\hV³G�´�O�´sG�\PAc_PAcGTB�;�»�XEAW\�AW\jV³GTfô7JWAWVQ@/_]OybÎACB¯_hXEONVQ@*\]OG*¹9@�B¡@*Jc_P@/ÖyACf¤Å�_hX·fmGTÅ7BT_,[�I1_hXEO¯¹�@*V³_>_hXE@/_%_hXEOÃ@/ÖyACf¤Å�_hX�@�BEb3MPG*_P@/_]G*Mgb7MhAc^*Oy\>XE@R^*OÃÐ�B7Ac_]O¯Mh@�B�D*Oy\>G*¹j_]Mh@y^*OyJÜ;»UX�O�¹�G�JWJcGRS�ACB�D(VQ@*JWVyÅEJW@/_PAcGTB7\NXE@R^*OgB�G*_H[sOQORBδ�ÅE[7JWAW\hX�OybËOyJW\POQS�X�OQMPO*F�@�B7bÎ@/MPO,_hX�OQMPOQ¹�G*MPO,D�Ac^*ORBµACBÎbEOQ_P@*AWJÜ;

ß5i�hgi�j ² ��l®�PvPo�n��&m Ö n��¶n[oWt×�_¤AW\¤VQJcOy@/M¯_hX7@/_¤@�BºG�[�É0OyV³_mAW\m@*JcS¦@RI�\Ã@*[�G.^*OÎ_hX�OÎX�G*MhAcÖQGTBÆJWACf¯Ac_¤Ac¹�"�� �¦�Â$¥���1@�BEbÆ@*JcSj@yI�\¯[sOyJcGRS�Ac_mAc¹" « $¥�r��;a»UX�Oy\]OÄbEOyVQJWACBE@/_PAcGTBE\¤@/MPOÀK,é å � Ô�Ó � @�BEb���æ å � Ô�Ó � F|MPOy\P´sOyV³_PAc^*OyJcI¡¹�G*M>_hX�O(¾ ¿N»�;|<NB¡G�[�É0OyV³_>SUAc_hXbEOyVQJWACBE@/_PAcGTB7\�[sOQ_�S¦OQORBÎ_hXEOy\]O�^�@*JCÅEOy\HMhAW\]Oy\U@*[�G.^*O%_hX�O�OyJcOQ^/@/_PAcGTB1JWACf¯Ac_H@/_U@�BµX�GTÅ�MU@�B�D�JcO��N 5F7SNX�OQMPO*Ø

V³G�\�z�ÊV³G�\"LV³G�\ UV³G�\&$=KÆ\hACB,")\hACBN$G*M ��¼@/MhVQV³G�\N� V³G�\&�T�¡\PACBN")\hACBN$V³G�\"LV³G�\&$ �@�BEbd\POQ_P\U@/_�X�GTÅEMH@�B�D�JcO~KT $;ß5i�hgi�h ����n�����oSp<�ÖyACfgÅE_hXÎAW\9D�Ac^*ORBaACBË_]OQMvf¯\jG*¹�X�GTÅ�M�@�B�D�JcO%@�BEbdb7OyVQJWACBE@/_PAcGTBµ[�IÄ_hX�O�O³Ï�´7MPOy\P\PAcGTBE\UACBµÚ�OyV³_PAcGTB1Ô�;»UX�OQMPOQ¹�G*MPO*Øv=� _P@�B,� � �d\PACB, UV³G�\&"

\PACB,"LV³G�\&$���V³G�\&"LV³G�\ H\hACBN$Ú�Ç�ÅE@/MhACB�Dm_hX7AW\9OyÇ�Å7@/_PAcGTBÎD�Ac^*Oy\N@¯Ç�Å7@*bEMh@/_PAWV�ACB*�M�ÊV³G�\& 5Ø��� ` Kt�C�sK�Q � lS�X�OQMhO � � V³G�\ ` "�Á å K0v ` \PACB ` $$Â� � �UÔ�v ` \PACBM"LV³G�\e"L\PACBN$�V³G�\5$Q � v ` V³G�\ ` $�\PACB ` "V��V³G�\ ` "»UX�O,b�AW\PV³MhACf¯ACB7@�B�_jG*¹|_hXEAW\9OyÇ�ÅE@/_PAcGTBdAW\yØ� ` ��Ó���Q � Ó�V³G�\ ` "c§�v ` ÁÜV³G�\ ` "��¡V³G�\ ` $$Â&KÆV³G�\ ` "u©<�BËG�[�É0OyV³_�àG���Guï�ORBEV³GTÅ7BT_]OQMh\U@�Bd@/ÖyACfgÅE_hXÎJWACf¯Ac_UAc¹

V³G�\&" « � \PACB,�1V³G�\&$ �G*M "o�¸@/MhVQV³G�\.Á � \hACB,�aV³G�\g$ � Â

k ò

Page 40: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

¹�G*M¤@a_]OyJcOy\PV³G�´sOÎACB¡_hXEOÄÙ�G*MP_hX�OQMvBÆX�ORfÃAW\P´�X�OQMhO*;µ»UX�O(¾ ¿N»�í=\¤´sG�\PAc_PAc^*OÎ@/ÖyACfgÅE_hX3JWACfÃAc_gAW\¤\]OQ_¤@/_m< � k æ*æ � FS�XEAWVYX1V³G*MPMPOy\P´sGTBEb7\U_]GÎ@(bEOyVQJWACB7@/_PAcGTBÝG*¹ "�� I æ � è*Ô � ;�ÞEG*M,bEOyVQJWACB7@/_PAcGTBE\�JcOy\P\N_hXE@�Ba_hXEAW\N^�@*JCÅEO*Fs_hXEOgÇ�ÅE@*bEMh@/_PAWVXE@*\9_hXEO%\]G�JCÅ�_PAcGTBE\yØ

�� X @/MhVQV³G�\�¡ v®`�\PACBN")\hACBN$�V³G�\&$ X §�v�`�ÁÜV³G�\Ì`�"��¡V³G�\°`�$$Â5K·V³G�\¡`�"u© f¼» `/ÂV³G�\"�Á å Ktv ` \PACB ` $$ ¢

»UX�OmÐ�Mh\]_ X ACBÝ_hX�O¯\PG�JCÅ�_PAcGTB�MPOy\vÅEJc_P\�¹�MPGTf _hX�Om¹Ü@*V³_%_hXE@/_�S¦O(XE@R^*OÄÅE\POyb�@�BÝOyÇ�Å7@/_PAcGTB�¹�G*M%V³G�\ º@�BEb�VQ@�B7B�G*_b7AW\]_PACBEDTÅEAW\hX,[sOQ_�S�OQORBg´sG�\PAc_PAc^*Oj@�BEb>B�OQD�@/_PAc^*OHX�GTÅEM)@�B�D�JcOy\Q;�»UXEO�@�fg[7AcDTÅEAc_�I,VQ@�B%[sO�\PG*MP_]Oyb%GTÅE_)[�I,ACBE\P´sOyV³_PAcGTB,G*MfmG*MhO�¹ÈG*MvfÃ@*JWJcIÄ[�IdB�G*_PACB�D¯_hX7@/_QF�\PACBEV³O>\PACB,� �{�dV³G�\&"L\PACBM �L\hACBM�¯S�Ac_hX¦�M���/Ôr£Â"�£r���/Ô¯@�B7b l £Â�r£¨���/Ô�F\PACB,� @�BEb¡\hACBM 3f¤ÅE\]_,XE@R^*OÃG�´7´sG�\PAc_]O¯\hAcDTBE\Q;¯»UX�O¯\POyV³GTBEb X G�VQVyÅ�Mh\,[sOyVQ@�ÅE\POÃ@�BÝG�[�É0OyV³_>f¯@RI1´�@*\P\�_hX�MPGTÅEDTX_hX�Om\P@�f¯Og@/ÖyACf¤Å�_hXa_�S�AWV³O*;>»UX�Og_]OyJcOy\PV³G�´sOmSUAWJWJÜF!X�G.S�OQ^*OQMRF![sOgfmG.^�ACBEDËACBaG�´7´sG�\PAc_]Omb7AcMhOyV³_PAcGTBE\�ACB1@/ÖyACfgÅE_hXaACB_hX�O,_�S�G(VQ@*\]Oy\�@�B7bÎ@¯JWACf¯Ac_9¹�G*Mh[7AWb7\�fmG*_PAcGTBËGTBEJcIËACBËGTB�O%G*¹)_hX�Oy\PO*;

×]B�_hX�OVQ@*\PO�G*¹�_hX�O�¾Ê¿�»�FR_hX�O�´sG�\PAc_PAc^*O�@�BEb>B�OQD�@/_PAc^*O¦JWACfÃAc_P\$@/MPO@/_)<}� k æ*æ � @�BEb,<r��� å é/æ � F�MPOy\P´sOyV³_PAc^*OyJcI*;»UX�O,@/ÖyACf¤Å�_hXÎ^*OyJcG�VQAc_�IµAW\9D�Ac^*ORBa[TIsØ

� y �Ê\hACBN$�� V³G�\&$�V³G�\�V³G�\Q�\hACBM�»UX�O�@/ÖyACf¤Å�_hXËG*¹|@�BËG�[�É0OyV³_H@/_U<{� � å é/æ � _hX�OQMhOQ¹ÈG*MPO,@*JcSj@yI�\~E[à(¤Wï�G ñ�æ G æ S�Ac_hXÄ_PACfmO,@�BEbË_hX�O%BEOQD�@/_PAc^*O>JWACf¯Ac_HAW\AcMPMPOyJcOQ^/@�BT_�¹ÈG*M%B�G*MYf¯@*J$_]Mv@*VP¶�ACB�DE;g»�X�Og´sG�\PAc_PAc^*O¯JWACfÃAc_�VQ@�B1GTBEJcIa[sOgORBEV³GTÅ7BT_]OQMPOybÝS�X�ORBa_]Mh@*Vh¶�ACB�Dd@ËÙ�G*MP_hX�OQMvBG�[�É0OyV³_U[sOyJcGRSà_hX�O,²LG�JcO>@�BEbÎ_hX7AW\HV³G*MPMPOy\P´sGTBEb�\j_]G¯_hX�O%\]G�JCÅE_PAcGTB�Ø

�� KÝ@/MhVQV³G�\ ¡ v�`5\PACBM"L\PACBM$�V³G�\g$¤��§�v®`�ÁÜV³G�\¡`5"��¡V³G�\¡`�$$Â&KÆV³G�\Ì`g"H© f¼» `V³G�\"�Á å Ktv ` \PACB ` $$ ¢

Z�[�É0OyV³_P\,[sOyJcGRSÛ@ÎV³OQMP_P@*ACB�bEOyVQJWACBE@/_PAcGTB¡SUAWJWJ|ORBEV³GTÅ7BT_]OQM%_hXEOmXEG*MhAcÖQGTB�JWACf¯Ac_�Ð�Mh\]_Q;g¾�O¯OyÇ�Å7@/_]Om_hX�OmO³Ï�´7MPOy\P\PAcGTBE\¹�G*MjV³G�\& ËbEOQMhAc^*Oyb˹�G*Mj_hX�O�OyJcOQ^/@/_PAcGTBÎ@�BEbË@/ÖyACf¤Å�_hXÄJWACf¯Ac_P\y;|»�X�O�MhOy\hÅEJc_PACB�DgOyÇ�Å7@/_PAcGTBÄMPOyb�ÅEV³Oy\¦_]Gm@¤Ç�ÅE@*b7Mh@/_PAWV�ACB"V�Ê\PACBM"TØ �o" ` K0¥[" Km¦ � lS�X�OQMhO

� � å K0v `¥ � �UÔ|V³G�\��\PACBN$LÁ å K0v ` ¦ � V³G�\ ` �7Á å Ktv ` \PACB ` $$ÂA�3V³G�\ ` $ÞEG*Mm_hX�O˾ʿ�»,F|< � k æ*æ � F�Ö�� I l � @�B7b}$Â� Ô I � é/è � ;¡»UX7AW\>D�Ac^*Oy\¯_hX�OÎ\]G�JCÅ�_PAcGTB}"¥� é l�� è*è � ;¡¿UORBEV³OÎ_hXEO@/ÖyACf¤Å�_hX¯JWACfÃAc_AW\�GTB7JcImMPOyJcOQ^�@�BT_¹�G*M�b7OyVQJWACBE@/_PAcGTBE\j[sOQ_�S¦OQORB(é l�� è*è � @�BEb I æ � è*Ô � S�X�ORBm_]Mv@*VP¶�ACB�D>[sOyJcGRS _hX�OU²LG�JcO*;ß5i�hgi�� Ð pAlY�xlcm8n[oSpZ���!n�mAqrtWés�eo»UX�O�V³GTBEb�Ac_PAcGTBι�G*MH_hX�O�_]Mh@*Vh¶�ACB�D(\P´sOQOybÎACBÎ@/ÖyACf¤Å�_hXË_]GmO³ÏEV³OQOybdáßAW\,^ � kx�T�#k® � �Z§¯FES�X�OQMhOT^ÝAW\H_hX�O,_]Mh@*Vh¶�ACB�DMh@/_]O�ACBÄX�GTÅ�Mj@�B�D�JcO¯Á å æ>@/MvVQ\]OyV�\ bgf ÂP;�¾�O�bEOQÐ�B�O � � X § �S^(Á�� X Ô�Ó l ¹�G*Mj_hX�ON¾ ¿N»�F�_hX�ON\hAcDTB([sOyACB�DmB�OQD�@/_PAc^*O_]GÎ_hX�O¯Ù�G*MP_hXÝG*¹¦_hX�OmÖQORBEAc_hX�@�B7b�´�G�\hAc_PAc^*O¯_]GÎ_hX�O(Ú�GTÅ�_hX�Â9@�B7b�\]G�Jc^*O¯_hX�OmOyÇ�ÅE@/_PAcGTB�k®�V�#k� U� � ¹�G*M,V³G�\ �_]GD�Ac^*O%_hXEO%X�GTÅ�MU@�B�D�JcO>@/_HS�XEAWVYXÎ@�BÎG�[�É0OyV³_HORBT_]OQMh\H_hXEO,[7JWACBEbd\P´sG*_Q;� � k®�V�#k� � V³G�\ D V³G�\"��L\PACB2�� V³G�\&"�ÁÜV³G�\5"L\PACBN$��¡\PACBM"LV³G�\5$UV³G�\&

å �'ÁÜV³G�\&"LV³G�\ HV³G�\g$LKÆ\PACBM"L\PACBM$$Â `Ó l

Page 41: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

»UXEAW\UVQ@�BÎ[sO�MPOQSHMhAc_]_]ORBÎACBÎ_hX�O,¹�G*MvfÎØ ¨ � ` K��_�BKZ©¥� lS�X�OQMhOÃÁÜ@*\U[sOQ¹ÈG*MhO/ª�M�ÊV³G�\ µ@�BEb ¨ � K � V³G�\ ` "LV³G�\ ` $� � V³G�\"L\PACBM"LV³G�\5$(ÁêÔ � \PACBM$�� å © � V³G�\ ` "L\PACBN$�� � K � \PACB ` "L\PACB ` $»UX�O�MhOyJcOQ^�@�BT_�\]G�JCÅE_PAcGTBE\H@/MPO*Ø

V³G�\ �� \PACBM"�Á å �ºÔ � � � \PACB�$5 X ÁÜ\PACB ` "���Ó � � � \hACB2$=K·Ó � `� f¼» `X Ô � � � V³G�\5"LV³G�\&$S�X�OQMhO�_hX�OzKâ@�BEbZ��\PAcDTBE\9MPOQ¹�OQMU_]GÃG�[�É�OyV³_P\�´7@*\P\PACBED(Ú�GTÅ�_hXÎ@�BEbÎÙ�G*MP_hXdG*¹)_hX�O%ÖQORBEAc_hX�F7MPOy\h´�OyV³_PAc^*OyJcI*;

Ú�G�JCÅE_PAcGTBÆG*¹U_hXEAW\¯OyÇ�ÅE@/_PAcGTB¸V³GTB�Ð7MvfÃ\%_hXE@/_¯@�\hACf¯´7JcOÎ@*´7´EMhGyÏEACf¯@/_PAcGTBÆAW\m\hÅ�Õ(VQAcORB�_m_]G�D�Ac^*Od_hXEOÎMh@�B�D*OÎG*¹bEOyVQJWACBE@/_PAcGTB7\US�X7AWVvXÎAW\H@�Ñ�OyV³_]Oyb1[TIÄ_hX�O,ÖQORBEAc_hXd[7JWACBEbd\P´sG*_Q; e JcG�\PO,_]G¯_]Mh@�BE\hAc_QØkx�T�#k® ½ªÊV³G�\5$&�L\hACB$Á!"V�U$$Â\]G¤_hX�O�V³GTBEb7Ac_PAcGTB � k®�V�#k� � � � � � D�Ac^*Oy\ � ",�¥$ ��« V³G�\&$5� � ;Þ7G*M9_hX�O�¾ ¿N»�F�_hXEAW\9V³G*MPMPOy\P´sGTBEb�\_]G�"T� $ X l�� Ô åH�G*MHÔ I � æ*æ �T« " « Ô I � ò é � ;�×0BÃ_hX�OUS¦G*Mh\]_jVQ@*\]O*FE_hX�O�@/ÖyACf¤Å�_hXÃ^*OyJcG�VQAc_�I(Ð7Mv\]_O³ÏEV³OQOyb7\ å bEOQDg\ bgf @/_9@�B(X�GTÅEM¦@�B�D�JcOG*¹ î�k å \QF7\]Gm¹�G*MH@*JWJ5´EMh@*V³_PAWVQ@*J!´�Å�Mh´sG�\]Oy\¦Ac_HVQ@�BÎ[sON_hXEGTÅ�DTX�_9G*¹|@*\jORBT_]OQMhACB�D¯_hX�O�[7JWACB7bÎ\P´sG*_¦O³ÏE@*V³_PJcIÎ@/_9_]Mh@�BE\PAc_Q;»UX�O�_]OyJcOy\hV³G�´�O>SUAWJWJ5_hX�ORBÎMPG*_P@/_]O>@*\UMh@*´7AWb7JcIË@*\U´sG�\P\PAW[�JcO,ACBËG*MhbEOQMH_]G(@*VQÇ�ÅEAcMhO,_hX�O,G�[�É0OyV³_�@/_U_hX�O,G*_hX�OQMU\hAWbEO,G*¹_hX�O%[�JWACBEbÎ\P´sG*_Q;�»UXEAW\9_P@/¶*Oy\�MPGTÅ�DTX7JcI k fÃACB�Å�_]Oy\U@/_H¹ÜÅ7JWJ5\P´sOQOyb5;

ß5i�hgi�� ���eoWvPo�n��&m��!n���n[oWt¾�OË\]_P@/MP_%¹�MPGTf _hX�OÃO³ÏE´EMPOy\P\hAcGTBE\,MPOyJW@/_PACBED1\]¶�I�@�BEbºf¯GTÅ7BT_%´sG�\PAc_PAcGTB3@�BED�JcOy\>@�BEbº´7@/Mh@*JWJW@*V³_PAWVË@�B�D�JcOÄD�Ac^*ORB3ACBÚ�OyV³_PAcGTBÄÔ�;�»UX�OH^/@/MhAW@/_PAcGTB(G*¹$´7@/Mh@*JWJW@*V³_PAWV�@�B�D�JcO�SUAc_hXÄX�GTÅ�M@�B�D�JcON¹�G*M^/@/MhAcGTÅE\¦bEOyVQJWACBE@/_PAcGTBE\jAW\\vX�GRS�BÃACB¯Þ|AcDTÅ�MPOåyò ;9»UX�O%´�@/Mh@*JWJW@*V³_PAWV¤@�B�D�JcO>AW\�Å7BEbEOQÐsB�OybÎ@/_U_hX�O%ÖQORBEAc_hXºÁ!"z�*$!F& ½� l ¦@�BEbµ_hX�O>BE@*b7AcM¤Á!"��{��$$F5 ½� �LÂP;j×]B_hX�O%\h´�OyVQAW@*J!VQ@*\]Oy\ D � l @�BEb D ���|FE_hX�OgX�GTÅ�MH@�B�D�JcOgAW\9D�Ac^*ORBd[�I�ØD � l � �� l ¹�G*M�" « $a@�BEb� �����¹�G*M2"o� �2$!;D ��� � �� l ¹�G*M2"o��$1@�BEbÀ ����ݹÈG*MV" « �2$!;e Å�Mh^*Oy\9G*¹ D Á! �Â�ÁÜÞLAcDTÅEMPO åyò ¦´�@*\P\9_hX�MPGTÅEDTXË_hX�O�¹�G�JWJcGRSUACB�DÄ´sG�ACB�_P\QØ ����|F D �ü�¡@�BEb� �� l F D � l ¹�G*M2" « �2$!; ����|F D � l @�BEb� �� l F D � l ¹�G*M��2$ « " « $!; �� l F D � l @�BEbÀ ����|F D � l ¹�G*M2"o��$!;

ã�Å�MhACBED>@%\hAWbEOQMPOy@*J�_]Mh@*VP¶sFE@,D�Ac^*ORBÄ´7@/Mh@*JWJW@*V³_PAWV�@�B�D�JcO�f¯@RI¤G�VQVyÅ�M¦GTBEV³O*F�_�S�AWV³O�G*M9B�G*_j@/_�@*JWJÜ;»UXEOUV³GTBEb7Ac_PAcGTB¹�G*M l G*MHÔ%\]G�JCÅE_PAcGTBE\jAW\�_hX7@/_�_hX�O�¹ÜÅ�BEV³_PAcGTB D Á! �ÂXE@*\�O³Ï�_]MPORf¯@�;�×�_P\�b7OQMhAc^�@/_PAc^*O,@/_j@¤f¯@�ÏEACfgÅ�fâG*MHf¯ACBEACf¤Å7fßAW\yØ

D y Á! �Â8�{�dV³G�\&$�V³G�\e�T�L\PACBM�~� lD�Ac^�ACB�DË_hX�Og\PG�JCÅ�_PAcGTBE\�V³G�\e�|� l G*M�<0� X ���/Ô�;�»UX�O>O³Ï�´EMhOy\P\PAcGTBa¹ÈG*M�V³G�\Q�ïD�Ac^*ORBÝACBÝÚ�OyV³_PAcGTB1Ô(VQ@�BÝ[sOgÅE\POyb_]G¯MPOyb�ÅEV³O�_hXEAW\H_]GEØ

V³G�\ �� _P@�BM"��)_P@�BV$Ó å

Page 42: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO åyò ØU»UX�O>^�@/MvAW@/_PAcGTBµG*¹�´7@/Mh@*JWJW@*V³_PAWV¤@�B�D�JcO¤SUAc_hX1X�GTÅ�M�@�BED�JcOg¹�G*MN_hX�OgJW@/_PAc_hÅ7bEO>G*¹_hX�O>?)@(²|@*JCf¯@ÎZ�[7\POQM]Õ^/@/_]G*MPI*; e Å�MP^*Oy\�@/MhOô7JcG*_]_]Oyb�¹�G*M%bEOyVQJWACBE@/_PAcGTB7\,G*¹V�9ÓTæ � FC� k/l � FC� å æ � F l � F å æ � F k/l � F!ÓTæ � F)è l � FLé/æ � @�BEb ò l � ;»UX�OÄVyÅ�MP^*Oy\g@/MPOÄGTBEJcI¡´7JcG*_]_]Oybƹ�G*M>G�[7\POQMP^�@*[�JcOÃOyJcOQ^/@/_PAcGTBE\dÁ«� å l � ÂP;aãNOyVQJWACBE@/_PAcGTBÆACBEV³MPOy@*\POy\¤Å7´TSj@/Mhb7\gACB¡_hXEO_]G�´�Õ�MhAcDTXT_�Ç�ÅE@*bEMv@�B�_H@�BEbÎb7GRS�BTS¦@/Mvb7\HACBË_hX�O>[�G*_]_]GTfmÕ�JcOQ¹È_�Ç�ÅE@*b7Mh@�B�_Q;

ÓTÔ

Page 43: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

S�XEAWVYXËGTBEJcIdXE@*\H\PG�JCÅ�_PAcGTBE\UAc¹_�2$A£¨"o£�$!;»UXEO%f¯@�ÏEACfgÅ�fÒG�VQVyÅ�Mh\H¹ÈG*M2 A� l ÁÜ<Ù�|���/Ô�ÂPFs\]G\PACB D �|�dV³G�\5$�\PACB,�T�LV³G�\"T�ÊV³G�\&$5�LV³G�\5"

@�BEbÎ_hXEO%f¯ACBEACf¤Å7f @/_2 « l ÁÜ<Ù�|���/Ô�ÂPF�\PG\hACB D �{�dV³G�\$5�LV³G�\&"

¿�ORBEV³O*Ø| »�X�OQMPOU@/MPOzà(¬U\PG�JCÅ�_PAcGTBE\¦Ac¹8��$$£�"�£Â$Ä@�BEb � D � « ���/Ô�F�\PACB D �¸V³G�\$5�LV³G�\&"NG*M¦\PACB D « �dV³G�\$5�LV³G�\5"�;| »�X�OQMPO,@/MPO¤á9­�¬%\]G�JCÅ�_PAcGTBE\�Ac¹ ��$i£¨"o£�$a@�BEbZ�dV³G�\5$&�LV³G�\&" « \PACB D « V³G�\&$5�LV³G�\&"�;| »�X�OQMPO,AW\�¬xàG9\]G�JCÅE_PAcGTBdAc¹B"o��$µG*M2" « �2$!;×]B¡G*Mhb7OQM>_]GÝbEOQ_]OQMvfÃACB�OÃ_hX�OËX�GTÅ�M¤@�B�D�JcOËV³G*MPMPOy\P´sGTBEb7ACBEDµ_]GÝ@µD�Ac^*ORB·´7@/Mh@*JWJW@*V³_PAWVÎ@�BED�JcOË@�B7bºbEOyVQJWACB7@/_PAcGTB�F�S�O\]_P@/MP_U¹ÈMPGTf _hX�O�MPOyJW@/_PAcGTBE\�¹ÈG*M�\PACB D @�BEbÎV³G�\ D D�Ac^*ORBÎOy@/MhJWAcOQMR;�»UX�Oy\PO�D�Ac^*O*Ø

® � _P@�B D � V³G�\5$�\PACBM ÁÜV³G�\"L\PACB2$¤�3\PACBM"LV³G�\&$�V³G�\ 5Â

»UXEAW\HMPOyJW@/_PAcGTBdVQ@�Bµ@/D�@*ACBd[sO,\PÇ�ÅE@/MPOybd@�BEbËMhOy@/MPMh@�B�D*Oybµ_]G¯D�Ac^*O>@mÇ�ÅE@*bEMh@/_PAWV%ACBÎVz�âV³G�\& 5دD� ` K�°ª�sK0�¹� lSUAc_hX ¯ �ßÁ å K ® ` \PACB ` "�ÂTV³G�\ ` $°��|�UÔ ® ` \hACBM"LV³G�\"L\PACBM$�V³G�\&$� � ® ` V³G�\ ` "L\PACB ` $���V³G�\ ` $»UX�OQMhO,@/MPO>B�G¯\]G�JCÅE_PAcGTBE\UAc¹±°C`,�ÝÓ�¯D� « l F7S�X7AWVvXËMPOyb�ÅEV³Oy\9_]GEØ

\PACB ` D � V³G�\¡`�$V³G�\ ` "

@*\U[sOQ¹�G*MPO*;�ZN_hX�OQMhSUAW\]O*FE_hX�O%´sG�\P\hAW[7JcO,\]G�JCÅ�_PAcGTBE\�@/MPO*Ø

�� X @/MhVQV³G�\�¡ ® ` \PACBM"LV³G�\e"L\PACBN$ X § ® ` ÁÜV³G�\ ` $��¡V³G�\ ` "�ÂgKÆV³G�\ ` $P© f¼» `V³G�\5$)Á å K ® ` \PACB ` "� ¢

<N\USUAc_hXa@/ÖyACf¤Å�_hX�F�_hX�OgÅE\PO%G*¹�@�BµOyÇ�ÅE@/_PAcGTBa¹�G*MNV³G�\& aSUAc_hXd_]OQMYf¯\UACBµ_P@�B ` D ACBT_]MPG�b�ÅEV³Oy\�@�fg[7AcDTÅ7Ac_PAcOy\¤Á D @�B7bXVD K��g�ÝD�Ac^*O%_hX�O,\h@�fmO�^/@*JCÅ�O,G*¹|´Î¹ÈG*M�@�B�IÎACBT_]OQD*OQM�BsÂP;�»�X�O,\PAcDTBËG*¹|_hX�O,@/MhVQV³G�\�¹êÅ7BEV³_PAcGTBÎAW\Hb7OQ_]OQMvf¯ACB�OybÎ[�IB�G*_PACB�Dµ_hXE@/_~ « l Ac¹ D « l @�BEbU m� l Ac¹ D � l ;(¾�OÃ_hX�OQMPOQ¹�G*MPO¯_P@/¶*OÀKÝ@/MhVQV³G�\%¹ÈG*M D � l @�B7br�d@/MhVQV³G�\¹�G*M D « l ;N»UX7AW\�JcOy@R^*Oy\�_hX�O¤´�G�\hAc_PAc^*O¤@�B7b1B�OQD�@/_PAc^*OmMhG�G*_P\NG*¹�_hX�O¤Ç�ÅE@*bEMh@/_PAWV/;�ÞEG*M�"%�ü$!F5Ac_�AW\�G�[�^�AcGTÅE\N¹ÈMPGTfÞ|AcDTÅ�MPO åyò _hXE@/_m_hXEOQMPOdAW\¤GTBEJcI·GTB�Od\]G�JCÅ�_PAcGTBƹ�G*M¯@ÝD�Ac^*ORBÌ´7@/Mv@*JWJW@*V³_PAWVµ@�B�D�JcO*;Æ×]B3¹Ü@*V³_QF¦¹ÈG*M l £ D £ �Ê_hXEOMPG�G*_P\�V³G*MPMPOy\P´sGTBEbµ_]GË´�@/Mh@*JWJW@*V³_PAWVm@�B�D�JcOy\ D @�BEbY��� D ;,Ú�ACf¯AWJW@/MhJcIι�G*M·" « ��$$F8�M��£ D £ l @�BEba_hX�OgMPG�G*_P\V³G*MPMPOy\h´�GTB7bÎ_]G D @�BEbZ� D �Z�|;j»UX�O,\PAc_hÅ7@/_PAcGTBd¹�G*Mz�2$i£Â"�£Â$1AW\�b7A�ÑsOQMhORB�_QئOyAc_hX�OQMU_hXEOQMPO>@/MPOgB�G¯MPG�G*_P\>ÁÜ\]OQO@*[sGR^*O/¦G*MU[sG*_hXËMPG�G*_P\HV³G*MPMPOy\P´sGTBEbd_]G¯_hX�O æ�ñ è=GU´7@/Mh@*JWJW@*V³_PAWVg@�B�D�JcO*;

×�¹ D � X ���/Ô�F�´Q`=²´³ @�BEbË_hXEO,MPG�G*_P\UfmOQMPD*O*;×0BÄ_hXEAW\�VQ@*\]O*F

�� X @/MhVQV³G�\�Á X _P@�BN$5�)_P@�B�"*ÂSUAc_hXË_hXEO%\P´sOyVQAW@*J$VQ@*\]Oy\� �� X ���/Ô¯@/_U_hX�O,²LG�JcOy\Q;

Ó k

Page 44: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|ACBE@*JWJcI*F�S�O%V³GTB7\PAWbEOQMH_hX�O>\]ORBE\]O�G*¹|MPG*_P@/_PAcGTB�;

DCy Á! 5Â8�|� V³G�\5$�V³G�\e�\PACBN� �|� V³G�\&$�\PACB2$UV³G�\&"\PACB ` � µ _P@�B2"_P@�B2$ �¡V³G�\ 4¶×�_�AW\¦VQJcOy@/M¦¹�MPGTfï_hXEAW\OyÇ�ÅE@/_PAcGTBÃ_hXE@/_ D y Á! �Â�AW\@*JcSj@yI�\ « l ¹�G*M,"��ÂK·$Ä@�BEb$� l ¹�G*M " « �2$!;�ÞEG*MjACBT_]OQMvfmOyb7AW@/_]ObEOyVQJWACBE@/_PAcGTB7\QF�_hX�O¡Ç�Å7@*bEMh@/_PAWV¡XE@*\Ë_�S�GÌ^/@*JWAWb"\]G�JCÅ�_PAcGTB7\Q; »�X�O�V³GTBEb7Ac_PAcGTBÊ_hXE@/_dAc_P\µb7AW\PV³MhACfÃACBE@�B�_ËAW\ÎÖQOQMPG¸AW\V³G�\ |�ä_P@�BN"��)_P@�BV$!; »UX�ÅE\(_hX�OÝ´�G�\hAc_PAc^*O1MhG�G*_ÎXE@*\ÄV³G�\ ·� _P@�BM"��)_P@�B�$!FN\]G D y � l ; e GTB�^*OQMv\]OyJcI*F�_hXEOB�OQD�@/_PAc^*O¤[EMh@�BEVYXÎXE@*\HV³G�\& « _P@�BN"��)_P@�BV$1@�BEb D y « l ;

»UXEOJWACf¯Ac_!V³GTB7b7Ac_PAcGTBE\!@/MhO�@*\$¹�G�JWJcGRS�\¦ÁêB�G*_]O�_hXE@/_!_hXEO�fmGTÅ7BT_$²�<Ì@�BEb,´7@/Mv@*JWJW@*V³_PAWV¦@�BED�JcO�ACBEV³MPOy@*\PO�ACB�G�´�´�G�\hAc_]O\]ORBE\POy\³ÂPØ

"o��$ D y « l ¹�G*MÄ@*JWJ�X�GTÅ�MË@�B�D�JcOy\QFU\PGº_hX�O1MPG*_P@/_]G*MÎVQ@�B GTBEJcI¸_]Mh@*Vh¶'ACBT_]G·_hXEOa´sG�\PAc_PAc^*O¡fmGTÅ7BT_ò�< JWACfÃAc_Q;ÚEACBEV³Om_hX�O¤MPG*_P@/_PAcGTB¡AW\,f¯GTB�G*_]GTBEAWV/F5_hX�O¯JWACfÃAc_�SUAWJWJ|OQ^*ORB�_hÅ7@*JWJcIÝ[sOgMPOy@*VvXEOyb�¹ÈMhGTf @�B�IÝ\]_P@/MP_PACB�Dd´sG�\PAc_PAcGTB´7MPGR^�AWbEOyb¤_hXE@/_�_hX�Oj_]OyJcOy\PV³G�´sOUAW\�BEG*_�\]_]G�´7´sOyb¤[TI>_hX�OH@/ÖyACf¤Å�_hX>G*M�X�G*MhAcÖQGTB¤JWACfÃAc_QF*Oy@*VvX¯V³GTfô7JcOQ_]O9MPG*_P@/_PAcGTB_P@/¶�ACB�DËÔ�ÓÄX�GTÅ�Mv\Q;�×�_UAW\U´sG�\P\PAW[�JcO,¹ÈG*MU_hX�O,_]OyJcOy\PV³G�´sOg_]G¯_]Mh@*VP¶dV³GTBT_PACB�Å�GTÅE\PJcIdAc¹B"�� I æ � è*Ô � FsACBËS�XEAWVYXdVQ@*\]O_hXEOdJcORB�D*_hXÌG*¹N_hX�OÎG�[7\]OQMh^�@/_PAcGTB'AW\mMPOy\]_]MhAWV³_]Oyb'GTBEJcIÆ[TI·_hX�Od´sG�\PAc_PAc^*Oaf¯GTÅ7B�_m²�< JWACf¯Ac_dÁÜ@*b�fÃAc_]_]Oyb7JcIÌ@\PGTfmOQS�XE@/_j@*VQ@*bEORfÃAWV�O³Ï�@�fô7JcO/ÂP;�»UX�O�´sG�\PAc_PAc^*O�MPG�G*_9G*¹!_hX�O�Ç�ÅE@*bEMh@/_PAWV�@*´7´7JWAcOy\9Ac¹ � D � �¨���/Ô�FEG*_hX�OQMPSUAW\]O_hXEO>B�OQD�@/_PAc^*O%MhG�G*_Q;�2$ « " « $ »UXEOQMPO9@/MPO�B�G,\]G�JCÅE_PAcGTBE\Ac¹ � \PACB D � �¸V³G�\&$5�LV³G�\5"�G*M � D � �¨���/Ô�F�ACB¤SNXEAWVvXmVQ@*\PO�B�G,JWACf¯Ac_P\VQ@�B¯[sOX7Ac_Qç5G*_hX�OQMPSUAW\]Om[sG*_hXaMPG�G*_P\�D�Ac^*Om^/@*JWAWbÝ\]G�JCÅ�_PAcGTBE\�@�B7baOyAc_hXEOQM�JWACfÃAc_�VQ@�Ba[sOgORBEV³GTÅ7BT_]OQMPOybÝ´EMPG.^�AWbEOyb1_hXE@/__hXEO%ACBEAc_PAW@*J5^/@*JCÅ�O,G*¹|_hX�O%f¯GTÅ7B�_H²�<âAW\H\hÅPÕÃVQAcORB�_PJcIÎVQJcG�\]O*;¦»UX�O,V³GTBEb�Ac_PAcGTBdAW\QØ

Á!%T�U%SR.Â��¡@/MhVQ\PACB$ÁÜV³G�\g$5�LV³G�\"� « O « Á!%T�U%SR.Â&KÆ@/MhVQ\PACB!ÁÜV³G�\&$5�LV³G�\&"�ÂSNX�OQMPOÀO·AW\¯_hX�OµVyÅEMPMPORBT_(fmGTÅ7BT_¯´sG�\PAc_PAcGTBÌ@�B�D�JcO1@�BEbàÁ!%¤�Â%SR.Â>AW\¯Mv@�B�D*Oyb'[�IÌ@*b7b7ACB�D�G*MÄ\hÅE[E_]Mh@*V³_PACBEDf¤ÅEJc_PAW´�JcOy\�G*¹|Ô��a\PGg_hX7@/_�Á!%M�¥%SRRÂ&�ÀO_¸3AW\jACBÃ_hXEONMv@�B�D*O�§��M�±:°�&©�;�»UX�O�´sG�\PAc_PAc^*O�MPG�G*_9V³G*MPMhOy\P´sGTBEb7\�_]Gg_hXEOBEOQD�@/_PAc^*O¤f¯GTÅ7B�_9´sG�\PAc_PAcGTBµ@�B�D�JcO%JWACf¯Ac_QF7@�B7bdV³GTB�^*OQMv\]OyJcI*;" « �2$à»UX�Od´sG�\PAc_PAc^*OµMPG�G*_¯AW\Ã@*JWJcGRS¦Oyb5FH\]G D y � l @�BEbÆ_hX�OµMPG*_P@/_]G*M(VQ@�BÆ_]Mv@*VP¶ÌACB�_]G3_hX�OaB�OQD�@/_PAc^*OÝfmGTÅ7BT_²�<ÛJWACf¯Ac_Q;�<�\N¹�G*M·"O�Ã$!F�_hX�OgMPG*_P@/_PAcGTB�AW\�fmGTBEG*_]GTBEAWV/F5\]G(_hXEOg_hÅEMvB�_P@*[�JcO>SUAWJWJLOQ^*ORBT_hÅE@*JWJcI�XEAc_�_hXEOgJWACfÃAc_´7MPGR^�AWbEOyba_hXE@/_�_hXEO%G�[�É0OyV³_Nb7G�Oy\�B�G*_�\]OQ_�Ð�Mh\]_Q;HÞEG*M�@(_]OyJcOy\PV³G�´sO¤ACBd_hX�O¤ÙUG*MP_hXEOQMvBaXEORf¯AW\P´�XEOQMPO*F�\hÅEVYXµ@*\_hXEO,¾ ¿N»�F�G�[�É�OyV³_P\USUAc_hX�" « $1@/MPO>B�G*_UVQAcMvVyÅ7f¯´sG�JW@/MyF7\]G(Ac_�AW\UACfôsG�\P\PAW[7JcO�¹�G*MU_hX�O,_hÅEMvB�_P@*[�JcO,_]G¯MPG*_P@/_]O[�Iaf¯G*MPO%_hXE@�B1@ĹêÅEJWJ$_hÅ�MYBdS�X7AWJW\]_�_hXEO>G�[�É0OyV³_�MPORf¯@*ACB7\�@*[sGR^*O¤_hX�O¯X�G*MvAcÖQGTB�;N»�X�O¤BEOQD�@/_PAc^*OmMPG�G*_�G*¹�_hXEOÇ�ÅE@*bEMv@/_PAWV,@*´7´7JWAcOy\�Ac¹ � D � �r���/Ô�F�G*_hXEOQMPSUAW\]O,_hXEO,´�G�\hAc_PAc^*O%MPG�G*_Q;

ß5i�hgi�ß Ø ���U�Uve�W ¨vemAqÂé��WvewJo�n�wxv� �!n��¶n[oSvPo�n��mAt»UX�O�O³ÑsOyV³_P\|G*¹�_hX�O�OyJcOQ^/@/_PAcGTB¤@�BEbg@/ÖyACf¤Å�_hX%JWACfÃAc_P\|@�BEb%G*¹E_hXEO�ÖQORBEAc_hXg[7JWACB7b>\P´sG*_L@/MPO¦\vÅ7fÃfÃ@/MhAW\]Oyb�¹�G*M)_hXEO�¾Ê¿�»ACB1»)@*[�JcOgÓE;%Z�B7JcId_hX�OgOyJcOQ^�@/_PAcGTB3JWACf¯Ac_�B�OQOybÝ[�OgV³GTBE\PAWbEOQMhOyb1ACBÝf¯G�\]_NVQ@*\POy\QF5_hX�O¤´�G�\h\PAW[7AWJWAc_�IaG*¹�ORBEV³GTÅ7BT_]OQMhACB�D_hX�O%@/ÖyACf¤Å�_hXdJWACf¯Ac_H[sOyACB�DmMPOy\]_]MvAWV³_]Oybd_]GÃ@m¹�OQSàB�G*Mh_hX�OQMhJcIÄG�[�É�OyV³_P\UG�[7\]OQMP^*Oybµ[�OyJcG.S�_hX�O,²LG�JcO*;

×�_�\hX�GTÅEJWbm[sOUB�G*_]Oyb¯_hXE@/_�_hX�OH@/ÖyACf¤Å�_hXm@�B7bmOyJcOQ^�@/_PAcGTB(JWACf¯Ac_P\�@/MhOUbEOQÐ�B�OybmACBm_hX�O·è�¬�¹�àQá7V³G�G*Mhb7ACBE@/_]OU\PI�\]_]ORf@�BEbÄ_hXE@/_9¹êÅ�MP_hX�OQM¦_]Mh@�BE\P¹ÈG*MvfÃ@/_PAcGTBE\9@/MPO�MPOyÇ�ÅEAcMPOybËACBÄG*MhbEOQMj_]G¯V³GTBT^*OQMP_9_]G¯@*\]_]MPGTBEGTf¯AWVQ@*JWJcI�Õ�ÅE\]OQ¹êÅEJ�Á! �:Ì"�ÂP;9Ú�ACB7V³O_hX�O9ACBEbEO³ÏgOQMPMPG*Mh\L¹�G*M�_hX�Oj¾ ¿N»Ì@/MPO9ACBEVQJCÅEb7Oyb>_]G,@ND*G�G�bm@*´�´EMPGyÏEACf¯@/_PAcGTB¤ACB>_hX�OjORBEV³G�bEOQMf¯G�bEOyJÜF/_hX�O9b7A�Ñ�OQMPORBEV³O[sOQ_�S¦OQORBºf¯GTÅ7BT_%@�BEb¡_]G�´sG�V³ORB�_]MvAWV(@*´7´�@/MPORB�_>\]I�\P_]ORf¯\%AW\¤B�G*_%\hAcDTBEAcÐ�VQ@�BT_g@/_>_hX�O(JcOQ^*OyJ�G*¹H@*VQVyÅ�Mh@*V³I¡MhOyÇ�ÅEAcMhOybÁ�ª å f¯ACB�Å�_]O¯G*¹j_PACfmO/ÂP;(×�¹HXEAcDTX�OQMg´EMPOyVQAW\PAcGTB3AW\,MPOyÇ�ÅEAcMPOyb$F!_hX�ORBÝ_hXEOùêÅEJWJ�´sG�ACB�_PACB�DÝfmG�bEOyJ�f¤ÅE\]_,[sOÃACBEVQJCÅEb7OybACBa_hX�O¤VQ@*JWVyÅEJW@/_PAcGTB�;%»UXEO>_hX�OQG*MhOQ_PAWVQ@*J|Mh@*b7ACÅE\�G*¹_hX�OgÖQORBEAc_hX1[7JWACBEb1\P´sG*_�XE@*\�[�OQORB1ÅE\]Oyb$Fs@�BEbÝAc_�AW\�JWAc¶*OyJcIµ_hXE@/__]Mh@*Vh¶�ACB�D(SUAWJWJ5[sOyV³GTfmO,´EMhG*D*MPOy\P\PAc^*OyJcIÎJcOy\P\�@*VQVyÅ�Mh@/_]O>@*\H_hXEAW\UAW\H@*´�´EMPG�@*VvXEOyb5;ÞEG*MN´EMh@*V³_PAWVQ@*J!´�Å�Mh´sG�\]Oy\QFE@mJW@/MPD*OQMMh@*b7ACÅ7\Uf¯AcDTXT_U[sO,@*´7´EMPG�´7MhAW@/_]O*;¦»�X�O�MPG*_P@/_]G*M�JWACf¯Ac_P\U@/MhO%\hÅ7f(f¯@/MhAW\]OybËACBµ»)@*[7JcOgæEÁ�_hX�O>\P@�f¯O,VQ@y^*Oy@/_P\�@*´7´�JcIË@*\¹�G*MU@/ÖyACf¤Å�_hXÎ@�BEbÎOyJcOQ^/@/_PAcGTBaJWACf¯Ac_P\³ÂP;

Ó*Ó

Page 45: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

»L@*[7JcO,ÓEØjÚEÅ7fÃfÃ@/MPImG*¹|O³ÑsOyV³_PAc^*O¤JWACf¯Ac_P\H¹ÈG*MH_hXEO�¾ ¿N»�;ã�OyVQJWACB7@/_PAcGTB n ÑsOyV³_PAc^*OgJWACf¯Ac_

" « ��æ å � Ô�Ó � ÙUOQ^*OQM�@*[sGR^*O,OyJcOQ^/@/_PAcGTB1JWACf¯Ac_

�Uæ å � Ô�Ó � « " « Ô I � æ*æ � :UAW\]Oy\�@�BEbd\]OQ_P\�@/_HOyJcOQ^�@/_PAcGTBaJWACf¯Ac_

Ô I � æ*æ � « " « Ô I � ò é � :UAW\]Oy\�@�BEbd\]OQ_P\�@/_HOyJcOQ^�@/_PAcGTBaJWACf¯Ac_Qç7´�@*\P\]Oy\H_hXEMPGTÅ�DTXË[7JWACBEbµ\P´sG*_

Ô I � ò é � « " « é l�� è*è � :UAW\]Oy\�@�BEbd\]OQ_P\�@/_HOyJcOQ^�@/_PAcGTBaJWACf¯Ac_

é l�� è*è � « " « é å � Ô�Ó � :UAW\]Oy\�@/_HOyJcOQ^�@/_PAcGTBaJWACf¯Ac_Qç�\]OQ_P\U@/_U´sG�\PAc_PAc^*O>@/ÖyACfgÅE_hXÎJWACf¯Ac_Á�KâSHMh@*´5Â�G*MHOyJcOQ^�@/_PAcGTBaJWACf¯Ac_gÁ��¼SHMh@*´�Â

é å � Ô�Ó � « " « I æ � è*Ô � <�JcSj@yI�\�@*[sG.^*O%OyJcOQ^/@/_PAcGTBµJWACfÃAc_QçÚ�OQ_P\U@/_U´sG�\PAc_PAc^*O>@/ÖyACfgÅE_hXÎJWACf¯Ac_>Á�KâSHMh@*´ËGTBEJcI�ÂI æ � è*Ô � « " ÙUGÃJWACfÃAc_P\

»L@*[7JcO%æ�ئÚEÅ7f(f¯@/MPI¤G*¹L_hÅ�MvBT_P@*[7JcO,JWACf¯Ac_P\H¹ÈG*M9_hX�O�¾Ê¿N»ÒÁ D � %2�Z%SR ��O�FES�X�OQMhOT%¤AW\j_hXEO,\]¶�IË´sG�\PAc_PAcGTBÎ@�B�D�JcO*F% R AW\�@�BÎACBE\]_]MYÅ7fmORBT_0Õ�bEOy´sORBEbEORBT_�G/Ñ5\]OQ_N@�BEb½O(AW\H_hX�O>fmGTÅ�B�_9´sG�\PAc_PAcGTBd@�BED�JcO,G*¹|_hX�O,JWACf¯Ac_³ÂP;ãNOyVQJWACBE@/_PAcGTB n ÑsOyV³_PAc^*OgJWACf¯Ac_

" « �UÔ I � é/è � e @�BÎXEAc_�B�OQD�@/_PAc^*O¤fmGTÅ7BT_H²�<âJWACf¯Ac_

�UÔ I � é/è � « " « Ô I � é/è � ÙUG¯JWACfÃAc_P\UAc¹ � \PACB D � �¸V³G�\"�� l�� I é*éG*M � D � �¨���/Ô�çG*_hX�OQMPSUAW\]O,VQ@�BaXEAc_9OyAc_hX�OQM�fmGTÅ7BT_H²�<àJWACfÃAc_

Ô I � é/è � « " e @�BÎXEAc_U´sG�\PAc_PAc^*O>f¯GTÅ7BT_H²s< JWACf¯Ac_

ÓTæ

Page 46: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

º � ±°),ÉN©¤¬N+�ª�±h° È'«5¬,°s/­¯®¤«g/B+F87:9 z �!�� )���� C¯Ì�*��.���×]BµG*MvbEOQM�_]Gdf¯Oy@*\hÅ�MPOg_hX�Og_]OQMvf¯\NACBa_hX�Om´�G�ACBT_PACB�DÎfmG�bEOyJÜF5@ÃD*MvAWbaG*¹¦\]_P@/Mh\NSUAc_hX1@*VQVyÅ�Mh@/_]OyJcI1¶EB�GRS�B1´sG�\PAc_PAcGTBE\V³GR^*OQMvACB�D>@*JWJ�G*¹s_hX�OH@*VQV³Oy\P\PAW[�JcOU´7@/MP_P\�G*¹s_hX�O9\]¶�IgAW\�ÅE\]Oyb5;|»UX�O9\]_P@/Mh\@/MPOH\PJcOQS¦Oybm_]G,ACBm\]OyÇ�Å�ORBEV³OH@�BEbmV³ORBT_]MPOybmGTB@ND�Ac^*ORB¤´sG�ACB�_�ACB>_hX�Oj¹ÈG�VQ@*J�´7JW@�B�O�ÁêÅE\hÅE@*JWJcI>_hX�OjMPG*_P@/_]G*M�V³ORBT_]MPO/ÂP;�»UX�O¦^�@*JCÅEOy\|G*¹&#d@�B7b~"�ACB>_hX�OjORBEV³G�b7OQM|\PI�\]_]ORf@/MPO>_hX�ORBÎJcG*D*D*Oyb5F�_]G*D*OQ_hX�OQMNSUAc_hXÎ_hXEO>\PAWbEOQMhOy@*J5_PACfmO*; å l*lmî å æ l f¯Oy@*\hÅ�MPORf¯ORB�_P\9@/MPO>_P@/¶*ORB�F�V³GTBEV³ORB�_]Mv@/_PACB�D(GTB_hX�ONÖQORBEAc_hX(S�X�OQMPON@mB�Å7fg[sOQM�G*¹$_hXEO�_]OQMvfÃ\�[sOyV³GTf¯OUOy@*\PAcOQM9_]G¤b7AW\]_PACBEAcDTÅ7AW\hX�;�»UX�O�b7@/_P@g@/MPON@�B7@*JcI�\]OybÎÅE\hACB�D>_hXEO»H²jZN×�ÙN» ´7@*VP¶/@/D*O(Á�¾¡@*JWJW@*V³O åyòJI*ò ÂPF�S�XEAWVvXËÅE\POy\¦@¤JcOy@*\]_0Õ�\hÇ�ÅE@/MhOy\9Ð7_¦_]Gg_hXEON¹êÅ7BEV³_PAcGTB7@*J�¹�G*Mvf¯\�D�Ac^*O,ACBÄ»)@*[�JcO åACBÄG*MhbEOQM9_]GmOy\P_PACf¯@/_]O�_hX�O,V³G�OuÕÃVQAcORBT_P\Q;�»)Oy\]_P\H@/MPO,´sOQMP¹�G*Mvf¯Oyb k G*MHÓm_PACf¯Oy\9@>I*Oy@/MN@/_9Oy@*VvX˹�G�VQ@*J$\]_P@/_PAcGTB�F�@�B7b@/¹�_]OQM�@�BTIÎfÃ@�É�G*MUf¯OyVvXE@�B7AWVQ@*J$VvXE@�BED*O*;F87[6 8 �� &Ä� � �5» � � 8 ; ��������e] > ��»UX�O e <N?$× i :U<�» n ´EMPG�V³Oyb�Å�MPOmAW\�@Î\hX�G*Mh_�´sG�ACBT_PACB�DÎ_]Oy\]_,´sOQMP¹�G*MvfmOyb1@/_�_hX�O¯\]_P@/Mh_�G*¹¦@dBEAcDTXT_Qí=\�G�[7\POQMP^�ACBEDËACBG*MhbEOQMÃ_]GºfmOy@*\hÅEMPOÎ_hX�Od_hX�MhOQOµV³G�OuÕ(VQAcORB�_P\(S�XEAWVYXÌ@/MPOaf¯G�\]_¯JWAc¶*OyJcIÌ_]GºVYXE@�B�D*O·Á�_hXEOµ@/ÖyACf¤Å�_hXÌ@�BEbÌOyJcOQ^/@/_PAcGTBACBEbEO³ÏÌOQMPMhG*Mh\Ã@�BEb'_hX�O1XEG*MhAcÖQGTB�_P@*JNV³G�JWJWACf¯@/_PAcGTB�¤@�BEb'_]Gº´EMhGR^�AWbEOa@�B¸Oy\]_PACf¯@/_]OaG*¹�_hX�Oµ_]OyJcOy\PV³G�´sO*í=\Ë´sG�ACB�_PACBED´sOQMP¹�G*Mvf¯@�BEV³O*;(Ú�OQ^*ORB¡\]_P@/Mh\%@/MPOÃ\]OyJcOyV³_]Oybº¹ÈMhGTf _hX�O¯\]_P@�B7b7@/Mhb�D*MhAWb$F!GTB�_hXEOÃB�G*MP_hX�OQMvB�G*M>\]GTÅ�_hXEOQMvB�fmOQMhAWb�AW@�BÁ�S�XEAWVYX�OQ^*OQM,AW\�VQJcG�\]OQMQÂH@�BEb1SUAc_hX1@(Mh@�B�D*O¤G*¹OyJcOQ^/@/_PAcGTBE\Q;>»UX�Og_]OyJcOy\PV³G�´sO¤AW\�\hJcOQS�Oyb1_]GËOy@*VvX�\P_P@/M�ACBa_hÅ�MYBa@�B7b_hX�OmG�´sOQMh@/_]G*M%AW\%ACB�^�Ac_]Oyb�_]GdV³ORBT_]MPOÃAc_,GTB1_hX�OmMhOQ¹ÈOQMPORB7V³O¯´�G�\hAc_PAcGTB�;m»UX�Omb7@/_P@d@/MPO¯JcG*D*D*Oybº@�BEb�@�Å�_]GTfÃ@/_PAWVQ@*JWJcI@�BE@*JcI�\]Oyb¤@*\|ACB>@N\]_P@�BEb�@/Mhb>´sG�ACBT_PACB�DN_]Oy\]_QFT[�Å�_)SUAc_hXg@*JWJ�O³Ï�V³Oy´E_L_hX�Oj_hX�MPOQOjV³G�OuÕÃVQAcORB�_P\�\POQ_L_]GN_hX�O9bEOQ¹Ü@�ÅEJc_L^�@*JCÅ�Oy\¹�G*M,_hX�OÃVyÅ�MhMPORB�_%¹ÈG�VQ@*J�\]_P@/_PAcGTB�;Ë»UX�Om^/@*JCÅ�Oy\%G*¹¦_hXEOÃV³G�OuÕ(VQAcORB�_P\¤@�BEb�_hXEO¯My;�fÎ;=\y;mÐ7_]_PACB�DdOQMPMhG*M%@/MPOÃb7AW\h´7JW@yI*Oyb@�BEb1_hX�OmMh@RSïb7@/_P@Ë@/MPO¯\]_]G*MPOybݹ�G*M,JW@/_]OQM%@�BE@*JcI�\PAW\Q;g»UX�OgG�´sOQMh@/_]G*M>f¯@RId_hX�ORBÝ@*VQV³Oy´E_�_hXEOÃB�OQSßV³G�OuÕÃVQAcORBT_P\,G*MMPOQ^*OQMP_�_]GË_hX�Om´EMPOQ^�AcGTÅE\NG*M�bEOQ¹Ü@�ÅEJc_�^�@*JCÅ�Oy\y;>Ú�¶�IµMy;�fÎ;=\Q;�OQMPMhG*Mh\�\PAcDTBEAcÐ�VQ@�BT_PJcIaACBaO³ÏEV³Oy\P\�G*¹ å @/MhVQ\]OyV¤D*ORBEOQMh@*JWJcIACBEb7AWVQ@/_]O%OyAc_hX�OQM�@¯[7MPOy@/¶�b7GRS�BËG*M�@¯\PJcGRS VvXE@�BED*O%ACBÎ_hX�O,´sG�ACBT_PACB�D(f¯G�bEOyJÜ;F87[­ 8 ���5��¼��� C¯�½¦���5�*�s�*���! à�� ]ß� ����8]7�Ý�97��#0�$�T� �5 ��»UX�O�» e Ú(AW\9VQ@*´7@*[�JcO�G*¹)JcG*D*D�ACB�DÃACfÃ@/D*O�V³ORB�_]MPG�AWb�\j¹ÈMPGTf @�BË@*VQÇ�ÅEAW\PAc_PAcGTBdVQ@�fmOQMh@gG*MH@�Å�_]G*DTÅEAWb7OQMH@�BEbË@¤^�@/MhAcOQ_�IG*¹�b7@/_P@�V³GTBEV³OQMvB�Oyb¤S�Ac_hXg_]Mh@*VP¶�ACB�D%´sOQMP¹�G*Mvf¯@�B7V³O¦@/_�Mh@/_]Oy\�ÅE´g_]G%Ô l ¿UÖ*;�»UXEOy\]OHf¯@yI>_hX�ORB¤[sO9´7JcG*_]_]Oyb5F�@�B7@*JcI�\]Oyb¹êÅ�MP_hX�OQMÃÁ°GWF ±®FL_]GdD*ORB�OQMh@/_]OËJcG�G*¶�Õ�ÅE´�_P@*[�JcOy\,G*M%_]GµÐ7_,\PACf¯´�JcOm¹ÜÅ7B7V³_PAcGTBE\³ÂHG*M%O³ÏE´sG*MP_]Oyb3ÅE\hACB�DÎ_hX�Oû e Ú1²?LZ�»Å�_PAWJWAc_�I*;¦Ú�OQ^*OQMh@*J�O³ÏE@�f¯´7JcOy\�G*¹�_hX�OUÅ7\]OjG*¹�_hXEAW\�_]OyVvX7BEAWÇ�Å�O9S¦OQMPOHD�Ac^*ORBmACB(Ú�OyV³_PAcGTBmÓE;�Ô�ç�Ac_�AW\�@*JW\]G%ÅE\POyb¤_]G>fmOy@*\hÅEMPO_hX�O¤f¯AW\P@*JWAcDTB7f¯ORB�_�G*¹�_hX�O>b7OQMPG*_P@/_PAcGTB1G�´E_PAWVQ\Q;�×0BdG*MhbEOQMN_]G(_]Oy\]_N_hX�O>MPG*_P@/_]G*M,´sOQMP¹ÈG*MYf¯@�BEV³O,@/_N_hX�O e @*\P\]OQD*Mh@*ACB@�BEb>²�MhACf¯O�¹ÈG�VQAÜF*@�B,@*VQÇ�ÅEAW\PAc_PAcGTB>VQ@�fmOQMh@�AW\)ÅE\]Oyb,_]GN@�Å�_]G*DTÅ7AWbEOGTB%@U\]_P@/ML@/_!_hX�O¦V³ORB�_]MPO�G*¹EMPG*_P@/_PAcGTBÄÁ�OyJWACf¯ACBE@/_PACB�D_]Mh@*Vh¶�ACB�D(OQMPMPG*Mh\QÂS�XEAWJW\]_�@�BÎG/ÑsÕ�@�Ï�AW\N@�Å�_]G*DTÅEAWbEOQMN\PACf¤ÅEJc_P@�B�OQGTÅE\hJcIËJcG*D�\�_hX�O%V³ORBT_]MPG�AWbµG*¹�@�BÎACf¯@/D*O%@/_�_hX�O,OybED*OG*¹|_hX�O�Ð7OyJWb5;F87�ê ë ����7�¦]���5¯! ��!�.�����3�.�!#���¾Ä����»9S¦GHG*_hX�OQM�Å�_PAWJWAc_PAcOy\L@/MPO¦ÅE\POyb,´EMhACfÃ@/MhAWJcI�¹�G*MLX7@/MhbESj@/MPO�_]Oy\]_PACB�DE;K,Ú n J�<N` \]OQ_P\L@�BEb�MPOy@*b�\$_hX�O�D�JcG�[7@*J�^/@/MhAW@*[7JcOy\ÅE\]Oyb([TIm_hXEON» e Úg¹ÈG*MjACBT_]OQMh´EMPG�V³Oy\P\jV³GTfÃf¤Å7BEAWVQ@/_PAcGTBÃ@�BEbÄ@*JWJcGRSU\¦Oy@*\]IÃ@*VQV³Oy\h\�_]GgMh@RS ORBEV³G�bEOQMj@�BEb(_]Mh@�BE\Pb�Å7V³OQMb7@/_P@�; e <N`a< e » n ÚE»¼AW\H@m_]Oy\]_N´EMPG*D*Mh@�f ¹�G*MH_hX�O%X7@/MhbESj@/MPO,ACB�_]OQMh¹�@*V³O>S�XEAWVvXdAW\UACBEbEOy´sORBEb7ORB�_jG*¹L_hX�O%» e Ú�;

¿ À ®=1 1 )9«54Á)H©¤­ÂÁm®>ª�®¤«g/ � /Ã��/CËP¬2�=1 /©Nª»UX�O�´EMPOy\]ORBT_´7@*´sOQM¦X7@*\\hÅ7f(f¯@/MhAW\POyb>_hXEOUVQ@*JWVyÅEJW@/_PAcGTBE\9´sOQMP¹�G*MvfmOybm[�I¤_hX�OU¾Ê¿N»¸_]OyJcOy\PV³G�´sO�V³GTB�_]MPG�Js\]I�\]_]ORfïACB@¤f¯@�B7B�OQM�ACBEbEOy´sORBEbEORBT_�G*¹$ACf¯´�JcORfmORBT_P@/_PAcGTB�;�»UX�ON» e Ú¯X7@*\´EMPG.^*OybÄ_]Gg[sO�@*VQVyÅEMh@/_]ON@�B7bÃMPOyJWAW@*[�JcONACB(´EMh@*V³_PAWVQ@*JÅE\]O*FL@�BEb3Ac_P\>@*JcD*G*MhAc_hX7fÃ\%@/MPO¯S¦OyJWJ�Õ�_]Oy\]_]Oyb5; n B7XE@�BEV³ORf¯ORB�_P\,@/MhOô7JW@�B7B�Oyb3ACB�_�S¦G1fÃ@*ACB�@/MPOy@*\QØmfmOy@*\vÅ�MPORfmORBT_@�BEbdV³GTBT_]MPG�J!G*¹|fÃ@*ACBÎf¯AcMPMPG*MH´sG�\PAc_PAcGTBd@�BEbµfmG*MhO,\]G�´�XEAW\]_PAWVQ@/_]Oyba@�Å�_]G*DTÅEAWb7ACBEDE;

ÓTè

Page 47: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

ÚEX7@*VP¶�Õ�¿�@/MP_hfÃ@�B7B _]Oy\]_PACB�DÌG*¹g_hX�O�_]OyJcOy\PV³G�´sO�G�´E_PAWVQ\1XE@*\Î\hX�G.S�B _hXE@/_Î_hX�O¡\]OyV³GTB7b7@/MPI¼f¯AcMPMPG*MÄ_PAWJc_P\µ@�B7b_]Mh@�BE\hJW@/_]Oy\,ACBÝ\hÅEVYXÝ@ËS¦@RI1@*\�_]GdACBT_]MPG�b�ÅEV³O¯\PAcDTBEAcÐ�VQ@�B�_,V³GTfÃ@Ä@RS¦@RIݹÈMPGTf _hXEOgÖQORB7Ac_hX¸Á�S�X�OQMPO¤_hX�O¯@*JWAcDTB�fmORBT_AW\gG�´E_PACf¯AW\POyb�ÂP;�»UX�OËV³GTf¯@1AW\g@aMPOy´EMhG�b�Å7VQAW[7JcOùêÅ7BEV³_PAcGTBºG*¹UOyJcOQ^/@/_PAcGTBÌ@�BEb·VQ@�B�FACBº¹Ü@*V³_QF[sO(´EMhOyb7AWV³_]Oyb·¹ÈMPGTf_hX�OôsG�ACBT_PACB�D1f¯G�b7OyJ�@�BEb3b7AcMhOyV³_>fmOy@*\hÅEMPORfmORBT_P\�G*¹9\]OyV³GTBEb7@/MhI1_PAWJc_Q;d»�X�O¯_PAWJc_%G*¹j_hX�OÄ\]OyV³GTBEb7@/MhI�fÃAcMPMPG*M%VQ@�B[sO�V³GTB�_]MPG�JWJcOyb1[�IÃ_hX�O,» e ÚsFE@*Jc_hX�GTÅ�DTXË_hX�O,b7MhAc^*O�S¦@*\�B�G*_HbEOy\PAcDTB�Oybd¹ÈG*MHV³GTBT_PACB�ÅEGTÅE\�ÅE\PO�@�B7bµf¯@RIÄXE@R^*O,_]GÃ[sOMPOy[�Å7AWJc_Q; e @*JWVyÅEJW@/_PAcGTBE\9\hXEGRSÊ_hXE@/_¦_PAWJc_¦G*¹!_hX�ON\POyV³GTBEb7@/MPIÃ@*JcGTBEO�VQ@�B(MPORf¯GR^*O�V³GTf¯@g@/_¦_hX�O�Ð�OyJWbÄV³ORBT_]MPO�SUAc_hX�GTÅE_ACBT_]MPG�b�ÅEVQACB�D¯O³ÏEV³Oy\P\PAc^*Om@*\]_PAcDTfÃ@/_PAW\hfÍ@/_NJW@/MPD*O%Ð�OyJWbdMh@*b7AWA)@�BEbd_hX7AW\HS¦GTÅEJWbµJcOy@*ba_]G(\PAcDTB7AcÐ�VQ@�B�_ND�@*ACBE\NACBdACfÃ@/D*OÇ�ÅE@*JWAc_�I*;<¼\POyV³GTBEb5F�\]GTfmOQS�X7@/_�Oy@*\PAcOQMyFE´sG�\P\PAW[7AWJWAc_�I¯AW\_]GmfmOy@*\vÅ�MPO9MPOy\PAWb�ÅE@*J7_PAWJc_¦GTB¯_hXEO�´EMhACfÃ@/MPImf¯AcMPMPG*MNÁ�S�XEAWVvXAW\%\hAcDTBEAcÐ�VQ@�BT_>@/_,_hX�O l ; å @/MhVQ\]OyV(JcOQ^*OyJ�@�B7b�_]ORBEb7\�_]Ga^�@/MhIÝ\hJcGRSUJcIÝSUAc_hX¡_PACfmO/Â�@�BEb¡_]GaV³G*MPMPOyV³_gAc_P\,O³Ñ�OyV³_P\%GTB´sG�ACB�_PACBED(ÅE\PACB�D¤_hX�OgfmGTÅ7BT_Q;

»UXEO¦@*ACfàG*¹�ACfôEMPGR^*ORf¯ORB�_P\)_]G�_hX�Oj@�Å�_]G*DTÅEAWb7ACB�D�@*JcD*G*MhAc_hX7fÃ\9ÁÜ\]OQO9ó%ô¡¹�G*M�fmG*MPO¦bEOQ_P@*AWJ�Â!AW\)_]G�@*JWJcG.S¸@*VQVyÅ�Mh@/_]O[7JWACBEb1@*VQÇ�ÅEAW\PAc_PAcGTB1D�Ac^*ORBÝ@�BaG/Ñ�Õ�@�ÏEAW\�DTÅEAWb7Og\]_P@/M�SUAc_hX1@�B1@*VQVyÅ�Mh@/_]OyJcI�Õ�¶EB�GRS�BÝb�AW\P´7JW@*V³ORfmORBT_N¹ÈMPGTf _hX�Og_P@/MPD*OQ_Q;»UX�O�MhOyÇ�ÅEAcMhORfmORBT_P\9@/MPO*Ø

å ;U< ^*OQMhI3@*VQVyÅ�Mh@/_]OËVQ@*JWAW[EMh@/_PAcGTBºG*¹H_hX�O(¹ÈG�VQ@*J�Õ�´7JW@�B�OÄD*OQGTfmOQ_]MhI'ÁÜ@�Å�_]G*DTÅEAWbEOQMm´EMPG�[sO(f¯GR^*ORf¯ORB�_QF�bEOQ_]OyV³_]G*MG*MvAcORB�_P@/_PAcGTB�F�\PVQ@*JcOg@�BEbËMPG*_P@/_PAcGTBsÂP;

Ô�;U<�B¡@*JcD*G*MvAc_hX7f½S�XEAWVvX3´EMPOyb7AWV³_P\%_hX�O(V³G�G*Mhb7ACB7@/_]Oy\%G*¹9_hX�OÃG/Ñ�Õ�@�ÏEAW\gDTÅEAWbEOÃ\]_P@/MgGTB�_hXEO(@�Å�_]G*DTÅEAWb7OQM>D�Ac^*ORBAc_P\�´sG�\PAc_PAcGTBËGTBË_hX�O,\P¶�IË@�BEbË_hX�O,JcG�VQ@/_PAcGTBdG*¹L_hX�O�DTÅEAWb7O,´EMPG�[sO*;�»UXEAW\jS¦GTÅEJWbd[sO,ÅE´�b7@/_]OybÎV³GTBT_PACB�Å�GTÅ7\PJcIACB¡G*MhbEOQM,_]G1@*JWJcGRS ¹ÈG*M>_PACfmO³Õ�^/@/MhAW@*[7JcO¯O³Ñ�OyV³_P\¤\hÅEVYX�@*\%b7A�Ñ�OQMPORBT_PAW@*JMhOQ¹ÈMh@*V³_PAcGTB3[sOQ_�S¦OQORB¡DTÅEAWb7O¯\]_P@/Mg@�B7b_P@/MhD*OQ_QF�´EMPG�[sOTÅ7O³Ï7Å�MPO�@�BEbºÁ�¹ÈG*MN\]G�JW@/M]Õ�\]I�\]_]ORf G�[EÉ�OyV³_P\³Â9B�GTB�Õ�\PAWb7OQMPOy@*J$fmG*_PAcGTB�;

»UXEO%V³GTB�_]MhG�J!\]I�\]_]ORf ¹�G*MU_hXEOgKNORf¯ACB7A5_]OyJcOy\PV³G�´sOy\�b�A�ÑsOQMh\H¹ÈMPGTf�_hXE@/_U¹�G*MH_hX�O>¾ ¿N»�ACBÎGTB�OgfÃ@�É�G*MHMhOy\P´sOyV³_QØ_hX�OjG�´E_PAWVQ@*J7\vÅ�MP¹Ü@*V³Oy\�@/MPOUÅ7BEbEOQML¹êÅEJWJ�V³GTf¯´�Å�_]OQM�V³GTBT_]MPG�JÜF�\PGTfmO9@/_XEAcDTX¤\P´sOQOyb5;L»UX�Oj¾ ¿N»Ì\]I�\]_]ORfß@*\�bEOy\hV³MhAW[sOybX�OQMPOgAW\HORBT_PAcMPOyJcIµ@*bEOyÇ�ÅE@/_]Og_]GÄV³GTBT_]MPG�J)_hX�Ogf¯GTÅ7BT_QF7Ð7OyJWbaMPG*_P@/_PAcGTB1@�BEbµ@�Å�ÏEAWJWAW@/MPIaf¯OyVvXE@�B7AW\hf¯\9G*¹|_hX�OmKNORf¯ACB7A_]OyJcOy\PV³G�´sOy\QF�[�ÅE_%MPOyÇ�ÅEAcMPOy\g@*b7b7Ac_PAcGTBE@*J�MPGTÅ�_PACBEOy\%_]GÝbEOy@*J�S�Ac_hX¡_hX�OÄ´EMhACfÃ@/MPI�@�BEb3\]OyV³GTB7b7@/MPI3f¯AcMhMPG*M>\hÅ7´7´sG*MP_P\@�BEbµ_hX�OyAcM�@*\P\PG�VQAW@/_]Oyb1Sj@y^*OQ¹�MPGTB�_�\]ORBE\PG*Mh\Q;¦×0BÎ@*b�b7Ac_PAcGTB�F�_hXEO>XE@/MhbESj@/MPO%@�B7bµ\]G*¹�_�Sj@/MPO%ORBT^�AcMPGTB7fmORBT_U´EMhG�´�G�\POyb[�Im_hX�O�KNORfÃACBEA7´EMhG/É�OyV³_¦b7A�ÑsOQMv\ACB(@*JCfmG�\]_@*JWJ�MPOy\P´sOyV³_P\�¹ÈMhGTfß_hXE@/_jÅE\]OybÃ@/_¦_hX�OH¾Ê¿N»�;�Ù�OQ^*OQMP_hX�OyJcOy\h\QF�_hX�OUS¦G*MP¶bEOy\PV³MvAW[�OybmACB¯_hXEAW\�´7@*´sOQM�D*G�Oy\@%V³GTBE\PAWbEOQMh@*[�JcOHS¦@RIm_]GRSj@/Mhb7\�\]G�Jc^�ACBED,_hX�OU´EMhG�[7JcORf¯\�´sG�\]Oyb¯[�Ig_hX�O�B�OQS'´7MPG/É�OyV³_Q;

��l��¼lc�SlcmAwxlct<�fmG�\QF e ;�Ús;WF e X�Å�MhVYXEAWJWJÜF�ÚE; n ;WF$Þ|AW\hX�OQMyF!`3;�ÎÛ?)@*ACB�DEF$:,;=<>;WF åyò*ò Ô�;AÄY WøWø� CùJ�ÆÅT�výÌ��ð�e�Yø>Ç&�Yø��º��Yüy÷���È0ú;Ég���Rû�ü��þ�úÇ�ùR÷A�Nõ¦ú&�Yü4É��vý>Ê�ý³üÌ˺�W�Rû0F�:HK,Zï:HOy´sG*MP_H:HK,Z�Õ�ÙUÕ l*l I ;i ACB�DTXE@�fdF�:%;�Kg;WF åyòJI ÓE;�ôM�³úe�výYù/ø±Í÷|û! ��vù/ø;η�º��Pý¡ �÷Lû! ü/údü5Ï�û��e�2Ð_ÑÓÒ�/!�ÔÄY WøWø� CùJ�ÕÅT�výÌ��ð�e�Yø�Ç�Yø��ºu�Yüy÷A�.F7?)@>²|@*JCfÃ@»)OyVvX7BEAWVQ@*J)ÙUG*_]O�Ö5;¿NACB�¶�\yF7<%;=:%;WF åHI*òJI ;B×ØÑ�ÙoÑ�Ú[Ñ óoÑ�ÿpÑcF ß(� F7ÓTÔ I ;?!@*ACBEDEF7:,;=<>;WF åyò*ò k ;�óNøÜÛ�ü.ýÌ êû��Q��BÏêü.ý>ô·�� cÉ��Ì/�ÿ5û�ù�ýHó·��Ýe�� �° êû! ü/úÎù*ú;ÉiÞü/ú�ûÜýYü�ø$ü5ÏL×1üP�*ú�û�ù*ú;ÉiÍ÷Lû! ��vù/ø$ÿ��/ýjÏ�ù��º�ºy;:HK,Zâ×]BT_]OQMvBE@*J5:HOy´sG*MP_Q;NÁÜó%ô�Â`µGRI*OQMyFs»�;=ãg;WF åyòJI�å ;ÞC�Yø��ºyû! Cù/øß×��W���7ù*úQ ��ÌQF he� F å ;`1Å�MPMh@RI*F e ;=<>;WF åyò*ò k ;[à�W�Rû�ü.ýÌ Cù/øLó�yûÜýYü�����ûÜý]þ�F�<Nb7@�f ¿NAWJcD*OQMyF i MhAW\P_]G�JÜ;Ú�@*@*\]_P@�f¯G�ACB�ORB�FÚ7;WF åyò é/Ô/@�;âá·�/øWø9ÑNôM�Qü�É;ÑcF jUãRG F�Ô�é ò ;Ú�@*@*\]_P@�f¯G�ACB�ORB�FÚ7;WF åyò é/Ô/[5;ªá·�/øWø9ÑNôM�Qü�É;ÑcF jUãRG F k I k ;Ú�VYX�MPG�OybEOQMyF7ãg; ÚE;WF åyòJI é�;jó�yûÜýYü/ú�ü��¤ ��vù/ø�Í÷Lû! ��ÌQF�<NVQ@*bEORfÃAWV,²�MPOy\h\QF7?$GTBEb7GTB�;Ú�OyAWbEOyJCfÃ@�B7B�F�²L; Ûm;|Á�Oyb5;cÂPF åyò*ò Ô�;�õ�öT÷søCù*ú�ù�û�ü.ý0þÝÿ��R÷7÷�ø������³ú�û9û�üÎû��e�%ó2RûÜýYü/ú�ü��� ��vù/ø)ó�ø��(ù*ú7ù��yF�ì�BEAc^*OQMh\hAc_�IÝÚEVQA�ÕORBEV³O i G�G*¶�\yF�`µAWJWJ!á�@*JWJcOQI*F e @*JWAc¹ÈG*MvB7AW@�;Ú�_]Mh@/Oyb7O*FÚE;�Zg;eÎß¾¡@*JWJW@*V³O*F�²L;=»�;WF åyò é/è�;ªÊ±Ñ ó�Ñ�ÿ�Ñ�ÊLÑcF �(� Fsé ò Ô�;¾¡@*JWJW@*V³O*FE²L;=»�;WF åyòJI*ò ;2ÇÃÊ2ÍâÈ«Ù�Ç�ärÇ&�Yø��º��Yüy÷��BÊ�ü� Cú�û! Cú_Ûgó�ú7ù/ø�þQ° �QF�Ú�_P@/MhJWACB�¶>ìN\]OQMÙ�G*_]O j_ã(ã F�Ú�_P@/MhJWACBE¶g²MPG/É�OyV³_QF:�ÅE_hX�OQMP¹�G*MhbÎ<�´�´7JcOQ_]GTBÎ?!@*[sG*Mh@/_]G*MhI*;¾¡@*JWJW@*V³O*F)²L;=»�;WF åyò*ò l ;�Ê�ýYüy÷Lü�hù/ø��Ïêü.ý�å~�W�çæ�Ç&�Yø��º��Yüy÷��oÊ�ü� Cú�û! Cú�ÛÎóNøÜÛ�ü.ýÌ êû��Q�¤QF!Ú�_P@/MhJWACB�¶a²�MPG/É0OyV³_QF$:�Å�_hXEOQMP¹ÈG*Mvb

Ó�é

Page 48: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

<N´7´7JcOQ_]GTBÎ?)@*[�G*Mv@/_]G*MPI*;¾¡@*JWJW@*V³O*F5²L;=»�;eÎß»)MhAc_]_]GTB�FÛ¯;=²);WF åyò é ò ;â×ØÑ�Ù�Ñ�Ú�Ñ ó�Ñ�ÿpÑcF jU� Ö5F å*å æ�;

Ó I

Page 49: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

è é ¬Hª&)¦ª�±h¬�©$ ?!@/_PAc_hÅ7bEO,G*¹L_hX�O,_]OyJcOy\PV³G�´sOÄÁ�$��¼Ô I � ÓTæ y k I � å y y  à¿UGTÅ�M�@�B�D�JcO# :UAcDTXT_U@*\PV³ORBE\hAcGTB"·ãNOyVQJWACBE@/_PAcGTB� n JcOQ^/@/_PAcGTB� o ORBEAc_hXÎb7AW\]_P@�B7V³O(Á!�z�Â���/Ô��Z�mÂ�ä<UÖyACf¤Å�_hXD ´7@/Mh@*JWJW@*V³_PAWVg@�B�D�JcO%'Ú�¶�I(´sG�\PAc_PAcGTBµ@�B�D�JcO% R ×0BE\P_]MvÅ7fmORBT_0Õ�bEOy´sORBEbEORBT_�´sG�\PAc_PAcGTBµ@�B�D�JcO,G/Ñ5\]OQ_O f¯GTÅ7BT_H´�G�\hAc_PAcGTBÎ@�B�D�JcO^ÛÚ�AWbEOQMhOy@*J5_]Mh@*VP¶�ACB�D(Mh@/_]O%ACBdX�GTÅEMH@�B�D�JcO´�êsµ e @/MP_]Oy\PAW@�BdV³G�G*Mhb7ACB7@/_]Oy\UACBË_hX�O�_P@�BED*ORB�_N´7JW@�B�O*F�´7@/Mv@*JWJcOyJ5_]G�KT#·@�BEb¥K·"�F7MhOy\P´sOyV³_PAc^*OyJcI¾Lês¿ e @/MP_]Oy\hAW@�BÎV³G�G*Mvb7ACBE@/_]Oy\NACBË_hX�O�_P@�B�D*ORBT_�´7JW@�BEO*F�´7@/Mh@*JWJcOyJ5_]G�KV�à@�B7b¥KV�¯F�MPOy\P´sOyV³_PAc^*OyJcI¢ ê Ä e @/MP_]Oy\PAW@�BÄV³G�G*Mhb7ACBE@/_]Oy\9ACBÃ_hX�ON_P@�B�D*ORBT_j´�JW@�B�ON@*JcGTBEDmf¯GTÅ7BT_�´sG�\PAc_PAcGTBÄ@�B�D�JcO l � @�BEb ò l � F�MPOy\P´sOyV³_PAc^*OyJcI(ACB

_hXEO%ACBE´�Å�_9V³G�G*Mhb7ACBE@/_]O>\]I�\P_]ORf

¢Æ : ÄJÆ e @/Mh_]Oy\PAW@�BdV³G�G*Mhb7ACBE@/_]O>\]I�\P_]ORf ÐEÏ�OybdACBË_hX�O�¹�G�VQ@*J$´7JW@�B�Ol f ê�l ` ê�l ÞEG�VQ@*J�JcORB�D*_hXE\ËG*¹,_hXEOÝ´7MhACf¯@/MPIÌ@�BEb \]OyV³GTBEb�@/MPI fÃAcMPMPG*Mh\QF9@�BEb G*¹,_hXEO e @*\P\]OQD*Mh@*ACB V³GTfg[7ACBE@/_PAcGTB�FMhOy\P´sOyV³_PAc^*OyJcIe9f�ê�eEha»HAWJc_P\jG*¹)_hX�O,´EMhACfÃ@/MPI¯@�BEbÎ\]OyV³GTBEb�@/MPIÄfÃAcMPMPG*Mh\�SUAc_hXÄMPOy\P´sOyV³_j_]Gm_hX�O�@�ÏEAW\9G*¹!_hX�O�ACBE\P_]MvÅ7fmORBT_¦MPG*_P@/_]G*M.ÁÜ\³ÂX¸:UOyJW@/_PAc^*O>_]Mv@�BE\]^*OQMh\]O>b7AW\P´7JW@*V³ORf¯ORB�_9G*¹�´EMhACfÃ@/MPIÃ@�BEbµ\]OyV³GTBEb7@/MPIÎf¯AcMhMPG*Mh\n i @*Vh¶Î¹ÈG�VQ@*J$b7AW\]_P@�B7V³O { l fq¼:�@/_PAcG¯G*¹�X�OyAcDTX�_P\UG*¹|Mh@yI�\H@/_H_hX�Ogf¯@/MPD�ACBE\jG*¹|_hX�O,\POyV³GTBEb7@/MPIÎ@�BEbδEMvACf¯@/MPIËf¯AcMPMPG*Mv\kÊÚ�Oy´7@/Mh@/_PAcGTBdG*¹L´EMvACf¯@/MPIÄ@�BEbÎ\]OyV³GTBEb7@/MhIÎfÃAcMPMPG*Mh\£ f êB£ h êB£ s ²LG�ACBT_PACB�D¯OQMPMhG*Mh\Hb�Å�O�_]G(´EMhACf¯@/MhIÃ_PAWJc_QF�\]OyV³GTB7b7@/MPIË_PAWJc_U@�BEbdb7OyV³ORB�_]MPO*F�MPOy\P´sOyV³_PAc^*OyJcI� Æ�ë �2+ :UOQ¹ÈMv@*V³_PAcGTBµV³G�OuÕÃVQAcORBT_P\��� Æ `a@/_]MhA�Ïd_]G¯_]Mh@�BE\P¹ÈG*Mvf�@¯Å7BEAc_9^*OyV³_]G*MN¹ÈMPGTfÍÅE\]OQMH_]GÃ@*´�´7@/MPORBT_HV³G�G*Mhb�ACBE@/_]O>\]I�\]_]ORf� Æ ^ `a@/_]MhA�ÏÎ_]G¯_]Mh@�BE\P¹ÈG*Mvf�@¯Å7BEAc_9^*OyV³_]G*MN¹ÈMPGTf�@*´7´7@/MPORBT_H_]G(f¯GTÅ7B�_9V³G�G*Mhb7ACBE@/_]O>\]I�\P_]ORf

Ó ò

Page 50: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

( ì*Ê À ®L+&/�«ï±h©Nª5/�«�íH)9°s/ °�¬21 1 )H©¤­=+±îr) °BË°),+&+�±�ï�/�­ Ëv±°+�ª»UXEAW\L\]OyV³_PAcGTBmV³GTBT_P@*ACBE\�@�\hÅ7f(f¯@/MPING*¹�_hXEO¦V³GTf(f¯@�BEb7\)@y^/@*AWJW@*[7JcOU@/_|_hX�O9ÅE\]OQM�ACBT_]OQMP¹�@*V³O9G*¹�_hX�Oj_]OyJcOy\PV³G�´sOjV³GTBT_]MPG�J\]I�\]_]ORfÎFEVQJW@*\P\hAcÐ7OybµACBT_]G¯¹êÅ7BEV³_PAcGTBE@*J�D*MPGTÅ7´7\Q;�ãNOQ_P@*AWJW\UG*¹|ACBEb7Ac^�AWb�ÅE@*J�V³GTf(f¯@�BEb7\j@/MPO�D�Ac^*ORBµACBË_hX�O,@*JW´�X7@*[�OQ_PAWVQ@*JJWAW\]_HG*¹Ú�OyV³_PAcGTB e ;» 7:9 Í � �7���5� 8 &d+à���!�Ê� �� ]�| ÷Uð5ùWø Ú�OyJcOyV³_UORB�D�ACBEOQOQMhACB�D(f¯G�bEO�@�BEbÎVQJcG�\PO>bEG.S�BË_hX�O%V³GTBT_]MPG�J$\PI�\]_]ORfd;| �cûcÿ� eöx÷�ø Ú�OyJcOyV³_NXE@�B7b7\]OQ_UfmG�bEO*;| ��÷_�U� KNOQ_�X�OyJW´ÎGTBµ@mV³GTfÃfÃ@�BEb5;| ý�÷�þxû��U� :HOyVQ@*JWJ!@ôEMPOQ^�AcGTÅE\HV³GTfÃfÃ@�BEb5;| øcýcû�ÿQöJõ�÷�ý »!Mh@�B7\]¹ÈOQM�V³GTB�_]MPG�J$_]GÃG*MH¹�MPGTf @mMhORfmG*_]O�_]OQMvfÃACBE@*JÜ;» 7[6 +L� > �T��}]��s�*�'� )�*�*-| P÷�þ n BT_]OQM�bEOyVQJWACBE@/_PAcGTBdG*¹|Oyb7Ac_U\]GTÅ�MvV³O*;| gùSõ�õ ý�ûcø�÷�ö n B�_]OQM�BEGTB�Õ�\PAWbEOQMPOy@*J$_]Mh@*VP¶�ACB�DÃMv@/_]Oy\H¹�G*MH_hX�O�Oyb7Ac_U\PGTÅ�MhV³O*;| ÷_�Pô®þ�� n BT_]OQMUOy´sG�VYXËG*¹|´�G�\hAc_PAcGTBι�G*MHOyb7Ac_U\]GTÅEMhV³O*;| ÷4ñ�`5ùSÿPô�ð n BT_]OQMUOyÇ�ÅEACB�GyÏ˹�G*MUOyb7Ac_H\]GTÅEMhV³O*;| ��ûcý�û��U��û_ð n BT_]OQM�´7@/Mh@*JWJW@�ÏÎG*¹LOyb7Ac_U\]GTÅEMhV³O*;| �®ú Ú�I�BEGTB�IEf ¹ÈG*M2�®ýQô���÷�ý úeôJø5ù�ôxÿ1Á�òSFó��F)ÂP;| ��ýQô��c÷®ý úQôxø5ù�ôxÿ n B�_]OQMU´7MPG�´sOQMUfmG*_PAcGTBE\9G*¹|Oyb7Ac_H\PGTÅ�MhV³O*;| ýcû n BT_]OQMUMhAcDTXT_H@*\PV³ORBE\PAcGTBdG*¹|Oyb7Ac_U\]GTÅ�MvV³O*;| ýcûU 5ùSû_� ôc÷_� n B�_]OQMHMv@*b7AW@*J5^*OyJcG�VQAc_�IdG*¹LOyb7Ac_U\]GTÅEMhV³O*;| ý_ô Ú�I�BEGTB�IEf ¹ÈG*M2ý�ûU gùWû�� ô�÷U�ÝÁ�òWF��SF)ÂP;| öcô�`cýPþ®÷ n BT_]OQMNBE@�f¯O*F�MvAcDTX�_U@*\hV³ORBE\PAcGTB�F�b7OyVQJWACBE@/_PAcGTBµ@�B7bÎOyÇ�Å7ACB�GyÏι�G*MHOyb7Ac_U\]GTÅEMhV³O*;» 7[­ &(�s�*������¯ > ·��� ]���� B¯| ûU _ <�b7b¯_hX�OUV³GTBT_]ORB�_P\¦G*¹s_hX�OHOyb7Ac_\PGTÅ�MhV³OUb7@/_P@>[7JcG�VP¶¤_]G,_hX�OUVQ@/_P@*JcG*DTÅEO�@*\�@%BE@�f¯Oyb¤ORB�_]MPI*;| þ®ûcø�û���ô�õ�`�÷ :HOy´7JW@*V³O>_hX�O,VyÅ�MPMPORBT_UÅE\]OQM�VQ@/_P@*JcG*DTÅ�O>S�Ac_hXÎ@ÃB�OQS�[�ACBE@/MPI(VQ@/_P@*JcG*DTÅEO*;| þ®ûcø ÷� 5ùSø n b7Ac_H@m_]O³Ï�_0Õ�Ð�JcO>VQ@/_P@*JcG*DTÅ�Og¹�MPGTf _hX�O>ÅE\POQMUACB�_]OQMh¹�@*V³O*;| _`cú�� Ú�@y^*O>_hX�O,VyÅ�MPMPORBT_UÅE\]OQM�VQ@/_P@*JcG*DTÅ�Og@*\�@m[7ACBE@/MPIÄÐ�JcO*;| ÷�ýcûPö®÷ e JcOy@/MU_hX�O%Å7\]OQMUVQ@/_P@*JcG*DTÅ�O*;| õ5ùSÿ� KNOQ_U@ÃBE@�f¯OybÎVQ@/_P@*JcG*DTÅ�OgORB�_]MPIÎ@�BEbµ´�Å�_9Ac_UACBË_hX�O%Oyb7Ac_U\]GTÅ�MvV³O,[7JcG�Vh¶�;| ùSÿPþ���`U P÷ <�´7´sORBEbË@m_]O³Ï�_�VQ@/_P@*JcG*DTÅEO>_]G¯_hXEO,VyÅ�MPMPORBT_UÅE\]OQMUVQ@/_P@*JcG*DTÅEO*;| ú�ûcýUa Ú�_]G*MPO,_hX�O,VyÅEMPMPORBT_9_]OyJcOy\PV³G�´sO>´sG�\PAc_PAcGTBd@*\U@ÃBE@�fmOybÎVQ@/_P@*JcG*DTÅEO>ORBT_]MPI*;| ô�`�ø_��`cø Z�Å�_P´�Å�_j_hX�O>VyÅ�MPMPORBT_HVQ@/_P@*JcG*DTÅ�Og_]GÃ@�BÎ<�Ú e ×P×�Ð�JcO*F7_]OQMvfÃACBE@*J�G*MUJWACB�O%´7MhACB�_]OQMR;| ý�÷®úQô�ôc÷ ã�OyJcOQ_]O¤@mVQ@/_P@*JcG*DTÅ�OgORB�_]MhI*;

æ l

Page 51: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

» 7�ê +L� > �T��Ì�T��� C¯$| ��&ùWÿU ôxõ�õQö®÷®ø Ù�OQS�\]GTÅ�MvV³O(Á�¹ÈMhGTf VQ@/_P@*JcG*DTÅ�O/ÂjSUAc_hXÎJcG�VQ@*J!V³G*MPMPOyV³_PAcGTB7\U_]G¯_hXEO,´�G�ACBT_PACB�D(f¯G�b7OyJÜ;| õPô�þxûcø ÙUOQS \]GTÅ�MhV³OÃÁ�¹�MPGTf VQ@/_P@*JcG*DTÅ�O*ç5\P´sOyVQAcÐ7OybÎ[�IdBE@�fmO�GTBEJcI�ÂP;| õPôxøPô ÙUOQS \]GTÅ�MhV³OÃÁÜb7AcMhOyV³_UACBE´�Å�_9G*¹�BE@�f¯O*FEMhAcDTX�_�@*\PV³ORBE\PAcGTB�F�bEOyVQJWACBE@/_PAcGTBa@�BEbÎOyÇ�ÅEACB�GyÏsÂP;| ÿ�÷Uð�ø ÙUOQS \]GTÅ�MhV³OÃÁêÅE\hACB�D¯b7@/_P@¯ACBËOyb�Ac_U\]GTÅ�MhV³O>[7JcG�Vh¶�ÂP;» 7�� z �!�/�ê�����! �5�H�5 C]ß�Ý�97��� > ��·� ì ��E���| û��c÷®ýcø�`�ý�÷ n Ï�OyVyÅ�_]O%@¯´EMhOy\]OQ_%ÁêB�Å�f>[sOQMPOyb5Â�@*´sOQMP_hÅEMPO�G/Ñ�\POQ_Q;| �÷�û®úeö#�gùSø�þ�� n Ï�OyVyÅ�_]O%@�Bd@*´sOQMP_hÅEMPO�G/Ñ�\]OQ_�SUAc_hXÎb7AcMhOyV³_HACBE´�Å�_9G*¹ ¢ @�B7b Ä ;| ÷�ÿcøc÷�ý ×0BE´�Å�_9b7@/_P@m¹�G*M�B�Å�f>[sOQMPOybË@*´sOQMP_hÅ�MhO�G*MU´sG�\PAc_PAcGTBE@*J5G/Ñ5\]OQ_P\Q;| ôxõcõPö®÷®ø n Ï�OyVyÅ�_]O%@¯´sG�\PAc_PAcGTBE@*J$G/Ñ�\]OQ_�SUAc_hXÎb7AcMhOyV³_HACBE´�Å�_9G*¹s£�#F£�">G*MN´�FQµ�;| �PôcöQùSø&ùJôxÿ n Ï�OyVyÅ�_]O%@¯´EMhOy\]OQ_%ÁêB�Å�f>[sOQMPOyb5Â�´sG�\PAc_PAcGTB7@*JÁ�´�Feµ7Â�G/Ñ�\]OQ_Q;| öxøQôJý�÷ Ú�_]G*MPO%@*´sOQMP_hÅ�MhONG*MN´sG�\PAc_PAcGTBE@*J5G/Ñ5\]OQ_P\U\POQ_�ÅE´dÅE\PACBEDm_hX�O>XE@�BEb�\]OQ_Q;| øU�P÷®û_a <�´7´�JcIÄ@mD�Ac^*ORBºÁ ¢Æ : ÄJÆ :ðO Æ Â@*´sOQMP_hÅ�MPO�G/Ñ5\]OQ_Q;» 7�F � > �*��¯ > �:]��� B¯| û�õPöx÷_��÷�þ®ø ×�bEORBT_PAc¹�I(_hX�O>@�Å�_]G*DTÅEAWbEOQMNVyÅ�MPMPORBT_PJcIÄACBµÅE\]O*;| û�õUô&ù�÷�� <�´sOQMP_hÅ�MhONG/Ñ5\]OQ_�_]G(fmG.^*O%ACf¯@/D*O�_]GÄ@�Å�_]G*DTÅEAWbEOQMHÐ�OyJWb5;| ûU`�øPô�õ�`gù� �÷ ?$G�VP¶ËG*M�Å7BEJcG�VP¶Ë_hX�O,@�ÅE_]G*DTÅEAWbEOQM�JcG�G�´5;| ��ýQô��÷ ×0BE´�Å�_,Á ¬ :Ì%�¦V³G�G*Mhb�ACBE@/_]Oy\HG*¹|DTÅEAWbEO,´7MPG�[sO*;| ø_ôPþxû�ú�÷�ýcû ×�bEORBT_PAc¹�I(_hX�O>»9á VQ@�f¯OQMh@mVyÅ�MPMhORB�_PJcIÎACBdÅE\PO*;| ø_ô�õ�`gù� P÷ ?$G�VP¶ËG*M�Å7BEJcG�VP¶Ë_hX�O,»HáàDTÅEAWb�ACB�DÃJcG�G�´5;| ð_ö��®ýQô��÷ ×0BE´�Å�_,ÁÈÏsF7I�Â�V³G�G*Mhb7ACBE@/_]Oy\UG*¹)DTÅ7AWbEO%´EMPG�[sO*;» 7 \ &(�5���1÷���s�����! à��T�|��] > �T��| þ®û��ùT�ýcûcøc÷ ã�OQ_]OQMYf¯ACB�O�ORBEV³G�bEOQM�ÖQOQMPG/Õ�´sG�ACB�_P\�@�BEbdV³G�JWJWACf¯@/_PAcGTBdOQMPMPG*Mh\y;» 7�d � ������5 ����� ���! )�/�T�!�| û���ø&ùSø�`_ P÷ `dG.^*O%_hX�O,_]OyJcOy\hV³G�´�O>_]GÃ@mD�Ac^*ORBµ@*Jc_PAc_hÅEbEO>@�B7bÎ\]_]G�´µAc_Q;| û4øùHú_`cø_� `dG.^*O%_hX�O,_]OyJcOy\hV³G�´�O>_]GÃ@mD�Ac^*ORBµ@/ÖyACfgÅE_hXÎ@�BEbd\]_]G�´µAc_Q;| eôJú�÷ `dG.^*O%_hX�O%b7GTfmO�_]G(@¤D�Ac^*ORBa@/ÖyACf¤Å�_hXÎ@�BEbÎ\]_]G�´aAc_Q;| ÷_�c÷�ôcû�ø5ùJôJÿ Ú�I�BEGTB�IEf ¹ÈG*M2û_��ø5ùWøU`U P÷µÁ�òSFó��F)ÂP;| �õQô®þ�`Qö e XE@�B�D*O�_hX�O%¹ÈG�VyÅE\H[�IÄ@Ã\P´sOyVQAcÐ7OybÎ@�fmGTÅ7BT_Q;| õQô�þ�`eö `dG.^*O%_hX�O,¹�G�VyÅE\9_]GÃ@¯\h´�OyVQAcÐ�Oybδ�G�\hAc_PAcGTB�;| ýQôxø�ûcøPôxý `dG.^*O%_hX�O,MhG*_P@/_]G*M�_]GÃ@¤D�Ac^*ORBa\]¶�IIJ�< Á�_]Mh@*Vh¶�ACB�D�¦G*MNf¯GTÅ7B�_9²�< ÁÜ\]_]G�´7´sOyb�ÂP;| öxøQô�� Ú�_]G�´d@Ãf¯OyVvXE@�BEAW\vf G*MUV³GTfg[7ACBE@/_PAcGTBdG*¹|f¯OyVvXE@�BEAW\vf¯\Q;| `�ÿU�cýcû_� `dG.^*O>@/ÖyACf¤Å�_hXËG*M�MPG*_P@/_]G*M�[�I k è l � ;

æ å

Page 52: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

» 7�u � ������5 ����� ���! Ãù ¯ > ���s�����) | ÷�ÿPþcô� �÷�ý Ú�OQ_H_hX�O,V³GTfg[7ACBE@/_PAcGTBdG*¹)ORB7V³G�bEOQMv\UÅE\]Oybι�G*MU´sG�ACBT_PACB�DE;| ÷�ÿ�õùSÿc÷c÷�ý&ùSÿ_õ Ú�OyJcOyV³_UORB�D�ACBEOQOQMhACB�D(f¯G�bEO*;| ýcûcøc÷ Ú�OQ_H_hX�O�ORBEV³G�bEOQM�Å7\]Oybd[�I(_hX�OgXE@/MhbESj@/MPO,´sG�\PAc_PAcGTBÎJcG�G�´5;| ö®÷�ÿPöcôJý n B { b7AW\h@*[7JcO,V³G*MPMPOyV³_PAcGTBE\�¹�MPGTf b7AW\P´�JW@*V³ORfmORBT_9_]Mh@�BE\Pb�Å7V³OQMh\Q;| øcýcû�þ�a »LÅ�MYBĹÈG�VyÅE\QF7bEGTf¯O*FEMPG*_P@/_]G*MUG*M�_]OyJcOy\PV³G�´sO%_]Mh@*Vh¶�ACBED¯GTBÎG*MHG/Ñ|;| ��ýcû_� ZN^*OQMPMhAWbEO�_hXEO%@/ÖyACf¤Å�_hXËSHMh@*´Îb7OQ_]OQMvf¯ACB�Oyb˹�MPGTf _hXEO,ÖQGTB�O%\]S�Ac_PVvXdACBdVQ@*\]O,G*¹|¹�@*AWJCÅEMPO*;| ø�÷�ýPôcöx÷�ø ã�OQ_]OQMYf¯ACB�O,ACBEV³MhORfmORBT_P@*J5ORBEV³G�bEOQMHÖQOQMPG/Õ�´sG�ACBT_P\Q;» 7:9�x &Ä��� C¯$Æ�$#%#0�����5���R�*�s�����! �5 C]ß�� �.�*� > � � )�Ù�G*_]ON_hX7@/_¤ðhÚ�OyJcOyV³_Pñ¯ACB¯_hX7AW\¦V³GTBT_]O³Ï�_UfmOy@�BE\gð]\]OQ_UÅE´Ä\]G*¹�_�Sj@/MPO�@�BEbËbEMhAc^*ON_hX�ONV³G*MhMPOyV³_9MPG*_P@/_]G*Mhñ�Ø�_hXEONÙN@*\hf>I�_hXÅ�@/_UAW\�B�G*_�fmG.^*Oyb5;| þ®ûQö�ö®÷Uõ�ýcû&ùSÿ Ú�OyJcOyV³_ e @*\h\]OQD*Mh@*ACB˹�G�VyÅ7\Q;| õU�cý&ù5� Ú�OyJcOyV³_�K�¿N:H×0? ÁÜ@*JWAW@*\NVQ@*[7JcO³Õ�SHMv@*´µ\PAWbEO/ÂÙN@*\hf>I�_hX˹ÈG�VyÅE\Q;| ùSÿQöJøcý�`cúP÷®ÿcø »!OyJWJ5_hXEO%» e Ú(S�X7AWVvXÎACBE\P_]MvÅ7fmORBT_9AW\HACBdÅE\PO*;| ��ý5ùHúP÷ Ú�OyJcOyV³_�´EMvACfmON¹ÈG�VyÅE\Q;| `P÷Pö Ú�OyJcOyV³_�ì n Ú�ÁÜ@*JWAW@*\�bEMhAc^*O³Õ�\PAWb7O/¦ÙN@*\hf>I�_hX˹�G�VyÅE\Q;» 7:9�9 �¡���.�¦���E-à# > �������) �| gùJö��_�®û_ö e XE@�B�D*O�_hX�O>V³G�G*Mhb�ACBE@/_]O%\]I�\]_]ORf G*¹L_hX�O%b�AW\P´7JW@yI*Oybµ_]OyJcOy\PV³G�´sO>´sG�\PAc_PAcGTB�;| úeôcôJÿ K�Ac^*O%_hX�O,VyÅEMPMPORBT_HMhAcDTXT_H@*\PV³ORBE\PAcGTBµ@�BEbdbEOyVQJWACBE@/_PAcGTBµG*¹L_hX�O>`µG�GTB�;| ��û�õ�÷ Ú�SUAc_PVvXÎ_]G(@�B�G*_hX�OQM�ACB�¹ÈG*MYf¯@/_PAcGTBÎb7AW\h´7JW@yIË´7@/D*O*;| ö��Qô#� ?!AW\]_H_hXEO�Oyb7Ac_U\]GTÅ�MvV³O%[7JcG�VP¶s;| ô�÷�ýPöeù�ôxÿ ãNAW\h´7JW@yId» e ÚÄ@*VQV³GTÅ7B�_N@�BEbË^*OQMh\PAcGTB5;» 7:9e6 � ��¯�¯!�� C¯ �!#,�*��.�¥]��s�*�| �Pô�õ ?$G*D¯_]Mh@*Vh¶�ACBEDÃOQMPMPG*Mv\H@�BEbÎ@*\P\]G�VQAW@/_]Oyb1b7@/_P@�;| �PôeùWÿcø ¾�MhAc_]O%ORBEV³G�bEOQMUV³G�G*Mhb7ACB7@/_]Oy\H_]GÃ@¯b�@/_P@mÐ�JcO*;| öxÿcû_�Pö��Qôxø :HOyV³G*Mhbµ_hX�O,VyÅ�MPMPORBT_HACB�¹�G*Mvf¯@/_PAcGTBdb7AW\P´7JW@RIË´�@/D*O*;» 7:9e­ � E�*7�!���!����¯!�����5�H�5 ] ; �s���*�Ã]Y���$�/�s�����) Ã]���*�| �U`cú5ù� 5ùSø_ö ×0BE´�Å�_jMPOyJW@/_PAc^*O¤X�Å7fÃAWb7Ac_�IËÅE\]OybÎACBÎMhOQ¹ÈMh@*V³_PAcGTBµVQ@*JWVyÅEJW@/_PAcGTB�;| �Pô���÷ ×0BE´�Å�_j^�@*JCÅ�Oy\UG*¹L´sG�JW@/M�f¯G*_PAcGTB�;| ��ý�÷�öcö#`�ý�÷ ×0BE´�Å�_9[7@/MPGTfmOQ_]MvAWV�´EMPOy\P\hÅEMPO,ÅE\]OybdACBËMhOQ¹ÈMh@*V³_PAcGTBµVQ@*JWVyÅEJW@/_PAcGTB�;| ø�÷®ú��c÷®ýcûcø�`�ýc÷ ×0BE´�Å�_j_]ORf¯´sOQMh@/_hÅ�MPO,ÅE\POybdACBËMPOQ¹�Mh@*V³_PAcGTBdVQ@*JWVyÅ7JW@/_PAcGTB�;| `�øûúÌ`�ø�þ ×0BE´�Å�_9ì�» å �"ì�» e ;| ��û_ôc÷_��÷�ÿ�õ®ø_� ×0BE´�Å�_jS¦@R^*OyJcORB�D*_hXÝÅE\]OybÎACBËMPOQ¹�Mh@*V³_PAcGTBµVQ@*JWVyÅEJW@/_PAcGTB�;

æ*Ô

Page 53: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Ê ì*Ê À ®L+&/�«ï±v©Nª&/�«�íW)9°s/Í°�¬21 1 )H©¤­=+±îr)H© )MËü��ýL)=þ�/�ª�±P°s)MËYÉ�ËP¬N+&+&)9«54»UX�ON¹�G�JWJcGRSUACB�Dm\]OyV³_PAcGTBÎD�Ac^*Oy\9@g[7MhAcOQ¹$\hÅ7f(f¯@/MPIgG*¹$_hX�O�G�´sOQMh@/_PAcGTB(G*¹!Oy@*VYXËV³GTfÃf¯@�B7b¯_]G*D*OQ_hX�OQMHS�Ac_hX¯O³ÏE@�f¯´7JcOy\@�BEbdb7OQ¹�@�ÅEJc_P\y;

ÿ �eoWvPo�n��&m�~| n Ï�@�fô7JcOy\9G*¹|V³GTfÃfÃ@�BEb7\¦ORB�_]OQMhOybµ@/_H_hX�O%_]OQMvf¯ACBE@*J5@/MhO,ACBÎ_�I�´sOQSHMhAc_]OQMH¹�GTBT_QØà �÷�þ ú ��������� �� ç| <�B�D�JcO%[7Mh@*VP¶*OQ_P\NbEORB�G*_]O%´�@/Mh@�fmOQ_]OQMH^/@*JCÅ�Oy\UG*MH¶*OQI�S¦G*Mhb7\yØ «���������� ��ç| ÚEÇ�ÅE@/MhO%[EMh@*Vh¶*OQ_P\�bEORBEG*_]O%G�´E_PAcGTBE@*J)´7@/Mh@�f¯OQ_]OQMU^/@*JCÅ�Oy\HG*M�¶*OQI�S¦G*Mhb7\QØ������ � �ç7@*JWJ$G*_hXEOQM�´7@/Mh@�f¯OQ_]OQMh\U@�B7b¶*OQI�S¦G*Mhb7\U@/MhO,G�[7JWAcD�@/_]G*MPIsç| Û,OQI�S¦G*Mhb7\¤ÁÜ´7@/Mh@�f¯OQ_]OQMh\USNXEAWVvX1f¤ÅE\]_H_P@/¶*OgGTB�OgG*¹�@(B�Å7fg[�OQMUG*¹´EMPOy\]OQ_�^�@*JCÅEOy\³Âj@/MhO>ACBEb7AWVQ@/_]OybÝ[�Id[sG�JWb_�I�´sO*Ø,Ñ � Ø�Ø ² Ü�����Ò ÿ3;

×]BÄf¯G�\]_jVQ@*\]Oy\QF�» e Ú¯V³GTf(f¯@�BEb7\¦VQ@�BË[sONAW\h\hÅ�OybÄOyAc_hX�OQMH@/_9_hX�O�JcG�VQ@*J$ÅE\]OQM9ACB�_]OQMh¹�@*V³O�_]OQMvfÃACBE@*JsG*MH@/_j_hX�O�á�@�Ï7Ú�Õ_P@/_PAcGTBËMvÅ�B7BEACB�D>× e ?;�ìN\]OQMh\¦S�XEG>SUAW\vXÃ_]GmV³G�G*Mhb7ACBE@/_]O�V³GTBT_]MPG�J�G*¹!_]OyJcOy\hV³G�´�O,@�B7bÄACB7\]_]MvÅ7f¯ORB�_P\�@/MPO�ORBEV³GTÅ�Mh@/D*Oyb_]GÃ_P@/¶*O¤@*bE^/@�B�_P@/D*OgG*¹�_hX�O%JW@/_]_]OQM,f¯G�bEO�G*¹|G�´sOQMh@/_PAcGTB�; n ^*OQMPIËO³ÑsG*MP_�XE@*\U[sOQORBaf¯@*bEO�_]GËf¯@/¶*O%_hXEO%V³GTfÃfÃ@�BEb\]IEB�_P@�Ï1AWbEORB�_PAWVQ@*J|GTBa_hX�Og_�S¦Gdf¯@*VYXEACB�Oy\QF�[�Å�_Nb7A�ÑsOQMhORBEV³Oy\�[�OQ_�S�OQORBa_hX�O¤ã e ?Ì@�BEba× e ?·V³GTf(f¯@�BEbaJW@�B�DTÅE@/D*Oy\f¯@RI¯VQ@�ÅE\]O�\]GTf¯O�V³GTB�¹êÅE\PAcGTB�;�×]BÃD*ORB�OQMh@*JÜFEAc¹!@gV³GTfÃf¯@�B7bÃAW\jAW\P\hÅ�OybÄV³G*MPMPOyV³_PJcI(SUAc_hX(@*JWJ�G*¹)Ac_P\¦´�@/Mh@�fmOQ_]OQMh\yF�_hX�ORB_hX�O>_�S¦GË\PI�\]_]ORfÃ\HSUAWJWJ)[sORXE@y^*O¤\PACf¯AWJW@/MvJcI*; i G*_hX1V³GTf(f¯@�BEbdJW@�BEDTÅE@/D*Oy\�@/MPO>\]OQ_�ÅE´µ¹ÈG*M�f¯ACBEACf¤Å7f�fÃ@/_PVvXEACBEDÃG*¹V³GTfÃfÃ@�BEbË\]_]MhACB�D�\U@�BEbµB�OyAc_hX�OQM�AW\U\]ORBE\hAc_PAc^*O,_]G(VQ@*\]O*;�»UX�O%f¯@*ACBdb7A�ÑsOQMhORBEV³Oy\H@/MPO*Ø

å ;H× e ?ÆSUAWJWJL@*JcSj@yI�\,@*VP¶EB�GRS�JcOybED*OÃV³GTf¯´�JcOQ_PAcGTBµG*¹�@ÄV³GTf(f¯@�BEb$;�:HOy\h´�GTB7\]O>S�AWJWJ)[sO¤@*JCfmG�\]_�ACBE\]_P@�BT_P@�B�OQGTÅE\O³ÏEV³Oy´E_,¹�G*M%V³GTf(f¯@�BEb7\�S�XEAWVYX¡fmG.^*Om_hX�Om_]OyJcOy\PV³G�´sOÄf¯OyVvXE@�B7AW\hf¯\Q;g»UX�Oy\]OmV³GTfô7JcOQ_]O¯S�X�ORB1_hXEOÃfmOyVvX7@�ÕB7AW\hf¯\9V³GTBEV³OQMYB�Oybd@/MPO%ACBd´�G�\hAc_PAcGTB�;

Ô�;U²MPGTf¯´7_PACB�D¤¹ÈG*M�Å�BE\P´sOyVQAcÐ7OybÎACBE´�ÅE_UXE@*\Hb7A�Ñ�OQMPORBEV³Oy\9G*¹�bEOQ_P@*AWJÜ;k ; n MPMPG*MjfmOy\P\P@/D*Oy\¦b7A�Ñ�OQMyF�Å7\hÅE@*JWJcI¯ACBÃ_hX�O�\]ORB7\]OH_hXE@/_¦_hX�O�» e ÚgD�Ac^*Oy\j@%_]OQMv\]OQM¦@�B7b(fmG*MhOU@*VQVyÅ�Mh@/_]O�bEOy\PV³MhAW´EÕ_PAcGTBdG*¹|_hX�O,´EMPG�[7JcORfd;

ÓE;H× e ?¸b7G�Oy\,B�G*_�@*JWJcG.SÛ@ËV³GTfÃfÃ@�BEbµ_]Gd[sOmAW\P\hÅEOyb1Ac¹j@Ë´EMPOQ^�AcGTÅE\�@/_]_]ORf¯´7_�@/_�_hXEO¯\P@�fmO¤@*V³_PAcGTB¡AW\�\]_PAWJWJ�ACB´7MPG*D*MPOy\P\Q;�»UXEOU» e Úg@*JWJcG.SU\_hXEOUÐ7Mh\P_�V³GTfÃf¯@�B7b>_]Gg[sO9GR^*OQMPMhAWb�bEORB¯[�I¤_hX�OU\]OyV³GTBEb$;�»UXEAW\�VQ@�BÃ\]GTfmOQ_PACf¯Oy\JcOy@*bµ_]GôEMPG�[�JcORf¯\j¹�MPGTf × e ?'Á°GHF�±xF$Ac¹)_hX�O%SHMPGTB�DmG�[�É0OyV³_UAW\H\POyJcOyV³_]Oyb�ÂP;

æ�;U<¸¹ÈOQSÌV³GTfÃfÃ@�BEb7\ÁÜ´7MhACf¯@/MhAWJcI�_hXEG�\]O�SNXEAWVvXg´EMPG�b�ÅEV³O�\PV³MPOQORB>GTÅ�_P´�Å�_³Â5@/MPO9B�G*_|@y^/@*AWJW@*[7JcOH¹�MPGTf"× e ?;.»UX�Oy\PO@/MhO>B�G*_]OybdO³ÏE´7JWAWVQAc_PJcId[sOyJcGRS%;

& 7:9 �Ý&"!$# ë 2 �N; � Í�;»|Å�MvBÄG/Ñ�_hX�O�ORB�D�ACB�OQOQMvACB�D(fmG�bEO�@�BEb { G*MN\]G*¹�_�Sj@/MPO%JWACf¯Ac_�@*JW@/Mvf¯\Q;ãû¬xï¡è ñ á&% ûPþ�acÿQô#�4��÷_õ� �÷ «��'����(�) * �,+ � �-LG/. ñ ¹ � á æ % ûPþ�acÿQô#�4��÷� 4õ�÷�û_�_�0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % Ö Ò × Ò Ð _hÅ�MYB G/Ñß@�BÊ@*JW@/MYf VQ@�ÅE\]Oyb�[TIÊ@�BÊ@*Jc_PAc_hÅEbEO*F,@/ÖyACf¤Å�_hXÊG*M

MPG*_P@/_]G*M�\]G*¹�_�Sj@/MPO>JWACfÃAc_Qç² ÿ Ü�Ò ÿ ²V² ��Ò ÿ Ü _hÅ�MvBµG/Ñ·@�B1@*JW@/Mvf VQ@�Å7\]Oyb�[TIa@�B1Å�B�O³Ï�´sOyV³_]OybÝ\]SUAc_PVYXÝACB�_]GORB�D�ACBEOQOQMhACB�DÄf¯G�b7O*ç� Ö Ö _hÅEMvBÄG/Ñ¡@�B�IÎ@*JW@/Mvfd;

1�2 ñ è43 � G5% ûPþ�acÿQô#�4��÷� 4õ�÷æ k

Page 54: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

6 ¬JèLè�GuàQá æ % <�BÊ@*JW@/Mvf ÁÜV³GTBT_PACB�ÅEGTÅE\µ[7JcOQOy´�ACB�D�ÂÃAW\Î_]MhAcD*D*OQMPOyb�Ac¹>_hX�OÝ_]OyJcOy\PV³G�´sO¡G*MµMPG*_P@/_]G*MµORBEV³GTÅ�B�_]OQMh\µ@\]G*¹�_�Sj@/MPOgJWACf¯Ac_9S�XEAWJW\P_H_]Mh@*VP¶�ACB�D¯G*M�S�X�ORBÄMPOyÇ�Å�Oy\]_]Oybµ_]GÃ\PJcOQSà_]GÃ@�BËG�[�É0OyV³_U[sOyJcGRSà_hX�O>X�G*MhAcÖQGTBG*M¯Ac¹U@Ý\]S�Ac_PVvX·¹�MPGTfÀV³GTf¯´�Å�_]OQM¤_]GÝORB�D�ACB�OQOQMvACB�D¡fmG�bEOÃG�VQVyÅ�Mh\mÅ7B�O³ÏE´sOyV³_]Oyb7JcI ÁÜAÜ; O*;·B�G*_m@*\m@MPOy\vÅEJc_9G*¹�@�B½÷®ÿ�õ&ùWÿ�÷�÷�ý5ùWÿ�õmG*MN÷Uð&ùSø(V³GTf(f¯@�BEb5ÂP;

& 7[6 ���¡�¾�MhAc_]O>_hX�O,VyÅ�MPMPORBT_UV³GTBT_]ORB�_P\�G*¹L_hX�O,Oyb7Ac_U\PGTÅ�MhV³O,b7@/_P@¯@/MhOy@¯@*\U@ÃBEOQS"ORB�_]MhIÄACBË_hXEO>ÅE\]OQMUVQ@/_P@*JcG*DTÅEO*;ãû¬xï¡è ñ á&% ûU U -LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;

& 7[­ � Í + ;��N; & 8Ú�OyJcOyV³_�S�XEAWVvXd@�Å�_]G*DTÅEAWbEOQM�_]G(ÅE\]O*;ãû¬xï¡è ñ á&% û�õ�ö®÷_��÷�þxø «���7�*'8���7:9<;���( �=�<)>� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;»UXEO e @*\P\]OQD*Mh@*ACBµ@�Å�_]G*DTÅEAWbEOQMNAW\H\]OyJcOyV³_]OybaGTBÎ\]_P@/MP_hÅ7´5;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % á�@*JWAWb1@�Å�_]G*DTÅEAWbEOQMNBE@�fmOy\H@/MhO*ØÑ � ØAØ ² Ü�����Ò ÿ _hXEO e @*\P\]OQD*Mh@*ACBdG/Ñ�Õ�@�ÏEAW\N@�Å�_]G*DTÅEAWbEOQMyçÏ ² Ø�Ø5Ö Ò Ð _hX�Omì n Úa@�Å�_]G*DTÅEAWb7OQM>ÅE\]Oyb1_]GÎ^�AcOQSß_hX�O¯\P´sOyV³_]MPG*D*Mh@*´�X1\PJWAc_

@�BEbd_]G¯DTÅEAWbEO,GTBÎ_hX�O,G�[�É0OyV³_U[sOyACB�DmG�[7\]OQMh^*Oyb5çÏ ² ØAÑ@? ��� Ø ² _hXEO,ì n ÚË@�Å�_]G*DTÅEAWbEOQM�ÅE\]OybÎS�Ac_hXË_hX�O,V³G�@/Mh\]O>Ð�[EMPO�[�Å�BEb7JcO*çÏ ² Ø ÝMÒ ÿ ² _hXEO,ì n ÚË@�Å�_]G*DTÅEAWbEOQM�ÅE\]OybÎS�Ac_hXË_hX�O�Ð�B�O�Ð�[EMPO�[�Å7BEb�JcO*ç�·��Ò × ² _hXEO,´EMhACfmO³Õ�¹�G�VyÅE\jG/Ñ�Õ�@�ÏEAW\N@�Å�_]G*DTÅEAWbEOQMyç��Ý2h ÝMÒBA ² Ó _hXEO�ÐEÏ�Oybµ´EMPG�[sO�G*¹L_hXEO,<NÅ�_]G*Ð�[�Ô¤Ð�[EMhO�´sG�\PAc_PAcGTBEOQMyç��Ý2h ×C?ED Ò ÿ Ü _hXEO%fmGR^�ACB�Dô7MPG�[sONG*¹L_hX�O%<�Å�_]G*Ð�[�ÔgÐ�[EMPO,´sG�\PAc_PAcGTB�OQMR;1�2 ñ è43 � G æ % û�õ�ö®÷_��÷�þxø þ®ûPöcö6 ¬JèLè�GuàQá æ % »UXEO>» e ÚµB�OQOyb7\�_]G([sO%_]G�JWb1S�X7AWVvXa@�Å�_]G*DTÅEAWbEOQM�AW\�VyÅEMPMPORBT_PJcIµACBaÅ7\]O%ACBµG*MhbEOQMN_]GÄ´sOQMP¹�G*Mvf _hXEO

V³GTBT^*OQMh\PAcGTBa[sOQ_�S¦OQORBÎDTÅEAWbEO,\P_P@/M�´7A�Ï�OyJ$´sG�\PAc_PAcGTBÎ@�BEbµbEMhAc^*O,V³G*MPMPOyV³_PAcGTB7\Q;

& 7�ê � Í�\ � ; 2²LOQMP¹�G*Mvf @�Bd@*´sOQMP_hÅEMPO�G/Ñ�\]OQ_�_]G(fmG.^*O%@�BÎACfÃ@/D*O�GTB�_]G(_hX�O%@�Å�_]G*DTÅEAWb7OQM eHe ãg;ãû¬xï¡è ñ á&% û�õ�ô5ù�÷��-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;6 ¬JèLè�GuàQá æ % »UX7AW\UV³GTfÃfÃ@�BEbÎ@*JWJcGRS�\N@ÃÐ7OyJWbd_]GÄ[sO,^�AcOQS¦OybÝÅE\PACB�D¯_hXEO>@�Å�_]G*DTÅEAWb7OQMy;H<NBdG/Ñ�\POQ_�AW\N@*´7´7JWAcOybd_]G

f¯GR^*O%_hXEO%ACf¯@/D*O>¹ÈMPGTf�_hX�O>B�GTfÃACBE@*J5@*´sOQMP_hÅ�MPOÄÁêÅE\hÅE@*JWJcIË_hX�O>MPG*_P@/_]G*MNV³ORBT_]MPO/Âj_]GÃ_hX�O>V³ORB�_]MPOgG*¹_hX�OË@�Å�_]G*DTÅEAWb7OQM>Ð7OyJWb$;d×�_gAW\%Oy\h\]ORB�_PAW@*J¦_]G1_]OyJWJ¦_hX�O(» e ÚÝS�XEAWVYX3@�ÅE_]G*DTÅEAWbEOQMmAW\>ACB·ÅE\]OÄ@�BEb¡_]GbEOQÐsB�O,Ac_P\�´sG�\PAc_PAcGTBµACBË_hX�O>¹ÈG�VQ@*J$´7JW@�B�OÄÁêÅE\]O,_hX�O�û_õPöx÷_�c÷cþ®ø�F4��ýPô��÷(@�BEb*ðUö��®ýQô�c÷(V³GTfÃf¯@�B7b7\@*\NB�OyV³Oy\P\P@/MPI�ÂP;

& 7�� � � 8 � 8GF � ;`µGR^*O%_]G(_hX�O,\P´sOyVQAcÐ7Oybd@*Jc_PAc_hÅ7bEO%@�BEbd\P_]G�´5;ãû¬xï¡è ñ á&% û��®ø5ùSø�`_ �÷ «����'�=��� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;

æ�Ó

Page 55: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

0 ñ ï ñ è�GHá:Guï æ % »UXEO,@�B�D�JcO%ACBÎbEOQD*MhOQOy\Q;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % û��®ø5ùSø�`_ �÷ ���� ���6 ¬JèLè�GuàQá æ % »)Gµ´7@/MP¶1_hX�O¯_]OyJcOy\hV³G�´�OÄ@/_%_hX�OÃÖQORBEAc_hX�SUAc_hXEGTÅ�_%fmG.^�ACB�DaAc_%ACB�@/ÖyACf¤Å�_hX�F)_�I�´�O¤û_��ø&ùSøU`U P÷�HI7;

»UX7AW\)AW\�f¤ÅEVvX%¹Ü@*\]_]OQM|_hXE@�B,_hXEOjXE@/MvbES¦@/MhO o�n ÙU×0»H¿Ì²�<N:NÛ ¹ÜÅ7B7V³_PAcGTB>@�B7b>AW\|@*JWJ�_hXE@/_|AW\)MhOyÇ�ÅEAcMhOybACBÄfmG�\]_¦VQAcMhVyÅ7fÃ\]_P@�BEV³Oy\Q;�»)Mh@*VP¶�ACB�DmACBÃ@/ÖyACf¤Å�_hX(@�BEb(¹ÈG*M¦_hX�O�MPG*_P@/_]G*MH@/MPO�@*JW\PG¤b�AW\P@*[7JcOybÄ[TIm_hXEAW\V³GTf(f¯@�BEb5;

& 7�F � z¤;�� 8JF ��;Z�Ñ5\]OQ_H_hX�O�_]OyJcOy\hV³G�´�Og\]G¯_hXE@/_�@�BËG�[�É0OyV³_�fmG.^*Oy\U[�IÄ@m^*OyV³_]G*MNÐEÏ�OybdACBË_hX�O�¹�G�VQ@*J$´7JW@�B�O*;ãû¬xï¡è ñ á&% û���÷�ýcø�`�ýc÷ «�� + ��(,*�7'('� �,7,)�K=��( �-LG/. ñ ¹ � á æ % Ù�GTB�O*;�»UX�OUMPOQ¹ÈOQMhORBEV³ON´sG�\PAc_PAcGTBaÁÜ@*´sOQMP_hÅ�MPO l ÂLAW\¦\]OyJcOyV³_]OybÄGTBÃ\]_P@/Mh_hÅE´5;�»UXEAW\�AW\¦ÅE\vÅE@*JWJcIm@*JW\]G>_hXEO

MPG*_P@/_]G*M�V³ORBT_]MPO*F)Á l F l ÂP;0 ñ ï ñ è�GHá:Guï æ % »UXEOË@*´sOQMP_hÅEMPOËB�Å7fg[sOQMgAW\mACBº_hX�OËMh@�BED*O l.î å l ;·»UXEOÄV³G*MPMhOy\P´sGTBEb7ACB�DÌÁ ¢Æ : ÄJÆ Â,b7AW\P´�JW@*V³ORfmORBT_

f¤ÅE\]_ÄXE@y^*O�[sOQORB¸\]OQ_ÎÅE´ ´EMPOQ^�AcGTÅE\PJcI¸ACB'_hX�OaACB7Ac_PAW@*JWAW\P@/_PAcGTBÊÐ�JcO*F9G*MÎ[�I'ÅE\PACB�Dº_hX�O¥÷�ÿ�ø�÷�ý·G*MöxøPôxý�÷ÃV³GTfÃfÃ@�BEb7\Q;�û���÷�ý�øU`�ýc÷LIÃAW\9_hX�O,MPOQ¹�OQMPORBEV³O>´�G�\hAc_PAcGTB¡ÁÜ\]OQO>[sOyJcG.S�ÂP;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % û���÷�ýcø�`�ýc÷ �6 ¬JèLè�GuàQá æ % <N\�b7Oy\PV³MhAW[sOybÃACBËÚ�OyV³_PAcGTB k ;�é�FE@�BaÁ ¢&Æ : ÄJÆ Â|\hXEAc¹�_�ACBÃ_hX�OU¹�G�VQ@*J�´7JW@�BEO�AW\¦b7Ac^�AWb7Oyb(ACBT_]G>_�S�G¤´7@/MP_P\yØ

_hX�ONMPOQ¹�OQMPORBEV³O�´sG�\PAc_PAcGTB�F�S�XEAWVYXÄAW\jÅ�BE@*Jc_]OQMPOybÄGTBÄ\]GTÅ�MhV³O�VvXE@�BED*O�@�B7bÄ@�BÄ@*´sOQMP_hÅ�MhOUG/Ñ5\]OQ_jS�XEAWVvXAW\�MhOy\]OQ_�_]G�ÖQOQMPG,GTB¯\]GTÅ�MhV³OHVYXE@�B�D*O*;�»UX�O_û���÷�ýcø�`�ýc÷%V³GTfÃf¯@�B7b>´EMhGR^�AWbEOy\�@,fmOy@�B7\|G*¹s\]S�Ac_PVvXEACB�D[sOQ_�S¦OQORBÎ_hXEO,MPOQ¹�OQMPORBEV³O%´sG�\PAc_PAcGTBÎ@�B7bd´EMPOQ^�AcGTÅE\PJcI�Õ�bEOQÐ�B�OybÎ@*´sOQMP_hÅEMPO�G/Ñ�\POQ_P\Q;

& 7 \ � F38 ë�Í F �.� ;?$G�VP¶ËG*M�Å�BEJcG�Vh¶Ë_hX�O eHe ãâ@�Å�_]G*DTÅEAWb7OQM�JcG�G�´5;ãû¬xï¡è ñ á&% ûU`cøQô�õ�`gù� P÷ «NMO*=��*'� � ���P� -LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % »UXEOÄG�´7_PAcGTBE@*JH´7@/Mh@�f¯OQ_]OQMh\>ÏÆ@�B7bÆIº@/MPOÎ_hX�Odb7Oy\PAcMPOybÆ´7A�Ï�OyJ9V³G�G*Mhb�ACBE@/_]Oy\m¹�G*M¯_hX�OËDTÅEAWbEOd\]_P@/M

@�BEbÎ@/MhO�Å7\]OybËSUAc_hXÄ_hX�OQ?rÿ ¶*OQI�S�G*Mhb$;�×�¹!_hX�OQIÄ@/MhO�BEG*_H\P´sOyVQAcÐ7Oyb5F�_hX�O�\]I�\]_]ORf SUAWJWJ�@*bEG�´E_9_hXEOVyÅ�MhMPORB�_H´sG�\PAc_PAcGTBdG*¹)_hXEO,DTÅEAWbEO,\]_P@/MR;ä=G ç ­�¬Jï�í æ % á�@*JWAWb1@�Å�_]G*DTÅEAWbEOQM�\]_P@/_]Oy\�@/MhO*Ø

?�ÿ \P´sOyVQAc¹�I�ACBED·_hX7@/_Î_hX�O�_]OyJcOy\PV³G�´sO¡\hX�GTÅEJWb¼[sOÝDTÅEAWbEOyb¼ACB MhO³Õ\P´sGTBE\PO�_]G¯DTÅEAWb7ACB�DmOQMhMPG*Mh\9¹�MPGTf _hX�O eHe ãâ@�Å�_]G*DTÅEAWbEOQMR;

? ÝMÝ \P´sOyVQAc¹�I�ACB�DÄ_hXE@/_�@�Å�_]G*DTÅEAWb�ACB�DÄ\vX�GTÅEJWbÝ[sO>\]SUAc_PVYX�OybÝG/Ñ|FBE�F�GHF_hXE@/_j@�BTImDTÅEAWb7ACB�D,OQMhMPG*Mh\�¹�MPGTfÒ_hX�O eHe ã"@�Å�_]G*DTÅEAWbEOQMj\hX�GTÅ7JWb[sO,AcDTB�G*MPOyb$;ØgÏYØ � ² ÿ¥Ó ²�Å�_�_hX�O�» e ÚmACB(@>\P_P@/_]O�S�XEOQMPO�´7A�Ï�OyJ�V³G�G*Mhb7ACB7@/_]Oy\¦@/MhO�MPOy@*b¹�MPGTfÒ_hX�O�@�Å�_]G*DTÅ7AWbEOQM¦@�B7b¯_hX�ONVyÅ�MPMPORBT_MPOQ¹�OQMPORBEV³ON´sG�\PAc_PAcGTBÃAW\fÃ@*ACB�_P@*ACB�Oyb$F�[�Å�_9DTÅEAWb�ACB�DmOQMPMPG*Mh\U@/MPO%B�G*_U@*´7´�JWAcOyb5;� ² ØgÏÀ× ² :UOy\]_P@/MP_HDTÅ7AWb7ACB�D¯Ac¹|_hX�O,JcG�G�´aXE@*\H[sOQORBË\hÅ7\P´sORBEbEOyb5;

1�2 ñ è43 � G æ % ûU`cøQô�õ�`gù� P÷üôJÿûU`cøQô�õ�`gù� P÷üôJÿ ú ���R�����S �6 ¬JèLè�GuàQá æ % »UXEO%@�Å�_]G*DTÅEAWbEOQMN\]ORBEb7\HÏ�Iδ7A�Ï�OyJ$V³G�G*Mhb7ACBE@/_]Oy\�G*¹�@¯DTÅEAWb7O%\]_P@/MN_]G¯_hX�O%_]OyJcOy\hV³G�´�OgV³GTB�_]MhG�J)V³GTfmÕ

´�ÅE_]OQMy;�»UX�O�» e Ú¤_hX�ORBÄ@*b/ÉPÅE\]_P\_hX�ON_]OyJcOy\PV³G�´sO�b7MhAc^*Oy\¦_]G>¶*OQOy´Ä_hX�O�\]_P@/Mj@/_j@%D�Ac^*ORBËJcG�VQ@/_PAcGTBÄGTB_hX�OH@�ÅE_]G*DTÅEAWbEOQM eHe ãg;/×�¹�_hX�OHACBT_]ORB�_PAcGTB¯AW\|_]G%f¯@*ACBT_P@*ACB¤_hX�O9VyÅ�MPMPORBT_�´sG�\PAc_PAcGTBEACB�D�G*¹�@�Ð�OyJWbdÁ°GHF�±xFAc¹�@*VQÇ�ÅEAW\PAc_PAcGTBÎGTBT_]G(@Ã\P´sOyV³_]MPG*D*Mh@*´�XÎ\hJWAc_�XE@*\H[sOQORBË^*OQMhAcÐ�Oyb�ÂPF7_hX�ORBË_hXEO%V³GTfÃfÃ@�BEb�û�`�øPô�õ�`5ù� �÷ôxÿµ\hX�GTÅ7JWb1[sOmÅE\]Oyb5;,»�XEAW\N_P@/¶*Oy\�_hX�O¤Ð7Mh\]_�´sG�\PAc_PAcGTB1MPOyV³OyAc^*Oyb�¹�MPGTf _hX�Om@�Å�_]G*DTÅEAWb7OQM,@/¹È_]OQM,_hXEO

æ*æ

Page 56: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

V³GTf(f¯@�BEb¯AW\¦AW\P\hÅEOyb5F�@�BEbö*OQOy´7\�_hX�OUDTÅEAWb7O�\]_P@/M¦_hX�OQMPO*;�Z�B¯_hX�OUG*_hXEOQMjXE@�B7b5F�Ac¹�_hX�ON@�Å�_]G*DTÅEAWbEOQMV³G�G*Mhb7ACBE@/_]Oy\¤@/MPOË@*JcMPOy@*bEI3¶�B�G.S�B�F|_hX�ORB3_hX�O(@*´�´EMPG�´EMhAW@/_]OËV³GTfÃfÃ@�BEb¡AW\zû�`�øQô�õ�`5ù� P÷�ôxÿL�P�s;»UXEOQMPO�@/MPO,_�S¦GÃVQ@*\]Oy\US�X�OQMPO�_hXEAW\UAW\HJWAc¶*OyJcIË_]GÃ[sO�Å7\]OQ¹ÜÅ7JÜ;|»�X�O�Ð7Mh\]_9AW\9SNX�ORBË@�BÄG�[7\]OQMP^/@/_PAcGTBdAW\_]GË[sO,MPOy´sOy@/_]Oybµ@�BEba_hX�O,Ð�OyJWbaAW\U_]GÄ[sO%´sG�\PAc_PAcGTB�Oyb1@/_U_hXEO>\P@�f¯O%´7JW@*V³OgGTBÎ_hX�OgbEOQ_]OyV³_]G*My;U»UXEODTÅEAWb7Og´EMhG�[�O¤@�BEb1´7A�Ï�OyJL´sG�\PAc_PAcGTB7\N\vX�GTÅEJWb1[�OgMPOy´sOy@/_]Oyb5;,»UXEO>\]OyV³GTBEb�VQ@*\PO¤AW\NDTÅEAWb�ACB�DËGTBµ_hXEO_P@/MPD*OQ_�G�[�É0OyV³_�ÅE\PACB�Dm_hXEO,ì n ÚË\PJWAc_H^�AcOQS�OQMR;»UX�O�ÏÎ@�BEbÎIË\hX�GTÅEJWbÎ[sO�_hX�O,´�A�Ï�OyJ$V³G�G*Mhb7ACB7@/_]Oy\HG*¹_hX�O(V³ORB�_]MPOÃG*¹¦_hXEO¯\PJWAc_Q;ÃÙ�G*_]OÃ_hXE@/_QF)¹ÈG*M,_]OyVYX7BEAWVQ@*J�MPOy@*\]GTBE\%V³GTB7B�OyV³_]Oyb¡S�Ac_hX¡ÅE\]OmG*¹j_hX�O¯V³GTfmÕfÃ@�BEb¯¹�MPGTfÒ× e ?FT_hX�O�V³GTfÃfÃ@�BEb=ûU`cøQô�õ�`gù� P÷üôJÿUT;úVTRú�f¯Oy@�BE\�_hX�O�\P@�f¯O�@*\ ûU`cøQô�õ�`gù� P÷�ôxÿs;»UXEOÄ» e Úºf¤ÅE\P_g[sOÄ_]G�JWbÆ_hX�OÎ@�Å�_]G*DTÅEAWbEOQM¯ACBÌÅE\POÝÁÜ\]OQO½û�õPöx÷_��÷�þ®ø�Â�@�BEb5F@/_ e @*\P\POQD*Mh@*ACB�F_hXEOG*MhAcORBT_P@/_PAcGTBËG*¹$_hXEONDTÅ7AWbEON´7MPG�[sOgÁÜ\]OQO��ýPô�c÷�ÂPFTG*_hXEOQMPSUAW\]ON_hX�O�_]OyJcOy\PV³G�´sO�V³G*MPMPOyV³_PAcGTBE\jSUAWJWJ�[sO�ACB_hX�OgSHMPGTBEDÃb7AcMPOyV³_PAcGTB�;N»UX�O>¹ÜÅ7B7V³_PAcGTBd¶*OQI WYX,Z GTBµ_hX�O>» e Ú˶*OQI�[sG�@/MhbaAW\�OyÇ�ÅEAc^�@*JcORBT_�_]G(_hXEOûU`cøQô�õ�`gù� P÷üôJõcõµV³GTfÃfÃ@�BEb5;�»UX�Og¹ÜÅ�BEV³_PAcGTBa¶*OQI WYX�[ GTB1_hX�O¤» e Úµ¶*OQI�[�G�@/Mvb1AW\NOyÇ�ÅEAc^/@*JcORB�__]G¯_hXEO·û�`�øQô�õ�`5ù� P÷�ôxÿÄV³GTf(f¯@�BEb$;

& 7�d �$\M�.� F¡8 6`µGR^*O%_]G(_hX�O,\P´sOyVQAcÐ7Oybd@/ÖyACf¤Å�_hXd@�BEbd\]_]G�´5;ãû¬xï¡è ñ á&% û4øeùWú_`cø_� «��<�'����� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % »UXEO,@�B�D�JcO%ACBÎbEOQD*MhOQOy\Q;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % û4øeùWú_`cø_� ������ �,�6 ¬JèLè�GuàQá æ % »)Mh@*VP¶�ACB�DÄACBÎ@*Jc_PAc_hÅEbEO%@�B7bιÈG*MU_hX�O,MPG*_P@/_]G*MN@/MPO%@*JW\]GÃb�AW\P@*[7JcOybd[�IË_hXEAW\HV³GTfÃfÃ@�BEb5;

& 7�u » ; ��� +)2 � 8 &Ä6Z�Ñ5\]OQ_H_hX�O�_]OyJcOy\hV³G�´�Og\]G¯_hXE@/_�@�BÎACf¯@/D*O>f¯GR^*Oy\H[�IÎ@¤^*OyV³_]G*M�Ð7Ï�OybdACBÎ_hX�O,¹�G�VQ@*J$´�JW@�B�O*;ãû¬xï¡è ñ á&% �÷®û�úeö#�gùWøPþ�� «�8�]]�M���* �;� «�8�],]>M���* �p�-LG/. ñ ¹ � á æ % Ù�GTB�O*;¦Z�B(\]GTÅ�MvV³O�VYXE@�B�D*O¯Á°GHF�±xF$õ�ôxøQô�ÂPF�G/Ñ�\]OQ_P\U@/MPO�MhOy\]OQ_j_]Gg_]G¤_hX�O,B�GTfÃACBE@*J7^/@*JCÅ�Oy\,Á�_hXEAW\9VQ@�B

@*JW\]G([�O,b7GTB�O�SUAc_hXË_hX�O[c÷�û®úeö��5ùSø�þ��LIPI¯G*MNû_�c÷®ýcøU`cý�÷�IÃV³GTfÃfÃ@�BEb7\QØ�\]OQO�û_�c÷®ýcøU`cý�÷7ÂP;0 ñ ï ñ è�GHá:Guï æ % »UXEO,@*´�OQMh_hÅ�MPOÃÁ ¢ Æ : Ä Æ Â�´sG�\PAc_PAcGTB7\HACBÎ@/MhVQ\]OyV³GTB7b7\Q;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % �÷®û�úeö#�gùWøPþ�� � I R� T;úOII& 7:9(x » � �O#·� ë$yy + ; 8Z�Ñ5\]OQ_U[sOQ_�S¦OQORBd@¤MhOQ¹ÈOQMPORB7V³O,G�[�É0OyV³_HS�XEAWVYXdAW\HV³ORBT_]MPOybdGTBÎ_hX�O%@*VQÇ�ÅEAW\PAc_PAcGTBd»Háâ@�B7bÎ@m¹�@*ACBT_H_P@/MPD*OQ_�G�[�É0OyV³_Q;ãû¬xï¡è ñ á&% ��ùSÿU ôxõ�õQöx÷�ø «NM�8<7'(�^�� ���<)�� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % »UXEO%BE@�fmO�G*¹|_hX�O,¹Ü@*ACB�_U_P@/MPD*OQ_UG�[�É0OyV³_Q;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % ��ùSÿU _I � ú ��`'�,� ÷6 ¬JèLè�GuàQá æ % »UX7AW\�AW\�_hX�O�\]_P@�BEb7@/MhbËfmOQ_hXEG�bùÈG*MjJcG�VQ@/_PACBEDg^*OQMhI¯¹�@*ACBT_¦G�[�É�OyV³_P\yF�SNXEAWVvX(@/MPO�b7A�ÕÃVyÅEJc_¦G*M¦ACfôsG�\0Õ

\PAW[�JcO%_]GË\]OQO%GTBµ_hX�O>@*VQÇ�ÅEAW\PAc_PAcGTB1»9ág;�<NVQVyÅ�Mh@/_]O¤´sG�\PAc_PAcGTBE\�¹ÈG*M�@Ã[7MhAcDTX�_PAW\vXµ\]_P@/M�@�BEbµ_hX�O%¹Ü@*ACB�__P@/MPD*OQ_UG�[�É�OyV³_Uf¤ÅE\P_¦[sONORB�_]OQMPOybµACBÃ_hXEO�VQ@/_P@*JcG*DTÅEO*;9Ú�JcOQS¼_]Gm_hXEO�[7MhAcDTX�_9\]_P@/MUÅ7\PACB�D�õ�ô�þ®û�øÃ@�B7bV³ORBT_]MPO¯Ac_�GTB1_hX�O¤MPOQ¹�OQMPORBEV³O¯´sG�\PAc_PAcGTB1SUAc_hX1_hXEOmX7@�BEb7\]OQ_N¶*OQI�\y;g»UXEORBµ_�I�´sO���ùSÿ� «aM�8�7�(>^�����b)>� �3¹�G*M)_hXEO�¹Ü@*ACB�_|G�[�É0OyV³_Q;�»UXEAW\)G/Ñ�\POQ_P\|_hX�O�_]OyJcOy\hV³G�´�OH\PG�_hXE@/_|_hX�O¦¹Ü@*ACB�_LG�[�É0OyV³_|AW\|@*VQVyÅ�Mv@/_]OyJcI@*JWAcDTB�OybdSUAc_hX(_hX�O�MPOQ¹ÈOQMhORBEV³O�´�G�\hAc_PAcGTB�;�×�_9VQ@�BÄ_hX�ORBÄ[sO�fmGR^*OybÎ@/MhGTÅ7BEbÄ_hX�O�bEOQ_]OyV³_]G*MNÅE\hACB�D>_hXEO�÷®û�úeö#�gùWøPþ��(G*MVû���÷�ý�øU`�ýc÷ËV³GTfÃfÃ@�BEb7\Q;&_�&ùSÿ� ôJõcõPö®÷�øË´sOQMP¹�G*MvfÃ\U@ÄJcG�VQ@*J|V³G*MPMPOyV³_PAcGTB�_]GÄ_hXEO

æ*è

Page 57: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

´sG�ACBT_PACB�DµfmG�bEOyJÜF!@*\P\vÅ7f¯ACB�DÄ_hXE@/_,_hXEO¯´�G�\hAc_PAcGTB�G*¹¦_hX�OmMPOQ¹�OQMPORBEV³O¯G�[�É0OyV³_,AW\%@*VQVyÅEMh@/_]O*;ÄÚEÅE[�\]O³ÕÇ�Å�ORBT_¦O³Ï�OyVyÅ�_PAcGTBE\HG*¹���ùSÿ� ôJõcõQöx÷�ø¯@*JWJ5ÅE\]ON_hXEAW\9V³G*MPMPOyV³_PAcGTB�F�\]Gm\]OQ^*OQMh@*J�¹Ü@*ACB�_jG�[�É0OyV³_P\HVQ@�BË[sOG�[7\POQMP^*OybµÅE\PACBEDg_hXEO,\P@�fmO�MPOQ¹�OQMPORBEV³O,\]_P@/MR;»UX�OVÿ�÷�ðcø�F4õPôJøQô¤@�BEbSõPô�þxûcøÃV³GTfÃfÃ@�BEb7\¦MPOQ^*OQMP_9_]G_hX�O>bEOQ¹�@�Å7Jc_9D�JcG�[7@*J!´sG�ACBT_PACB�DÃ\]G�JCÅ�_PAcGTB5;

& 7:9�9 &Ä� � �T» � � 8 ;ìN´sb�@/_]O,´�G�ACBT_PACB�DÃV³G�OuÕÃVQAcORBT_P\�@/_U_hX�O%\]_P@/MP_UG*¹L@�BËG�[�\]OQMP^�ACB�DÃ\]Oy\P\hAcGTB�;ãû¬xï¡è ñ á&% þ®û_�&ùT�ýcû�ø�÷ «NM�8'�b7*c9�8�� �-LG/. ñ ¹ � á æ % þ®û_�&ùT�ýcû�ø�÷�ÿc÷��0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % á�@*JWAWb1VQ@*JWAW[EMh@/_]Og\]G�JCÅ�_PAcGTBE\H@/MhO*ØÖ � Ø�Ð MPOyVQ@*JWJW\�_hX�O>JW@*\P_�´sG�ACB�_PACBEDÄ\]G�JCÅE_PAcGTB�;U»UXEAW\Nf¯@RIË[sO¤ÅE\]OQ¹êÅEJ$Ac¹

_hX�OUMvÅ7B7BEACBEDNG*¹�_hX�O�V³GTB�_]MPG�J�´EMPG*D*Mh@�fÒXE@*\�[sOQORBmACBT_]OQMPMvÅE´E_]Oyb$F[�ÅE_�b7G�Oy\%BEG*_�ORBE\hÅ�MPO¤^*OQMPIÝ@*VQVyÅ�Mh@/_]O(´�G�ACBT_PACB�Dd[sOyVQ@�ÅE\]Om_hXEOORBEV³G�bEOQM�ÖQOQMPG/Õ�´sG�ACB�_P\Nf¯@yIÎXE@R^*O>VvX7@�B�D*Oyb5;Ó ² Ýg� ϽÖgÐ MPOQ^*OQMP_P\(_]Gº_hXEO1bEOQ¹Ü@�ÅEJc_Ä´�G�ACBT_PACB�D·\]G�JCÅ�_PAcGTB ACB¸_hXEOaACBEAc_PAW@*J�ÕAW\P@/_PAcGTB�Ð�JcO*; »UXEAW\dAW\d@'\hÅEAc_P@*[7JcO·V³GTÅ�Mh\]O�G*¹m@*V³_PAcGTBàAc¹g_hXEOþ®û_�&ùT�ýcû�ø�÷ÃV³GTf(f¯@�BEb˹Ü@*AWJW\>Á°GWF ±®F�D�Ac^*Oy\N^*OQMPIÎJW@/MPD*O>Mvf¯\9OQMPÕMPG*Mv\³ÂP;ÿ ² � ´�@*VP¶/@/D*Oy\�@,\POyÇ�Å�ORB7V³OHG*¹5V³GTfÃf¯@�B7b7\L_]G%bEG%@�\hXEG*MP_´sG�ACB�_PACBEDVQ@*JWAW[EMv@/_PAcGTB�;

1�2 ñ è43 � G æ % þ®û_�&ùT�ýcû�ø�÷þ®û_�&ùT�ýcû�ø�÷ �®ûQöJø6 ¬JèLè�GuàQá æ % »UXEOLþ®û_�&ùT�ýcû�ø�÷Âÿc÷��µV³GTfÃfÃ@�BEb1ACBEAc_PAW@/_]Oy\,@�BÝ@�Å�_]GTfÃ@/_PAWVg\POyÇ�Å�ORB7V³OgSNXEAWVvXÝbEG�Oy\�@ÄMPOy\]_]MhAWV³_]Oyb

´sG�ACBT_PACB�D>fmOy@*\vÅ�MPORfmORBT_�GTB(é�\]_P@/Mh\�¹�MPGTfï_hX�OU´sG�ACB�_PACBED,D*MhAWbÃACB¯G*MhbEOQM�_]G>ÅE´�b7@/_]OH_hX�OU^�@*JCÅ�Oy\¹ÈG*M_hX�OgORBEV³G�bEOQM�ÖQOQMPG/Õ�´sG�ACB�_P\�ACBa@/ÖyACf¤Å�_hX1@�BEbaOyJcOQ^�@/_PAcGTB�@�B7ba_hXEOgV³G�JWJWACfÃ@/_PAcGTB1OQMPMPG*M�ACBa@/ÖyACf¤Å�_hX5;Ú�_P@/Mv\�@/MPOm\]OyJcOyV³_]Oyb¡_]GÎ[sOmVQJcG�\]Om_]GÎ_hX�O¯fmOQMhAWb�AW@�Bµ@�BEbÝOyAc_hXEOQM,ÙUG*MP_hX1G*M>Ú�GTÅ�_hXaG*¹_hX�O¤ÖQORBEAc_hX�FbEOy´sORBEb�ACB�DHGTB>_hX�O�ACB7Ac_PAW@*J�@/ÖyACf¤Å�_hX5;L<ÌMv@�B�D*O�G*¹EOyJcOQ^/@/_PAcGTBE\f¤ÅE\P_![sO�V³GR^*OQMhOyb5;�»UX�O�_]OyJcOy\PV³G�´sOjAW\bEMvAc^*ORBm_]G,_hX�OUÐ7Mh\]_�\]_P@/M¦@�BEbm_hX�ONXE@�BEb7\]OQ_¦fmG�bEO9AW\\]OyJcOyV³_]Oyb5;¾ÊX�ORBm_hX�OH_]OyJcOy\PV³G�´sO�AW\_]Mh@*VP¶�ACB�DEF_hX�O�\]_P@/M�\hX�GTÅEJWbË[sO�f¯GR^*OybËGTBÄ_]Gm_hX�O�MPOQ¹�OQMPORBEV³O�´sG�\PAc_PAcGTBÎÅE\hACB�D¤_hX�O,XE@�BEb7\]OQ_j¶*OQI�\Q;¦Z�B7V³ONI*GTÅ@/MPOd\h@/_PAW\]Ð7Oyb5F¦´EMPOy\P\g_hX�O dfehgjilk5m=n ¶*OQI*;Ì»UX7AW\gJcG*D�\Ã_hX�OδsG�\PAc_PAcGTBÌ@�BEbÌbEMvAc^*Oy\¤_]G�_hX�OµB�O³Ï�_\]_P@/MR;¤:UOy´sOy@/_�_hX�Oy\]OmG�´sOQMh@/_PAcGTBE\%Å�B�_PAWJ�@*JWJéÄ´sG�\PAc_PAcGTBE\>XE@y^*OÃ[sOQORB1JcG*D*D*Oyb5;�K�GTÅÝS�AWJWJ|_hX�ORB�[sO@*\]¶*Oyb¸S�X�OQ_hX�OQMm@*JWJjG*¹N_hX�OÎ\]_P@/Mh\¤S¦OQMPOdV³ORB�_]MhOybÌV³G*MPMPOyV³_PJcI*;Æ×�¹�I*GTÅÆbEG¡B�G*_m@�BE\]S¦OQM�ö3_]G�_hXEAW\Ç�Å�Oy\]_PAcGTB�F!_hX�ORB1_hX�O¯´EMPG�V³Oyb�Å�MhO>SUAWJWJ�[sOm@*[sG*MP_]Oyb5;¤»UX�OmbEOQMhAc^*Oyb�@�B7b�´EMPOQ^�AcGTÅE\�^�@*JCÅEOy\�SUAWJWJ�[sOb7AW\h´7JW@yI*Oyb5Fs_]G*D*OQ_hX�OQM�SUAc_hXd_hX�OyAcM�MR;�fÎ;=\Q;�OQMPMPG*Mh\QFs@�BEbdI*GTŵSUAWJWJ)[�O>@*\]¶*OybµSNX�OQ_hX�OQMU_hXEO%\]G�JCÅ�_PAcGTBAW\9MhOy@*\]GTBE@*[7JcO*;»�X�O�OQMPMPG*Mh\H\vX�GTÅEJWbË[sO�ACBÎ_hX�O�Mh@�B�D*O l ;�æ î å ; l @/MhVQ\]OyV�¹�G*M9× n F å ; l.î Ô�; l @/MhVQ\POyV�¹ÈG*Me <Ò@�BEb å ; l.î�k ; l @/MvVQ\]OyV%¹�G*M�×�<>;s×�¹�_hX�O>OQMPMPG*Mh\N@/MPOmf¤ÅEVvXaJW@/MPD*OQM�_hXE@�Ba_hX�Oy\]Og^�@*JCÅEOy\QF�_hXEORBµ_hXEO\]G�JCÅE_PAcGTBd\hX�GTÅ7JWbd[sO�MPO0É�OyV³_]Oyb$;¦ì�BEJcOy\P\U_hX�OQMPO>XE@*\U[�OQORBd@(f¯@�É0G*MHVvX7@�B�D*O%G*¹�V³GTB�Ð7DTÅEMh@/_PAcGTB�F�_hXEOV³G�OuÕÃVQAcORBT_P\,\hX�GTÅEJWb�B�G*_�@*Jc_]OQM%[�IafmG*MhO%_hXE@�B1@ĹÈOQSß@/MhVQ\POyV³GTBEb7\�¹�MPGTf BEAcDTX�_�_]GdBEAcDTXT_Q;>KNMPG�\P\b7A�Ñ�OQMPORBEV³Oy\mfÃ@yI¡ACBEb7AWVQ@/_]OË@1´EMPG�[7JcORfd; e »H:U? î�o fÃ@yI�[sOÄÅE\]Oybº_]GÝ@*[�G*Mh_%_hX�OÄ´EMPG�V³Oyb�Å�MPOÃ@/_@�BTIµ_PACf¯O*F�[�Å�_N@*JWJLG*¹�_hX�O¤f¯Oy@*\hÅ�MPORf¯ORB�_P\�SUAWJWJ|[sOgJcG�\P_Q;,ÙUG*_]Om_hXE@/_QF$@*Jc_hXEGTÅ�DTX1_hXEAW\�V³GTfÃfÃ@�BEbAW\H@R^�@*AWJW@*[�JcO>GTBË_hXEO,\]I�\P_]ORf V³GTf¯´�ÅE_]OQM%Á�¹ÈMPGTf × e ?�ÂPFEI*GTÅËSUAWJWJBàR¬Já5[sO,@*\]¶*OybÎS�X�OQ_hXEOQMU@*JWJ$\]_P@/Mh\XE@R^*O>[sOQORBËV³ORBT_]MPOybµV³G*MPMhOyV³_PJcIÎG*MHS�X�OQ_hX�OQMU_hX�O%\]G�JCÅ�_PAcGTBµAW\H@*VQV³Oy´E_P@*[7JcO*;

& 7:96 &Ä�º+�+ ;�ÍD� ���b#Ú�OyJcOyV³_�_hX�O e @*\P\]OQD*Mv@*ACBι�G�VQ@*J$\P_P@/_PAcGTB�;ãû¬xï¡è ñ á&% þ®ûPöcö®÷Uõ�ý�û5ùSÿ

æ�é

Page 58: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;6 ¬JèLè�GuàQá æ % <N´7´7JWAcOy\ e @*\P\]OQD*Mh@*ACB ´sG�ACB�_PACBED·fmG�bEOyJÜF¦ORBE@*[7JcOy\ e @*\P\]OQD*Mv@*ACB¸MPG*_P@/_]G*MË@�BEb b7AW\P@*[7JcOy\(@*JWJUG*_hX�OQM

MPG*_P@/_]G*Mv\Q;�Ù�G*_]O>_hX7@/_�_hX�OgÙ�@*\vf%I�_hX�Å�@/_o¤ ñ àQà(¬Já�[sO>\]_]G.S�Oyb�Å7BEb7OQMUV³GTf¯´�ÅE_]OQM�V³GTBT_]MPG�JÜF5\]G(_hXEO[�ÅE_]_]GTBËGTBË_hX�O,ORBED�ACB�OQOQMhACB�DÃb7Oy\]¶Ëf¤ÅE\P_j[sO%ÅE\POybιÈG*MU_hXEAW\H´�Å�Mv´�G�\PO*;

& 7:9­ &Ä� 8 � �Të�Í F ;ãNOyJcOQ_]Oº_hXEO3VyÅ�MPMPORBT_d» e ÚÊÅ7\]OQMµACBT_]OQMP¹�@*V³O·VQ@/_P@*JcG*DTÅ�OÆ@�BEb"V³G�´�I¼_hX�O3BE@�fmOyb�[7ACBE@/MPI Ð�JcO3@*\d_hXEOºB�OQS½ÅE\POQMVQ@/_P@*JcG*DTÅ�O*;ãû¬xï¡è ñ á&% þ®û�øcû���ô�õ�`P÷ «N^���*=����8���7�� �=�<)>� �-LG/. ñ ¹ � á æ % Ù�G�b7O*Ø��U�Uô_�F

ã�AcMPOyV³_]G*MPIsØ�`eö®÷®ý þxûcøsFn Ï�_]ORBE\hAcGTB�Ø öJû_ô�;

0 ñ ï ñ è�GHá:Guï æ % »UXEO%BE@�fmO�G*¹|_hX�O%ACBE´�Å�_9VQ@/_P@*JcG*DTÅ�OgACBÎ_hX�O,¹�G*Mvf¯@/_QØ��,� «o��8�;'� �qp,pr «s;���tc9,^�� �upv «s;=9<('�'^O*'8�( �;�s «w]�9,��� �u� «4� � *'�<�:M9<8�� �w �;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;

1�2 ñ è43 � G æ % þ®û�øcû���ô�õ�`P÷m`Qö®÷®ý þ®û�øop�þ®ûcø öJû_ôsFTG*Mþ®û�øcû���ô�õ�`P÷�þxûcø6 ¬JèLè�GuàQá æ % »UXEO�[7ACBE@/MhI¯Ð�JcO�AW\jV³G�´7AcOybÎACBT_]GmfmORfmG*MhI¤@*\¦_hX�O�VyÅ�MPMhORB�_9ÅE\]OQMjVQ@/_P@*JcG*DTÅ�O*; n ÏEAW\]_PACB�DgORB�_]MhAcOy\9@/MhO

JcG�\]_Q;�<NJc_hX�GTÅ�DTXg_hX�O9V³GTf(f¯@�BEb>VQ@�B¤[�O9ÅE\]Oybg_]G�V³G�´�I>@NÐ�JcOj¹ÈMhGTf�_hXEO¦b7@/_P@�MhOyb�ÅEV³_PAcGTBgV³GTf¯´�ÅE_]OQMÁÜ\]OQON[sOyJcGRS�ÂPF�Ac_AW\�O³ÏE´sOyV³_]Oyb¯_hXE@/_�_hX�OUB�G*MvfÃ@*J7fmG�bEOjG*¹5Å7\]OHSUAWJWJ7[sO9_]G%V³G�´�I¯@�_]O³Ï�_�Ð�JcOUACBT_]G%_hXEOÅE\POQMVQ@/_P@*JcG*DTÅ�ONSUAc_hX½ùSÿ�þU��`_ P÷(Á�òWF��SF�ÂPFT_]G%b�Å�f¯´¤@,[7ACBE@/MhIgV³G�´�I¤_]G,_hX�OUbEOQ¹Ü@�ÅEJc_VQ@/_P@*JcG*DTÅEON@/MPOy@GTB(_hX�ON_]OyJcOy\PV³G�´sO�V³GTf¯´�Å�_]OQM¦SUAc_hXr U`cú4� «s]�9,���<���b)>� �¸@�BEb(_hX�ORB¯_]G�þ®û�øcû���ô�õ�`P÷>_hXEAW\jV³G�´TI¯GTB\hÅ7[7\]OyÇ�Å�ORB�_mBEAcDTXT_P\Q; i ACBE@/MhI3V³G�´7AcOy\ÃB�OQOybÆGTB7JcIº[sOËfÃ@*bEOÄG*¹H^*OQMPIÆJW@/MPD*OdVQ@/_P@*JcG*DTÅ�Oy\aÁ«� å l*lG�[�É0OyV³_P\³ÂP;¦ÙUG*_]O>_hXE@/_H_hX�O,V³GTf(f¯@�BEb�÷�ý�ûQöx÷(VQ@�Bd[sO%ÅE\]OybË_]GÃOQMh@*\]O,_hX�O%ORB�_PAcMPOgÅE\]OQMUVQ@/_P@*JcG*DTÅ�O*;

& 7:9Qê &Ä� 8 ; �D� 8n b�Ac_H@m_]O³Ï�_0Õ�Ð�JcO>VQ@/_P@*JcG*DTÅ�Og¹ÈMhGTf _hX�O,» e ÚdÅE\]OQM]Õ�ACBT_]OQMP¹Ü@*V³O,_]OQMvf¯ACB7@*JÜ;ãû¬xï¡è ñ á&% þ®û�ø ÷� 5ùSø «N^���*=����8���7�� �=�<)>� �-LG/. ñ ¹ � á æ % Ù�G�b7O*Ø��U�Uô_�F

ã�AcMPOyV³_]G*MPIsØ�`eö®÷®ý þxûcøsFn Ï�_]ORBE\hAcGTB�Ø þxûcø�;

0 ñ ï ñ è�GHá:Guï æ % »UXEO%BE@�fmO�G*¹|_hX�O%ACBE´�Å�_9VQ@/_P@*JcG*DTÅ�OgACBÎ_hX�O,¹�G*Mvf¯@/_QØ��,� «o��8�;'� �qp,pr «s;���tc9,^�� �upv «s;=9<('�'^O*'8�( �;�s «w]�9,��� �u� «4� � *'�<�:M9<8�� �w �;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;

1�2 ñ è43 � G æ % þ®û�ø ÷� 5ùSø þxûcø�ûPþU��öQö�úgù�þcö6 ¬JèLè�GuàQá æ % »UXEOHOyb7Ac_]G*MjAW\[7@*\PAWV n á n @�BEb(AW\bEG�VyÅ7f¯ORB�_]Oyb¯ACB¯_hX�OHá|<>J { á�`1ÚËK�ÅEAWb7OH_]G>»)O³Ï�_¦²�MPG�V³Oy\P\PACBEDEF

e X7@*´E_]OQM k ;�Ù�G*_]Og_hX7@/_�_hXEAW\�V³GTf(f¯@�BEbdAW\�B�G*_�VyÅ�MPMhORB�_PJcIµ@R^�@*AWJW@*[�JcOmGTBd_hX�O¤\]I�\]_]ORf V³GTf¯´�ÅE_]OQMÁ�¹�MPGTf × e ?�ÂP;

& 7:9R� � ; &n BT_]OQM�@mb7OyVQJWACBE@/_PAcGTBµACBÎ_hX�O,Oyb7Ac_H\]GTÅEMhV³O%b7@/_P@¯@/MhOy@�;ãû¬xï¡è ñ á&% P÷cþ «4;��=^ ;'���('�,�=M � «s;'�'^ ):9O�,7�*=�'M � «s;'�=^ M��'^�8<�';>M �-LG/. ñ ¹ � á æ % á�@*JCÅ�O>G*¹Lb7OyVQJWACBE@/_PAcGTB�Ø�Ù�GTB�O*F

Ú�AcDTBÎG*¹|b7OyVQJWACBE@/_PAcGTB�Øsx K¤íW;æ I

Page 59: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

0 ñ ï ñ è�GHá:Guï æ % »UXEOgbEOyVQJWACB7@/_PAcGTB�ACB1bEOQD*MPOQOy\QF!fÃACB�Å�_]Oy\N@�BEbÝ\]OyV³GTBEb�\�G*M�@/MhV/;,»�X�O>^/@*JCÅ�OmAW\�MPO0É0OyV³_]Oyb�Ac¹@�BTIµG*¹_hX�O>V³GTf¯´sGTB�ORBT_P\9JWAcO,GTÅ�_P\PAWbEO%_hX�O,¹�G�JWJcGRSUACB�DÃMh@�B�D*Oy\QØ

;��=^ ;'���,('�,�=M l.î I*ò ACBEVQJCÅE\PAc^*O;��=^ )f9O�,7�*'�=M l.î æ ò ACBEVQJCÅE\PAc^*O;��=^ M��=^�8���;>M l ; l.î æ ò ; ò*ò ;W;W;HACB7VQJCÅE\PAc^*Oä=G ç ­�¬Jï�í æ % Ù�GTB�O*;

1�2 ñ è43 � G æ % P÷cþLT;ú ��������� ��& 7:9RF � yTë & F +Z�Ñ5\]OQ_H_hX�O�¹�G�VyÅE\9_]GÃV³GTfô�ORB7\P@/_]O�¹ÈG*M�@*b7b7Ac_PAcGTBE@*J!G�´E_PAWVQ@*J$OyJcORf¯ORB�_P\Q;ãû¬xï¡è ñ á&% �õPô�þ�`Qö «s]'8'^O7:M 8�],]>M���* �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % ÞEG�VyÅE\UG/Ñ�\]OQ_QFsACBdfÃfd;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % �õPô�þ�`Qö�I r�6 ¬JèLè�GuàQá æ % »UX7AW\>V³GTf(f¯@�BEbºAW\gACBT_]ORBEbEOyb·_]GÝ[sOÄÅE\]OybºS�X�ORB3_hX�OÄ_]OyJcOy\PV³G�´sOιÈG�VyÅE\¤XE@*\g_]G1[sOËVvXE@�BED*Oybº_]G

V³GTfô�ORB7\P@/_]O>¹�G*M�_hX�Om@*b7b7Ac_PAcGTBE@*JLG�´E_PAWVQ@*J|_hX7AWVP¶EB�Oy\P\�G*¹@ÄÐ�Jc_]OQMy;�»UXEO>^�AcMP_hÅE@*JL¹�G�VyÅE\�MPOy@*b7ACBEDËAW\Å7B7VvXE@�B�D*Oyb$F�@�B7bË_hX�O�¹ÈG�VyÅE\jG/Ñ5\]OQ_HACBÎÅE\]O�AW\9b7AW\P´�JW@yI*OybdACBÄ_hX�O�ã�Þ·Ð7OyJWbÄGTBÄ_hX�O,[sG*_]_]GTf JWACB�O�G*¹_hX�O%×0B�¹�G*MvfÃ@/_PAcGTBËãNAW\h´7JW@yI*;

& 7:9p\ �D� yy � � 8 ; +n BT_]OQM�b�A�ÑsOQMPORBT_PAW@*J5_]Mh@*Vh¶�ACBEDÃMh@/_]O%ACBÎMhAcDTX�_�@*\PV³ORBE\PAcGTBµ@�BEbdbEOyVQJWACBE@/_PAcGTB5;ãû¬xï¡è ñ á&% gùWõcõ ýcûcøc÷Pö «s;>9b]] ('��*=� 9O� (�� � «4;�9<],] (���*=� 9O� ;'�'^ �-LG/. ñ ¹ � á æ % Ù�GTB�O*;ì�BE\P´sOyVQAcÐ7Oybdb�A�ÑsOQMPORBT_PAW@*J$Mv@/_]Oy\H@/MPO%@*\P\vÅ7fmOybË_]GÃ[sO�ÖQOQMPGE;0 ñ ï ñ è�GHá:Guï æ % :�AcDTX�_j@*\PV³ORBE\PAcGTBÄ@�BEbÄbEOyVQJWACBE@/_PAcGTBÄb7A�Ñ�OQMPORBT_PAW@*Js_]Mh@*VP¶�ACB�DgMh@/_]Oy\jACBÃ\]OyV³GTB7b7\ { \]OyV³GTBEbË@�BEbÄ@/MhVQ\]OyVYÕ

GTBEb�\ { \]OyV³GTBEb5F�MPOy\P´sOyV³_PAc^*OyJcI*;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % gùWõcõ ýcûcøc÷PöPI I;úyTI r�6 ¬JèLè�GuàQá æ % »UXEOÄb7A�Ñ�OQMPORBT_PAW@*J,ÁêB�GTB�Õ�\PAWb7OQMPOy@*J�Â,_]Mh@*VP¶�ACB�D�Mh@/_]Oy\m@/MhOË@*b�bEOyb3_]G�_hXEO(Oyb7Ac_m\]GTÅEMhV³OÎb7@/_P@Ý[7JcG�Vh¶�;

»UXEOQI�f¤ÅE\P_,[�O(@*V³_PAcGTB�OybÌÅE\PACB�Dd_hXEO¤ÿ�÷�ðcø1V³GTf(f¯@�BEb$;(Ù�G*_]O(_hXE@/_gb7A�Ñ�OQMPORB�_PAW@*J�Mh@/_]Oy\g@/MPOÄBEG*_ACBEVQJCÅ7bEOybdACBÎ@¯VQ@/_P@*JcG*DTÅEO>ORBT_]MPI*;

& 7:9Rd �D��+ zP� �{ze XE@�BED*O�_hX�O%V³G�G*Mhb7ACBE@/_]O%\PI�\]_]ORf�G*¹)_hXEO%ACB�¹�G*Mvf¯@/_PAcGTBËb7AW\h´7JW@yI*;ãû¬xï¡è ñ á&% gù�ö��_�®û_ö «N^�88�(,;>9|����*'� M � Mb*=�b) �-LG/. ñ ¹ � á æ % Ù�GTB�O*;»UXEO,bEOQ¹�@�Å7Jc_UV³G�G*Mvb7ACBE@/_]O%\]I�\]_]ORf�GTBÎ\]_P@/MP_hÅE´µAW\ Ò ÿ � ÏÀÐÃ;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % »UXEO,@*JWJcGRS¦OybaV³G�G*Mhb7ACBE@/_]O>\]I�\P_]ORf¯\H@/MPO*ØÒ ÿ � ÏÀÐ #�@�BEb�"�ACBÃ_hX�O�\]I�\]_]ORf ÅE\]Oyb(_]G¤ACBE´�Å�_�_hXEON\]GTÅEMhV³ON´sG�\PAc_PAcGTB5ç���·� ��� ² ÿYÐ #·@�BEbÀ"gACBdD*OQG�V³ORBT_]MhAWV%@*´�´7@/MPORBT_UV³G�G*Mvb7ACBE@/_]Oy\Qç

} h�ã(ãRã #·@�BEbÀ"gACB¥ÚTÔ l*l*l f¯Oy@�BÎV³G�G*Mvb7ACBE@/_]Oy\QçÔ j Ö ß(ã #·@�BEbÀ"gACB i åyò æ l fmOy@�BËV³G�G*Mhb7ACBE@/_]Oy\yçY¥� Ó ² Ñ »)G�´sG�V³ORBT_]MhAWV%XEGTÅ�MH@�B�D�JcO>@�B7bdbEOyVQJWACBE@/_PAcGTB�;1�2 ñ è43 � G æ % gù�ö��_�®û_ö_~ � I,II6 ¬JèLè�GuàQá æ % »UXEO%\]I�\]_]ORf¯\�@/MPO>bEOy\hV³MhAW[sOybµACBµf¯G*MPO%bEOQ_P@*AWJLACBÝÚ�OyV³_PAcGTB n ;HÞEG*MN_]OyVvX7BEAWVQ@*JLMPOy@*\PGTBE\QFs_hX�OQMPO>@/MhO

MPOy\P_]MhAWV³_PAcGTBE\¦GTB(_hX�O�´sOQMvfÃAc_]_]Oyb(V³GTfg[7ACBE@/_PAcGTB7\G*¹!ACB7´�Å�_@�BEbÄb7AW\P´�JW@yIÃV³G�G*Mhb7ACBE@/_]Oy\yF�@*\¦¹�G�JWJcGRSU\yØ

æ ò

Page 60: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Ò ÿ � ÏÀÐ @*JcSj@yI�\N@*JWJcGRS¦Oyb5ç���·� ��� ² ÿYÐ @*JcSj@yI�\N@*JWJcGRS¦Oyb5ç} h�ã(ãRã BEG*_H@*JWJcGRS¦Oyba¹�G*MUACBE´�Å�_9ACBÎ@*´7´7@/MPORBT_UV³G�G*Mhb7ACBE@/_]Oy\yçÔ j Ö ß(ã B�G*_!@*JWJcGRS¦Oybg¹ÈG*MLACBE´�Å�_)ACB,@*´7´7@/MhORB�_$G*M|Þ8Û%æ,Á!ÚEÂsV³G�G*Mhb7ACBE@/_]Oy\QçY¥� Ó ² Ñ @*JcSj@yI�\N@*JWJcGRS¦Oyb5;

& 7:9Ru � ë � ;`µGR^*O%_hXEO%bEGTfmO�_]G(_hX�O,\P´sOyVQAcÐ7Oybd@/ÖyACf¤Å�_hXÎ@�B7bd\]_]G�´5;ãû¬xï¡è ñ á&% eô�úP÷ «���������� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % »UXEO,@�B�D�JcO%ACBÎbEOQD*MhOQOy\Q;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % eô�úP÷ �,���r�,�& 7[6ûx � F � zÚ�@R^*O>@m[7ACBE@/MhI(^*OQMh\hAcGTBÎG*¹L_hX�O%VyÅ�MPMhORB�_UÅE\POQMUVQ@/_P@*JcG*DTÅ�O¤ACBË_hX�O%BE@�f¯OybËÐ�JcO*;ãû¬xï¡è ñ á&% _`�ú4����,� «o��8�;'� �up,p|� «w7cM���(����b)>� + �=MM|��8�(; �{�� «s;'��tc9,^�� �qpv «s;>9b('�=^O*=8�( �p�s «s]>9,��� �u� «�� � *'���cM9�8<� �s -LG/. ñ ¹ � á æ % Ù�G�b7O*Ø��U�Uô_1Á�_]OyJcOy\PV³G�´sO>V³GTfô�Å�_]OQMQÂPF

ãNOQ^�AWV³O { b7AcMPOyV³_]G*MPIsØâ`Qö®÷®ý þxûcøsFn Ï�_]ORBE\hAcGTB öJû_ô�;

0 ñ ï ñ è�GHá:Guï æ % »UXEO%BE@�fmO�G*¹|_hX�O,GTÅ�_P´�Å�_9Ð�JcO*;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % _`�ú4�,��ûPöxø�ÿ5ù5õ��cøa_]GÝ\P@R^*OË@aÐ�JcOÄACB¡_hX�OËbEOQ¹Ü@�ÅEJc_¤VQ@/_P@*JcG*DTÅ�Od@/MPOy@aSUAc_hX¡_hXEO(Ð�JcORB7@�fmO(?)<�ÚE»jÕ

Ù�×]K�¿�»�;�ÚE<!ág; _`�ú4�,�_��ô�÷Spp|�Ìõ�`�÷Pöxø'I;úDõ� _�U`_ �õh�ü gùJö�a=�#`eö®÷®ýûújp��çõ�`P÷�öJø'I;ú þ®û�øPö� _�®ûPöJøcÿ5ù�õU��øÄ_]GaV³G�´�I3@dÐ�JcO_]GÆ_hX�O1áL<&JëÓ l*l*l b7@/_P@·MPOyb�ÅEV³_PAcGTB V³GTf¯´�Å�_]OQM�ÁÜ?!²á n ÂP;9»UX�OµÐ�JcOaSUAWJWJ�[sOaACB _hX�O}§�; e <�»�Úc©\hÅ7[sb�AcMPOyV³_]G*MPI3G*¹N_hX�OaK�ì n ÚE» l å @*VQV³GTÅ7BT_ÃGTB·_hX�Oµì�Ú n : å b7AW\]¶Æ@�BEbÆSUAWJWJ9[sOÎVQ@*JWJcOyb ?)<�ÚE»jÕÙ�×]K�¿�»�;�ÚE<!ág;

6 ¬JèLè�GuàQá æ % »UXEO>O³Ï�_]ORBE\PAcGTBÆ;�ÚE<!á AW\�fÃ@�BEb7@/_]G*MPI*;%×�¹@�BEG*_hX�OQM�O³Ï�_]ORB7\PAcGTBÝAW\�\P´sOyVQAcÐ7Oyb5F5Ac_�SUAWJWJ|[sO>MhORfmGR^*Oyb@�BEb¡;�Ú�<!áâ\hÅE[�\]_PAc_hÅ�_]Oyb5;

& 7[6B9 ;��M;~\ � 8 � ë #Ú�IEB�GTBTI�f ¹�G*MNû��®ø5ùSø�`_ �÷aÁ�òWF��SF)Â& 7[6�6 ; #¸& ë � ;��Ú�OQ_H_hXEO,V³GTf>[�ACBE@/_PAcGTBÎG*¹|ACBEV³MPORf¯ORB�_P@*J5ORB7V³G�bEOQMv\UÅE\]Oybι�G*MU´sG�ACBT_PACB�D¯ACBÎ@/ÖyACf¤Å�_hX�;ãû¬xï¡è ñ á&% ÷�ÿ�þ�ô� �÷�ý «��<�:^�8�;'��( �=�<)�� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;»UXEO�D*Oy@/MUORBEV³G�bEOQM�AW\U\]OyJcOyV³_]OybµGTBd\]_P@/MP_hÅE´5;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % á�@*JWAWbaORBEV³G�bEOQM�BE@�f¯Oy\9@/MPO*ØÜ ² ��� D*Oy@/M�ORBEV³G�bEOQMyç� ?�Ö Ö ¹�MhAWV³_PAcGTB�Õ�b7MhAc^*ORBÎMPG�JWJcOQM�ORBEV³G�bEOQMyçÐ ��� ² m ACBEb7Ac^�AWb�ÅE@*J�ACBEb�ÅEV³_PAc^*O�_P@*´sONORBEV³G�b7OQM¦MhOy@*b7ACB�D¯X�Oy@*b7\�ÁêB½� å F

Ô�F k G*MUÓ�ÂPç

è l

Page 61: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Ð ��� ² m � f¯Oy@�BE\|G*¹sG�´7´sG�\PACB�D�_P@*´sOHMPOy@*b7ACBED%X�Oy@*b7\UÁ�_hX�O�@*JWJcGRS¦Oyb(V³GTfmÕ[7ACB7@/_PAcGTBE\U@/MPO~Ð ��� ² j � @�BEb�Ð ��� ² h � ÂPçÐ ��� ² × ² � ÿ f¯Oy@�BÄG*¹�@*JWJ5¹ÈGTÅEMH_P@*´sO�MPOy@*b7ACB�D(XEOy@*b7\Q;

1�2 ñ è43 � G æ % ÷�ÿ�þ�ô� �÷�ý,õ�÷�û�ý6 ¬JèLè�GuàQá æ % »UXEOQMPOg@/MhOm_hX�MPOQO¤ACBEbEOy´sORBEbEORBT_NACB7V³MPORfmORBT_P@*JLORBEV³G�b�ACB�DÎ\]I�\P_]ORf¯\�GTB1_hX�O¤¾ ¿N»ß@/ÖyACf¤Å�_hX1@�Ï�AW\QF

@�BTI¯G*¹!SNXEAWVvXÄf¯@RIÃ[sONÅE\]Oyb(¹�G*Mj´sG�ACBT_PACB�D¤@�BEbÃ_]Mv@*VP¶�ACB�DE;�»UXEOy\]O�@/MPO*Ø�@gD*Oy@/M9ORBEV³G�bEOQMyF�V³GTÅE´7JcOyb_]G1_hX�OÃ_]OyJcOy\hV³G�´�OÄ^�AW@µ_hX�OËf¯@*ACB�b7MhAc^*OÃD*Oy@/Myç�@�B3ACBEb�ÅEV³_PAc^*O(_P@*´sO(ORBEV³G�b7OQM%SUAc_hX3¹ÈGTÅEM%MPOy@*b7ACBEDX�Oy@*b�\9@�BEbÎ@g¹ÈMhAWV³_PAcGTB�Õ�bEMhAc^*ORBËMPG�JWJcOQMUORBEV³G�b7OQMy;�»UX�ONMPG�JWJcOQMHORBEV³G�bEOQMHAW\HB�G*_9MhOyV³GTfÃfmORB7bEOyb5F�@*\9Ac_\PJWAW´�\Q;m»UX�O¤D*Oy@/MÄÁÜbEOQ¹Ü@�ÅEJc_³ÂU@�BEb¡_hX�OÃfmOy@�BaG*¹¦_hX�Om¹ÈGTÅEM�_P@*´�OÃXEOy@*b7\,@/MPOm_hX�O¯[sOy\]_�¹�G*M>B�G*MvfÃ@*JÅE\PO*Ø�_hX�O�MPORfÃ@*ACBEACB�Dm_P@*´sO,V³GTfg[7ACBE@/_PAcGTBE\�@/MPO%ÅE\]Oybι�G*MH_]Oy\]_�´�Å�Mh´sG�\]Oy\Q;

& 7[6�­ ; # Í �b# ;L;�� �O# Ͳ�ÅE_9_hX�O,_]OyJcOy\PV³G�´sO%ACBT_]GÃORB�D�ACBEOQOQMhACB�D(f¯G�bEO*;ãû¬xï¡è ñ á&% ÷�ÿ_õ&ùSÿc÷c÷®ý5ùSÿ_õ-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;6 ¬JèLè�GuàQá æ % »UX7AW\%V³GTfÃfÃ@�BEbÝ\hX�GTÅEJWbº[sOÃÅE\]Oyb5Øg@*\%´7@/MP_%G*¹¦_hXEOÄB�G*MvfÃ@*J�\hX�Å�_PbEGRSNB�´EMPG�V³Oyb�Å�MPO¯@/_>_hX�OÃORB7b

G*¹�_hXEO¤BEAcDTXT_QF�_]G(MhOQ_hÅ�MvBµ_]G(ORB�D�ACBEOQOQMhACB�DdfmG�bEO%@/_�@�BTId_PACfmO*FsG*MNACB1@�BµORfmOQMPD*ORB7V³Id_]G(MhORfmGR^*O´sGRS¦OQM|¹ÈMhGTf�_hXEO¦bEMvAc^*Oy\L@�B7bg´�Å�_!GTB>_hX�Oj[EMh@/¶*Oy\Q;|×�_LAW\LOyÇ�ÅEAc^/@*JcORB�_|_]G�_hÅ�MvBEACBEDU_hX�O e Z�`a² { n Ù�K¶*OQImGTB¯_hX�OUORB�D�ACBEOQOQMhACB�D>b7Oy\]¶¤_]G%_hX�O n Ù�K�´sG�\PAc_PAcGTB�;�»)G%MPOQ_hÅ�MYB¤_]G>V³GTfô�Å�_]OQM¦f¯G�b7O*F�_hÅ�MvB¤_hXEO¶*OQIË_]G¯_hX�O e Z�`a²'´sG�\PAc_PAcGTBÎ@�BEbµ´EMPOy\P\9_hXEO e Z�`a² { n Ù�Kß[�Å�_]_]GTBdB�O³Ï�_9_]G(Ac_9GTBd_hX�O,bEOy\]¶s;

& 7[6gê ; # 8 ;��Ú�OQ_�Å7´Î@*´�OQMh_hÅ�MPO,@�BEbδsG�\PAc_PAcGTBE@*J$G/Ñ�\]OQ_P\�¹�G*MHMPOy´sOy@/_]OybµÅE\]O*;ãû¬xï¡è ñ á&% ÷�ÿ�ø�÷�ýüû_�c÷®ýcøU`cý�÷ «�� + ��(,*,7�('� �7�)�K=��( � « � 8�]]�M���* � « � 8�]]�M���* �÷�ÿ�ø�÷�ýüû�ýPþ �Pô�öeùSø&ùJôJÿ « + 8=M,9b*>9�8�� �,7,)K���( � «s(�� 8�],]>M���* � «s;'�'^ 8�]]>M���* �÷�ÿ�ø�÷�ýüø&ùWú�÷ ��ôcöeùWø5ù�ôxÿ « + 8=M9O*c9�8�� �7�)�K���( � «s('� 8�]]�M���* � «4;��=^ 8�],]>M���* �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % «�� + ��(,*�7'('� �,7,)�K=��( � AW\�@�B(ACBT_]OQD*OQMHACBÃ_hXEOUMh@�B�D*O l.î å l F l [�OyACBED%_hX�ONMPOQ¹�OQMPORBEV³O�´�G�\hAc_PAcGTBaÁ�_hX�O

bEOQ¹Ü@�ÅEJc_HGTBd\]GTÅ�MhV³O%VYXE@�B�D*O/ÂP;« + 8=M,9b*>9�8�� �,7,)�K=��( �'AW\�@�BÃACB�_]OQD*OQM9ACBÃ_hX�OUMh@�BED*O å î å l ;²LG�\PAc_PAcGTB l AW\�@%ÖQOQMPG%G/Ñ5\]OQ_j@�BEb(fÃ@yIB�G*_�[�O�MhOybEOQÐ�B�Oyb5;« � 8�],]>M���* ��F « � 8�],]>M���* �¼@�BEb «s;'�'^ 8�],]>M���* � @/MhO%ACBÎ@/MhVQ\]OyV³GTB7b7\Q;«s('� 8�]]�M���* �ÊAW\UACBd\]OyV³GTBEb7\9G*¹|_PACf¯O,Ac¹L_hXEO�Ð Ò × ² � ?�Ø Ò Ð Ò ?rÿ ¶*OQI�S¦G*MhbaAW\U\P´sOyVQAcÐ7Oyb5FEG*M@/MhVQ\POyV³GTBEb7\UAc¹L_hX�O ��� Ñ � ?�Ø Ò Ð Ò ?�ÿ ¶*OQI�S¦G*MhbµAW\�\P´sOyVQAcÐ7Oyb5;ä=G ç ­�¬Jï�í æ % á�@*JWAWbaG/Ñ�\POQ_�fmG�bEOy\9@/MPO*Ø ��� ² � ÐzÏ � ² F ��� Ñ � ?�Ø Ò Ð Ò ?rÿ3FPÐ Ò × ² � ?�Ø Ò Ð Ò ?�ÿ3;

1�2 ñ è43 � G æ % ÷�ÿ�ø�÷�ýüû_�c÷®ýcøU`cý�÷ � ú R��� I r�÷�ÿ�ø�÷�ýüû�ýPþ �Pô�öeùSø&ùJôJÿ � T �� I ú �� I÷�ÿ�ø�÷�ýüø&ùWú�÷ ��ôcöeùWø5ù�ôxÿ ú�T,I �,� T;úUú6 ¬JèLè�GuàQá æ % ÷�ÿ�ø�÷�ýüû_�c÷®ýcøU`cý�÷Ý\]OQ_P\mÅE´Æ@�Bº@*´sOQMP_hÅEMPO(G/Ñ5\]OQ_¤S�XEAWVYX·VQ@�BÆ[�OË@*´7´7JWAcOybÌÅE\hACB�Da_hXEO�û���÷�ýcø�`�ýc÷

V³GTf(f¯@�BEb5;�÷®ÿcøc÷�ý�û�ýPþ ��ôcöQùSø5ù�ôxÿa@�BEbU÷®ÿcøc÷�ýüø5ùHúP÷ �Pô�öeùSø&ùJôJÿ1\]OQ_>ÅE´3@µ´sG�\PAc_PAcGTBE@*JG/Ñ�\]OQ_S�X7AWVvXÎVQ@�Bµ[�O,@*b�bEOybË_]G¯_hX�O,_]OyJcOy\hV³G�´�OgbEORf¯@�B7bÄ´sG�\PAc_PAcGTBaÅE\PACB�Dm_hXEOC��ôcöQùSø5ù�ôxÿÃV³GTfÃfÃ@�BEb5;

& 7[6�� ;�z½ë &Ä6n BT_]OQM�@¤^/@*JCÅ�O,¹�G*MH_hX�O%Oy´�G�VvXÎG*¹)_hX�O>´�G�\hAc_PAcGTBÎACB�_]G(_hX�O�Oyb7Ac_U\PGTÅ�MhV³O%b7@/_P@Ã[7JcG�Vh¶�;ãû¬xï¡è ñ á&% ÷_��ô�þ�� «s;���*=� �

è å

Page 62: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % »UXEO�Oy´�G�VvXdACBËI*Oy@/Mh\Q;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % ÷_��ô�þ��·úOH ���S ��6 ¬JèLè�GuàQá æ % »UXEO¯Oy´sG�VYX¡AW\>Å7\]Oyb3ACB3V³GTB�É]Å�BEV³_PAcGTB�SUAc_hX¡_hX�O(´7MPG�´sOQM%fmG*_PAcGTBE\%_]GaV³GTf¯´�Å�_]O¯_hX�OôsG�\PAc_PAcGTB3G*¹

b7@/_]O*;

& 7[6�F ;G� F �O# ëG�n BT_]OQM�@¤^/@*JCÅ�O,¹�G*MH_hX�O%OyÇ�ÅEACBEGyÏÎG*¹)_hXEO%´sG�\PAc_PAcGTBÎACBT_]GÃ_hX�O�Oyb7Ac_�\]GTÅ�MhV³O%b�@/_P@¯[7JcG�VP¶s;ãû¬xï¡è ñ á&% ÷4ñ#`gùSÿPô�ð «�����7:9|��8 �p�-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % <�V³G�bEOĹÈG*Mg_hX�OËV³G�G*Mvb7ACBE@/_]OË\]I�\P_]ORfÎF|¹ÈG�JWJcG.S�OybàÁ�¹ÈG*MmfmOy@�BºV³G�G*Mvb7ACBE@/_]Oy\³Â,[�I�_hX�O(OyÇ�ÅEACB�GRÏsF�ACB

I*Oy@/Mh\y;�»UX�O�@*JWJcG.S�OybÝ\]I�\]_]ORf¯\9@/MhO*Ø���·� ��� ² ÿYÐ K�OQG�V³ORBT_]MhAWV%@*´�´7@/MPORBT_UV³G�G*Mvb7ACBE@/_]Oy\Qç} «  lcve� � `µOy@�BdV³G�G*Mhb7ACB7@/_]Oy\>ÁÜÞ8Û%æm\]I�\]_]ORfÎÂPçÔ «  lcve� � `µOy@�BdV³G�G*Mhb7ACB7@/_]Oy\>ÁÜÞ8Û�ÓÃ\]I�\]_]ORfÎÂP;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;

1�2 ñ è43 � G æ % ÷4ñ#`gùSÿPô�ð��úbH � I÷4ñ#`gùSÿPô�ð_~�úbH,H �� �÷4ñ#`gùSÿPô�ð�û_�_�6 ¬JèLè�GuàQá æ % »UXEO�I*Oy@/MNf¤ÅE\]_9[sO,ACBË_hX�O,Mv@�B�D*O åHI l*l ; l _]GËÔ å l*l ; l ;& 7[6L\ ;�� �º+ ;n Mv@*\]O,@*JWJ$ORBT_]MhAcOy\H¹�MPGTf _hXEO,VyÅ�MPMPORBT_�ÅE\]OQMHVQ@/_P@*JcG*DTÅEO*;ãû¬xï¡è ñ á&% ÷�ý�ûQö®÷-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;

& 7[6�d ;{� � 8×]BEAc_PAW@/_]O>@�BËG*MvbEOQMhJcIË\hX�ÅE_PbEGRS�BÎG*¹)_hX�O%_]OyJcOy\PV³G�´sO>V³GTBT_]MPG�J$\]I�\]_]ORfÎ;ãû¬xï¡è ñ á&% ÷Uð&ùSø-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;6 ¬JèLè�GuàQá æ % »UX7AW\)V³GTf(f¯@�BEb,´�Å�_P\$_hX�O¦_]OyJcOy\PV³G�´sO9ACB�_]GNORB�D�ACB�OQOQMvACB�D�f¯G�b7O[sOQ¹ÈG*MPO¦\hX�Å�_]_PACB�D�b7GRS�B%_hX�O�V³GTBT_]MPG�J

\]I�\]_]ORfd;LÙ�G*_]Oj_hXE@/_|_hXEAW\|V³GTfÃf¯@�B7b%AW\�B�G*_|VyÅ�MPMPORBT_PJcI%@R^�@*AWJW@*[7JcOUGTB%_hXEO¦\]I�\]_]ORfâV³GTfô�Å�_]OQM9Á�¹ÈMPGTf× e ?�ÂP;

& 7[6�u y �b#º�:HOQ_]MvAcOQ^*Oµb7@/_P@�¹�G*Mm_hX�OµBE@�f¯Oyb·\PGTÅ�MhV³O˹ÈMhGTfä_hX�OdÅE\]OQMmG*MÃ\PI�\]_]ORfäVQ@/_P@*JcG*DTÅEOy\Ä@�B7b·´�JW@*V³Od_hX�ORfäACBÆ_hX�OËOyb7Ac_\]GTÅ�MvV³O%b7@/_P@¯[7JcG�VP¶s;ãû¬xï¡è ñ á&% õ5ùWÿU «NM�8<7'(>^�� ���<)�� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;

è*Ô

Page 63: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

0 ñ ï ñ è�GHá:Guï æ % »UXEOÃBE@�fmOgG*¹�_hXEO¯_hX�O¯\]GTÅ�MvV³Om_]Gd[�O¤MPOQ_]MvAcOQ^*Oyb5;¯×�_,VQ@�B�[sO¤@Î\P_]MhACB�DÎG*¹9ÅE´Ý_]GaÔ l VvX7@/Mh@*V³_]OQMh\QçO³Ï�_]Mh@ÄVvXE@/Mh@*V³_]OQMv\�@/MPOgJcG�\P_Q;N»)GÄACB7VQJCÅEbEO¤\P´7@*V³Oy\N_hX�O%SNX�G�JcOg\P_]MhACB�DË\hX�GTÅEJWba[�O>ORBEVQJcG�\]Oyb1SUAc_hXEACBbEGTÅ7[7JcO,Ç�ÅEG*_]Oy\Q;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;

1�2 ñ è43 � G æ % õ5ùWÿU ��U ûú ���,�'�,�õ5ùWÿU ÿ�õcþ � ú � úõ5ùWÿU ��Wö 7 + ��(��=8�t'�L9O� �xúQþf�6 ¬JèLè�GuàQá æ % »UXEO%ÅE\]OQMUVQ@/_P@*JcG*DTÅ�O¤AW\H\]Oy@/MvVvX�OybµÐ7Mh\]_QFE¹�G�JWJcGRS¦Oyba[�IÄ_hX�O%\]I�\]_]ORf VQ@/_P@*JcG*DTÅ�O*;

& 7[­ûx yTë & F +ãNMhAc^*O,_hX�O%¹ÈG�VyÅE\9_]GÃ@Ã\P´sOyVQAcÐ7OybÎ\]OQ_]_PACB�DÄ@�BEbd\]_]G�´dAc_Q;ãû¬xï¡è ñ á&% õQô®þ�`eö «NM���**>9O��� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % »UXEO�¹ÈG�VyÅE\HACBdf(f Á k ÓE;�æ î å Ô ò ; l fÃfÎÂP;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % õQô®þ�`eö � I �& 7[­B9 Í 6 � � �Ú�OyJcOyV³_�_hX�O>K�¿N:H×0? ÁÜÙN@*\hf>I�_hXdVQ@*[7JcO³Õ�SHMh@*´a\PAWbEO/Â�¹�G�VQ@*J)\]_P@/_PAcGTB�;ãû¬xï¡è ñ á&% õU��ý5ù5� «s(�8�*=��*=8�( )�8�;�� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % »UXEO�^�@*JWAWbµMPG*_P@/_]G*MNf¯G�bEOy\9@/MhO*ØÓ ² � ?¤Ð � Ð�? � AW\g¹ÈG*M¯ÅE\]OÄS�X�ORB¡_hX�OÎbEOQMPG*_P@/_PAcGTB·G�´E_PAWVQ\¤@/MPOdf¯GTÅ7B�_]Oyb$;µ×�_

bEMvAc^*Oy\H_hX�O�MPG*_P@/_]G*M�\]GÃ@*\H_]G¯D�Ac^*O>@¯\P_P@/_PAcGTBE@/MPIdACf¯@/D*O*;� ?¤Ð � Ð@? � @*\P\vÅ7fmOy\�_hXE@/_9_hX�O�ACBE\]_]MYÅ7fmORBT_¦AW\Hf¯GTÅ7BT_]OybÄb�AcMPOyV³_PJcI(GTBÄ_hXEO_hÅ�MYB�_P@*[7JcO*;ÿ�? � ?¤Ð � Ð�? � AW\%¹�G*MgÅE\PO¯S�X�ORB¡_hX�O(bEOQMhG*_P@/_PAcGTB3G�´7_PAWVQ\>@/MPOËB�G*_gf¯GTÅ7BT_]Oyb@�BEbd_hX�O%ACBE\]_]MYÅ7fmORBT_9AW\H\]_P@/_PAcGTBE@/MPIÎGTBÎ_hX�O,G�´E_PAWVQ@*J5_P@*[�JcO*;

1�2 ñ è43 � G æ % õU��ý5ù5� �÷�ýPôxøcû�øQôJý6 ¬JèLè�GuàQá æ % <N´7´7JWAcOy\�K�¿�:U×�?º´sG�ACB�_PACB�DÄfmG�bEOyJÜFEORBE@*[7JcOy\�K�¿�:U×�?ºMPG*_P@/_]G*M�@�BEbdb7AW\P@*[�JcOy\H@*JWJ$G*_hX�OQM�MPG*_P@/_]G*Mh\Q;

ãNG�Oy\�B�G*_�f¯GR^*O,_hXEO,Ù�@*\hf>I�_hX�Å�@/_QF7SNXEAWVvXÎAW\�B�G*_�Å7BEb7OQMHV³GTf¯´�Å�_]OQMHV³GTBT_]MPG�JÜ;& 7[­�6 Í�ë &Ä� 8:HOQ_]MvAcOQ^*Og_hXEO%ORBT_]MPIιÈG*M�_hX�OgB7@�fmOybµ\PGTÅ�MhV³O%¹�MPGTf�_hX�OgÅE\POQM�VQ@/_P@*JcG*DTÅ�O¯@�BEbµ_hX�ORBa\]ORBEbd_hXEO%_]OyJcOy\PV³G�´sOg_]G(_]Mh@*Vh¶_hXE@/_U\PGTÅ�MhV³O*;ãû¬xï¡è ñ á&% õPô®þ®ûcø «NM�8�7'(�^�� ���b)>� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % »UXEO%BE@�fmO�G*¹|_hX�O,_P@/MPD*OQ_UG�[�É�OyV³_Q;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;6 ¬JèLè�GuàQá æ % »UXEO%ÅE\]OQMUVQ@/_P@*JcG*DTÅ�O¤AW\H\]Oy@/MvVvX�OybµÐ7Mh\]_QFE¹�G�JWJcGRS¦Oyba[�IÄ_hX�O%\]I�\]_]ORf VQ@/_P@*JcG*DTÅ�O*;

& 7[­�­ Í�ë 8 ë`µGR^*O%_hXEO,_]OyJcOy\PV³G�´sO%_]GÃ@(B�OQS�\]GTÅ�MvV³O,@�BEbÎ_]Mh@*Vh¶ËAc_Q;ãû¬xï¡è ñ á&% õPôJøQô «NM�8<7'(>^�� ���<)�� � «4(�9<����* �=M,^����cM9�8�� � «s;'�'^,�9O����*c9�8�� � «�����7:9|��8 �p�-LG/. ñ ¹ � á æ % Ù�GTB�O*;

è k

Page 64: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

0 ñ ï ñ è�GHá:Guï æ % «NM�8�7�(>^�� �=�<)>� �Æ»UX�OUB7@�fmOjG*¹�_hX�OUB�OQS'\]GTÅEMhV³O*;|×�_f¤ÅE\]_�[sOH@,\]_]MvACB�D�G*¹�Å7´¤_]G>Ô l VvX7@/Mh@*V³_]OQMh\QçO³Ï�_]Mh@ÄVvXE@/Mh@*V³_]OQMv\�@/MPOgJcG�\P_Q;N»)GÄACB7VQJCÅEbEO¤\P´7@*V³Oy\N_hX�O%SNX�G�JcOg\P_]MhACB�DË\hX�GTÅEJWba[�O>ORBEVQJcG�\]Oyb1SUAc_hXEACBbEGTÅ7[7JcO,Ç�ÅEG*_]Oy\Q;

«s(>9<����* �=M,^����cM9�8�� �ÊÚ�´sOyVQAcÐ7Oy\H_hX�O�MhAcDTXT_U@*\PV³ORBE\PAcGTBdG*¹|_hX�O%B�OQS�\]GTÅEMhV³O%ACBË_hX�MhOQO�Ð7OyJWb7\H\]Oy´EÕ@/Mh@/_]Oyb [TIÌ\P´�@*V³Oy\Q; ÞEG*MYf¯@/_QØ «s('� �=8�7�(>M � «s('� )f9|�7�*'�=M � «s('� M��'^�8<�';>M ��;Ì»UXEOÎMhAcDTX�_@*\PV³ORB7\PAcGTBdAW\UMPO0É�OyV³_]OybaAc¹L@�BTIËG*¹)_hXEO%V³GTf¯´sGTB�ORBT_P\9JWAcO%GTÅ�_P\hAWbEO�_hX�O,¹�G�JWJcGRSUACBEDÃMh@�B�D*Oy\yØ«s('� ��8<7'(�M � l.î Ô k ACBEVQJCÅE\PAc^*O«s('� )f9|�7*=�=M � l.î æ ò ACBEVQJCÅE\PAc^*O«s('� M��'^�8<�';>M � l ; l.î æ ò ; ò*ò ;W;W;HACB7VQJCÅE\PAc^*O

«s;'�=^���9|����*>9�8<� � ÚE´�OyVQAcÐ�Oy\9_hX�O,bEOyVQJWACBE@/_PAcGTBdG*¹)_hXEO%B�OQS"\]GTÅ�MhV³O>ACBÄ_hX�MPOQO�Ð7OyJWb7\U\]Oy´7@/Mh@/_]Oybd[�I\P´�@*V³Oy\Q;�»UX�O « b7OyV bEOQD*MhOQOy\��·Ð7OyJWbgfÃ@yI,[sO\PAcDTBEOyb5;)×�¹�B�G*_L\PAcDTB�Oyb5F/_hX�OjbEOQ¹Ü@�ÅEJc_)AW\�x KgíW;|ÞEG*Mvf¯@/_QØ«s;'�=^ ;'���(���=M � «s;��=^ )f9O�,7�*'�=M � «s;'�'^ M��=^�8<�';�M ��;%»�X�O¯bEOyVQJWACBE@/_PAcGTB3AW\�MPO0É�OyV³_]OybºAc¹�_hXEO@�BTIËG*¹)_hX�O>V³GTf¯´sGTB�ORBT_P\9JWAcO%GTÅ�_P\PAWb7O�_hX�O,¹�G�JWJcGRSUACB�D(Mh@�B�D*Oy\QØ«s;'�'^ ;����,('��'M � l.î I*ò ACBEVQJCÅE\PAc^*O«s;'�'^ ):9O�,7�*=�'M � l.î æ ò ACBEVQJCÅE\PAc^*O«s;'�'^ M��=^�8��';�M � l ; l.î æ ò ; ò*ò ;W;W;HACB7VQJCÅE\PAc^*O

«��,��7c9O�=8 �p�¼ÚE´�OyVQAcÐ�Oy\9_hX�O�OyÇ�ÅEACB�GyÏÎG*¹|_hX�O%\PGTÅ�MhV³O,V³G�G*Mhb7ACBE@/_]Oy\Q;¦< ^�@*JWAWbÎOyÇ�ÅEACB�GRϵfgÅ7\]_UXE@y^*O_�S�GÎV³GTf¯´sGTB�ORBT_P\QØH@ÄJcOy@*b7ACB�DÎJcOQ_]_]OQM,ACBEb7AWVQ@/_PACBED(_hX�O¤\]I�\]_]ORf G*¹�_hX�O¤V³G�G*Mvb7ACBE@/_]Oy\Qç$@�BEb1@ËB�Å7fmÕ[sOQMËACBEb7AWVQ@/_PACB�D·_hX�O1Oy´�G�VvX'G*¹,_hX�O�fmOy@�B¸OyÇ�Å7@/_]G*Md@�BEb'OyÇ�ÅEACB�GRÏ'G*¹,_hXE@/_Ë\]I�\]_]ORfÎ;àÞEG*Mvf¯@/_QØ«Y����*,*=��( T�� ���( ��F,GHF�±xF ûúOH � IEF�~ � II,IaG*M=û��_�®ûcýc÷�ÿcøÌÁ�¹�G*MmS�XEAWVYXÆB�GÝB�Å7fg[sOQMgAW\gMPOyÇ�ÅEAcMPOyb5ÂP;Ù�G*_]O�_hXE@/_�GTB7JcIr�F�~,G*M_û¯@/MPO�@*VQV³Oy´E_P@*[�JcO,@*\¦JcOy@*b�ACB�DgJcOQ_]_]OQMv\Q;»UX�O�I*Oy@/MHfgÅ7\]_JWAcO�ACB¯_hXEO�Mh@�BED*OåHI l*l ; l _]G(Ô å l*l ; l ;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;

1�2 ñ è43 � G æ % õPôJøQôZ�U ûú ���,�'�,� ú �L������� ������P���L��� úbI�~ � II,I& 7[­gê 6·��#º�Æ+ ; 8²JW@*V³O>_hX�O,» e ÚËÅ7\]OQMUACBT_]OQMP¹�@*V³OgACBdXE@�BEb�\]OQ_UfmG�bEO*;ãû¬xï¡è ñ á&% �cû�ÿU eöx÷�ø-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;6 ¬JèLè�GuàQá æ % ×]BÊXE@�BEb7\]OQ_df¯G�bEO*FU_hX�Oݶ*OQI�´7@*b"fÃ@yI [�O�ÅE\]OybÊ_]GÆDTÅEAWb7O1_hXEO1_]OyJcOy\hV³G�´�O*F,\POQ_ÎÅ7´ G/Ñ5\]OQ_P\ÎG*M

@*´sOQMP_hÅ�MhOy\QF9VvXE@�B�D*O1_hX�Od¹�G�VyÅE\ÃG*MËfmG.^*Oµ_hX�OaMPG*_P@/_]G*My; Ú�OQOÝÚ�OyV³_PAcGTB ã ¹ÈG*MÄ@ºf¯G*MPOµbEOQ_P@*AWJcOybbEOy\hV³MhAW´E_PAcGTB�;Ë»UXEAW\,V³GTf(f¯@�BEbÝAW\>[�GTÅ�BEbÝ_]Gµ_hX�O il� ¶*OQI�GTB�@a\]_P@�BEb7@/Mhb¡áN»UÔ*Ô l ¶*OQI�[sG�@/Mhb$;»)G¯O³ÏEAc_H¹ÈMhGTf _hX�O>XE@�B7b7\]OQ_UfmG�bEO�´EMPOy\h\9_hX�O i�� ¶*OQIÎ@�BEbµV³GTB�_]MPG�J$SUAWJWJ5MPOQ_hÅ�MYBË_]G¯_hX�O�`eöx÷�ýp�´EMhGTf¯´E_Q;

& 7[­�� 6 ;��=z²�MhGR^�AWbEO%ACB�¹�G*Mvf¯@/_PAcGTBd@*[�GTÅE_9_hX�O,V³GTfÃfÃ@�BEb7\j@y^/@*AWJW@*[7JcOg¹ÈMPGTf _hX�O,» e ÚÎÅ7\]OQMHACB�_]OQMh¹�@*V³O*;ãû¬xï¡è ñ á&% ��÷U�_��� *'8 + 9^ � MO7K*=8 + 9^ , -LG/. ñ ¹ � á æ % ?)AW\]_P\U@*JWJ$@R^�@*AWJW@*[�JcOgV³GTf(f¯@�BEb7\y;0 ñ ï ñ è�GHá:Guï æ % »UXEO,V³GTfÃf¯@�B7b(I*GTÅdSUAW\hXÄ_]G(MPOyV³OyAc^*OgX�OyJW´dGTB�;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % ��÷U�_�,õPôJøQô�÷�ñ�`5ùSÿQô�ð

è�Ó

Page 65: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

6 ¬JèLè�GuàQá æ % ×]B�^*G*¶�ACB�DÆ_hX�O���÷U�_�ÌV³GTfÃfÃ@�BEb'ACBEAc_PAW@/_]Oy\µ@�B ACBT_]OQMh@*V³_PAc^*O·b7AW@*JcG*DTÅ�OÝSUAc_hX _hX�O¡ÅE\]OQMËACB�_]OQMh¹�@*V³O¿ n ?)²ÍJWAW[EMh@/MhI*F�@¸BEG*Mvf¯@*JNá�`1ÚÊ¿ n ?)²ÍJWAW[EMv@/MPI*; ×0B MhOy\P´sGTBE\]O�_]G¸@¸»)G�´7AWV�� G*Mµ\hÅE[E_]G�´�AWV´EMhGTf¯´E_jI*GTÅdfÃ@yIsØ

� »�I�´�O�_hXEO>BE@�fmO�G*¹|_hX�O,V³GTf(f¯@�BEb { _]G�´�AWV�¹ÈG*MHSNXEAWVvXËI*GTÅaB�OQOybµX�OyJW´$ç� »�I�´�O,@ÃÇ�Å�Oy\P_PAcGTBdf¯@/MP¶�Áv��Â,_]GÃMPOyb7AW\h´7JW@yIÄMPOyV³ORBT_PJcIÎMPOyÇ�ÅEOy\]_]OybÎ_]O³Ï�_Qç� ²MPOy\P\9_hXEO%: n »Hì�:�Ù�¶*OQIËGTB�O%G*M�fmG*MPO�_PACf¯Oy\9_]GÃO³ÏEAc_H¹�MPGTf ¿ n ?!²Uç� ²MPOy\P\ e »H:U? î�o GTBEV³O,_]G¯O³ÏEAc_H¹�MPGTf ¿ n ?)²Hç� <N[7[EMhOQ^�AW@/_]O¯@�BTIa_]G�´�AWV¯BE@�fmO*F$[�ÅE_�BEG*_]Om_hXE@/_,@�fg[7AcDTÅ�GTÅE\�@*[7[7MPOQ^�AW@/_PAcGTB7\�MPOy\hÅEJc_�ACB ñ#�c� f¯@/_PVvXEOy\�[�OyACBEDb�AW\P´7JW@yI*Oyb$;

Ù�G*_]O%_hXE@/_H_hX7AW\HV³GTfÃfÃ@�BEbËAW\UB�G*_UVyÅ�MhMPORB�_PJcIÎ@R^�@*AWJW@*[7JcO>GTBÎ_hX�O,\PI�\]_]ORfÍV³GTf¯´�ÅE_]OQM%Á�¹ÈMPGTf × e ?�ÂP;

& 7[­�F 6 F � ���D� 8 zn BT_]OQMU_hXEO�^�@*JCÅ�O%G*¹)_hX�O%MPOyJW@/_PAc^*O¤X�Å7fÃAWb7Ac_�IËÅE\]OybÎACBÎ_hXEO,VQ@*JWVyÅEJW@/_PAcGTBaG*¹)MPOQ¹�Mh@*V³_PAcGTB�;ãû¬xï¡è ñ á&% �U`�úgù� 5ùSøUö «s('�'����*>9bt=� �,7,)f9b;>9O* �p�-LG/. ñ ¹ � á æ % Ù�GTB�O*;»UXEO�^�@*JCÅ�O>@*\P\hÅ7f¯OybËGTBÎ\]_P@/MP_hÅE´µAW\ l ;�æ�;0 ñ ï ñ è�GHá:Guï æ % »UXEO�¹ÈMh@*V³_PAcGTB7@*J)X�Å7f¯AWb7Ac_�I(ACBË_hXEO,Mh@�B�D*O l.î å ;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % �U`�úgù� _I R�

& 7[­L\ �b#Ì& � F � ;:HOy@*baACBÎ@¤_]O³Ï�_U¹�G*Mvf¯@/_H\]GTÅEMhV³O,VQ@/_P@*JcG*DTÅ�O*;ãû¬xï¡è ñ á&% ùSÿ�þU��`U P÷ «N^���*=����8���7�� �=�<)>� �-LG/. ñ ¹ � á æ % Ù�G�b7O*Ø��U�Uô_�F

ã�AcMPOyV³_]G*MPIsØ�`eö®÷®ý þxûcøsFn Ï�_]ORBE\hAcGTB�Ø þxûcø�;

0 ñ ï ñ è�GHá:Guï æ % »UXEO%BE@�fmO�G*¹|_hX�O%ACBE´�Å�_9VQ@/_P@*JcG*DTÅ�OgACBÎ_hX�O,¹�G*Mvf¯@/_QØ��,� «o��8�;'� �qp,pr «s;���tc9,^�� �upv «s;=9<('�'^O*'8�( �;�s «w]�9,��� �u� «4� � *'�<�:M9<8�� �w �;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;

1�2 ñ è43 � G æ % ùSÿ�`Qö®÷�ý þ®û�øopðö��c÷cþU�U�Pôxø þ®û�ø,G*MTùSÿÃö��c÷�þ��U�Pôxø¤_]GmACBE´�Å�_¦@%Ð�JcO�VQ@*JWJcOybµÚ�² n¦e ²�¿�Z�»�; e <�»'ACB_hX�O>bEOQ¹�@�Å7Jc_Hb7AcMPOyV³_]G*MPI*F�G*MùSÿ��U�Uô�÷Sppg gùJö�a=�#`eö®÷®ýûújp��çõ�`P÷�öxø=I �� þ®û�ø ®øcûcýUõc÷®øPöÄ_]G¡ACBE´�Å�_¤@1Ð�JcOdVQ@*JWJcOyb¸»L<�:HK n »�Ús; e <�»ACBÝ_hXEO�§�; e <�»_©\hÅE[�b7AcMhOyV³_]G*MPIµG*¹¦_hX�OÄK�ì n ÚE» l ÔË@*VQV³GTÅ7BT_,GTBÝ_hX�Omá|<>J Ó l*l*l b�@/_P@ÎMPOyb�ÅEV³_PAcGTBV³GTfô�Å�_]OQM%ÁÜ?!²á n ÂP;

& 7[­�d �b#Ì+ 8 � F � ; # 8»)OyJWJ5_hX�O%» e Ú(S�XEAWVvXdACBE\]_]MvÅ7f¯ORB�_9AW\HACBµÅE\]O*;ãû¬xï¡è ñ á&% ùSÿPöxøcý�`cú�÷�ÿcø «N9O�:MO*�(�7,)>�<��* �=�<)>� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;»UXEO,´7@/Mh@�fmOQ_]OQMv\9¹ÈG*MU×]Ú�×PÚÄ@/MPO%\POQ_HGTBÎ\]_P@/MP_hÅ7´5;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % á�@*JWAWb1ACBE\]_]MvÅ�fmORBT_jBE@�f¯Oy\H@/MPO*ØÒ Ø Ò Ø ×PÚ�×PÚÄ@�BEbdÞ)Z%ÚË\P´sOyV³_]MPG*D*Mh@*´�X7\Q;Ð � Ï � ÏYØ »L@�Å�MvÅ7\9ACf¯@/D�ACB�DÃÞ�@*[EMPI�Õ�²)OQMhG*_�ACBT_]OQMP¹ÈOQMhGTfmOQ_]OQMy;× ² Ø `a@�BEVYX�Oy\]_]OQM n VvX�OyJWJcOmÚ�´sOyV³_]MPG*D*Mh@*´�X5;Ó½Ï ��� ?=Ö ã�Å�MYXE@�f ACf¯@/D�ACB�D(´�G�JW@/MvACfmOQ_]OQMy;� Ï A Ñ�Ñ~Ó e @*\P\]OQD*Mh@*ACBµ@�Å�Ï�AWJWAW@/MhIË´sG*MP_ eHe ã VQ@�f¯OQMh@�;

è*æ

Page 66: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Ï ² Ø ì�_]MPOyVYX�_ n VvXEOyJWJcO>\P´sOyV³_]MPG*D*Mh@*´�X�;Ö ÓYØ�Ø ?!GRS9Õ�b�AW\P´sOQMh\PAcGTBÎ\hÅEMP^*OQIÄ\h´�OyV³_]MhG*D*Mh@*´�X�;�·Ý Ñ�ÑzÓ ²MhACfmO�¹�G�VyÅ7\HACf¯@/D�ACB�D eUe ãâVQ@�fmOQMh@�;� ÏÀÐ@? ÝNÒ Ô ²MhACfmO³Õ�¹�G�VyÅE\9@�Å�_]GTf¯@/_PAWV,Ð�[EMPO�´sG�\PAc_PAcGTB�OQMy;? � ÿ ÚE´7@/MPO�¹�G*M�ÅE\]OQMh\yí�G.S�BdACB7\]_]MvÅ7f¯ORB�_Q;

1�2 ñ è43 � G æ % ùSÿPöxøcý�`cú�÷�ÿcø�ùJöQùJö6 ¬JèLè�GuàQá æ % »UX7AW\$V³GTfÃfÃ@�BEb�\]OQ_P\$_hXEO�G*MhAcD�ACB%G*¹�´sG�\PAc_PAcGTB%@�B�D�JcO¦Å7\]Oyb�¹�G*M)@H\P´sOyVQAcÐ�VACBE\]_]MvÅ7f¯ORB�_5@�BEb,_hX�O�\PVQ@*JcO

@�BEb¡G*MhAcORB�_P@/_PAcGTB3¹�G*M,_hX�O�øU��÷�û_aµV³GTfÃfÃ@�BEbÌÁ�òWF��SF�ÂP;òLG�\PAc_PAcGTBº@�B�D�JcO¯GTBÝ_hXEO¯\]¶�IÝAW\>BEG*Mvf¯@*JWJcIbEOQÐsB�OybÎ_]G([sO,@*JcGTB�D(_hX�O%\PJWAc_NACBd@¯\h´�OyV³_]MhG*D*Mh@*´�XÎ@�BEba@*JWAcDTB�OybaSUAc_hXËGTB�O>G*¹L_hXEO%bEOQ_]OyV³_]G*M�@�Ï�Oy\¹�G*Mg@�BºACf¯@/D�ACBED1ACBE\P_]MvÅ7fmORBT_Q;d»UX�O(\PVQ@*JcOÎ@�BEb3G*MvAcORB�_P@/_PAcGTBÆ´7@/Mv@�fmOQ_]OQMh\>@/MPOÄVyÅEMPMPORBT_PJcI¡\]OQ_>_]GfÃ@/_PVvXº_hX�OÎ\]_P@�BEb7@/Mvbº» e ÚÝÏ�I3V³G�G*Mhb7ACBE@/_]OÎ\]I�\]_]ORfÀO³ÏEV³Oy´E_¤¹ÈG*M¤_hX�O�Ö ÓYØ�Ø ¶*OQI�S¦G*Mhb5F�S�X�OQMhO_hX�OQIÎV³G*MPMhOy\P´sGTBEbË_]G¯_hX�O%\PI�\]_]ORfÍÅE\]Oybd[�I(_hXEO,? n J�»"\]G*¹�_�Sj@/MPOg´7@*VP¶/@/D*O*;

& 7[­�u �TëYÍ?$G*DÃ_]Mh@*VP¶�ACB�DÃOQMhMPG*Mh\H@�BEbÎ@*\h\]G�VQAW@/_]Oyb1b7@/_P@m¹�MPGTf »Há>F�@�ÅE_]G*DTÅEAWbEOQMU@�BEbd_]OyJcOy\PV³G�´sO%ORBEV³G�bEOQMh\Q;ãû¬xï¡è ñ á&% �Pô�õ «aM � MO*=�<) � «NMO*=��*'� � � « + ��(>9�8�; �4 -LG/. ñ ¹ � á æ % »UXEO,´�OQMvAcG�bδ7@/Mv@�fmOQ_]OQMUbEOQ¹Ü@�ÅEJc_P\9_]GÄÔ l V³I�VQJcOy\>Á å \]OyV³GTB7b�ÂP;0 ñ ï ñ è�GHá:Guï æ % »UXEO,´�OQMvAcG�b5F7ACBµACB�_]OQD*OQM�V³I�VQJcOy\UG*¹|_hX�O%\PI�BEVYX�MPGTB�GTÅ7\HJcG�G�´·Á l ; l æÃ\QÂP;�»UX�O>@*JWJcGRS¦OybµMh@�BED*O%AW\ å î

Ô l*l*l*l ;j»UXEAW\H´�@/Mh@�fmOQ_]OQMUAW\HGTBEJcIËÅ7\]OybÎSUAc_hXË_hXEO ² ÿ¦Ñ@?�Ó ² � @�BEb �ÀkBÒ ×�ÏÀÐ Y ¶*OQI�S�G*Mhb�\Q;ä=G ç ­�¬Jï�í æ % «NM � MO*=�b) � î ^/@*JWAWbd¶*OQI�S�G*Mhb�\H@/MPO*ØÐED ´7A�Ï�OyJ¦V³G�G*Mhb7ACBE@/_]Oy\g´EMPG�b�ÅEV³Oyb¡[�I�_hX�OÄ@*VQÇ�ÅEAW\hAc_PAcGTBº»Há�\]I�\]Õ_]ORfdí=\�K�ì�×�ã n G*MU×�Õ�K�ìU×0ã n ¹êÅ7BEV³_PAcGTB7\Qç� ÏÀÐ@? Ü Ï Ò Ó ² � ´7A�Ï�OyJ)V³G�G*Mhb7ACBE@/_]Oy\�´EMhG�b�Å7V³Oybµ[�IÎGTB�O>G*¹_hX�O eUe ãï@�Å�_]G*DTÅ�ÕAWbEOQMv\QF² ÿZÑ@?�Ó ² � Ø ORBEV³G�bEOQM�MPOy@*b7ACBED�\QFT\]OQMP^*G�OQMhMPG*Mh\|@�BEbmbEMhAc^*O9bEORfÃ@�BEb7\)¹ÈG*M�_hXEO@*Jc_PAc_hÅEb7O*F�@/ÖyACf¤Å�_hXÎ@�BEbµVyÅ�MPMPORBT_9MPG*_P@/_]G*M�bEMhAc^*Oy\QF��ksÒ ×�ÏÀÐ Y @*JWJ!´sG�\P\PAW[7JcO%ORBEV³G�b7OQMh\HGTBd_hX�O%@/ÖyACf¤Å�_hXd@�ÏEAW\�_]G(@*JWJcGRSßV³GTfmÕ´7@/MvAW\]GTBÎ[sOQ_�S¦OQORBdACBEb7Oy´�ORB7bEORB�_H\PI�\]_]ORfÃ\Q;

«NMb*=��*=� � î ^/@*JWAWbd¶*OQI�S¦G*Mhb7\U@/MhO*Øw?rÿ G*Ma? ÝMÝ ;1�2 ñ è43 � G æ % �Pô�õ�ø_ôÃôxÿ�Pô�õü÷�ÿPþ ôJÿ ��Pô�õ�û4øùHú_`cø_�*ôJÿ6 ¬JèLè�GuàQá æ % ×�¹EJcG*D*D�ACB�DNAW\!_hÅ�MvB�Oyb,GTB�S�X�ORB,Ac_!AW\)@*JcMhOy@*bEI�ORBE@*[7JcOyb,¹�G*M!_hXEO�¶*OQI�S¦G*MhbgACB,Ç�Å�Oy\]_PAcGTB�F�_hX�O¦JcG*DUÐ�JcOAW\

VQJcG�\]Oyb(@�BEbm@,B�OQSÌGTB�OHAW\�G�´�ORBEOyb5;L<�BTI%G*¹s_hX�OHJcG*D*D�ACB�D%¹êÅ7BEV³_PAcGTB7\�f¯@yIg[sO¦MYÅ7Bg\PACf¤ÅEJc_P@�B�OQGTÅE\PJcI*;i OQSj@/MPO%G*¹LMvÅ7B7B7ACB�D¤GTÅ�_HG*¹|b7AW\]¶Ë\P´7@*V³O%Ac¹L^*OQMPIËMh@*´7AWbÎORB7V³G�bEOQM�JcG*D*D�ACB�D(AW\UÅ7\]Oyb5;

& 7�êßx ��� � !Ú�_]G*MPO%_hX�O,VyÅ�MPMPORBT_H´sG�\PAc_PAcGTBÎG*¹L_hX�O,_]OyJcOy\hV³G�´�Og@*\H@ÃBE@�f¯OybÎVQ@/_P@*JcG*DTÅ�OgORB�_]MPI*;ãû¬xï¡è ñ á&% ú�û�ý_a «NM�8<7'(>^�� ���<)�� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % »UXEO%BE@�fmO�G*¹|_hX�O%\]GTÅEMhV³O*;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % ú�û�ý_aÃö�`��c÷®ýcÿQô�ôcû6 ¬JèLè�GuàQá æ % »UX7AW\NV³GTf(f¯@�BEba\]_]G*MPOy\�_hXEOgVyÅ�MhMPORB�_�´sG�\PAc_PAcGTB1_]GÎ@*JWJcGRSÒMPOQ_hÅ�MvBa_]GÎ@�BaG�[�É�OyV³_,@/_�@ËJW@/_]OQM%b7@/_]O*;

»UXEO,´�G�\hAc_PAcGTBÎAW\U\]_]G*MhOybdACBË_hX�O%VyÅEMPMPORBT_HACBE´�Å�_HV³G�G*Mhb7ACBE@/_]O>\]I�\P_]ORfÎ;

è*è

Page 67: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

& 7�ê 9 � ë�ë #ã�AW\P´7JW@RIÎ_hX�O�D*OQG�V³ORBT_]MhAWVg@�BEbË_]G�´sG�V³ORBT_]MhAWV>@*´7´7@/MPORBT_9MhAcDTXT_U@*\PV³ORBE\PAcGTBµ@�BEbdbEOyVQJWACB7@/_PAcGTBdG*¹L_hX�O>`µG�GTB5;ãû¬xï¡è ñ á&% úeô�ôxÿ-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;6 ¬JèLè�GuàQá æ % »UX7AW\HV³GTfÃfÃ@�BEbËAW\UB�G*_UVyÅ�MhMPORB�_PJcIË@y^/@*AWJW@*[7JcOgGTBË_hX�O%\PI�\]_]ORf�V³GTf¯´�Å�_]OQMgÁ�¹ÈMPGTf × e ?�ÂP;

& 7�ê�6 # ;{� 8Ú�ORBEbË_hXEO,_]OyJcOy\PV³G�´sO%_]G¯_]Mv@*VP¶Ë_hX�O%\]GTÅEMhV³O�S�X�G�\]O>b7@/_P@¯@/MPO,ACBd_hX�O�Oyb7Ac_U\]GTÅEMhV³O,[7JcG�VP¶s;ãû¬xï¡è ñ á&% ÿ�÷�ðcø-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;6 ¬JèLè�GuàQá æ % »UXEO%ÅE\]OQMUVQ@/_P@*JcG*DTÅ�O¤AW\H\]Oy@/MvVvX�OybµÐ7Mh\]_QFE¹�G�JWJcGRS¦Oyba[�IÄ_hX�O%\]I�\]_]ORf VQ@/_P@*JcG*DTÅ�O*;

& 7�ê�­ ë$yy + ; 8Z�Ñ5\]OQ_H_hX�O�_]OyJcOy\hV³G�´�Og[TIË@mD�Ac^*ORBµ@�fmGTÅ7BT_HACBËMhAcDTXT_U@*\PV³ORBE\hAcGTBd@�BEbdb7OyVQJWACBE@/_PAcGTB�;ãû¬xï¡è ñ á&% ôxõ�õQö®÷®ø «�8�],]>M���* M � MO*=�<) � «�8�]]�M���* ('� � «�8�],]>M���* ;'�'^ �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % ×�¹E_hX�O ��� Ñʶ*OQI�S¦G*Mhb¤AW\L\P´sOyVQAcÐ7OybÄÁÜ\POQO¦[sOyJcGRS,ÂPF�_hXEO�G/Ñ5\]OQ_P\|ACB,MvAcDTX�_L@*\PV³ORBE\PAcGTBg@�BEbgbEOyVQJWACBE@/_PAcGTB

f¤ÅE\]_¦[sONACBÄ@/MhVQ\]OyV³GTB7b7\Q;�×�¹$_hX�OTÐ Ò × ² ¶*OQI�S¦G*MhbÎAW\j\P´sOyVQAcÐ7Oyb�ÁÜ\]OQO,[sOyJcGRS�ÂPF�_hX�O�G/Ñ5\]OQ_9ACB(MhAcDTX�_@*\PV³ORB7\PAcGTB�f¤ÅE\]_�[sO>ORB�_]OQMPOyb�ACB1\]OyV³GTB7b7\NG*¹�_PACfmO¤@�BEb1G/Ñ�\POQ_�ACBabEOyVQJWACBE@/_PAcGTB3fgÅ7\]_�[sO%ORBT_]OQMPOybACBÎ@/MvVQ\]OyV³GTBEb7\Q;ä=G ç ­�¬Jï�í æ % »UXEO�^�@*JWAWbµG/Ñ�\]OQ_�\]I�\P_]ORf¯\9@/MPO*Ø��� Ñ G/Ñ5\]OQ_P\�_hX�O¤_]OyJcOy\PV³G�´sOÃ[�IµD�Ac^*ORBÝ@�f¯GTÅ7B�_P\�´�@/Mh@*JWJcOyJ|_]GËMhAcDTX�_

@*\PV³ORB7\PAcGTB1@�BEbµbEOyVQJWACB7@/_PAcGTBaACBd_hX�O%_P@�BED*ORB�_�´7JW@�B�O*;H²LG�\PAc_PAc^*OG/Ñ5\]OQ_P\�ACf¯´�JcIÄ_hX7@/_�_hX�OgMhAcDTXT_N@*\hV³ORBE\PAcGTB1@�BEb1bEOyVQJWACBE@/_PAcGTB1G*¹_hX�O�_]OyJcOy\hV³G�´�O>[�G*_hXÄACBEV³MhOy@*\]O*;�»UXEO�fÃ@/DTBEAc_hÅEbEO�G*¹!_hXEO�G/Ñ�\]OQ_AW\�ACBEbEOy´sORBEbEORBT_jG*¹|´sG�\PAc_PAcGTB5;Ð Ò × ² G/Ñ5\]OQ_P\�_hX�OH_]OyJcOy\PV³G�´sO�[TI¤D�Ac^*ORB(@�fmGTÅ7BT_P\�ACB¯MhAcDTX�_�@*\PV³ORBE\PAcGTB@�BEbÄbEOyVQJWACBE@/_PAcGTB5;»UX�O�fÃ@/DTBEAc_hÅEbEOUG*¹$_hX�OUG/Ñ5\]OQ_jbEOy´sORBEb7\�GTBbEOyVQJWACB7@/_PAcGTB�;�£�#Æ@�B7bY£�"¤@/MhOg@*\P\vÅ7fmOybÎ_]GË[sO%ACBµ_hX�O>ACBE´�Å�_V³G�G*Mhb7ACBE@/_]Og\]I�\]_]ORfÎ;

1�2 ñ è43 � G æ % ôxõ�õQö®÷®ø�ûcý�þ ú ��R� T;ú �Sr�ôxõ�õQö®÷®ø�ø5ùHúP÷�I ��� TRú ��r�& 7�ê�ê ë F¡8 z F¡8¾�MhAc_]O,GTÅE_9_hX�O,VyÅ�MPMPORBT_UÅE\]OQMHVQ@/_P@*JcG*DTÅEOgACBÄ_]O³Ï�_H¹�G*Mvf¯@/_9_]Gm_hX�O,´7MhACB�_]OQMRF7» e ÚËÅE\]OQMHACBT_]OQMP¹Ü@*V³O,G*MH_]GÃ@mb�AW\]¶(Ð�JcO*;ãû¬xï¡è ñ á&% ô�`cø���`cø «�8�7* + 7* ;���t>9^�� ��F�G*Mô�`cø���`cøw�,�� «o�=8�;'� �{� «o7:M���(��=�<)�� + �'MMO�=8�(,; �{�B

pp «4;���t>9^�� �qpr «s;�9<('�'^b*'8�( �;�s «s]>9,��� �u� «�� � *'���cM9�8<� �s -LG/. ñ ¹ � á æ % »UXEOQMPO,AW\UB�GÃb7OQ¹�@�ÅEJc_9GTÅE_P´�Å�_HbEOQ^�AWV³O*;�»UXEO,bEOQ¹�@�Å7Jc_P\9¹ÈG*MU_hX�O%VQ@/_P@*JcG*DTÅ�OmBE@�fmO�@/MPO*Ø

Ù�G�b7O*Ø��U�Uô_1Á�_]OyJcOy\PV³G�´sO>V³GTfô�Å�_]OQMQÂPFè�é

Page 68: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

ã�AcMPOyV³_]G*MPI { bEOQ^�AWV³O*Øâ`Qö®÷®ý þxûcø1Á ñ�� E ñ�æ `�úhp�g�_�cø øPþcö `Qö®÷®ý þxûcø �ÂPFn Ï�_]ORBE\hAcGTB�Ø þxûcø�;

0 ñ ï ñ è�GHá:Guï æ % »UXEO�¹ÜÅEJWJ5´�@/_hX˹ÈG*MU_hX�O,GTÅ�_P´�ÅE_9Ð�JcOÃÁÜAc¹|_hX�O ÝMÒ Ö ² ¶*OQI�S¦G*MhbµAW\H\h´�OyVQAcÐ�Oyb î \]OQO%[sOyJcG.S�ÂP;ä=G ç ­�¬Jï�í æ % á�@*JWAWbaGTÅ�_P´�Å�_Hb7OQ^�AWV³Oy\�@/MPO*Ø �·��Ò ÿ¥Ð ² � FeÐ ² � × Ò ÿ � Ö�F ÝMÒ Ö ² ;1�2 ñ è43 � G æ % ô�`cø���`cø,��ý&ùSÿ�ø�÷�ýô�`cø���`cø�ø�÷®ý�ú5ùSÿcû_�ô�`cø���`cø�õ5ùT�c÷,�U�Uô�÷j��õ�`P÷PöJø=IRú�õ� ��U`U 4õj�fppg gù�ö�a=�#`eöx÷�ýûújp��1õ�`P÷�öJø'I;ú þxûcøQö� _�®ûPöJøcÿ&ùTõ��cø6 ¬JèLè�GuàQá æ % »UXEO(VQ@/_P@*JcG*DTÅ�Odf¯@RI¡[sOÃ\P@y^*OybÆACB3_hX�O(b7OQ¹�@�ÅEJc_¤VQ@/_P@*JcG*DTÅ�OÎ@/MPOy@aGTB¡_hXEOÃ_]OyJcOy\PV³G�´sOÎV³GTf¯´�ÅE_]OQMyF

S�XEORBEV³OÃAc_gfÃ@yI�[sO¯MPOyV³G.^*OQMPOyb·GTB¡@µ\vÅE[7\]OyÇ�Å�ORBT_>BEAcDTXT_Q;Ä×�_,SUAWJWJÜF�X�G.S�OQ^*OQMRF|[sOÃb7OyJcOQ_]Oyb3S�XEORBI*GTÅÃJcOy@y^*O�_hX�OU\PAc_]O*;�Þ|AWJcOy\�S�XEAWVYX¯@/MPOH_]Gg[sOH[7@*VP¶*OybËÅE´¯\hXEGTÅEJWb¯[sO9_]Mh@�BE\]¹�OQMPMPOyb¯_]G%I*GTÅ�M@*VQV³GTÅ�B�_GTBË_hXEONá|<&JàÓ l*l*l ÁÜ?)²�á n ÂP;�»�X�O�\]I�BT_P@�Ï˹ÈG*M9_hXEAW\9AW\U\]GTfmOQS�X7@/_jVyÅ�f>[sOQMh\PGTfmO*ØL_hX�O,ÅE\]OQMvBE@�f¯O@�BEba´7@*\P\]S¦G*Mhb1fgÅ7\]_U[sO%\P´sOyVQAcÐ7Oyb5F�G*_hX�OQMPSUAW\PO%_hX�O>Ð�JcO%SUAWJWJ)[sO%GRSNB�Oybµ[�Idã n¦e Ù n »à@�BEbµS�AWJWJ_hX�OQMhOQ¹ÈG*MPO¦[sO�Å7B�MPOy@*b�@*[7JcO�[�I�_hX�O¦ÅE\POQMy;)»UXEO´7@*\P\]S¦G*Mhb>AW\LB�OQOyb7Oyb%ACB%G*MhbEOQM!_]GN@y^*G�AWb¤G.^*OQMPSHMhAc_PACB�DG*¹EG*_hX�OQM�ÅE\POQMh\QíyÐ�JcOy\y;L»UXEOU; e <�»ºO³Ï�_]ORB7\PAcGTBgAW\LfÃ@�BEb7@/_]G*MPI*;L×�¹E@�BTI,G*_hX�OQMLO³Ï�_]ORB7\PAcGTBgAW\)\P´sOyVQAcÐ7Oyb$F_hX�ORB(Ac_S�AWJWJ�[sOHMPORf¯GR^*OybÃ@�B7bµ; e <�» \hÅE[7\P_PAc_hÅ�_]Oyb5;�»!Gg´EMhACBT__hX�O�VQ@/_P@*JcG*DTÅ�O�GTBm_hX�ONJWACB�O�´7MhACB�_]OQMACBº_hX�Oľ ¿N»�F|_�I�´sO½ô�`�ø_��`cø,��ý&ùSÿcøc÷�ý�@�BEb·_]G1JWAW\]_mAc_m@/_¤_hX�OÎÅE\]OQM¤ACB�_]OQMP¹Ü@*V³OÎ_]OQMvfÃACBE@*JÜF�_�I�´sOô�`cø���`cø�ø�÷®ý�ú5ùSÿcû_��;

& 7�êL� z � ͦ;ã�AW\P´7JW@RIÎ_hX�O%B�O³Ï�_U´7@/D*O%ACBË_hXEO,V³I�VQJcO>G*¹|ACBE¹ÈG*MvfÃ@/_PAcGTBË@�BEbd\]_P@/_hÅ7\Ub7AW\P´�JW@yI�\Q;ãû¬xï¡è ñ á&% ��û_õc÷ «s;>9,M + ��� � M^b('�,��� �-LG/. ñ ¹ � á æ % ��û_õc÷�ÿ�÷�ðcø î _hX�O¯B�O³Ï�_,b7AW\P´7JW@RIa\PV³MhOQORB�ACB1_hX�OmV³I�VQJcO*;m»UXEO¤ACBE¹ÈG*MvfÃ@/_PAcGTBÝb7AW\P´7JW@RIa@*´7´sOy@/Mh\�GTB

\]_P@/Mh_hÅE´5;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % »UXEO�^�@/MhAcGTÅ7\Hb7AW\P´7JW@RI�\�ACBË_hX�O,V³I�VQJcO>@/MPO*F�ACBËG*MhbEOQMyØÿ ² A Ð ã�AW\P´�JW@yIË_hX�O>B�O³Ï�_H´7@/D*OgACBË_hX�O,V³I�VQJcO*çÒ ÿ Ý ? »)G�´�Õ�JcOQ^*OyJ)ACB�¹ÈG*MYf¯@/_PAcGTBÎb7AW\h´7JW@yI�ÁÜ@*´7´sOy@/Mh\9GTBµ\]_P@/MP_hÅE´�ÂPç² ÿ¦Ñ@?�Ó ² � Ø n BEV³G�bEOQM9MPOy@*b7ACB�D�\yçÖ Ò × Ò Ð�Ø ?)ACf¯Ac_HACBEb�AWVQ@/_]G*Mh\Qç� Ö ��� ×ÙØ <NJW@/Mvf ACB7b7AWVQ@/_]G*Mh\QçÓ�?¤× ² ãNGTf¯O,\]_P@/_hÅE\U@�B7bµf¯@�B�ÅE@*JsGR^*OQMPMvAWbEOy\Q;1�2 ñ è43 � G æ % ��û_õc÷ü÷�ÿ�þ��û_õc÷6 ¬JèLè�GuàQá æ % Ú�OQO¤Ú�OyV³_PAcGTB n ¹ÈG*M�f¯G*MPO,bEOQ_P@*AWJW\Q;

& 7�êLF z � � � �>� � �n BT_]OQM�@m´�@/Mh@*JWJW@�ϵACB�_]GÃ_hX�O�Oyb7Ac_U\]GTÅEMhV³O%b7@/_P@¯@/MhOy@�;ãû¬xï¡è ñ á&% ��û�ýcû��U��ûUð « + ��(��'�,��� � ��(>^M��=^,M �-LG/. ñ ¹ � á æ % Ù�GTB�O*;ì�BE\P´sOyVQAcÐ7Oybd´�@/Mh@*JWJW@�Ï�Oy\�@/MPO%@*\P\vÅ7fmOybË_]GÃ[sO�ÖQOQMPGE;0 ñ ï ñ è�GHá:Guï æ % »UXEO,´7@/Mh@*JWJW@�ÏdACBÎ@/MhVQ\]OyV³GTB7b7\Q;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % ��û�ýcû��U��ûUð�I I �,�6 ¬JèLè�GuàQá æ % »UXEO,´7@/Mh@*JWJW@�ÏdAW\HMPO0É0OyV³_]OybµAc¹|Ac_UJWAcOy\UGTÅ�_P\PAWbEO,_hXEO�Mh@�B�D*O l ; l _]G å l ; l @/MhVQ\POyV³GTBEb7\Q;

& 7�êÃ\ z �Ú�IEB�GTBTI�f ¹�G*M&��ýPô��c÷®ý úeôxø&ùJôJÿÝÁ�òWF��SF)ÂP;

è I

Page 69: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

& 7�êLd zÀë �b# 8?$G*DEF�ACBλH²¦Z�×�ÙN»¼¹�G*Mvf¯@/_QFE_hX�O,´7MPOy\]ORBT_H´�G�\hAc_PAcGTBÎG*¹L_hX�O,_]OyJcOy\PV³G�´sO>@*\UMPOy@*bÎGTBË_hXEO,ORBEV³G�bEOQMh\Q;ãû¬xï¡è ñ á&% �PôQùSÿcø «s]�9,��� MO*=��*�7:M �-LG/. ñ ¹ � á æ % �PôQùSÿcøÃô��� 0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % »UXEOµJcG*D¡Ð�JcOafÃ@yIÌ[sOÎOyAc_hX�OQM(@�B¸G�JWb¸Ð�JcO·ÁÜ\P´sOyVQAcÐ7Oyb'[�Iº_hXEO�?�Ö Ó ¶*OQI�S¦G*Mhb�Â%G*MÄ@3B�OQSÍÐ�JcO

ÁÜ\P´sOyVQAcÐ7Oybµ[TIÄ_hX�O[ÿ ² � ¶*OQI�S�G*Mhb5ÂP;1�2 ñ è43 � G æ % �PôQùSÿcø�PôQùSÿcøüÿc÷��6 ¬JèLè�GuàQá æ % »UXEOUb7@/_P@,@/MPO�JcG*D*D*Oyb(_]G>@%´sG�ACB�_PACBED%b7@/_P@�Ð�JcO�ACB¯@�¹�G*Mvf¯@/_�\vÅEAc_P@*[7JcOU¹�G*MACBE´�Å�_�_]G%_hX�O�»H²¦ZN×0ÙN»

@�BE@*JcI�\PAW\¤´7@*Vh¶�@/D*O*;i��ôeùWÿcøüÿ�÷��¡@*JcSj@yI�\gV³MhOy@/_]Oy\g@ÝB�OQS ´�G�ACBT_PACB�DaÐ�JcO*;$�PôQùSÿ�øÝG*Mo��ôeùWÿcøÃô��� ÅE\POy\j_hX�O�JW@/_]Oy\]_HÐ�JcO,V³MPOy@/_]Oybd_hXE@/_UBEAcDTXT_¦G*M�V³MPOy@/_]Oy\H@¯B�OQS¼GTB�O�Ac¹|B�GTB�O%XE@*\j[sOQORBËV³MPOy@/_]OybÎ_hXE@/_BEAcDTXT_Q;»UXEO�¹ÜÅ7B7V³_PAcGTB˶*OQI W4�� AW\HOyÇ�ÅEAc^/@*JcORB�_�_]G¯_hX�OC�PôQùSÿcø(V³GTfÃfÃ@�BEb5;

& 7�êLu zÀë*�N;×]BE´�Å�_j^/@*JCÅ�Oy\HG*¹|´sG�JW@/M�fmG*_PAcGTB�;ãû¬xï¡è ñ á&% �Pô��c÷ « � + 8=M9O*c9�8�� � « � + 8=M,9b*c9�8�� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;¦Ú�OQO>V³GTfÃfmORBT_P\9[sOyJcGRS,;0 ñ ï ñ è�GHá:Guï æ % »UXEO,´�G�JW@/MNfmG*_PAcGTBÄÏ�IÄV³G*MhMPOyV³_PAcGTBE\NACBÎ@/MhVQ\]OyV³GTBEb�\Q;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % �Pô��c÷�I úbI�T �� úbI6 ¬JèLè�GuàQá æ % »UX7AW\NV³GTf(f¯@�BEbµGR^*OQMPMvAWbEOy\�_hX�OmACBEAc_PAW@*JL^�@*JCÅEOy\�¹ÈG*M�´sG�JW@/M,fmG*_PAcGTB�F�S�XEAWVYX1@/MPOmbEOQMhAc^*Oyb1¹ÈMhGTf @�B

ACBT_]OQMh´sG�JW@/_PAcGTB̹�G*Mvf¤ÅEJW@Ý\hÅE´7´�JWAcOybÌ[TIº_hX�O n @/MP_hX¸:HG*_P@/_PAcGTB¸²MPOyb7AWV³_PAcGTB Ú�OQMP^�AWV³O*;·×�_Ãf¯@/¶*Oy\Ã@^*OQMPIÎ\hfÃ@*JWJ5b7A�Ñ�OQMPORBEV³O,_]G¯_hXEO,´�G�ACBT_PACB�D¯G*¹L_hX�O,_]OyJcOy\hV³G�´�Og@�BEbdAW\9_]G�G¯Oy\]G*_]OQMvAWV,¹�G*M�B�G*MvfÃ@*J$ÅE\]O*;

& 7��ûx zÀë +±� 8 � ë #`µGR^*O%_hXEO,_]OyJcOy\PV³G�´sO>[�IÄ@ôEMPOQ^�AcGTÅE\PJcI�Õ�\]_]G*MPOyb3Á�´�:°µ�Â�G/Ñ5\]OQ_Q;ãû¬xï¡è ñ á&% �Pô�öeùSø&ùJôJÿ « + 8=M,9b*>9�8�� �,7,)�K=��( �-LG/. ñ ¹ � á æ % Ù�GTB�O*;��Pô�öeùWø5ùJôJÿ�IËÁ�ÖQOQMPGgG/Ñ�\POQ_³Â|AW\j@�Å�_]GTfÃ@/_PAWVQ@*JWJcI(\]OyJcOyV³_]OybÄGTB(\]_P@/MP_hÅE´(G*M¦VYXE@�B�D*ONG*¹!\]GTÅ�MvV³O*;0 ñ ï ñ è�GHá:Guï æ % »UXEO%´sG�\PAc_PAcGTBµB�Å7fg[sOQMHAW\�@�BµACB�_]OQD*OQM�ACBÎ_hX�O>Mh@�B�D*O l Õ å l ;H»�X�O,G/Ñ5\]OQ_�^/@*JCÅ�Oy\U¹ÈG*MN@¯D�Ac^*ORBa´�G�\hA�Õ

_PAcGTBÝB�Å7fg[�OQM�f¤ÅE\]_�XE@R^*Om[�OQORBa\]OQ_�ÅE´ÝÅE\PACB�D(_hX�O~÷�ÿcøc÷�ýËG*M·öxøQôJý�÷ËV³GTfÃf¯@�B7b7\Q;>�Pô�öeùSø&ùJôJÿLIV³G*MPMhOy\P´sGTBEb7\j_]GÃ@mÖQOQMhG¯G/Ñ�\POQ_�@�BEbËMPOQ_hÅEMvBE\j_hX�O,_]OyJcOy\hV³G�´�O>_]G¯_hX�O,MhOQ¹ÈOQMPORB7V³O,´�G�\hAc_PAcGTB�;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;

1�2 ñ è43 � G æ % �Pô�öeùSø&ùJôJÿ �& 7��B9 z%�Y; +�+ F ��;n BT_]OQMU_hXEO�^�@*JCÅ�O%G*¹)_hX�O>[7@/MPGTfmOQ_]MvAWV�´EMPOy\P\hÅEMPO,ÅE\]OybdACBË_hXEO,VQ@*JWVyÅEJW@/_PAcGTBaG*¹LMhOQ¹ÈMh@*V³_PAcGTB5;ãû¬xï¡è ñ á&% ��ýc÷Pöcö#`�ýc÷ « + ('�'MM|7'('� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;»UXEO,´EMPOy\P\hÅEMPO�@*\P\hÅ7f¯OybËGTBÎ\]_P@/MP_hÅE´µAW\Né*é ò fÃAWJWJWAW[7@/My;0 ñ ï ñ è�GHá:Guï æ % »UXEO,[7@/MPGTfmOQ_]MvAWV�´EMPOy\P\hÅEMPO�ACBdf¯AWJWJWAW[7@/Mv\Q;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % ��ýc÷Pöcö#`�ýc÷ �� H R�6 ¬JèLè�GuàQá æ % »UXEO>MPOQ¹�Mh@*V³_PAcGTB�V³G*MhMPOyV³_PAcGTB�AW\�´EMPG�´sG*MP_PAcGTB7@*J)_]GË_hX�Om´EMhOy\P\hÅ�MPO*;,<�BaOQMPMPG*M�G*¹�æÎfÃAWJWJWAW[7@/M�AW\�É]ÅE\P_

@*[sGTÅ�_�B�G*_PAWV³Oy@*[7JcOµÁÜAc_�V³G*MPMPOy\P´sGTBEb7\U_]GÄ@Ä´sG�ACB�_PACBEDÄbEOQ^�AW@/_PAcGTB1G*¹ å @/MhVQ\]OyV³GTBEbÝ@/_�@ÃÖQORBEAc_hX1b7AW\]Õ_P@�BEV³O>G*¹�é/æ � ÂP;

è ò

Page 70: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

& 7���6 z%� ��� ;Ú�OyJcOyV³_�_hX�O,´EMhACf¯ON¹�G�VQ@*J$\]_P@/_PAcGTB�;ãû¬xï¡è ñ á&% ��ý&ùWúP÷-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;6 ¬JèLè�GuàQá æ % <N´7´7JWAcOy\�´EMvACfmO%¹�G�VyÅE\�´sG�ACB�_PACB�Ddf¯G�bEOyJÜF�ORBE@*[�JcOy\�´EMhACfmO>¹ÈG�VyÅE\�MPG*_P@/_]G*M>@�BEbÝb7AW\P@*[7JcOy\�@*JWJ|G*_hX�OQM

MPG*_P@/_]G*Mv\Q;

& 7���­ z%��ë » ;n BT_]OQM�VyÅEMPMPORBT_H´�G�\hAc_PAcGTBËG*¹|_hX�O e @*\P\]OQD*Mv@*ACBd@�Å�_]G*DTÅEAWb7OQM�´EMPG�[sO�ACB¡Á ¬ :Ì%�Â�V³G�G*Mhb7ACBE@/_]Oy\y;ãû¬xï¡è ñ á&% ��ýPô��÷ «s(���;>9|7:M � «w*�����*'� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % »UXEO,@�Å�_]G*Mh@*b7AW@*J)´�G�\hAc_PAcGTBÎACBdf¯AWV³MhGTBE\9@�BEbÎ_hX�O>@�Å�_]G*_hX�OQ_P@ôsG�\PAc_PAcGTBdACBdf¯AWJWJWAWbEOQD*MhOQOy\Q;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % ��ýPô��÷ úOII,II úOIII,I6 ¬JèLè�GuàQá æ % »UXEOy\]O(^/@*JCÅ�Oy\¤VQ@�B·[sOÃMPOy@*bÆb7AcMPOyV³_PJcI3¹ÈMPGTf½_hX�OÄ× e ?¼f¯ACf¯AWVÃb7AW\P´7JW@RI*;1×�¹9_hX�O½%µV³G�G*Mhb7ACB7@/_]OËAW\

ACBEV³G*MhMPOyV³_QFT_hX�ORB¯\P´�Å�MhAcGTÅ7\)DTÅ7AWb7ACB�D,V³G*MPMPOyV³_PAcGTB7\�SUAWJWJE[sO9@*´7´7JWAcOyb5; i G*_hXmV³G�G*Mhb7ACBE@/_]Oy\�@/MPOUB�OQOybEOyb¹�G*MH_hX�O·û�õUô&ù�÷��ËV³GTfÃfÃ@�BEbÄ_]G¯S�G*Mh¶�;

& 7��gê z%��ë*z¤;�� � ë 8 � ë #n BT_]OQM�´7MPG�´sOQM9f¯G*_PAcGTBE\HACBT_]GÃ_hX�O�Oyb�Ac_U\]GTÅ�MhV³O>b7@/_P@¯@/MPOy@�;ãû¬xï¡è ñ á&% ��ýPô��c÷®ý úQôxø&ùJôxÿ « + ) 9|� (�� � « + ) 9O� ;'�'^ �-LG/. ñ ¹ � á æ % ì�BE\P´sOyVQAcÐ7Oybd´7MPG�´sOQM9f¯G*_PAcGTBE\H@/MPO>@*\P\hÅ7f¯OybË_]GÃ[sO l ;0 ñ ï ñ è�GHá:Guï æ % »UXEO>´EMPG�´sOQM�f¯G*_PAcGTBµACBµMhAcDTXT_�@*\PV³ORB7\PAcGTB1@�BEbµbEOyVQJWACB7@/_PAcGTBaACB1Å7BEAc_P\UG*¹\]OyV³GTBEb�\ { I*Oy@/M�@�BEbµ@/MhVYÕ

\]OyV³GTB7b7\ { I*Oy@/MyF�MPOy\P´sOyV³_PAc^*OyJcI*;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % ��ýPô��c÷®ý úQôxø&ùJôxÿLT;ú ��� I R�����6 ¬JèLè�GuàQá æ % »UXEO,\]I�BEGTB�IEf �®úËVQ@�BÎ@*JW\PG([sO,ÅE\]Oyb5;& 7���� � �n BT_]OQM�@¤MvAcDTX�_U@*\hV³ORBE\PAcGTBdACBÎ_hX�O,Oyb7Ac_U\PGTÅ�MhV³O,b7@/_P@¯@/MhOy@�;ãû¬xï¡è ñ á&% ýcû «s('� ��8<7'(>M � «s(�� ):9O�7*=�'M � «4(�� M��=^�8��';�M �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % »UXEOMhAcDTXT_L@*\hV³ORBE\PAcGTBgACB%X�GTÅEMh\QF*f¯ACB�Å�_]Oy\)@�B7b%\]OyV³GTBEb�\!G*¹7_PACf¯O*;L»�X�O�MhAcDTXT_L@*\hV³ORBE\PAcGTBgAW\!MhO0É�OyV³_]Oyb

Ac¹L_hX�O%@�BTIËG*¹)_hX�O>V³GTf¯´sGTB�ORBT_P\9JWAcO%GTÅ�_P\PAWb7O�_hX�O,¹�G�JWJcGRSUACB�D(Mh@�B�D*Oy\QØ(�� �=8�7'(�M l.î Ô k ACBEVQJCÅE\PAc^*O(�� ):9O�7*=�'M l.î æ ò ACBEVQJCÅE\PAc^*O(�� M��=^�8<�';�M l ; l.î æ ò ; ò*ò ;W;W;HACB7VQJCÅE\PAc^*Oä=G ç ­�¬Jï�í æ % Ù�GTB�O*;

1�2 ñ è43 � G æ % ýcû·ú �L������� �� H& 7���F � ���D��� � \Z;��n BT_]OQM�@¤Mv@*b7AW@*J5^*OyJcG�VQAc_�IµACBË_hXEO,Oyb7Ac_H\]GTÅ�MvV³O%b7@/_P@¯@/MPOy@�;ãû¬xï¡è ñ á&% ýcû� gùSû_� ôc÷_� «s('��;>9��'� t=����8=^,9b* �p�-LG/. ñ ¹ � á æ % ì�BE\P´sOyVQAcÐ7OybÎMv@*b7AW@*J�^*OyJcG�VQAc_PAcOy\�@/MPO>@*\P\hÅ7f¯OybË_]GÃ[sO l ;

é l

Page 71: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

0 ñ ï ñ è�GHá:Guï æ % »UXEO�Mh@*b7AW@*J5^*OyJcG�VQAc_�IµACBζ�f { \]OyV/;�<â´�G�\hAc_PAc^*O,^*OyJcG�VQAc_�IµACf¯´�JWAcOy\H@¤MPOyV³Oyb7ACB�D(\]GTÅ�MhV³O*;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % ýcû� gùSû_� ôc÷_��T,H �6 ¬JèLè�GuàQá æ % »UXEO,\]I�BEGTB�IEf ý_ôÄVQ@�BÎ@*JW\PG([sO,ÅE\]Oyb5;& 7��L\ � � 8 ;Ú�OQ_H_hXEO�ORBEV³G�b7OQM�ÅE\]OybdACBÎ_hX�O,<UÖyACf¤Å�_hXµXE@/MhbESj@/MPO,´sG�\PAc_PAcGTBdJcG�G�´5;ãû¬xï¡è ñ á&% ýcû�ø�÷ «����c^�8�;���( �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % Ü ² ��� »�X�O,<UÖyACf¤Å�_hXÄD*Oy@/MNORBEV³G�bEOQMy;Ð ��� ² »�X�O,<UÖyACf¤Å�_hXÄ_P@*´sO,ORB7V³G�bEOQMR;1�2 ñ è43 � G æ % ýcû�ø�÷�øcû_�c÷6 ¬JèLè�GuàQá æ % »UX7AW\ÃV³GTfÃfÃ@�BEbÌAW\(Å7\]OybÌ_]GºVYXE@�B�D*Oa_hX�Oa\]GTÅEMhV³OdG*¹,´�ÅEJW\POy\mMPOyV³OyAc^*OybÊ[TIÆ_hX�O1`µ@/MhV³GTB7AU\]OQMP^*G

OyJcOyV³_]MPGTB7AWVQ\¦@�B7bÃÅE\]Oyb¯ACB¯_hX�O�XE@/MvbES¦@/MhOU´7@/MP_�G*¹�_hX�O�´�G�\hAc_PAcGTB¯JcG�G�´5; e GTf¯´7@/MhOM÷®ÿPþcô� P÷®ýsF/S�XEAWVvXVYXE@�B�D*Oy\N_hX�O%ORB7V³G�bEOQM�V³GTfg[7ACBE@/_PAcGTBÝÅE\]Oyba[TIÎ_hXEO>\]G*¹�_�Sj@/MPO¤´7@/MP_UG*¹_hX�O>JcG�G�´5;U»UXEO%V³GTfÃfÃ@�BEb¹�G*MhV³Oy\¤@µ\]S�Ac_PVvXº_]GaORBED�ACB�OQOQMhACB�D�fmG�bEO*;dÙ�G*_]O(_hXE@/_¤VvX7@�B�D*Oy\g_]Ga_hX�OË\]SUAc_PVYX3\POQ_]_PACB�D�\¤GTB¡_hXEOMh@/_]O%D*ORB�OQMh@/_]G*M�[�G�@/MvbÎ@/MPO%@*JW\]G(BEOQOybEOyb5;

& 7���d ��; &Ä� �>�:HOyVQ@*JWJ)@¯´EMPOQ^�AcGTÅE\HV³GTf(f¯@�BEb$;ãû¬xï¡è ñ á&% ý�÷cþ®û��U� «N^�8b))>�<�'; ���b)>� �-LG/. ñ ¹ � á æ % ?)@*\]_UV³GTfÃfÃ@�BEb5;0 ñ ï ñ è�GHá:Guï æ % <â\]_]MhACBED¯V³GTB�_P@*ACBEACBEDÃ_hX�O�Ð7Mv\]_H´7@/MP_9G*¹|_hX�O,V³GTf(f¯@�BEbËI*GTÅËS�AW\hXË_]G¯MPOyVQ@*JWJÜ;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % ý�÷cþ®û��U��õPô®þ®û�ø6 ¬JèLè�GuàQá æ % ý�÷cþ®û��U�,AW\�Å7\]Oybg_]G�MPOyV³GR^*OQM�_hX�OHJW@*\]_�G�VQVyÅ�MPMPORBEV³OjG*¹s@�_�I�´�OybmV³GTf(f¯@�BEb>SUAc_hXEACBg@,æ l Õ�JWACB�O�[�Å�Ñ�OQMyF

ÉPÅE\]_H@*\HACBËã e ?;7ÙUG*_]O>_hXE@/_9_hXEAW\HV³GTf(f¯@�BEbËAW\UBEG*_H@y^/@*AWJW@*[7JcO%GTBË_hXEO,\]I�\P_]ORf V³GTf¯´�ÅE_]OQM%Á�¹ÈMPGTf× e ?�ÂP;

& 7���u ��; � ë¤\Z;:HORf¯GR^*O,_hXEO,ORB�_]MhI(¹�G*MU_hX�O%B7@�fmOybÎ\]GTÅ�MvV³O,¹ÈMhGTf _hX�O>ÅE\]OQM�VQ@/_P@*JcG*DTÅ�O*;ãû¬xï¡è ñ á&% ý�÷xúeô�ôc÷ «NM�8<7'(>^�� �=�<)�� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % »UXEONBE@�f¯OUG*¹$_hX�ON\]GTÅ�MhV³ON_]G¤[�ONbEOyJcOQ_]Oyb5;»�X�ONBE@�f¯ONfÃ@yI¯[sO�@g\]_]MhACB�D>G*¹)ÅE´Ã_]GmÔ l VvX7@/Mh@*V³_]OQMh\Qç

O³Ï�_]Mh@ÃVYXE@/Mh@*V³_]OQMh\N@/MPO%JcG�\P_Q;¦»)G(ACBEVQJCÅ7bEO,\P´7@*V³Oy\QF�_hX�O,S�XEG�JcO%\]_]MhACB�D(\hX�GTÅEJWbd[sO�ORBEVQJcG�\POybdSUAc_hXEACBbEGTÅ7[7JcO,Ç�ÅEG*_]Oy\Q;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;

1�2 ñ è43 � G æ % ý�÷xúeô�ôc÷Âÿ�õcþ � ú � úý�÷xúeô�ôc÷��Wö 7 + ��(��=8�t'�L9O� �xúQþf�& 7�Fûx ��ë 8 � 8 ë*�`µGR^*O%_hXEO,MPG*_P@/_]G*MN_]G¯_hX�O,\P´sOyVQAcÐ7Oybµf¯GTÅ7BT_¦G*MN\]¶�IÄ´sG�\PAc_PAcGTBÎ@�BED�JcO%G*MUVYXE@�B�D*O%Ac_P\NfmG�bEO�G*¹LG�´sOQMh@/_PAcGTB5;ãû¬xï¡è ñ á&% ýQôJøcûcøPôxý «s(�8�*=��*=8�( )�8�;�� � « + 8=M,9b*c9�8�� ��������� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;

é å

Page 72: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

0 ñ ï ñ è�GHá:Guï æ % « + 8=M,9b*>9�8�� �<�'����� � î _hX�OδsG�\PAc_PAcGTBÆ@�B�D�JcOÎACBÆbEOQD*MhOQOy\Q;3»UXEAW\¤´7@/Mv@�fmOQ_]OQMmAW\¤GTBEJcI3MhOyÇ�ÅEAcMhOybS�XEORB·Å7\PACB�DÝ_hX�OYØ Þu� @�B7b�×C?�ÏSÿ¥Ð ¶*OQI�S¦G*Mhb7\dÁÜ\POQOd[�OyJcG.S�ÂP;ÆÚ�¶�I3´sG�\PAc_PAcGTBÆ@�BED�JcOµfgÅ7\]_[sO>ACBµ_hX�OgMh@�B�D*O l � îµk è l � Á�_hX�O¤BEOy@/MPOy\]_�V³G*MPMPOy\P´sGTBEb7ACBED(fmGTÅ7BT_�´sG�\PAc_PAcGTB1@�B�D�JcO¤AW\�\]OyJcOyV³_]Oyb�ÂP;»UXEO e @*\h\]OQD*Mh@*ACBÄMPG*_P@/_]G*MUXE@*\Hf¯GTÅ7BT_�´sG�\PAc_PAcGTBÄ@�B�D�JcO,JWACf¯Ac_P\¦G*¹C��Ô*æ l � î K�Ô*æ l � ç�_hXEONÙN@*\hf>I�_hX_hÅ�MYB�_P@*[7JcOy\LVyÅ�MPMhORB�_PJcI>X7@y^*O9B�G�JWACfÃAc_P\!ORBE@*[�JcOyb5F*\PACBEV³O_hXEOQI%@/MPO�VQ@*´�@*[7JcO�G*¹7V³GTBT_PACB�Å�GTÅE\LMPG*_P@/_PAcGTB�;ä=G ç ­�¬Jï�í æ % «s('8�*'��*'8�( )>8�;'� � î _hX�O,¹�G�JWJcGRSUACBED¯¶*OQI�S¦G*Mhb7\UMPOy´EMPOy\PORB�_9_hX�O%^�@*JWAWbµMPG*_P@/_]G*MNf¯G�bEOy\yØØ Þu� »�XEAW\5¶*OQI�S�G*Mhb%D�Ac^*Oy\)@U´�G�\hAc_PAcGTB,@�B�D�JcO�GTB,_hX�O\]¶�ImÁêfmOy@*\hÅ�MhOyb

@�BT_PAWVQJcG�Vh¶�S�AW\]Oµ¹�MPGTfÀÙUG*Mh_hX·S�XEAWVvXÆAW\ l � @�BEbÆbEOQÐsB�OybÆ[TI·@BE@/_hÅEMh@*J�@�Ï�AW\ËACB _hX�OÝACBE\]_]MvÅ7f¯ORB�_Ä\hÅEVYX @*\Ë@·\P´sOyV³_]MPG*D*Mh@*´�X\PJWAc_³ÂP;ß×�¹,MPG*_P@/_]G*MÎ_]Mv@*VP¶�ACB�D¸AW\ÄORBE@*[7JcOybßÁÜ@*\ÎAW\Ä_hX�O1VQ@*\PO1GTB\]_P@/Mh_hÅE´�ÂPF�_hX�ORBµ_hX�O>MhG*_P@/_]G*M�SUAWJWJ!¹�G�JWJcGRSß_hX7AW\N´sG�\PAc_PAcGTB1@�B�D�JcO@*\U_hX�O,_]OyJcOy\PV³G�´sOgf¯GR^*Oy\Q;×�?�ÏSÿYÐ »UX7AW\)¶*OQI�S¦G*Mhb¯\P´sOyVQAcÐ7Oy\|_hXE@/_�_hXEOH´7@/Mh@�fmOQ_]OQM|D�Ac^*Oy\�@,fmGTÅ7BT_´sG�\PAc_PAcGTB�@�BED�JcO*F E�F�GWFÊfmOy@*\hÅ�MhOybaS�Ac_hX1MPOy\P´sOyV³_�_]Gµ@ËÐ�b�Å7VQAW@*JfÃ@/MP¶ÝÐEÏ�Oyb¡_]Gµ_hX�OËf¯AcMPMPG*M,V³OyJWJÜ;½ýQôxø�ûcøPôxýÂúQô�`�ÿ�ø�\]_]G�´7\�_hXEO_hÅ�MYB�_P@*[7JcO1@/_Ã_hX�OµMPOyÇ�ÅEOy\]_]Oyb'´sG�\PAc_PAcGTB'@�B�D�JcO·ÁÜAc_Ëf¯@/¶*Oy\(BEG\]ORB7\]O,_]G¯_]Mh@*Vh¶d@¯fmGTÅ7BT_H´sG�\PAc_PAcGTBÎ@�B�D�JcO/ÂP;Ý Ö4? � Ð »UXEAW\)G�´E_PAcGTBgAW\)b7Oy\PAcDTB�Oybg_]G�fÃACBEACf¯AW\PO�Å7B7B�OyV³Oy\h\P@/MPI�MPG*_P@/_PAcGTBACBg_hX�OHVQ@*\PO9S�X�OQMPOj_hX�OH´EMhOyVQAW\]Oj^�@*JCÅ�O9G*¹s_hX�O9\]¶�I>´sG�\PAc_PAcGTBm@�B�ÕD�JcO¤AW\NÅ�BEACf¯´sG*MP_P@�BT_Q;jZ�Bµ\]GTÅ�MhV³OgVvXE@�BED*O*F�_hX�O>MPG*_P@/_]G*M�AW\U\]OQ__]GN@9\]¶�I�´sG�\PAc_PAcGTB�@�BED�JcOV³G*MPMPOy\P´sGTBEb�ACB�D9_]GUAc_P\!VyÅEMPMPORBT_!fmGTÅ7BT_^/@*JCÅ�O*;�»�X�OQMPOy@/¹�_]OQMyF7Ac_HMPG*_P@/_]Oy\N@*\H¹�G*MH_hX�OLØ Þq� ¶*OQI�S�G*Mvb5;

D ² � Ð Ò Ñ � Ö »�XEAW\�¶*OQI�S¦G*Mhbº\]OQ_P\�_hX�O¯MhOQ¹ÈOQMPORB7V³O¯@�Ï�AW\>ACBÝ_hX�O¯ACBE\]_]MYÅ7fmORBT__]Ga_hX�O¯^*OQMP_PAWVQ@*J¦b7AcMPOyV³_PAcGTB3@�BEb¡\]_]G�´7\%_hX�OmMPG*_P@/_]G*Mg_]Mh@*VP¶�ACB�DE;×�_HAW\9ACB�_]ORB7bEOybË_]G¯f¯ACBEACfÃAW\]O�JcG�\P\HG*¹)JWAcDTXT_Hb�Å�O�_]Gmb7A�ÑsOQMhORB�_PAW@*JMPOQ¹�Mh@*V³_PAcGTBµb�Å�MhACB�D¤\P´sOyV³_]MPG�\PV³G�´�AWV�G�[7\]OQMP^�ACB�DE;�Ù�G*_]O,_hXE@/_U@�Å�Õ_]G*DTÅEAWb�ACB�D¡AW\mB�G*_m´�G�\h\PAW[7JcO*F�\PACBEV³OËG/ÑsÕ�@�Ï�AW\ÃACf¯@/D*Oy\mfmG.^*OËACB_hX�O%¹ÈG�VQ@*J$´7JW@�B�O*;

D Ý Ö4? � Ð »UX7AW\>¶*OQI�S¦G*MhbÌ\]OQ_P\m_hX�OÎ\PJWAc_m_]G�_hXEOÄ^*OQMh_PAWVQ@*JHb7AcMPOyV³_PAcGTBÆGTB\]GTÅEMhV³OaVYXE@�B�D*OÝ@�BEb¸_hX�ORB¸_]Mh@*VP¶�\Ä@/_(@3V³GTB7\]_P@�B�_Ë\]¶�IÌ´�G�\hA�Õ_PAcGTBa@�B�D�JcO*;9×�_UAW\H_hX�OQMhOQ¹ÈG*MPO>OyÇ�Å7Ac^�@*JcORBT_�_]G(_�I�´7ACB�DEØ ýPôxøÃö�aUö« + ��(��'�,���=^O*c9,^ �<�'�=��� ��; »UX7AW\¯AW\ÃD*ORBEOQMh@*JWJcI'fmG*MPO1ÅE\]OQ¹êÅEJ_hXE@�Bd_hX�OaD ² � Ð Ò Ñ � Ö G�´E_PAcGTB�Fs\PACBEV³O%@�Å�_]G*DTÅ7AWb7ACB�DÃAW\�´�G�\]Õ\PAW[�JcO*;

1�2 ñ è43 � G æ % ýQôJøcûcøPôxý*ö�a_ö ������r�,�ýQôJøcûcøPôxýÂúQô�`cÿcø ���S IýQôJøcûcøPôxý�õ_�PôJûcø& 7�FB9 ��\Ú�IEB�GTBTI�f ¹�G*MNýcû� gùSû_� ô�÷_��ô�þeùSø_öaÁ�òWF��SFLÂP;& 7�F�6 + ; #¸+ ë*�n B7@*[7JcO�G*M�b7AW\h@*[7JcO�_]Mh@*VP¶�ACB�DÄV³G*MPMPOyV³_PAcGTBE\NbEOQMhAc^*Oybι�MPGTf b�AW\P´7JW@*V³ORfmORBT_9_]Mh@�BE\hb�ÅEV³OQMh\Q;ãû¬xï¡è ñ á&% ö®÷®ÿQöcôJý «NM��<�:M�8�( * �,+ � � «aMO*=��*=� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % «NM����cM�8�( * �,+ � �Ý»UXEAW\!\]OyJcOyV³_P\!_hXEO�\]ORBE\]G*Mh\$S�X�G�\]O�_]Mh@*Vh¶�ACBED�V³G*MPMPOyV³_PAcGTB7\!@/MPO�_]G�[�O|ORB { b�AW\P@*[7JcOyb5;

é/Ô

Page 73: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Ø ² Ñ@?rÿ�Ó ����� »UX�O(_hX�MPOQO(b�AW\P´7JW@*V³ORfmORBT_g_]Mh@�BE\Pb�Å7V³OQMh\,S�X7AWVvX·@/MPOÎÅE\]Oyb¡_]Gf¯Oy@*\hÅ�MPO�_hX�O�_PAWJc_�G*¹)_hXEO%\]OyV³GTBEb7@/MhIËfÃAcMPMPG*My;Y ? ��Ò�k ?�ÿYÐ � Ö »UX�O�_�S�GN_]Mh@�BE\Pb�ÅEV³OQMh\5S�X7AWVvX%f¯Oy@*\hÅ�MPO�_hXEO¦X�G*MhAcÖQGTBT_P@*J�fmGR^*O³Õf¯ORB�_NG*¹_hX�O¤_]OyJcOy\PV³G�´sO*;g»UX�Oy\]O¤@/MPO¯ÅE\]Oyb1_]GδEMPG.^�AWbEOg_]Mh@*Vh¶TÕACB�DaV³G*MPMPOyV³_PAcGTBE\>ACB�<UÖyACf¤Å�_hX1¹�G*M,_hX�OmD*Oy@/MgACBEV³MPORf¯ORB�_P@*J�ORB�ÕV³G�bEOQMyF¦[�Å�_m@/MPOµB�G*_mMPOyJcOQ^/@�BT_¯Ac¹�_hX�OË_P@*´sOÎORBEV³G�bEOQM¯AW\ÃÅE\POybÁÜ\]OQO~÷®ÿPþ�ô# P÷®ýsF�òWF��SF)ÂP;«NMO*=��*'� �

?rÿ ORB7@*[7JcOy\HV³G*MPMPOyV³_PAcGTB7\Q;? ÝMÝ b�AW\P@*[7JcOy\HV³G*MPMhOyV³_PAcGTBE\Q;

1�2 ñ è43 � G æ % ö®÷®ÿQöcôJý��QôJý5ù5ø ôxÿ& 7�F�­ +�6 ë 2ã�AW\P´7JW@RIdb7@/_P@mGTBË_hX�O�_]G�´�AWV%ACBEb7AWVQ@/_]Oyba[TIÄ_hX�O�¶*OQI�S�G*Mvb5;ãû¬xï¡è ñ á&% ö��Pô�� «NMO�=8�� *=8 + 9^ �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % «NMO��8<� *'8 + 9^ � î »UX�O�¹�G�JWJcGRSUACB�D(¶*OQI�S¦G*Mhb7\�@/MPO,^/@*JWAWbd\hX�G.S�_]G�´7AWVQ\yØ��� ² � Ð�Ï � ² Ø ã�AW\P´7JW@RI�\Ë_hX�O ¢Æ @�B7b ÄJÆ V³G�G*Mhb7ACBE@/_]Oy\ËG*¹g@*´sOQMP_hÅ�MPOy\ l3î

å l @�BEbÌ_hX�OµVyÅEMPMPORBT_PJcITÕ�\]OyJcOyV³_]OybÊ@*´sOQMP_hÅ�MhO*; Ú�OQOÀû���÷�ýcø�`�ýc÷�F�÷®û�úeö#�gùWøPþ���F�÷®ÿcø�÷®ýÄ@�BEb¥öxøPôxýc÷�;� Ø�Ð � ?�× ² Ð ��� ã�AW\P´�JW@yI�\$_hX�OÅE\POQM]Õ�fmG�b7AcÐ�@*[7JcO�@*\]_]MhGTfmOQ_]MhAWV�´�@/Mh@�fmOQ_]OQMh\yØ5S¦@R^*O³ÕJcORB�D*_hX5FT´EMPOy\P\vÅ�MPO*F�_]ORf¯´sOQMh@/_hÅ�MPO*F/MPOyJW@/_PAc^*OUX�Å7fÃAWb7Ac_�IÃÁÜ@*JWJ7ÅE\POyb_]G'VQ@*JWVyÅ7JW@/_]O3MPOQ¹�Mh@*V³_PAcGTBsÂPçmìN» å Õ�ì�» e FH@�BEb¼´sG�JW@/MafmG*_PAcGTB5;»L<U×�Õ�ìN» e AW\1@*JW\]GÊ\hX�G.S�B�;ëÚ�OQO���û_ôc÷_��÷�ÿ�õ®ø_��FM��ýc÷Pöcö#`�ýc÷�Fø�÷xú4�c÷®ýcû�øU`�ýc÷�FU�U`cú5ù� 5ùSø_ö�FU`cøûú�`cøPþ¯@�BEb$��ô���÷�;� ÏÀÐ�? Ü Ï Ò Ó ² � D�Ac^*Oy\�_hX�O,@�Å�_]G*DTÅEAWb7OQMUVyÅ�MPMPORBT_PJcIÎ\]OyJcOyV³_]Oybµ[�IÄ_hX�O,» e ÚÝÁÜ\]OQOû�õ�ö®÷_��÷�þxø�ÂPF�_hX�ON@*\P\]G�VQAW@/_]OybË´EMPG�[sOU´sG�\PAc_PAcGTBµÁÜ\POQO2��ýPô��÷g@�B7bð_ö_��ýQô��÷7ÂPFj_hX�O3DTÅEAWb7ACB�DÌ´7A�Ï�OyJ,V³G�G*Mhb7ACBE@/_]Oy\a@�BEbÊ_hX�O3\]_P@/_]OG*¹¦_hX�O¤DTÅEAWb7ACB�DÎJcG�G�´'ÁêÅ7BEJcG�VP¶*Oyb$F!JcG�Vh¶*Oyb�G*M,\hÅE\h´�ORB7bEOyb5ØU\]OQOûU`cøQô�õ�`gù� P÷�ÂP;Ñ � Ö Ò Ô ��� Ð ² b�AW\P´7JW@yI�\9_hX�O%^�@*JCÅ�Oy\HG*¹LOyJcOQ^/@/_PAcGTBaACBEbEO³ÏËOQMPMPG*MyF7@/ÖyACf¤Å�_hXÎACB�ÕbEO³ÏÆOQMPMPG*M(@�BEbÌ@/ÖyACf¤Å�_hXÆV³G�JWJWACf¯@/_PAcGTB�Fj_]G*D*OQ_hX�OQM(SUAc_hXÆ_hX�OyAcMMvfÃ\NOQMPMPG*Mh\�@�BEbÝ_hX�Om\]¶�Ia\hAcDTf¯@ĹÈG*M�_hXEO¯JW@*\]_�þxû��&ù�cý�ûcø�÷Ä@/__hX�O,VyÅEMPMPORBT_9¹ÈG�VQ@*J5\]_P@/_PAcGTB�;¦»UX�O�V³G*MPMPOy\P´sGTBEb�ACB�Dm´7@/Mh@�fmOQ_]OQMv\¹�G*MU_hX�O,b7OQ¹�@�ÅEJc_�´�G�ACBT_PACB�DÃf¯G�bEOyJ5@/MhO,@*JW\]GÃD�Ac^*ORB�;Ñ � Ð � Ös? Ü Ï ² Ø D�Ac^*Oy\N@mb7AcMPOyV³_]G*MhIÄG*¹�ÅE\POQMHVQ@/_P@*JcG*DTÅ�Oy\Q;² Ó Ò Ð b7AW\P´7JW@RI�\�_hX�O�´�@/Mh@�fmOQ_]OQMh\G*¹�_hX�OUOyb7Ac_¦\]GTÅ�MhV³O*F�S�XEAWVYX¯S�AWJWJ�[sO\]OyJcOyV³_]Oyb1[�IÄ_hXEOTÿc÷Uð�øÄV³GTfÃfÃ@�BEb5;² ÿ¦Ñ@?�Ó ² � Ø JWAW\]_P\�_hX�O>ORB7V³G�bEOQMv\�@�BEbµ_]Mh@�BE\Pb�ÅEV³OQMh\NVyÅ�MPMPORBT_PJcId[sOyACB�DÄÅE\POyb[�IË_hX�O%» e Ú(_]GÄV³GTB�_]MhG�J$_hX�O,_]OyJcOy\hV³G�´�O*;HÚ�OQO�÷�ÿPþcô� �÷�ýsFcýcûcøc÷@�BEb�öx÷�ÿQö�ôxý>¹�G*M�ACBE¹ÈG*MvfÃ@/_PAcGTBmGTB(X�GRS _]G>VYXE@�B�D*ON_hX�OUV³GTB�Ð7D/ÕÅ�Mv@/_PAcGTB�;Ý ?�Ñ � Ö Ø�Ð � Ð Ò ?rÿ D�Ac^*Oy\�_hX�O%VyÅEMPMPORBT_�XE@/MhbESj@/MPO,@�BEba\]G*¹�_�Sj@/MPO>\]OyJcOyV³_PAcGTBµG*¹|¹ÈG/ÕVQ@*J|\]_P@/_PAcGTB�;�»UX7AW\UG�´E_PAcGTB1AW\NACB�_]ORB7bEOyb1_]GÄ@*JWJcG.Sß_hX�O¤Å7\]OQM�_]GVYX�OyVP¶Ä_hXE@/_¦_hX�ONV³GTfg[7ACB7@/_PAcGTBÃG*¹5G�´7_PAWVQ@*J5V³GTB�Ð7DTÅ�Mh@/_PAcGTB5F�» e ÕÚ'\]OyJcOyV³_PAcGTB G*¹�¹�G�VQ@*J�Õ�\]_P@/_PAcGTB5FN@�Å�_]G*DTÅ7AWbEOQMÄ@�B7b'ACBE\]_]MYÅ7fmORBT_

é k

Page 74: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

AW\¯\POyJc¹ Õ�V³GTBE\hAW\]_]ORB�_Q;¼Ú�OQO*��ý&ùWú�÷�FBþxûQöcöx÷_õ®ýcû5ùWÿsFßõU��ý5ù5��FL`P÷�ö7FùSÿPöxøcý�`cú�÷�ÿcøÃ@�BEb½û�õ�ö®÷_��÷�þxøs;Ö Ò × Ò Ð�Ø JWAW\]_P\¯_hX�O1\]G*¹�_�Sj@/MPO1´sG�\PAc_PAcGTB'JWACf¯Ac_P\(ACB¸@*Jc_PAc_hÅEbEO*FH@/ÖyACf¤Å�_hX5FMPG*_P@/_PAcGTB·ÁÜ@*JWJ$¹�G�VQ@*J$\]_P@/_PAcGTBE\³Âj@�BEbι�G�VyÅ7\Q;Ös? Ü¥Ü�Ò ÿ Ü \vX�GRSU\H_hX�O,VyÅ�MPMPORBT_U\]_P@/_hÅ7\9G*¹�b7@/_P@¯JcG*D*D�ACB�DÝÁÜ\]OQO[�Pô�õ�ÂP;× ² Ñ YY� ÿ Ò Ø�×ÙØ b�AW\P´7JW@yI�\�_hX�O¯\P_P@/_hÅE\�G*¹9@*JWJ�G*¹¦_hX�OÃf¯@*ACB�f¯OyVvXE@�BEAW\vf¯\Q;¤<�J�Õ_PAc_hÅEb7O*FH@/ÖyACfgÅE_hX¸@�BEbÌMhG*_P@/_]G*MË@/MhOµ\P@*AWb¸_]G·[sO'ð0¹ÈG�JWJcG.SUACB�D�ñb�ÅEMhACB�D,@,\PAWb7OQMPOy@*JE_]Mh@*Vh¶�;�ÞEG*M¦_hX�OHbEGTf¯O*F!ð0¹�G�JWJcGRSUACB�D�ñ¤fmOy@�B7\_hXE@/_9Ac_jAW\¦_]Mh@*VP¶�ACB�D¤_hX�ON_]OyJcOy\PV³G�´sO�@�B7b(¹�G*M¦_hX�O�¹�G�VyÅE\QF�_hXE@/_¦Ac_AW\�[�OyACBED,@*b/É]Å7\]_]Oybm_]G%V³GTfô�ORB7\P@/_]O9¹ÈG*M�_]ORf¯´sOQMh@/_hÅ�MhOjVYXE@�B�D*Oy\ÁÜ\]OQO~øcý�ûPþ�a�ÂP;�»UXEO>\]G*¹�_�Sj@/MPO¤@�BEb1X7@/MhbESj@/MPO%JWACf¯Ac_N\]_P@/_hÅE\�¹ÈG*M_hX�O¯f¯OyVvXE@�BEAW\vf AW\�\vX�GRS�B1B�O³Ï�_¯ÁÜACBEVQJCÅEb7ACB�DË_hX�O¤VQ@*[7JcOmSHMv@*´¹�G*Mj_hX�O e @*\h\]OQD*Mh@*ACB(MPG*_P@/_]G*MQÂP;»�X�ONf¯OyVvXE@�BEAW\vfÒAW\gðPfmG.^�ACB�D�ñAc¹�Ac_¯AW\¯[sOyACB�D¡bEMvAc^*ORB¸Å7BEbEOQMmV³GTfô�Å�_]OQM¯V³GTBT_]MPG�JÜFjG*_hX�OQMPSUAW\]Oð]\]_]G�´�´�Oyb�ñ�;L»UXEO�B�O³Ï�_$Ð7OyJWb,MhOy@*b7\Uð]ACB>´sG�\PAc_PAcGTBEñHAc¹E_hX�O¦fmOyVvX�Õ@�BEAW\vf AW\�OyAc_hX�OQM�_]Mh@*Vh¶�ACB�DÄG*M�\]_]G�´7´sOybµS�Ac_hXEACBµ@(bEOQÐ�B�Oyba´sG/Õ\PAc_PAcGTB1OQMhMPG*MyF�bEOy´sORBEb7ACB�D(GTBaAc_P\NMPOyÇ�Å�Oy\]_]OybÝ\]_P@/_]O*;,»�X�O%Ð�B7@*JÐ7OyJWb1\hX�G.SU\HSNX�OQ_hX�OQMU_hXEOgfmOyVYXE@�BEAW\hf�VQ@�Bµ[sO%bEMvAc^*ORBµÅ7BEb7OQMV³GTfô�Å�_]OQMÃV³GTBT_]MPG�J>ÁÜAc¹,B�G*_QFj_hX�Oa\]_P@/_hÅE\Ã\vX�GRS�B¸AW\3ðP`a@�B�ÅE@*JG.^*OQMPMhAWbEOyñÃG*M(ð n BED�ACB�OQOQMhACB�D(f¯G�b7Oyñ�;� ?�Ø Ò Ð Ò ?rÿ¦Ø ?!AW\]_P\�_hX�O>:�<HÕ�ãNOyVgG/Ñ5\]OQ_P\mÁ å î å l ÂjVyÅ�MhMPORB�_PJcIdb7OQÐ�B�Oybµ@�B7b@�BTI"G/Ñ5\]OQ_�ACBàÅE\PO*;ÀÚ�OQO�ôxõcõPö®÷®øsF>�Pô�öeùSø&ùJôJÿsFN÷�ÿ�ø�÷�ýÊ@�B7böxøPôxý�÷�;ÐED D�Ac^*Oy\j_hX�O�»9á�VQ@�fmOQMv@>VyÅ�MhMPORB�_PJcI¯\POyJcOyV³_]Oybd[TIm_hXEON» e ÚµÁÜ\]OQOø_ô�þ®û�ú�÷�ý�û�ÂPF!_hXEOÄDTÅ7AWb7ACB�DÝ´7A�Ï�OyJ¦V³G�G*Mhb7ACBE@/_]Oy\m@�BEb·_hX�OÎ\]_P@/_]OG*¹|_hX�O,DTÅ7AWb7ACB�D¯JcG�G�´3ÁêÅ7BEJcG�VP¶*OybµG*M�JcG�VP¶*Oyb5ئ\]OQO·ø_ô_õ�`5ù� P÷7ÂP;

6 ¬JèLè�GuàQá æ % »UX7AW\HV³GTfÃfÃ@�BEbËAW\UB�G*_UVyÅ�MhMPORB�_PJcIË@y^/@*AWJW@*[7JcOgGTBË_hX�O%\PI�\]_]ORf�V³GTf¯´�Å�_]OQMgÁ�¹ÈMPGTf × e ?�ÂP;

& 7�Fgê +�#º� z +|6 ë 8ã�Å7f¯´Î@mV³G�´�IËG*¹|_hX�O,ACB�¹�G*Mvf¯@/_PAcGTBÎb�AW\P´7JW@yIÎ\PV³MhOQORBË_]GÃ@mÐ�JcO%G*MU´�XTI�\PAWVQ@*J!bEOQ^�AWV³O*;ãû¬xï¡è ñ á&% öxÿ�û��Pö��QôJø «s]>9,�����=�<)>� �-LG/. ñ ¹ � á æ % ã�AcMPOyV³_]G*MPIsØ�?|Z,K ãN×�:àGTBË_hX�O,_]OyJcOy\hV³G�´�OgV³GTf¯´�ÅE_]OQMyF

n Ï�_]ORBE\hAcGTB�ØH;=?LZ%Kg;0 ñ ï ñ è�GHá:Guï æ % »UXEO%BE@�fmO�G*¹|_hX�O,Ð�JcO�G*M�´�X�I�\PAWVQ@*J$b7OQ^�AWV³O*;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % öxÿ�û��Pö��QôJø�ûcý�þ��5ù�ô�÷öxÿ�û��Pö��QôJø,�_�Spöxÿ�û���ÿ�õcþpú �,�,�S cûcø6 ¬JèLè�GuàQá æ % »UX7AW\dV³GTfÃfÃ@�BEb¼f¯@yI [sO3ÅE\]Oyb¼_]G¸MhOyV³G*Mhb"ACB�¹�G*Mvf¯@/_PAcGTB MhOyJcOQ^�@�BT_µ_]G'@�B¼G�[7\]OQMP^/@/_PAcGTB¼G*Md_]G

´EMhGR^�AWbEO,OQ^�AWbEORBEV³O,G*¹�´EMPG�[�JcORf¯\Q;`µG�\]_NÅ7\]OQMh\jSUAWJWJ5ÐsBEbdAc_HOy@*\PAcOy\P_U_]GôEMvACB�_H_hXEO,\PV³MPOQORBdb�AcMPOyV³_PJcIÅE\hACB�D¥öJÿcû���ö��Pôxø,�U��pv;¯×0B¡VQ@*\]OÃG*¹9@d´EMhG�[7JcORf SUAc_hX¡_hX�O¯_]OyJcOy\PV³G�´sO*F�´7JcOy@*\]O¯MhOyV³G*Mhb3@*JWJG*¹¦_hXEOACB�¹�G*MvfÃ@/_PAcGTBÎb7AW\P´7JW@RIÄ\hV³MPOQORBE\HGTBdb7AW\]¶�Á°GHF�±xF�ÅE\PACBED�öJÿcû_�Pö��Pôxøü÷®ýcýPôxý�ÂP;

& 7�F�� + ë F � & ;n BT_]OQMNBEOQS"\]GTÅ�MhV³O%b�@/_P@¯ACB�_]GÃ_hX�O,Oyb7Ac_U\PGTÅ�MhV³O,b7@/_P@¯@/MhOy@�;ãû¬xï¡è ñ á&% öcô#`�ýPþ®÷ «NM�8<7'(>^�� �=�<)�� � «4(�9<����* �=M^����cM9�8<� � «s;'�'^,��9|����*c9�8<� � «��,��7:9|��8 �;�-LG/. ñ ¹ � á æ % ÙN@�fmO*F7MvAcDTX�_H@*\PV³ORB7\PAcGTB�F�b7OyVQJWACBE@/_PAcGTB�F�OyÇ�ÅEACB�GRÏsØ�ÙUGTB�O*;

<NJWJ5G*_hX�OQMN\]GTÅ�MhV³O�^/@*JCÅ�Oy\QØìN\]OQMNbEOQ¹�@�Å7Jc_P\Q;

é.Ó

Page 75: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

0 ñ ï ñ è�GHá:Guï æ % «NM�8�7�(>^�� �=�<)>� �Æ»UX�OUB7@�fmOjG*¹�_hX�OUB�OQS'\]GTÅEMhV³O*;|×�_f¤ÅE\]_�[sOH@,\]_]MvACB�D�G*¹�Å7´¤_]G>Ô l VvX7@/Mh@*V³_]OQMh\QçO³Ï�_]Mh@ÄVvXE@/Mh@*V³_]OQMv\�@/MPOgJcG�\P_Q;N»)GÄACB7VQJCÅEbEO¤\P´7@*V³Oy\N_hX�O%SNX�G�JcOg\P_]MhACB�DË\hX�GTÅEJWba[�O>ORBEVQJcG�\]Oyb1SUAc_hXEACBbEGTÅ7[7JcO,Ç�ÅEG*_]Oy\Q;

«s(>9<����* �=M,^����cM9�8�� �ÊÚ�´sOyVQAcÐ7Oy\H_hX�O�MhAcDTXT_U@*\PV³ORBE\PAcGTBdG*¹|_hX�O%B�OQS�\]GTÅEMhV³O%ACBË_hX�MhOQO�Ð7OyJWb7\H\]Oy´EÕ@/Mh@/_]Oyb [TIÌ\P´�@*V³Oy\Q; ÞEG*MYf¯@/_QØ «s('� �=8�7�(>M � «s('� )f9|�7�*'�=M � «s('� M��'^�8<�';>M ��;Ì»UXEOÎMhAcDTX�_@*\PV³ORB7\PAcGTBdAW\UMPO0É�OyV³_]OybaAc¹L@�BTIËG*¹)_hXEO%V³GTf¯´sGTB�ORBT_P\9JWAcO%GTÅ�_P\hAWbEO�_hX�O,¹�G�JWJcGRSUACBEDÃMh@�B�D*Oy\yØ«s('� ��8<7'(�M � l.î Ô k ACBEVQJCÅE\PAc^*O«s('� )f9|�7*=�=M � l.î æ ò ACBEVQJCÅE\PAc^*O«s('� M��'^�8<�';>M � l ; l.î æ ò ; ò*ò ;W;W;HACB7VQJCÅE\PAc^*O

«s;'�=^���9|����*>9�8<� ��Ú�´sOyVQAcÐ7Oy\m_hX�O1bEOyVQJWACBE@/_PAcGTB G*¹�_hX�O1BEOQS \]GTÅ�MvV³OµACBÌ_hX�MhOQOµÐ7OyJWb7\Ã\]Oy´7@/Mh@/_]Oyb[�I \h´7@*V³Oy\Q; »UX�O «s;'�=^ ;'���(���=M � Ð7OyJWb"fÃ@yI [sO¡\PAcDTBEOyb5; ×�¹¤B�G*_d\PAcDTB�Oyb5F�_hX�O¡b7OQ¹�@�ÅEJc_dAW\x KgíW;ÝÞEG*MvfÃ@/_QØ «s;'�'^ ;����(���'M � «4;��=^ )f9|�7�*'�=M � «s;'�'^ M��=^�8��';�M ��;µ»UXEO(bEOyVQJWACBE@/_PAcGTBÆAW\MPO0É0OyV³_]OybµAc¹|_hX�O,@�BTIËG*¹)_hXEO%V³GTf¯´sGTB�ORBT_P\HJWAcO,GTÅ�_P\hAWbEO�_hX�O,¹�G�JWJcGRSUACBEDÃMh@�B�D*Oy\yØ«s;'�'^ ;����,('��'M � l.î I*ò ACBEVQJCÅE\PAc^*O«s;'�'^ ):9O�,7�*=�'M � l.î æ ò ACBEVQJCÅE\PAc^*O«s;'�'^ M��=^�8��';�M � l ; l.î æ ò ; ò*ò ;W;W;HACB7VQJCÅE\PAc^*O

«��,��7c9O�=8 �p�¼ÚE´�OyVQAcÐ�Oy\9_hX�O�OyÇ�ÅEACB�GyÏÎG*¹|_hX�O%\PGTÅ�MhV³O,V³G�G*Mhb7ACBE@/_]Oy\Q;¦< ^�@*JWAWbÎOyÇ�ÅEACB�GRϵfgÅ7\]_UXE@y^*O_�S�GÎV³GTf¯´sGTB�ORBT_P\QØH@ÄJcOy@*b7ACB�DÎJcOQ_]_]OQM,ACBEb7AWVQ@/_PACBED(_hX�O¤\]I�\]_]ORf G*¹�_hX�O¤V³G�G*Mvb7ACBE@/_]Oy\Qç$@�BEb1@ËB�Å7fmÕ[sOQMËACBEb7AWVQ@/_PACB�D·_hX�O1Oy´�G�VvX'G*¹,_hX�O�fmOy@�B¸OyÇ�Å7@/_]G*Md@�BEb'OyÇ�ÅEACB�GRÏ'G*¹,_hXE@/_Ë\]I�\]_]ORfÎ;àÞEG*Mvf¯@/_QØ«Y����*,*=��( T�� ���( ��F,GHF�±xF ûúOH � IEF�~ � II,IaG*M=û��_�®ûcýc÷�ÿcøÌÁ�¹�G*MmS�XEAWVYXÆB�GÝB�Å7fg[sOQMgAW\gMPOyÇ�ÅEAcMPOyb5ÂP;Ù�G*_]O�_hXE@/_�GTB7JcIr�F�~,G*M_û¯@/MPO�@*VQV³Oy´E_P@*[�JcO,@*\¦JcOy@*b�ACB�DgJcOQ_]_]OQMv\Q;»UX�O�I*Oy@/MHfgÅ7\]_JWAcO�ACB¯_hXEO�Mh@�BED*OåHI l*l ; l _]G(Ô å l*l ; l ;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;

1�2 ñ è43 � G æ % öcô#`�ýPþ®÷ �U ûú ���,�'�,� ú ��������� �� H ú_ú �,�P��Sv�� �úbH,II6 ¬JèLè�GuàQá æ % öcô#`�ýPþ®÷ºV³G�´7AcOy\Ã_hXEOaÅE\]OQMÄbEOQ¹�@�Å7Jc_¯^�@*JCÅEOy\¯¹�G*M(@*JWJU\PGTÅ�MhV³Od^/@*JCÅ�Oy\ÃACBT_]G3_hXEOdOyb7Ac_(\PGTÅ�MhV³OdORBT_]MPI

@�BEbÝ_hXEORB1_P@/¶*Oy\,_hX�O¯V³GTf(f¯@�BEb1JWACB�OmG*M,´EMPGTfôE_]OybÝACBE´�Å�_N¹�G*M%\]GTÅ�MhV³O¯BE@�f¯O*F5MhAcDTXT_,@*\PV³ORBE\PAcGTB�FbEOyVQJWACB7@/_PAcGTBµ@�BEbdOyÇ�ÅEACBEGyÏ�;

& 7�F�F + 8 ë*zÚ�_]G�´Î_hXEO>BE@�fmOybdf¯OyVvXE@�B7AW\hf [TIËMh@�fô7ACB�Dg_hX�O,^*OyJcG�VQAc_�Id_]GÃÖQOQMPGE;ãû¬xï¡è ñ á&% öxøPô�� «�)>�'^O���<�:9,M|) �-LG/. ñ ¹ � á æ % öxøPô���û��U�0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % á�@*JWAWb"f¯OyVvXE@�BEAW\vf BE@�f¯Oy\(@/MhO*Ø � Ö Ö�F � ÖgÐ Ò Ð�Ï½Ó ² F �ÀkBÒ ×�ÏÀÐ Y F_Ó�?�× ² F Ý ?�ÑzÏYØ|F� ?¤Ð � Ð�? � FÐ ² Ö ² ØAÑ�? � ² Ó�?¤× ² ;1�2 ñ è43 � G æ % öxøPô���ø�÷U�öxøPô��6 ¬JèLè�GuàQá æ % »UXEOLöxøPô��Âû_�_�ÄG*MTöxøPô��ËV³GTfÃfÃ@�BEb7\H\]_]G�´1@*JWJ|fmOyVvX7@�BEAW\hf¯\y;j»�X�O~öxøPô���øc÷_�ËV³GTfÃfÃ@�BEbd\]_]G�´7\

_hX�O>@*Jc_PAc_hÅEbEO*F�@/ÖyACf¤Å�_hX�F�MPG*_P@/_]G*M�@�BEbµbEGTfmO*;

& 7�FL\ + 8 ë*��;Ú�_]G*MPO>@*´�OQMh_hÅ�MPO�@�BEbd´sG�\PAc_PAcGTBE@*J$G/Ñ�\]OQ_P\y;ãû¬xï¡è ñ á&% öxøPôxý�÷ «�8�]]>M���* * ��+ � � «�8�],]>M���* �7,)K���( �-LG/. ñ ¹ � á æ % Ù�GTB�O*;

é/æ

Page 76: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

0 ñ ï ñ è�GHá:Guï æ % «�8�]]�M���* �,7,)�K=��( �3AW\)_hXEOj@*´sOQMP_hÅEMPO¦B�Å7fg[sOQM!Ac¹7_hX�O ��� ² � ÐzÏ � ² ¶*OQI�S�G*MvbmAW\L\h´�OyVQAcÐ�OybÄÁÜ\]OQO[sOyJcGRS,ÂP;>×�_,fgÅ7\]_N[sO¤@�B�ACBT_]OQD*OQM%ACB1_hX�O¤Mh@�B�D*O l.î å l ;~û_�c÷�ý�øU`cý�÷LIÎAW\�_hX�O¤MPOQ¹�OQMPORBEV³O¯´sG�\PAc_PAcGTB@�BEbµAW\UB�G*_HMPOy\POQ_HGTBÎ\]GTÅ�MvV³O%VvXE@�BED*O(ÁÜ\]OQO¤Ú�OyV³_PAcGTB k ;�éTÂP;«�8�]]�M���* �,7,)�K=��( �¼AW\U_hX�O%´sG�\PAc_PAcGTBaB�Å7fg[sOQMHAc¹|_hX�O � ?�Ø Ò Ð Ò ?rÿ ¶*OQI�S¦G*MhbaAW\�\P´sOyVQAcÐ7Oyb3ÁÜ\]OQO[sOyJcGRS,ÂP;�×�_�f¤ÅE\]_H[sO%@�BÎACBT_]OQD*OQM�ACBË_hX�O>Mh@�B�D*O å î å l ÁÜ´sG�\PAc_PAcGTB l V³G*MhMPOy\P´sGTBEb7\9_]GÄ@mÖQOQMPG(G/Ñ�\]OQ_@�BEbµVQ@�B7B�G*_U[sO�GR^*OQMhSHMhAc_]_]ORBsÂP;ä=G ç ­�¬Jï�í æ % á�@*JWAWbaG/Ñ�\POQ_H_�I�´sOy\H@/MPO*Ø� ?�Ø Ò Ð Ò ?rÿ \]OQ_P\�ÅE´%@N´sG�\PAc_PAcGTBE@*J�G/Ñ5\]OQ_)SNXEAWVvXgVQ@�B>[�O¦@*b7bEOyb>_]G�_hX�O_]OyJcO³Õ

\PV³G�´sO,MhOQ¹ÈOQMPORB7V³O%´sG�\PAc_PAcGTBdÅE\PACBEDm_hX�O[�Pô�öeùWø5ùJôJÿÃV³GTf(f¯@�BEb$;��� ² � ÐzÏ � ² \]OQ_P\,ÅE´1@Ë[sOy@�f¯\]SUAc_PVYXµ´sG�\PAc_PAcGTB1SNXEAWVvX1VQ@�B1[sOg@*´7´�JWAcOyba_]G_hX�O%_]OyJcOy\PV³G�´sOgÅE\PACBEDm_hX�OTû_�c÷�ý�øU`cý�÷¯V³GTf(f¯@�BEb5;

1�2 ñ è43 � G æ % öxøPôxý�÷�û_�c÷®ýcøU`cý�÷ �6 ¬JèLè�GuàQá æ % »UXEOUV³GTfÃfÃ@�BEbmf¯@yIm[sOUÅE\]Oyb¯_]G>\]_]G*MPO�´�G�\hAc_PAcGTBE@*J7G*M¦@*´�OQMh_hÅ�MPO9G/Ñ5\]OQ_P\SNXEAWVvX(XE@y^*ON[�OQORBm¹ÈGTÅ7B7b

ÅE\hACB�D%_hX�ON<�²jZ�Þ|Þ�G*MHZ�Þ|Þ�Ú n » X7@�BEb7\]OQ_jfmG�bEOy\�G*MjACBE´�Å�_�Å7\PACB�D,_hX�O2�÷®û�úQö��gùWøPþ��>G*M,ôxõcõPö®÷®øV³GTf(f¯@�BEb7\y;%»UX�OQI�f¯@RIµ_hX�ORBÝ[sO¤MPOyVQ@*JWJcOyb¡¹�G*M,¹êÅ�_hÅ�MPOmÅE\]OmS�Ac_hX1_hX�O=û_�c÷�ý�øU`cý�÷ÎG*MC�Pô�öeùSø&ùJôJÿV³GTf(f¯@�BEb7\y;¾¼X�ORB¥öxøPôxý�÷ÄAW\UO³Ï�OyVyÅE_]Oyb5F�_hXEO>@*´sOQMP_hÅ�MPO%G*MUG/Ñ5\]OQ_N\P_]G*MPOyba[sOyV³GTf¯Oy\9_hX�O>VyÅEMPMPORBT_GTB�O>@�BEbÎ_hX�O�×]B�¹�G*Mvf¯@/_PAcGTBËã�AW\P´7JW@RIdAW\UÅE´�b7@/_]Oyb5;

& 7�F�d 8 ; � z¤;�� � 8JF ��;n BT_]OQMU_hXEO�^�@*JCÅ�O%G*¹)_hX�O%GTÅ�_P\PAWbEO%@*AcMU_]ORf¯´sOQMh@/_hÅ�MPO,ÅE\POybdACBË_hX�O%VQ@*JWVyÅ7JW@/_PAcGTBdG*¹|MPOQ¹�Mh@*V³_PAcGTB�;ãû¬xï¡è ñ á&% ø�÷xú4�c÷®ýcû�øU`�ýc÷ «w*=�b) + ��('��*,7�('� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;< _]ORf¯´sOQMh@/_hÅEMPO�G*¹�æ � e AW\H@*\P\hÅ7f¯OybËGTBÎ\]_P@/MP_hÅ7´5;0 ñ ï ñ è�GHá:Guï æ % »UXEO�GTÅ�_P\PAWbEO%@*AcMU_]ORf¯´sOQMh@/_hÅ�MPO�ACBµbEOQD*MPOQOy\ e ORBT_PAcD*Mh@*bEO*;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % ø�÷xú4�c÷®ýcû�øU`�ýc÷ ��R�6 ¬JèLè�GuàQá æ % <�BËOQMPMPG*MUG*¹ å l � e D�Ac^*Oy\�@m´sG�ACBT_PACB�D¯OQMPMPG*MUG*¹ å ;�ém@/MhVQ\]OyV³GTBEb7\�@/_U@�BËOyJcOQ^/@/_PAcGTBdG*¹|ÓTæ � ;& 7�F�u 8 � �Ý&J!»|Å�MvBÄ_hX�O,¹�G�VyÅE\QF7bEGTf¯O*F�MhG*_P@/_]G*M�G*MH_]OyJcOy\hV³G�´�O>_]Mh@*VP¶�ACB�D(GTBËG*MUG/Ñ|;ãû¬xï¡è ñ á&% øcý�ûPþ�a «w*('�=^O� M � MO*=�b) � «s*('�'^b� Mb*=��*=� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % »UXEO «w*('�=^O� M � MO*=�<) � ¶*OQI�S�G*Mhbà\]OyJcOyV³_P\d_hXEOºfmOyVYXE@�BEAW\hf4S�X7AWVvX¼AW\Î_]G XE@y^*O·Ac_P\d_]Mh@*Vh¶�ACB�D

\]_P@/_]OgVvXE@�BED*Oyb5;»UX�O�@*JWJcG.S�OybÝfmOyVYXE@�BEAW\hfÃ\¦@/MhO*ØCÓ�?¤× ² F Ý ?�ÑzÏYØLF � ?¤Ð � Ð@? � FeÐ ² Ö ² òØ�Ñ@? � ² ;7»UX�O «w*�('�'^b� Mb*'��*=� � ¶*OQI�S�G*Mhba\]OQ_P\H_hXEO�_]Mh@*VP¶�ACB�DÃOyAc_hXEOQMa?rÿ G*MN? ÝMÝ ;1�2 ñ è43 � G æ % øcý�ûPþ�aüõPô�þ�`eö�ôJõcõ6 ¬JèLè�GuàQá æ % »UXEO�O³Ñ�OyV³_�G*¹�_hXEO øcýcû�þ�a�ýPôxø�ûcøQôJý*ôxÿ%V³GTfÃfÃ@�BEb>AW\|_]G�VQ@�ÅE\PO¦_hXEOjACB7\]_]MvÅ7f¯ORB�_LMPG*_P@/_]G*M�_]G�\]_P@/MP_

_]Mh@*Vh¶�ACBEDË@/_�Ac_P\NVyÅ�MPMPORBT_�\]¶�Id´sG�\PAc_PAcGTBa@�B�D�JcO*;U×�_�AW\�_hX�OQMPOQ¹�G*MPOmÅE\]OQ¹êÅEJ$Ac¹�_hX�OQMPO¤AW\�B�G(V³GTBE\P_]Mh@*ACB�_GTBË_hXEO,bEOQ_]OyV³_]G*M�´sG�\PAc_PAcGTBÎ@�BED�JcO*F�@*\HAc_HVQ@�ÅE\]Oy\U_hX�O�MPG*_P@/_]G*MU_]G(\PJcOQS�[�I(_hX�O%fÃACBEACf¤Å7fï@�f¯GTÅ7BT_Á�_hXEAW\�AW\9OyÇ�ÅEAc^�@*JcORBT_U_]GÃ_hX�O·ýQôJøcû�øQôxýÂõ��PôJûcøÃV³GTfÃfÃ@�BEb�ÂP;

& 7 \px 8 � ��#Ì+ yV;o�e GTBT_]MPG�J5_hX�O%G�´�OQMv@/_PAcGTBE@*J$\]_P@/_]O>G*¹)MPORf¯G*_]O,_]OQMvfÃACBE@*JW\Q;ãû¬xï¡è ñ á&% øcý�ûcÿQöJõ�÷®ý «s('�<)�8�*'� MO*=��*=� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % »UXEO «s(��<)>8�*=� Mb*'��*'� �ʶ*OQI�S�G*Mhb1f¯@RI(_P@/¶*O>_hX�O�¹ÈG�JWJcG.SUACB�D(^�@*JCÅ�Oy\yØ

é/è

Page 77: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Ñ@?¤×|× � ÿ�Ó »UXEAW\�¶*OQI�S¦G*MhbÎ@*JWJcG.SU\9V³GTfÃfÃ@�BEb¯ACBE´�ÅE_¹�MPGTfÒ@gMPORf¯G*_]OU_]OQM]ÕfÃACBE@*JÜ;à»UX7AW\ÃS¦GTÅEJWb¼ÅE\hÅE@*JWJcI¸[sO1ACB'_hXEO�K�¿N:H×0? MPG�GTf G*MGTB _hX�OaORB�D�ACB�OQOQMhACB�DÆbEOy\]¶sFH[�Å�_ÄV³GTÅEJWb [�O1V³GTB�Ð7DTÅ�MhOyb'OyJW\]O³ÕS�XEOQMPO%Ac¹|MPOyÇ�ÅEAcMPOybaÅ7\PACB�Dm_hX�Og\]SUAc_PVvX�Õ�[�GRϵJcG�VQ@/_]OybaGTBÎ_]G�´aG*¹_hX�Om_]OyJcOy\hV³G�´�O(V³GTf¯´�Å�_]OQMR;%×�_,@*JW\]GdV³G�´7AcOy\,_hXEO¤V³GTBT_]MPG�J�Õ�MPG�GTfÅE\POQM]Õ�ACB�_]OQMh¹�@*V³OÄb7AW\P´7JW@RIa_]Gd_hXEO¯MPORfmG*_]Om_]OQMYf¯ACBE@*J�Ac¹¦_hXEAW\%XE@*\B�G*_¦@*JcMPOy@*bEI¯[sOQORB¯b7GTB�OHSUAc_hX¯_hX�ONøcý�ûcÿQöJõ�÷®ý gù�ö��_�®û_ö>V³GTfmÕfÃ@�BEb5;Ó Ò Ø � Ö ��� »UXEAW\L¶*OQI�S�G*Mvb¤ORBE@*[7JcOy\L_hX�OjMPORfmG*_]O¦_]OQMvfÃACBE@*J�\PGN_hX7@/_|@�V³G�´�IG*¹¦_hX�OmV³GTB�_]MhG�J|MPG�GTf b�AW\P´7JW@yIÝ@*´7´sOy@/Mh\NGTBÝAc_Q;%×�_�@*JW\]Gdb7AW\P@*J�ÕJcG.SU\>V³GTf(f¯@�BEbÝACBE´�Å�_�@�BEb�MPOQ_hÅ�MYBE\�V³GTB�_]MhG�J�_]Gd_hX�O(bEOQ¹�@�Å7Jc__]OQMvfÃACBE@*J5ACBË_hX�O>V³GTB�_]MPG�J!MPG�GTfÎ;

? ÝMÝ »UXEAW\�¶*OQI�S�G*Mhb�b�AW\P@*[7JcOy\N_hX�O¤MPORfmG*_]Og_]OQMvfÃACBE@*J!ORBT_PAcMPOyJcI*F$MhO³Õ_hÅ�MYBE\�V³GTf(f¯@�BEbaACBE´�Å�_N_]GË_hX�O¤V³GTB�_]MPG�J|MhG�GTf _]OQMvfÃACBE@*J)@�B7bVQJcOy@/Mh\�_hX�O�MPORf¯G*_]O%b7AW\P´�JW@yI*;

1�2 ñ è43 � G æ % øcý�ûcÿQöJõ�÷®ý þ�ô�úcú�û�ÿU & 7 \89 8 \ &Ä��� ;o� �×0bEORB�_PAc¹�IÄ_hX�O%»9áâVQ@�fmOQMh@mVyÅEMPMPORBT_PJcIËACBµÅE\]O�¹�G*MU@�Å�_]G*DTÅEAWb7ACBED(ÅE\PACB�Dm_hXEOgK�ì�×�ã n G*MH×�Õ�K�ìU×0ã n G�´E_PAcGTB7\Q;ãû¬xï¡è ñ á&% ø_ô�þ®û�ú�÷�ý�û «N^��<)���(�� �=�<)�� � � «N^��b)>��(�� )�8�;�� �s -LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % »UXEO «N^��b)>��(�� �=�<)�� �¸¶*OQI�S¦G*MhbË\P´sOyVQAcÐ7Oy\_hXEON»9á"VQ@�f¯OQMh@gVyÅ�MPMPORBT_PJcI¯ACB(Å7\]O�¹�G*Mj@�Å�_]G*DTÅEAWb7ACB�DE;

»UXEO�G�´E_PAcGTBE\U@R^�@*AWJW@*[�JcO>@/MPO*ØØ5Ö Ò Ð e @*\P\]OQD*Mh@*ACBµVQ@�fmOQMh@¤^�AcOQSUACB�D¯_hXEO�×]Ú�×PÚÄ\PJWAc_QçÝMÒ ² Ö Ó e @*\P\]OQD*Mh@*ACBµVQ@�fmOQMh@¤SUAc_hXÎ_hX�O,Ð7OyJWb�Õ�^�AcOQSUACB�DÃfÃAcMPMPG*Myç?rÿ �JA�Ò Ø b�AcMPOyV³_UVQ@�fmOQMv@dÁ�_]Oy\]_Nf¯G�bEO�GTBEJcI�ÂPç? ÝMÝ �GA�Ò Ø G/ÑsÕ�@�ÏEAW\UVQ@�fmOQMv@µÁ�_]Oy\]_�f¯G�bEO�GTBEJcI�ÂP;

»UXEO «N^��b)>��('� )>8�;'� �̶*OQI�S¦G*MhbÄ\P´sOyVQAcÐ7Oy\�_hXEOHÐ7OyJWb¯G*¹�^�AcOQS G*¹�_hX�O�VQ@�fmOQMh@�ç�OyAc_hX�OQM_Ó Òu� ² Ñ~ÐG*M � ² Ó½ÏYÑ ² ;�»�X�O «N^��<)>��('� )>8�;'� � ¶*OQI�S�G*Mvb�AW\�GTBEJcIµMPOyÇ�ÅEAcMPOybÝAc¹�_hX�O�Ø5Ö Ò Ð G*M ÝMÒ ² Ö ÓVQ@�f¯OQMh@*\H@/MPO%\POyJcOyV³_]Oyb5;

1�2 ñ è43 � G æ % ø_ô�þ®û�ú�÷�ý�û*ö��ùSø�ýc÷� _`Pþ�÷ø_ô�þ®û�ú�÷�ý�û*ôxÿ û_ð&ùJö6 ¬JèLè�GuàQá æ % »UX7AW\�V³GTf(f¯@�BEb¯AW\jÅE\]Oyb(_]Gg_]OyJWJ�_hXEO�» e Úm_]G¤Å7\]ON\hVQ@*JcON@�BEb(G*MhAcORBT_P@/_PAcGTBË´7@/Mh@�f¯OQ_]OQMh\¹�G*Mj@>´7@/MPÕ

_PAWVyÅEJW@/M>»9áÛVQ@�f¯OQMh@�;>»UXEOy\]Om@/MPO¯B�OQOybEOybÝS�X�ORBÝÅE\hACB�DË_hX�OLøUô�õ�`gù� �÷ÎV³GTf(f¯@�BEba_]Gd@�Å�_]G*DTÅEAWbEOG*MgS�X�ORB�JcG*D*D�ACBEDa_]Oy\]_¤b7@/_P@�;λUX�O�Ó Òu� ² Ñ~Ð ¶*OQI�S�G*MhbºMPOy´EMhOy\]ORB�_P\>@µ»9á \PVQ@*JcOÄG*¹9@*´7´EMPGRÏ�A�ÕfÃ@/_]OyJcIµæÃfÃf { @/MhVQ\]OyV/;H»UXEO � ² Ó½ÏYÑ ² ¶*OQI�S¦G*MhbaMPOy´EMPOy\]ORBT_P\N@û9áß\PVQ@*JcO¤G*¹�@*´7´EMhGyÏEACf¯@/_]OyJcIå Ô¯f(f { @/MhVQ\POyV/;

& 7 \g6 8 \ZÍ F �.� ;»|Å�MvBË»9á DTÅEAWb7ACB�DmG/Ñ|F7G*M�_hÅ�MvBËAc_HGTBËS�Ac_hXÎ@�BÎG�´E_PAcGTB7@*J�Ï�IË´sG�\PAc_PAcGTB�;ãû¬xï¡è ñ á&% ø_ô_õ�`gù� P÷ «NMO*=��*'� � ���P� -LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % »UXEO�G�´E_PAcGTBE@*J!´�@/Mh@�fmOQ_]OQMh\¦Ïd@�BEbdIÄ@/MPO%_hX�O,bEOy\PAcMPOybµ´7A�Ï�OyJ!V³G�G*Mhb�ACBE@/_]Oy\H¹�G*MH_hX�O,DTÅ7AWbEO,\]_P@/My;�×�¹

_hX�OQIÄ@/MPO%B�G*_9\P´sOyVQAcÐ7Oyb5F�_hX�ORBÄ_hX�O�\]I�\]_]ORf SUAWJWJ�@*bEG�´7_9_hX�O�VyÅ�MPMPORBT_¦´sG�\PAc_PAcGTBÄG*¹)_hX�O�DTÅEAWbEO�\]_P@/My;ä=G ç ­�¬Jï�í æ % á�@*JWAWb1\]_P@/_]Oy\U@/MhO*Ø

é*é

Page 78: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

?�ÿ \P´sOyVQAc¹�I�ACBED·_hX7@/_Î_hX�O�_]OyJcOy\PV³G�´sO¡\hX�GTÅEJWb¼[sOÝDTÅEAWbEOyb¼ACB MhO³Õ\P´sGTBE\PO�_]GÃDTÅEAWb7ACBED¯OQMPMPG*Mh\H¹ÈMPGTf�_hX�O%»9áß\]I�\]_]ORfÍACBµK�ì�×�ã nG*M�×�Õ�K�ì�×0ã n fmG�bEO*;

? ÝMÝ \P´sOyVQAc¹�I�ACBEDÄ_hX7@/_,»9áÒDTÅEAWb�ACB�DÎ\hX�GTÅEJWbÝ[sOm\]SUAc_PVvXEOyb�G/ÑLF E�F�GHF_hXE@/_m@�BTI¡DTÅEAWb7ACBEDaOQMPMhG*Mh\%¹�MPGTfë_hX�OË»9áÍ\]I�\]_]ORfÀ\hX�GTÅEJWb·[sOAcDTB�G*MhOyb5;

1�2 ñ è43 � G æ % ø_ô_õ�`gù� P÷ ôJÿø_ô_õ�`gù� P÷ ôJÿ·ú �,��R�P���S �6 ¬JèLè�GuàQá æ % ¾¼X�ORBµ_hX�O>»9áï\PI�\]_]ORfdí=\NK�ì�×0ã n G*MN×�Õ�K�ìU×0ã n ¹ÜÅ�BEV³_PAcGTBd@/MPO¤\]OyJcOyV³_]Oyb5FsÏ�Id´7A�Ï�OyJ!V³G�G*Mhb7ACBE@/_]Oy\

G*¹9@ÎDTÅEAWb7OÃ\]_P@/M>@/MhOÃ\]ORBT_%_]Gd_hX�OÃ_]OyJcOy\PV³G�´sO(V³GTBT_]MPG�J�V³GTfô�Å�_]OQMy;¯»�X�Oû e Úa_hXEORB¡@*b/ÉPÅE\]_P\�_hXEO_]OyJcOy\PV³G�´sOgbEMhAc^*Oy\H_]G(¶*OQOy´d_hX�O>\]_P@/M�@/_N@mD�Ac^*ORBµJcG�VQ@/_PAcGTBµGTBÎ_hX�O%»Há VQ@�f¯OQMh@�;×�¹)_hXEO%ACB�_]ORBT_PAcGTBAW\U_]GÄf¯@*ACBT_P@*ACBÎ_hXEO%VyÅ�MPMPORBT_U´sG�\PAc_PAcGTBEACBED¯G*¹�@mÐ7OyJWbºÁ°GWF ±®F¡Ac¹�@*VQÇ�ÅEAW\PAc_PAcGTBµGTB�_]GÄ@¯\P´sOyV³_]MPG*D*Mh@*´�X\PJWAc_gXE@*\�[sOQORB1^*OQMhAcÐ7Oyb�ÂPF)_hX�ORB1_hX�O¯V³GTfÃfÃ@�BEbYøUô�õ�`5ù� �÷üôxÿ1\hXEGTÅEJWbÝ[�O¯ÅE\POyb5;m»UXEAW\�_P@/¶*Oy\,_hXEOÐ7Mv\]_N´sG�\PAc_PAcGTB1MhOyV³OyAc^*OybݹÈMPGTf _hXEOg»9á \]I�\]_]ORf @/¹È_]OQM�_hX�OmV³GTf(f¯@�BEbaAW\�AW\P\hÅ�Oyb5F5@�BEb1¶*OQOy´7\�_hXEODTÅEAWb7O�\P_P@/MH_hX�OQMPO*;�Z�BÄ_hXEONG*_hXEOQM�XE@�BEb5F�Ac¹L_hX�O�»9áàV³G�G*Mhb7ACBE@/_]Oy\U@/MPO,@*JcMPOy@*bEIĶ�BEGRS�B�F�_hX�ORBÄ_hXEO@*´7´7MPG�´EMhAW@/_]O¦V³GTfÃf¯@�B7b�AW\�ø_ô_õ�`gù� P÷ ôJÿP�P�s;L»�XEAW\!AW\)JWAc¶*OyJcI%_]G�[sO�Å7\]OQ¹ÜÅ7J*S�X�ORB%@�B�G�[7\]OQMh^�@/_PAcGTBAW\�_]G,[sOjMPOy´sOy@/_]Oyb¯@�BEb¤_hXEO9Ð7OyJWbmAW\�_]G,[sO9´�G�\hAc_PAcGTB�Oyb¯@/_�_hX�OH\P@�f¯O9´7JW@*V³OHGTB¤_hX�O9bEOQ_]OyV³_]G*MR;ÙUG*_]O_hXE@/_QF�¹ÈG*M9_]OyVYX7BEAWVQ@*J$MhOy@*\]GTBE\HV³GTB7BEOyV³_]OybÎSUAc_hXÎÅE\]O�G*¹L_hX�O,V³GTf(f¯@�BEb(¹ÈMhGTf × e ?F�_hX�O,V³GTfÃfÃ@�BEbø_ô_õ�`gù� P÷ ôJÿUT;úVTRúgf¯Oy@�BE\j_hX�O>\h@�fmO,@*\Mø_ô�õ�`gù� P÷ ôJÿs;7»UX�O>» e ÚËf¤ÅE\]_H[sO�_]G�JWba_hX�O%VQ@�fmOQMv@ACB(ÅE\]OgÁÜ\POQONø_ô�þ®û®úP÷�ý�û�ÂPF*G*_hX�OQMPSUAW\POU_hX�O�_]OyJcOy\PV³G�´sONV³G*MPMhOyV³_PAcGTBE\S�AWJWJ�[sOUACBm_hXEOUSHMPGTBED%b7AcMPOyV³_PAcGTB�;

& 7 \g­ 8 2 ; ��!<N´7´7JcIË@¤D�Ac^*ORBºÁ ¢&Æ : ÄJÆ :ðO Æ Â@*´sOQMP_hÅEMPO�G/Ñ�\POQ_H_]GÃ@*JWAcDTBa@¤Ð7OyJWbÎGTBd@�BdACBE\]_]MvÅ7f¯ORB�_Q;ãû¬xï¡è ñ á&% øU��÷�û_a « � 8�],]>M���* � « � 8�],]>M���* � «s('8�*=��*>9�8<� �-LG/. ñ ¹ � á æ % «s('8�*'��*>9�8�� �ÊbEOQ¹Ü@�ÅEJc_P\9_]G l ;0 ñ ï ñ è�GHá:Guï æ % « � 8�],]>M���* � « � 8�]]�M���* �¼@/MPO>b7AW\P´7JW@*V³ORf¯ORB�_P\HACB ¢Æ @�B7b ÄJÆ F7ACBÎ@/MvVQ\]OyV/;«s('8�*'��*>9�8�� �ÊAW\9_hX�O%MPG*_P@/_PAcGTBÎG*¹|_hX�O,Ð�OyJWbÎACBdbEOQD*MPOQOy\y;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % øU��÷�û_aUI R� T,I � I ú6 ¬JèLè�GuàQá æ % »UX7AW\gV³GTf(f¯@�BEb·AW\mÅE\]Oyb·_]G¡´sG�\PAc_PAcGTBÆ@1Ð7OyJWbÆ´EMPOyVQAW\]OyJcIºGTBÆ@�BÆACBE\]_]MvÅ�fmORBT_Q;1×�_mVQ@�BÆ[sOËÅE\POyb

S�XEOQ_hX�OQM%G*MmB�G*_,_hX�O(_]OyJcOy\PV³G�´sOÄAW\g[sOyACB�Dµ@�Å�_]G*DTÅ7AWbEOyb5;Î×�_P\>f¯@*ACB3@*´7´7JWAWVQ@/_PAcGTB·AW\,S�Ac_hX¡?!ã,Ú7Ú�FS�XEOQMPO�_hXEONG�[EÉ�OyV³_PAc^*O,AW\j_]GmV³ORBT_]MPO,@¤JW@/MPD*O,B�Å7fg[sOQMG*¹)_P@/MPD*OQ_9G�[�É0OyV³_P\jGTBÄ_hX�O�\PJWAc_Hf¯@*\]¶sFE[�Å�_�Ac_fÃ@yI>@*JW\PG�[sO9ÅE\]OQ¹êÅEJ�¹ÈG*M�JcGTB�D/Õ�\hJWAc_\P´sOyV³_]MPG�\PV³G�´�I*F�Oy\P´sOyVQAW@*JWJcIgS�X�ORB>_�S¦G�G�[�É0OyV³_P\�@/MPOj_]G�[�Oj´7JW@*V³OybGTBÃ_hX�O�\hJWAc_�\PACf¤ÅEJc_P@�B�OQGTÅ7\PJcI*;�×�_¦AW\¦BEG*_�@*bE^�AW\P@*[7JcO�_]G¤ÅE\POUb7AW\P´7JW@*V³ORf¯ORB�_P\�G*¹!fmG*MhOH_hXE@�B å @/MhVQ\]OyVG*M�MPG*_P@/_PAcGTB7\|G*¹sfmG*MhO�_hXE@�B l�� åH� S�X�ORB>@�Å�_]G*DTÅEAWb�ACB�DEFT\PACBEV³Oj_hX�O¦DTÅEAWbEO9\]_P@/MfÃ@yI%[sO¦JcG�\]_Q;�?!@/MPD*OQMG/Ñ5\]OQ_P\jVQ@�BÄ[�O�\P´7JWAc_�ACBT_]G¤\hÅEVQV³Oy\P\PAc^*O�\hfÃ@*JWJcOQMGTB�Oy\yF�G*Mj@�Å�_]G*DTÅEAWb�ACB�DgfÃ@yI¯[sO�\hÅ7\P´sORBEbEOyb¤S�XEAWJW\P__hX�O eUe ã SUACBEbEG.S�AW\UfmG.^*Oyb5;�ÞEG*MN?!ã,Ú7ÚsFE_hX�O,\hAcDTBÎV³GTB�^*ORBT_PAcGTB1V³G*MPMPOy\P´sGTBEb�\�_]GÃ_hXE@/_�ÅE\]OybÎ[�I_hX�OÄ? n JN»Û\]G*¹È_�S¦@/MhOÄ´7@*Vh¶�@/D*O�Á�_hX�OYùWÿQöJøcýU`�úP÷®ÿcø��� eö�öµV³GTfÃfÃ@�BEb3f¤ÅE\]_,[sO(Å7\]Oyb�_]GÝACB�¹ÈG*MYf_hX�O¯» e Ú�ÂP;5ÞEG*M,G*_hX�OQM>ACBE\]_]MvÅ7f¯ORB�_P\yF5_hX�Om» e Úa¹�G�VQ@*J�´7JW@�BEOµÁÜ@*´�OQMh_hÅ�MPO/ÂUV³G�G*Mhb7ACBE@/_]O¯\]I�\]_]ORf AW\ÅE\POyb5FESUAc_hXδsG�\PAc_PAcGTBµ@�B�D�JcO>fmOy@*\vÅ�MPOybÎ@�BT_PAWVQJcG�Vh¶�SUAW\PO*;

& 7 \&ê F ; +Ú�OyJcOyV³_�_hX�O,ì n Ú�ÁÜÙN@*\hf>I�_hXÎb7MhAc^*O³Õ�\PAWbEO/¹�G�VQ@*J!\]_P@/_PAcGTB�;ãû¬xï¡è ñ á&% `P÷�ö «4(�8�*'��*=8�( )>8�;�� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % »UXEO�^�@*JWAWbµMPG*_P@/_]G*MNf¯G�bEOy\9@/MhO*Ø

é I

Page 79: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Ó ² � ?¤Ð � Ð�? � AW\g¹ÈG*M¯ÅE\]OÄS�X�ORB¡_hX�OÎbEOQMPG*_P@/_PAcGTB·G�´E_PAWVQ\¤@/MPOdf¯GTÅ7B�_]Oyb$;µ×�_bEMvAc^*Oy\H_hX�O�MPG*_P@/_]G*M�\]GÃ@*\H_]G¯D�Ac^*O>@¯\P_P@/_PAcGTBE@/MPIdACf¯@/D*O*;� ?¤Ð � Ð�? � _hXE@/_j@�BÃACBE\P_]MvÅ7fmORBT_AW\jfmGTÅ7BT_]OybÃb�AcMPOyV³_PJcI¯GTBÃ_hX�O�_hÅEMvB�_P@*[�JcO@�BEbµAW\�Å7BEJWAc¶*OyJcIË_]GÃ[sO,ÅE\]OybdSUAc_hXÎì n ÚËACBδ�JW@*V³O*;ÿ�? � ?¤Ð � Ð@? � ¹�G*MjÅE\PO�S�XEORB¯_hX�O�bEOQMhG*_P@/_PAcGTBÄG�´E_PAWVQ\9@/MPO�B�G*_HfmGTÅ7BT_]Oyb(@�B7b_hX�O>ACBE\]_]MvÅ7f¯ORB�_9AW\H\P_P@/_PAcGTBE@/MPI3ÁÜ@*\UAW\H_hX�O%VQ@*\]O,¹�G*MUì n Ú�ÂP;

1�2 ñ è43 � G æ % `P÷�öm P÷�ýPôxø�ûcøQôJý6 ¬JèLè�GuàQá æ % <N´7´7JWAcOy\Hì n Úδ�G�ACBT_PACB�D(f¯G�b7OyJÜF�ORB7@*[7JcOy\Uì n Ú(MPG*_P@/_]G*M�@�BEbdb�AW\P@*[7JcOy\H@*JWJ5G*_hXEOQMUMPG*_P@/_]G*Mh\y;ãNG�Oy\

B�G*_NfmGR^*O%_hX�O,Ù�@*\vf%I�_hX�Å�@/_QF�S�XEAWVvXdAW\UB�G*_�Å7B7bEOQMHV³GTf¯´�ÅE_]OQMHV³GTB�_]MPG�JÜ;& 7 \�� F #32 � � z:HG*_P@/_]O�OyAc_hXEOQMÄ_hXEO1<�ÖyACf¤Å�_hX'@�ÏEAW\ÄG*MË_hX�O1VyÅEMPMPORBT_(MPG*_P@/_]G*Md[�I k è l � ¹ÈMhGTf Ac_P\ÎVyÅ�MhMPORB�_Ä´sG�\PAc_PAcGTB�FUAc¹,_hX7AW\ÄAW\´sG�\P\PAW[7JcO*;ãû¬xï¡è ñ á&% `�ÿ���ýcû_� «�)>�'^O���<�:9,M|) �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % ��ksÒ ×�ÏÀÐ Y »�X�O,@/ÖyACf¤Å�_hXÎ@�ÏEAW\Q;� ?¤Ð � Ð@? � »�X�O,VyÅ�MPMPORBT_PJcI�Õ\]OyJcOyV³_]OybµMhG*_P@/_]G*My;1�2 ñ è43 � G5% `�ÿ���ýcû_�ÂýQôJøcû�øQôxý6 ¬JèLè�GuàQá æ % »UXEO%@/ÖyACf¤Å�_hXd@�ÏEAW\QF�@�B7bd_hX�G�\]O>MPG*_P@/_]G*Mh\�S�XEAWVYXµXE@R^*OgJWACfÃAc_P\HORBE@*[7JcOyb·Á e @*\P\]OQD*Mv@*ACBµ@�BEba²�MhACf¯O

¹�G�VQA�ÂXE@R^*O%fmG*MPO�_hXE@�B k è l � G*¹$_]Mh@y^*OyJ5@�B7bÄ´�@/MP_�G*¹!_hX�OyAcM9Mh@�B�D*Oy\j@/MPO�@�fg[7AcDTÅ�GTÅE\y;|»�X�O>`�ÿU�cýcû_�V³GTf(f¯@�BEbaAW\�Å7\]Oyb1_]GÄMhG*_P@/_]Og_hXEOy\]O¯fmOyVvX7@�BEAW\hf¯\�[TI k è l � ACBaG*Mhb7OQMN_]GÎ@R^*G�AWb�_]Mh@*VP¶�ACB�DÎACBT_]Gd@JWACfÃAc_9G*MU_]G¯MPOy\POQ_H_hX�O>f¯OyVvXE@�BEAW\vf Ac¹|@mJWACfÃAc_�XE@*\H[sOQORBÎXEAc_�b�Å�MhACB�D¤G�[7\POQMP^�ACBEDE;»UX�OQMPO,@/MhO,¹ÈGTÅEM´sG�\P\PAW[�JcO%fmG�bEOy\jG*¹|G�´�OQMv@/_PAcGTB�F�bEOy´sORBEb7ACBEDgGTBÎ_hX�O%ACBEAc_PAW@*J)\]_P@/_]O*;�Þ|AcMh\]_PJcI*FsAc¹)_hXEO>fmOyVYXE@�BEAW\hf AW\_]Mh@*Vh¶�ACBEDmBEG*Mvf¯@*JWJcI*F�@�BEbËAW\�ACBÄAc_P\j@�fg[7AcDTÅ�GTÅE\�Mh@�B�D*O*F�_hX�ORB(Ac_9AW\MhG*_P@/_]OybÎ[TI k è l � @�BEbÄ_]Mh@*Vh¶�ACB�DAW\�MPOy\hÅ7f¯Oyb5;�»�XEAW\HAW\�ÅE\]OQ¹êÅEJ5Ac¹�_hX�OQMPO%AW\NACBE\hÅPÕÃVQAcORB�_�_PACfmO,_]GÄV³GTf¯´7JcOQ_]Og@�BÎG�[7\POQMP^�@/_PAcGTBa[sOQ¹ÈG*MhO@mJWACfÃAc_jAW\HX7Ac_Q;�Ú�OyV³GTBEb7JcI*F7@�BË@/ÖyACf¤Å�_hXÄG*M9MPG*_P@/_]G*MN\]G*¹�_�Sj@/MPO,JWACf¯Ac_Hf¯@RI([sONORBEV³GTÅ7BT_]OQMPOybÎS�XEAWJW\P__hX�O>_]OyJcOy\PV³G�´sOgAW\U_]Mh@*VP¶�ACB�DE;B`�ÿ���ýcû_�(_hX�ORBµf¯GR^*Oy\U_hX�Ogf¯OyVvXE@�BEAW\vf _]GÃ_hXEO%V³G*MPMPOyV³_�´sG�\PAc_PAcGTB�F�@*\GTB1VvX7@�B�D*O>G*¹�\]GTÅ�MhV³O*F5@�BEba_]Mh@*VP¶�ACB�DÎAW\NMPOy\hÅ7f¯Oyb3Á�_hXEAW\�AW\�@*JcS¦@RI�\�´sG�\P\hAW[7JcO>´EMhGR^�AWbEOybµ_hX7@/_N_hXEO_P@/MPD*OQ_NAW\9\]_PAWJWJ$@*[sGR^*O%_hX�O%X�G*MhAcÖQGTBÎJWACfÃAc_³ÂP;»UXEAcMvb7JcI*FEAc¹)_hX�O%f¯OyVvXE@�B7AW\hf ACBÎÇ�Å�Oy\]_PAcGTBÎAW\H\P_]G�´7´sOybACBÆ@�BÆ@�fg[7AcDTÅ�GTÅ7\g´�@/MP_>G*¹NAc_P\m_]Mh@R^*OyJÜF�_hX�ORBØ`�ÿU�cýcû_�ÝS�AWJWJ¦b7MhAc^*OÎAc_g_]G¡@Ý´sG�\PAc_PAcGTB k è l � @RS¦@RI@�BEb·\]_]G�´ÆAc_Q;ÝÞLACB7@*JWJcI*FAc¹9_hX�OÎfmOyVvX7@�BEAW\hf½AW\>ACBº_hX�OÄ´EMPG�V³Oy\P\gG*¹UfmGR^�ACB�D1_]G1@aÐEÏ�Oybº´sG�\PAc_PAcGTBÁÜ@*\9@gMPOy\hÅ7Jc_¦G*¹L@�B�û�øùHú_`�øU�mG*M_ýQôJøcû�øQôxý�úeô�`cÿcø¯V³GTfÃfÃ@�BEb5FT¹�G*M9O³ÏE@�f¯´7JcO/ÂPF�_hX�ORB(_hX�O�bEORfÃ@�BEb´sG�\PAc_PAcGTB1AW\N@*Jc_]OQMPOyb�[TI k è l � Ac¹�´sG�\P\PAW[�JcO*;U×]Bµ@*JWJLVQ@*\]Oy\QF$@�BµOQMPMPG*M�fmOy\P\h@/D*OgAW\ND*ORB�OQMh@/_]OybÝAc¹�_hXEOf¯OyVvXE@�BEAW\vf AW\,GTBµ_hXEOÃÅ7BE@�fg[7AcDTÅ�GTÅE\N´7@/MP_�G*¹¦Ac_P\�Mh@�B�D*O*;C`�ÿU�cýcû_��ýQôxø�ûcøPôxýdAW\,B�G*_,ÅE\]OQ¹êÅEJ)¹ÈG*M_hX�O¤ÙN@*\hf>I�_hXµMPG*_P@/_]G*Mh\QF5SNXEAWVvX1bEGËB�G*_�X7@y^*OmJWACf¯Ac_P\NORBE@*[7JcOyb$Fs@�BEb1AW\�B�G*_�@*JWJcGRS¦Oyb¡Ac¹�_hX�OQIµ@/MhOACBdÅ7\]O*;

& 7 \�F F¡8 9 F¡8 &n BT_]OQMU_hXEO�^�@*JCÅ�O%G*¹)_hX�O>V³G*MPMPOyV³_PAcGTBµ_]GÃìNB7Ac^*OQMh\P@*J$»HACf¯OÃÁÜì�» å î ì�» e ¦ÅE\]OybÎACBË_hXEO%V³GTB�_]MhG�J!\]I�\]_]ORfÎ;ãû¬xï¡è ñ á&% `�ø�ú�`�ø�þ «N^�8�(('�'^b*>9�8�� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;�»UXEAW\UV³GTf(f¯@�BEbµGR^*OQMPMvAWbEOy\N_hX�Og\P_P@/MP_hÅE´a^�@*JCÅ�OgG*¹ìN» å � ìN» e FsS�XEAWVvXaAW\NbEOQ_]OQMvf¯ACBEOyb

¹�MPGTf @�BÎACBT_]OQMh´sG�JW@/_PAcGTBµ¹ÈG*Mvf¤ÅEJW@m\vÅE´7´7JWAcOybÎ[�I(_hXEO n @/MP_hXµ:HG*_P@/_PAcGTBa²�MPOyb7AWV³_PAcGTB1Ú�OQMP^�AWV³O*;0 ñ ï ñ è�GHá:Guï æ % »UXEO,V³G*MPMPOyV³_PAcGTBaACBÎ\]OyV³GTBEb7\y;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % `�ø�ú�`�ø�þPTI I ���

é ò

Page 80: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

6 ¬JèLè�GuàQá æ % »UXEOH× n :NÚ¯[�ÅEJWJcOQ_PACB(AW\´7ACB7BEOyb(ÅE´mGTB(@>BEG*_PAWV³Oy[�G�@/Mvb(ACB¯_hX�OU¾Ê¿�» V³GTBT_]MPG�J�MhG�GTfd;|»�X�OUV³G*MPMPOyVYÕ_PAcGTBµì�» å î ìN» e ¹ÈG*MHOy@*VYXµBEAcDTXT_UAW\�JWAW\]_]OybdACBd@¤_P@*[�JcO%S�XEAWVYXÎ\]_P@/MP_P\HGTBd´7@/D*O k G*¹)_hX�O>[�ÅEJWJcOQ_PACB�;

& 7 \�\ \Z;�� +L� ë #ã�AW\P´7JW@RI¤» e Ú>@*VQV³GTÅ7B�_NÁÜ» e Ú ã n á>F�» e Ú ?|Z,KN×0Ù%F*» e Ú Z�?)ã>Â!@�BEb¤^*OQMh\PAcGTBdÁ°GWF ±®F>^ l Õ�Ó/Õ å Â)VyÅEMPMPORBT_PJcIgACBmÅE\PO*;ãû¬xï¡è ñ á&% ô�÷®ýQöeù�ôxÿ-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % Ù�GTB�O*;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;6 ¬JèLè�GuàQá æ % »UX7AW\HV³GTfÃfÃ@�BEbËAW\UB�G*_UVyÅ�MhMPORB�_PJcIË@y^/@*AWJW@*[7JcOgGTBË_hX�O%\PI�\]_]ORf�V³GTf¯´�Å�_]OQMgÁ�¹ÈMPGTf × e ?�ÂP;

& 7 \�d 2�� \Z;��N; # Í 8 6n BT_]OQMU_hXEO�^�@*JCÅ�O%G*¹)_hX�O%O³ÑsOyV³_PAc^*OgS¦@R^*OyJcORB�D*_hXaG*¹LJWAcDTXT_NÅ7\]OybÎACBÎ_hX�O,VQ@*JWVyÅ7JW@/_PAcGTBµG*¹L_hX�O,MhOQ¹ÈMh@*V³_PAcGTBµV³G*MPMPOyV³_PAcGTB�;ãû¬xï¡è ñ á&% ��ûUô�÷_��÷�ÿ_õ�ø_� «o����t'�'�����'��*,� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;»UXEO,\]_P@/MP_hÅE´Î^/@*JCÅ�O%AW\ l ; Ó¤^!fÎ;0 ñ ï ñ è�GHá:Guï æ % »UXEO�S¦@R^*OyJcORB�D*_hX1ACBdf¯AWV³MPGTB7\Q;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % ��ûUô�÷_��÷�ÿ_õ�ø_�PI ��& 7 \�u 2 � � zZN^*OQMPMvAWbEO>_hXEOg@/ÖyACf¤Å�_hXaSHMh@*´a^/@*JCÅ�OdÁ�E�F�GHF·_hX�O¯f¤ÅEJc_PAW´7JcO>G*¹ k è l � S�XEAWVYX1f¤ÅE\P_�[sOg@*b�bEOybµ_]GË_hX�OgMh@RS ORB7V³G�bEOQMMPOy@*b7ACBEDm_]GÃD�Ac^*O,_hX�O>V³G*MPMPOyV³_�@/ÖyACf¤Å�_hX�ÂP;ãû¬xï¡è ñ á&% ��ý�û�� «o�'(�� + t=�'�O7�� �-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % »UXEOgSUMh@*´1^�@*JCÅ�OmACB�Å7B7Ac_P\�G*¹¦f¤ÅEJc_PAW´7JcOy\�G*¹�GTB�O¤MPOQ^*G�JCÅ�_PAcGTB�;¤»UX�Om@*JWJcGRS¦Oyb¡^/@*JCÅ�Oy\�@/MPO"x l í$@�B7b

x�� å íW;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % ��ý�û���T;ú6 ¬JèLè�GuàQá æ % »UXEOË@*[�\]G�JCÅ�_]OÎORBEV³G�bEOQMmACBÆ@/ÖyACf¤Å�_hXÌXE@*\m@1_]Mh@y^*OyJHG*¹UO³ÏE@*V³_PJcI k è l � F�@/¹�_]OQMmS�XEAWVvXÆAc_mMhOy´�Oy@/_P\y;

»UXEOH_]OyJcOy\PV³G�´sO�X7@*\�@%_]G*_P@*J�_]Mh@R^*OyJsG*¹!æ k/l � ACB(@/ÖyACfgÅE_hX�F�@�BEbÃ_hX�O�@�fg[7AcDTÅ7Ac_�IÃf¤ÅE\]_�_hX�OQMhOQ¹ÈG*MPO�[sOMPOy\PG�Jc^*Oyb(GTBÃ\]_P@/MP_hÅE´Ä[�IgMhOy@*b7ACB�D%_hXEO�´sG�\PAc_PAcGTBÃG*¹$@,ÖQGTB�O�\]SUAc_PVYX�;�»UX�OM��ýcû_�gV³GTfÃfÃ@�BEb¯\hX�GTÅ7JWbGTBEJcIÎ[sO%B�OyV³Oy\P\h@/MPIËS�X�ORBË_hX�O�ÖQGTBEO>\]SUAc_PVYXιÜ@*AWJW\QF�ACBdS�XEAWVvXdVQ@*\]O%_hX�O>@/ÖyACfgÅE_hXËMPOy@*b7ACB�DÃSUAWJWJ$[sOACBEV³G*MhMPOyV³_%[�I k è l � @�BEbÝ_hXEOm_]OyJcOy\PV³G�´sO¯SUAWJWJ�\]GTf¯OQ_PACfmOy\�\PJcOQSÒACBT_]Gµ@dXE@/MvbES¦@/MhO¤JWACfÃAc_Q;¤×0B1_hXEAW\VQ@*\]O*F(�cýcû��(f¯@RIÄ[sO%ÅE\POybË_]G¯ORB�_]OQM�_hX�O%V³G*MPMhOyV³_U^/@*JCÅ�O*;

& 7�dûx � z z%��ë » ;n BT_]OQM�_hX�O>ϵ@�BEb1IdV³G�G*Mhb�ACBE@/_]Oy\�G*¹@�Ba@�Å�_]G*DTÅEAWbEOQM�´EMPG�[sOËÁÜ@*´7´EMPG�´EMvAW@/_]O>¹�G*M�_hX�Og²MhACfmO*Fsì n ÚdÙN@*\hf>I�_hXa@�B7b<�Å�_]G*Ð�[�Ô¤@�Å�_]G*DTÅ7AWbEOQMh\³ÂP;ãû¬xï¡è ñ á&% ð_ö_��ýQô��÷��P�-LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % »UXEO�ÏË@�BEbdIÄV³G�G*Mhb7ACBE@/_]Oy\UG*¹|_hX�O�DTÅEAWbEO%´7MPG�[sO*F�ACBµÅ7BEAc_P\UÅE\POybd[TIÄ_hX�O,\]I�\]_]ORfÍV³GTf¯´�Å�_]OQM%Á�^!f

¹�G*MU@*JWJ!VQ@*\POy\U@/_U´EMhOy\]ORB�_³ÂP;ä=G ç ­�¬Jï�í æ % Ù�GTB�O*;1�2 ñ è43 � G æ % ð_ö_��ýQô��÷ � II,II � III,I6 ¬JèLè�GuàQá æ % »UX7AW\�V³GTfÃfÃ@�BEbm@*JWJcGRSU\�_hX�OH» e Úg_]G%VQ@*JWVyÅEJW@/_]ON_hX�OU´sG�\PAc_PAcGTB¯G*¹s_hXEOHDTÅEAWbEOU´7MPG�[sOjACB¯¹ÈG�VQ@*J�Õ�´7JW@�B�O

Á ¢ Æ : Ä Æ ÂHV³G�G*Mhb7ACBE@/_]Oy\y;N»UX7AW\�AW\�B�OQOybEOyb$Fs¹�G*MNO³Ï�@�fô7JcO*F5[TId_hXEOzû�õ�ô5ù�÷��dV³GTfÃfÃ@�BEb5F�[�Å�_�AW\Là(¬JáI l

Page 81: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

ÅE\POyb�b7AcMPOyV³_PJcI1¹ÈG*M,@�Å�_]G*DTÅ7AWb7ACB�DEF)\hACBEV³Om_hX�O¯bEOQ_]OyV³_]G*M¤f¯@*ACBT_P@*ACBE\�@ÎV³GTBE\]_P@�BT_,G*MhAcORBT_P@/_PAcGTB�SUAc_hXACBË_hXEO,¹ÈG�VQ@*J$´7JW@�BEO,Ac¹|Ac_�AW\UfmGTÅ7BT_]OybËGTBd@�BËÏ�Õ�IË\]_P@/D*O*;

& 7�dB9 \ ;���ë + ; 8Ú�OQ_H_hXEO�ÖQOQMPG/Õ�´sG�ACB�_P\�G*¹LACB7V³MPORfmORBT_P@*J5ORBEV³G�bEOQMh\H[�IË@m^�@/MvAcOQ_�IËG*¹�fmOQ_hX�G�b7\Q;ãû¬xï¡è ñ á&% ø�÷®ýQôcöx÷�ø «�)��=^O�=���c9M|) � «o)���*���8�; � � « + 8'M9b*>9�8<� �s -LG/. ñ ¹ � á æ % Ù�GTB�O*;0 ñ ï ñ è�GHá:Guï æ % »UXEOG� « + 8=M,9b*c9�8�� �4 U´7@/Mh@�f¯OQ_]OQM)AW\)MPOyÇ�ÅEAcMPOyb,GTB7JcI,Ac¹E_hX�O Ð@? «�)>��*,�=8�; �ݶ*OQI�S¦G*Mhb¤AW\)\h´�OyVQAcÐ�Oyb

ÁÜ\]OQOd[sOyJcG.S�ÂP;º»UXEOË´sG�\PAc_PAcGTBÆ\vX�GTÅEJWbÆ[sO(ORBT_]OQMPOyb¸ACB·_hX�O˹�G*Mvf¯@/_QØ «s;'���(���=M � «o):9O�,7�*=�'M �«NM��=^�8���;>M ��;ä=G ç ­�¬Jï�í æ % «�)>�=^|���<�:9M5) � î »UX�O�¹�G�JWJcGRSUACB�DËfmOyVYXE@�BEAW\hfÃ\jfÃ@yIË[sO�ÖQOQMPG�\]OQ_QØ� Ö5Ð Ò ÐzÏ½Ó ²��ksÒ ×�ÏÀÐ Y� ?¤Ð � Ð@? � Á�_hXEO%VyÅ�MPMPORBT_PJcI�Õ�\]OyJcOyV³_]OybµMhG*_P@/_]G*MQ«�)>��*���8�; � î Ú�OQ^*OQMh@*JLb7A�Ñ�OQMPORB�_�fmOQ_hXEG�b7\�@/MPO¤´EMPGR^�AWbEOyba_]GÄ\POQ_�_hX�O>ÖQOQMPG/Õ�´sG�ACB�_P\NG*¹�_hXEOgACBEV³MhO³Õf¯ORB�_P@*J9ORB7V³G�bEOQMv\QF�ACB¸G*MhbEOQMm_]G3MhOyb�ÅEV³OÎ_hX�OdbEOy´sORBEb7ORBEV³OÎGTBÌACBEb7Ac^�AWb�ÅE@*J9[�Ac_P\mG*¹�OyJcOyV³_]MPGTBEAWVQ\Q;»UXEOy\]O,@/MPO*ØÐ ����Ü ² Ð »UXEAW\�fmOQ_hXEG�baAW\QF5ACBa´7MhACBEVQAW´7JcO*F�VQ@*´7@*[7JcO¤G*¹�_hX�O¯XEAcDTXEOy\]_N@*VYÕ

VyÅ�Mv@*V³I*;¡< fmOyVYXE@�BEAWVQ@*J¦_P@/MPD*OQ_mAW\mÅE\]Oyb·_]G�´EMPG.^�AWbEOË@1ÐEÏ�OybMPOQ¹�OQMPORBEV³O¤´sG�ACB�_Q; e Å�MPMPORBT_PJcI*F�_hX7AW\Nf¯OQ_hX�G�b1f¯@RIË[sO¤ÅE\]OybdGTB_hX�O1@*Jc_PAc_hÅEbEOÝ@�BEb'@/ÖyACf¤Å�_hX @�Ï�Oy\ÃGTBEJcI*;"»�X�OyAcMÃ_P@/MPD*OQ_P\Î@/MhOJcG�VQ@/_]OybÝ@/_U@�Bd@*Jc_PAc_hÅEb7O IJI � k ò y @�BEbµ@/ÖyACfgÅE_hXZ� l Ô � Ô�é y F7MhO³Õ\P´sOyV³_PAc^*OyJcI*;,»UXEO¤f¯OyVvXE@�BEAW\vfÍAW\NbEMhAc^*ORB1\PJcG.SUJcIµ_hX�MhGTÅ�DTXd_hXEO\]_P@�B7b7@/Mhbm´sG�\PAc_PAcGTB¤ACB>ORB�D�ACB�OQOQMhACBED%fmG�bEO¦@�B7b>_hXEO¦ORB7V³G�bEOQM�AW\MPOy\POQ_HS�X�ORB(_hX�O�_P@/MPD*OQ_NAW\9bEOQ_]OyV³_]OybdOyJcOyV³_]MhGTBEAWVQ@*JWJcI*F5ACBÄS�XEAWVvXVQ@*\]OË_hX�OËÅE\]OQMg_]OQMvf¯ACB7@*J�SUAWJWJ¦[7JcOQOy´·@�BEb3GTÅE_P´�Å�_>@a\hÅEAc_P@*[7JcOf¯Oy\P\P@/D*O*;Ý<�Jc_PAc_hÅEb7OÄ@�BEb·@/ÖyACf¤Å�_hX3_P@/MPD*OQ_mÖQOQMPG�\]OQ_P\mf¯@RI3[sO@*V³_PAc^*O¤\PACf¤ÅEJc_P@�B�OQGTÅE\hJcI*;Ñ � ÿZÑ ² Ö »UXEAW\LAW\LÅ7\]Oyb%_]G�VQ@�BEV³OyJ�@�_P@/MPD*OQ_|ÖQOQMPG�\]OQ_|MPOyÇ�Å�Oy\]_)Ac¹�F/¹ÈG*M�\]GTf¯OMPOy@*\PGTB�F�Ac_H¹Ü@*AWJW\Q;� Ô¤Øl?�Ö ÏÀÐ ² »�X�OHACBEV³MPORf¯ORB�_P@*JEORB7V³G�bEOQMv\@/MPOH¹�G*MhV³OybÃ_]G,MPOy@*b¯_hXEOU\P@�fmOH@*\_hX�O(@*[7\]G�JCÅ�_]O(ORBEV³G�b7OQMh\�¹�G*M%_hX�OÃ\h@�fmOÃfmOyVYXE@�BEAW\hfd;¯»UXEAW\,AW\bEGTBEO�@�ÅE_]GTf¯@/_PAWVQ@*JWJcIÄGTB(\P_P@/MP_hÅE´5F�_]Gm´EMPG.^�AWbEO�@�BÄACBEAc_PAW@*J�Oy\]_PA�ÕfÃ@/_]O*;9×�_UAW\N´EMPGTBEO,_]GùÜ@*AWJCÅ�MPOg[�OyVQ@�Å7\]O,_hX�Og[�ÅEJW[7\HACBd_hX�O>@*[EÕ\]G�JCÅE_]O>ORBEV³G�bEOQMh\�@/MPOgBEG*_UOy\P´sOyVQAW@*JWJcIdMPOyJWAW@*[�JcO*Fs@*Jc_hX�GTÅEDTXd_hXEAW\\PAc_hÅ7@/_PAcGTB·SUAWJWJ[sO(ACfôEMPG.^*Oyb¡GTBEV³OÄ_hX�OÄBEOQS ? n ã ORBEV³G�bEOQMh\@/MPO%G�´�OQMv@/_PAcGTBE@*JÜ;Ð@? <�JWJcG.SU\�_hX�O¤VyÅ�MPMPORBT_�´�G�\hAc_PAcGTBµG*¹_hX�O¤f¯OyVvXE@�B7AW\hf�_]GÎ[sO>ACB�Õ´�ÅE_Q;)»UXEAW\$S�GTÅEJWb>B�G*Mvf¯@*JWJcIN[sO�bEOQMhAc^*Oyb�¹�MPGTfÊ_hX�O�ORBED�ACB�OQOQMhACB�D/ÕbEOy\P¶3\]IEBEVvX�MhG�\ËÁÜACB·@*Jc_PAc_hÅEb7OË@�B7b·@/ÖyACf¤Å�_hX�ÂNG*M¤¹�MPGTf½_hX�OÄ\]ÕVQ@*JcO�GTBg_hX�O e @*\P\]OQD*Mv@*ACB¤MPG*_P@/_]G*M�@�B7bmAW\�V³G*MPMPOyV³_]Oyb¯¹�G*M�¶EB�GRS�BÖQOQMPG/Õ�´sG�ACBT_HOQMPMPG*Mv\Q;�»UXEAW\9fmOQ_hXEG�bË´EMPG.^�AWb7Oy\9@m\]_P@/MP_PACB�D¯´sG�ACBT_¹�G*M9_hX�OVø�ûcý�õ�÷�ø¯´EMPG�V³Oyb�Å�MPO�@�BEbË@¤[7@*VP¶EÅE´ÎACBÄVQ@*\]O�G*¹)¹�@*AWJCÅ�MhOG*¹�[sG*_hXË_hX�O,@*[7\PG�JCÅ�_]O,ORBEV³G�bEOQMU@�BEbd_hX�O,_P@/MPD*OQ_�OyJcOyV³_]MPGTBEAWVQ\Q;k ² ÿ Ò Ð Y »UXEAW\¯AW\ÄÅE\]OybÌ_]G·\]OQ_Ã_hX�OµÖQOQMPG/Õ�´sG�ACB�_P\ÄACB¸@*Jc_PAc_hÅEb7Oa@�BEb { G*M@/ÖyACf¤Å�_hXº@*\P\hÅ7fÃACB�Dd_hXE@/_g_hX�O(_]OyJcOy\PV³G�´sOËAW\g@/_¤Ac_P\gXE@/MvbES¦@/MhOÖQORBEAc_hXg´7@/Mh¶,´�G�\hAc_PAcGTB�;L»�XEAW\)AW\L@�ÅE\]OQ¹êÅEJT[7@*Vh¶�Å7´%G�´E_PAcGTB>S�XEORB

I�å

Page 82: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

_hX�OQMhO¤AW\�@Ä´EMPG�[7JcORfÍSUAc_hXaGTB�OgG*¹�_hX�Om@*[7\]G�JCÅE_]O>ORBEV³G�bEOQMh\yF�\]ÕACBEV³Om_hXEOg_]OyJcOy\hV³G�´�O¯VQ@�BÝ[sOmfmG.^*OybÝ_]GË@ÄMPOy´7MPG�b�ÅEVQAW[7JcO¤´�G�\hA�Õ_PAcGTBµACBEbEOy´sORBEbEORBT_PJcI(G*¹L_hX�O,ORB7V³G�bEOQMv\Q;����j <N\�¹�G*M k ² ÿ Ò Ð Y [�ÅE_jÅE\hACB�D>_hXEO�XE@/MvbES¦@/MhON<NVQV³Oy\P\H²|@/MP¶ å´sG�\PAc_PAcGTB�;���zh <�\N¹�G*M ���¤j [�Å�_NÅ7\PACB�DÄ_hX�O¤X7@/MhbESj@/MPO><NVQV³Oy\P\�²|@/MP¶aÔ(´sG/Õ\PAc_PAcGTB5;

1�2 ñ è43 � G æ % ø�÷®ýQôcöx÷�ø�û_��ø&ùSøU`U P÷ÂûUQö�ô���`cø�÷ø�÷®ýQô�û4øeùWúU`�ø_�Âøcûcý_õc÷®øø�÷®ýQô�û4ø,ø®÷�ÿ&ùSø_�ø�÷®ýQô�ýQôJøüøQô � IPIIPII

I Ô

Page 83: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO�Ô l Ø�<NB¯O³Ï�@�fô7JcOHG*¹5_hX�O�X7@�BEb7\]OQ_b�AW\P´7JW@yI*;�»�XEAW\�O³ÏE@�f¯´7JcO�@*´7´7JWAcOy\�_]G>VvX7@�B�D*O�G*¹�_hX�O�MPOQ¹�OQMPORBEV³O�´sG�\PAc_PAcGTBACB ¢ : Ä V³G�G*Mhb7ACB7@/_]Oy\U@�BEbÎAW\U_hX�O,bEOQ¹Ü@�ÅEJc_HGTBÎ\]_P@/Mh_hÅE´5;� ì ýL/ ì*Ê À�� )H©¤­=+&/|ª� 7:9 Í � �7�T���»UX�OÄXE@�BEb7\]OQ_>´EMPGR^�AWbEOy\>@�B¡ACBT_]OQMh@*V³_PAc^*OÎS¦@RI�G*¹9ACBEV³MPORfmORBT_PACB�Da_hX�OôsG�\PAc_PAcGTB3G*¹¦_hXEOÃ_]OyJcOy\PV³G�´sO(ACB¡^�@/MvAcGTÅE\>V³G/ÕG*Mhb7ACB7@/_]O>\]I�\]_]ORf¯\yF�\]OQ_]_PACB�DË@*´sOQMP_hÅ�MPOy\�@�BEbaG/Ñ�\]OQ_P\�@�BEba@*Jc_]OQMhACB�DÄ_hX�Og¹ÈG�VyÅE\U@�B7bdMPG*_P@/_]G*M,´sG�\PAc_PAcGTBa@�B�D�JcO*;U»UXEOXE@�BEb�\]OQ_¦AW\j\]OyJcOyV³_]OybÎ[�IôEMhOy\P\PACB�D>_hX�O dfe�gji�k|m=n ¶*OQI(G*Mj_�I�´7ACB�Do��ûcÿ� eö®÷®øm@/_j_hX�O�ÅE\]OQMjACB�_]OQMP¹Ü@*V³O*;�²MPO³Õ�bEOQÐ�BEOyb@�BEbÌÅE\]OQMPÕ�\]OyJcOyV³_P@*[7JcOdACBEV³MPORf¯ORB�_P\mfÃ@yI3[sOÄÅ7\]OybÆ@�BEb·_hX�OÄ@/MhMPGRS ¶*OQI�\m@/MPOÎÅE\]Oyb·_]G�ACBE´�Å�_>_hX�OÎ\]_]Oy´7\Q;�»UX�Oy\PO@�Å�_]G/Õ�MPOy´sOy@/_HSNX�ORBÎX�OyJWbÎbEG.S�B�FE\]G¯@mV³GTBT_PACB�Å�GTÅ7\�fmG*_PAcGTBÎfÃ@yIÄ[�O�D*ORB�OQMv@/_]Oybµ[�IÄ\]OyJcOyV³_PACBEDÃ@m\hf¯@*JWJ�ACBEV³MhORfmORBT_@�BEb1X�G�JWb7ACB�DÄbEGRS�Bd_hX�O>@*´�´EMPG�´EMhAW@/_]O%¶*OQI*;U»UX�O%JcOQ¹�_ � gh¡ @�BEbdMhAcDTXT_ �¢g�¡ ¶*OQI�\N\]OyJcOyV³_�_hX�O>B�O³Ï�_�\hfÃ@*JWJcOQMN@�B7bB�O³Ï�_UJW@/MPD*OQM�ACBEV³MPORf¯ORB�_P\QFEMhOy\P´sOyV³_PAc^*OyJcI*; �c£Gg MhOyÇ�Å�Oy\P_P\H_hX�O%ACB7´�Å�_jG*¹�@�BdACBEV³MPORf¯ORB�_U^�@*JCÅ�O*; n BT_]OQMU_hX�O%^�@*JCÅ�O*FACBÎ_hXEO%@*´7´EMPG�´7MhAW@/_]OgÅ7B7Ac_P\QF�@�BEbÎ_hXEORBµXEAc_H_hXEO ¤fm=n:¥j¤fg ¶*OQI*;,Ú�ÅE\]_�X7Ac_ ¤fm�nc¥h¤fg _]G(Oy\PVQ@*´sO%¹�MPGTf ACBEV³MhORfmORBT_\]OyJcOyV³_PAcGTBµAc¹!I*GTÅË´EMPOy\h\ �c£Jg [�I(@*VQVQAWbEORBT_Q;�»�X�O�X7@�BEb7\]OQ_9b7AW\P´�JW@yI1ÁÜ@¤^/@/MhAW@�BT_9G*¹!_hXE@/_H\vX�GRS�BÄACBËÞ|AcDTÅ�MPO%Ô l ÂAW\bEMh@RS�B(@/_¦_hXEO�_]G�´ÄG*¹$_hX�O�ÅE\]OQMPÕ�ACB�_]OQMP¹Ü@*V³O,\PV³MPOQORB5;�×�_j\hX�G.SU\_hXEON@R^�@*AWJW@*[7JcO>ACBEV³MPORfmORBT_^/@*JCÅ�Oy\QF�_hX�O�@*VQVyÅ7f¤ÅEJW@/_]OybACBEV³MPORf¯ORB�_P\%@�BEb¡_hX�OÄfmG�bEOy\Q; e ÅEMPMPORBT_PJcITÕ�\]OyJcOyV³_]Oybº^/@*JCÅ�Oy\>@/MhOÃACB�MPOQ^*OQMv\]O¯^�AWbEOQGE;µZ�BEJcI1_hX�O¯¶*OQI�\>JW@*[sOyJWJcOyb3ACBÞ|AcDTÅ�MPO¯Ô å MPORf¯@*ACBa@*V³_PAc^*O*;%»UXEO ¦Q§{¨{©�ªc«�¬ ¶*OQI1AW\�ÅE\]Oyba_]GÄMhOQ_hÅ�MvBµ_]GÄ_hXEO[`eöx÷�ýp�à´EMhGTf¯´E_Q;N»UX�O¤bEOQ¹�@�Å7Jc_GTB�Ð�Mh\]_,\]OyJcOyV³_PACB�D1_hX�O(X7@�BEb7\]OQ_,AW\%_hX�OOJ KÍfmG�bEOmSUAc_hX3@�B¡ACBEV³MhORfmORBT_�G*¹ å ; l @/MhVQ\]OyV³GTBEb�\Q;Ä»�X�OQMPOy@/¹�_]OQMyF)_hXEO@*VQVyÅ7f¤ÅEJW@/_]Oyb(ACBEV³MPORfmORBT_P\�ACB¤Oy@*VYXÃfmG�bEO9@�BEb¤_hX�O�VyÅ�MPMPORBT_PJcITÕ�\POyJcOyV³_]OybÄf¯G�bEOj@�BEb¯ACB7V³MPORfmORBT_�^�@*JCÅEOH@/MPOHMPORf¯ORf¤Õ[sOQMPOyb�GTB3O³Ï�Ac_>_]G*`eöx÷�ýp�ïJcOQ^*OyJ�@�B7b¡MPOy\]_]G*MhOyb¡S�X�ORB¡_hX�O(XE@�B7b7\]OQ_%AW\gB�O³Ï�_¤ÅE\]Oyb5;Ë»UX�OQI�@/MPO(MPOy\]OQ_,GTBº\]GTÅ�MvV³OVvX7@�B�D*OÄÁêÅE\hACB�Dm_hX�OCõPôJøQôEF�õPô�þxûcø�F�ÿ�÷�ðcøÃG*M&_�&ùSÿ� ôJõcõPö®÷�øÃV³GTfÃfÃ@�BEb7\³ÂP;� 7[6 6º�� ]��E�Ý� �s]��»UX�OQMhOg@/MPO¯\POQ^*ORB�XE@�BEb7\]OQ_�fmG�bEOy\QF�Oy@*VYXÝG*¹S�X7AWVvX1VQ@�B�[sOg\POyJcOyV³_]Oyb3ÅE\PACB�DÄ_hX�O¯JW@*[sOyJWJcOybݹêÅ7BEV³_PAcGTBa¶*OQIaGTB1_hXEOÅE\]OQM�ACB�_]OQMP¹Ü@*V³O%¶*OQI�[sG�@/Mhb5;�»UXEO,\]OQ^*ORBιêÅ7BEV³_PAcGTBE\Ub7Ac^�AWb7O%BE@/_hÅ�Mh@*JWJcIÎACBT_]G¯_hX�MPOQO,D*MhGTÅE´7\QØ| <N?�» < o F¦:�< ã n¦e @�BEb J KÀACB7V³MPORfmORBT_(_hXEO1bEORfÃ@�BEb ´�G�\hAc_PAcGTB ACB _hX�O�ACBE´�Å�_ÄV³G�G*Mhb7ACB7@/_]OÝ\PI�\]_]ORf

@�B7b3b7A�Ñ�OQM%GTBEJcI�ACB¡_hX�OÃb7AcMPOyV³_PAcGTB7\%G*¹j_hX�OÃACB7V³MPORfmORBT_P\Q;Ë»UX�O¯ACBEV³MPORf¯ORB�_P\>b7AW\P´7JW@RI*Oybº@/MhO¯_hX�OQMPOQ¹�G*MPOÃ_hXEO@*VQVyÅ�fgÅ7JW@/_]Oyb¸^/@*JCÅ�Oy\¯¹�MPGTfä@*JWJ9_hX�MhOQOafmG�bEOy\mACBÆ_hX�OdV³G�G*Mhb7ACB7@/_]Oµ\]I�\]_]ORf G*¹N_hX�OdVyÅ�MPMhORB�_Ãf¯G�bEO*;Ì»UXEO_]Mv@*VP¶�ACB�D(´sG�\PAc_PAcGTBdGTBË_hX�O,ACB�¹�G*Mvf¯@/_PAcGTBdb7AW\P´7JW@RIË@*JW\PGÃVvXE@�BED*Oy\Q;| Z�ÞLÞ�Ú n » @�B7b(<N²¦Z�Þ|Þº@/MPO�Å7\]Oyb(ACB(V³GTB�ÉPÅ7BEV³_PAcGTB(SUAc_hX(_hX�OTöJøQôJý�÷mV³GTfÃfÃ@�BEbm_]G¤\]OQ_HÅE´Ã´sG�\PAc_PAcGTB7@*Js@�B7b@*´sOQMP_hÅEMPO�G/Ñ�\POQ_P\UACBT_]OQMh@*V³_PAc^*OyJcI*;9»UX�O�_]Mh@*Vh¶�ACB�DÄV³G�G*Mvb7ACBE@/_]Oy\Ub7GÃB�G*_UVvX7@�B�D*O*;| ÞLZ e ì�ÚË@�BEbd:HZ�»L<�»�Z�:âfmG.^*O,ACBEb7Ac^�AWb�ÅE@*J$fmOyVYXE@�BEAW\hfÃ\Q;

I k

Page 84: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPOdÔ å Ø(»�X�OÄ´sG*MP_PAcGTBºG*¹�_hX�O(á�»UÔ*Ô l G*Mmá�@�Ï�Ú�_P@/_PAcGTB¸ÅE\]OQMPÕ�ACB�_]OQMP¹Ü@*V³Oζ*OQI�[�G�@/MvbÆÅ7\]OybºACBÆXE@�B7b7\]OQ_mfmG�bEO*;Z�BEJcIÄ_hX�G�\]O%¶*OQI�\USUAc_hXÎJW@*[sOyJWJcOybd¹êÅ7BEV³_PAcGTBE\9@/MhO%@*V³_PAc^*O*;

¾�O>b7Oy\PV³MhAW[sO�Oy@*VvX1XE@�BEb7\]OQ_Uf¯G�b7O�ACBµfmG*MPO�bEOQ_P@*AWJ)[�OyJcG.S,Ø

Ó i�h5i!j � ÖgÐ �Àk*�U�gqAle XE@�BED*Oy\¤_hX�OdbEORf¯@�B7b·´sG�\PAc_PAcGTB¸ACBÆ@*Jc_PAc_hÅEbEOd@�BEbÌ@/ÖyACf¤Å�_hX"ÁêÅ�BEAc_P\m@/MPOd@/MhVQ\]OyV³GTB7b7\³ÂP;Ì»UX�OÎACf¯@/D*OdAW\(fmGR^*OybX�G*MhAcÖQGTBT_P@*JWJcIdG*MH^*OQMh_PAWVQ@*JWJcIdGTBÎ_hX�O>\]¶�I*;�×0B7V³MPORfmORBT_P\H@/MPO%b7OQÐ�B�OybÎACBÎ_hXEO,_P@�B�D*ORBT_�´7JW@�B�O*F�\]G¯_hX�OyAcM�f¯@/DTBEAc_hÅEb7Oy\bEGÃB�G*_Hb7Oy´�ORB7bËGTBËOyJcOQ^�@/_PAcGTB5;�»UXEAW\�fmG�bEONAW\NÅE\]OybË_]G¯Oy\P_P@*[7JWAW\hXË_hX�O%^*OQMP_PAWVQ@*J!b7AcMhOyV³_PAcGTB3Á°GHF�±xF1SNX�ORBÄS�G*MhMPI�ACBED@*[sGTÅ�_db7A�Ñ�OQMPORBT_PAW@*J,MPOQ¹�Mh@*V³_PAcGTBsÂÄG*Md_]G'@*\PV³OQMP_P@*ACB�S�X�OQ_hXEOQMµ@ƹ�@*AWJCÅEMPO3ACBÊ_]OyJcOy\PV³G�´sOº_]Mh@*VP¶�ACB�D'G*Ma´�G�ACBT_PACB�D'AW\´EMPOyb7GTf¯ACBE@�BT_PJcI(ACBÎ@/ÖyACf¤Å�_hXÎG*MUOyJcOQ^/@/_PAcGTB�;

Ó i�h5i�h ��� Ó ² Ñ �Z�gq�le XE@�BED*Oy\¤_hX�OÎbEORf¯@�BEb·´sG�\PAc_PAcGTBÆACB·MhAcDTXT_m@*\PV³ORBE\PAcGTBÌ@�B7b·b7OyVQJWACBE@/_PAcGTB�ÁêÅ7B7Ac_P\g@/MhOd@/MhVQ\]OyV³GTBEb7\QÂP;º»UX�OÎACfÃ@/D*OAW\mfmG.^*OybÌACB3_hXEO(Oy@*\]_0Õ�S¦Oy\]_¯G*M¯B�G*Mh_hX�Õ�\]GTÅ�_hXºb7AcMPOyV³_PAcGTB�;3×0BEV³MhORfmORBT_P\>@/MPOÎbEOQÐsB�OybºACBº_hX�OÄ_P@�B�D*ORBT_¯´7JW@�B�O*F\PG_hX�OyAcM�fÃ@/DTBEAc_hÅEbEOy\9b7GmBEG*_HbEOy´sORBEbÄGTBÎbEOyVQJWACBE@/_PAcGTB�;�×0fÃ@/D*O,fmGR^*ORf¯ORB�_9GTBÎ_hX�O,»9áà@�B7bÎbEOQ_]OyV³_]G*M�S�AWJWJ5bEOy´sORBEbGTB'_hX�OaVYX�G�\]ORB \]¶�I¸´sG�\PAc_PAcGTB @�B�D�JcO*; <j_(@·\]¶�IÌ´sG�\PAc_PAcGTB @�B�D�JcO1G*¹ l � F9_hX�OÝf¯GR^*ORf¯ORB�_P\(ACBtJ Kë@�B7b':U<ã n¦e @/MPO�AWb7ORB�_PAWVQ@*JÜ;¦:U< ã n¦e fmG�bEOUAW\jfmG�\P_�ÅE\]OQ¹êÅEJ7¹�G*M¦S¦@�BEb7OQMhACB�D%@/MPGTÅ�BEb¯Ð�B7b7ACB�D%VYXE@/MP_P\j@�BEb¯Oy\P_P@*[7JWAW\hXEACB�DG*MhAcORBT_P@/_PAcGTBE\�GTBÄ_hX�O%ACBE\]_]MYÅ7fmORBT_Q;|×�_HVQ@�BÎ@*JW\PG¯[�O%Å7\]Oyb˹ÈG*M9G/Ñ5\]OQ_]_PACB�D(¹ÈMhGTf @¤MPOQ¹ÈOQMhORBEV³O%\]GTÅ�MvV³O,@*Jc_hX�GTÅ�DTXË_hXEAW\VQ@�Bd[sO�bEGTB�OgfmG*MPOVÅ7O³ÏEAW[7JcIÄSUAc_hXËG*_hX�OQM�fmOQ_hX�G�b7\9\hÅEVYXÎ@*\9_hX�O[_�&ùWÿU ôxõcõPö®÷®øÄV³GTfÃfÃ@�BEb5;Ó i�h5i�� A �Á�Z�gq�le XE@�BED*Oy\U_hX�OgbEORf¯@�B7bd´sG�\PAc_PAcGTBµACBµb7AcMPOyV³_PAcGTBE\NÐEÏ�OybµACBµ_hX�O>¹ÈG�VQ@*J)´�JW@�B�OÄÁêÅ7B7Ac_P\U@/MPO¤@/MhVQ\]OyV³GTBEb�\³ÂP;U»UXEAW\�AW\U_hXEOfmG�\P_NV³GTf(fmGTBEJcIµÅE\POybµG*¹¦@*JWJ)_hXEOmf¯G�b7Oy\Q;�×�_,fmG.^*Oy\�_hX�O>_]OyJcOy\hV³G�´�O¯ACB1@Ë\]ORBE\hAW[7JcO¤S¦@RIaV³G*MPMPOy\h´�GTB7b7ACB�DÄ_]GÄ_hXEOVyÅE\]_]GTfÃ@/MPIa\PORBE\]OmG*¹ ¢ : Ä V³G�G*Mhb�ACBE@/_]Oy\�GTBÝ_hX�O¯@*VQÇ�ÅEAW\PAc_PAcGTB3»9áÛ\hV³MPOQORB¸ÁÜACBEbEOy´sORBEb7ORB�_�G*¹¦MPG*_P@/_]G*M%G*MhAcORBT_P@/_PAcGTB@�BEb1SUAc_hXaOyÇ�ÅE@*J|\]_]Oy´7\�ACB ¢ @�BEb Ä Âj@�BEbÝAW\�_hX�O¯B�G*MYf¯@*J)f¯OQ_hX�G�bµ¹�G*M�Ð�BE@*J|@*JWAcDTB7fmORBT_�G*¹@�B1G�[�É0OyV³_�GTB1_]GË@�BACBE\]_]MYÅ7fmORBT_@*´sOQMP_hÅ�MPO�\hÅEVvX(@*\j@>\h´�OyV³_]MhG*D*Mh@*´�X(\PJWAc_QF�Å�BEJcOy\P\�_hX�OUDTÅEAWb�ACB�DgJcG�G�´ÄAW\�@*JcMPOy@*b7IÃJcG�Vh¶*Oyb¡ÁÜ\]OQO�<�²jZ�Þ|Þ�F[sOyJcGRS�ÂP;>×�_�VQ@�B7BEG*_QF!X�GRS¦OQ^*OQMyF)[sO¤@*\P\hÅ7f¯Oybµ_hX7@/_�_hX�Om\P@�fmO ¢Ä ACBEV³MPORfmORBT_P\�VQ@�BÝ[sO¤ÅE\POyba¹�G*M%fmG*MhO>_hXE@�B1GTBEOG�[7\]OQMh^�@/_PAcGTBºG*¹H_hX�OÄ\P@�fmO(Ð7OyJWb5;1»UX�OÃMhOy@*\]GTB3AW\g_hXE@/_g_hX�OËXE@�BEb7\]OQ_gAW\¤[�OyACBED1ÅE\]Oyb3_]G1V³GTfôsORBE\P@/_]O([sG*_hX3¹ÈG*M

I Ó

Page 85: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

´sG�ACB�_PACBEDmOQMPMPG*Mh\,Á�S�X7AWVvXË_]ORBEbË_]G¯[sO�¹êÅ7BEV³_PAcGTBE\9G*¹L@/ÖyACf¤Å�_hXÎ@�BEbËOyJcOQ^/@/_PAcGTBd@�BEbË_hXEOQMPOQ¹ÈG*MhO�MPG*_P@/_]O%SUAc_hXÄMhOy\P´sOyV³__]GÃ_hXEO,¹ÈG�VQ@*J$´7JW@�BEO,S�X�ORBË_hXEO¤è�¬�¹�àQá9´sG�\PAc_PAcGTBd@�B�D�JcOgVvXE@�BED*Oy\³Â¦@�BEbd¹ÈG*M�OQMPMPG*Mh\HACBÎ_hX�O%´sG�\PAc_PAcGTBÎG*¹|_hX�O%G�[�É�OyV³_Á�S�XEAWVYXÎ@/MPO,Ð7Ï�OybÎGTBÎ_hX�O%\]¶�IÄ@�B7bÎ_hX�OQMPOQ¹�G*MPO�MPG*_P@/_]O>S�X�ORBË_hX�O æ®­�ç ´sG�\PAc_PAcGTBÎ@�B�D�JcOgVvXE@�B�D*Oy\QÂP;Ó i�h5i�� ? ÝMÝ Ø ² Ð �U�gqAl»UXEAW\jAW\HÅE\POybÄACBËV³GTB/É]Å7B7V³_PAcGTBÃS�Ac_hXÄ_hX�O�öJøQôJý�÷���ôcöeùWø5ù�ôxÿ¯V³GTfÃfÃ@�BEb(_]G¤\POQ_UÅE´(´sG�\PAc_PAcGTB7@*J�G/Ñ�\]OQ_P\HS�XEAWVvXËfÃ@yI[sO(MhOyVQ@*JWJcOybÌSUAc_hX·_hX�OS�Pô�öeùWø5ùJôJÿ�V³GTfÃfÃ@�BEb5;�»)GÝb7OQÐ�B�OË@�B·G/Ñ�\]OQ_QFjfmG.^*Od@�B3G�[EÉ�OyV³_m_]GÝ_hX�OÎ\]_P@/MP_¯´sG�\PAc_PAcGTBÅE\PACBEDÃGTB�OgG*¹ÃJ K¤Fs:�< ã n¦e G*M�<N?�» < o ;s»UX�ORBa\]SUAc_PVYXµ_]GdZ�Þ|Þ�Ú n » fmG�bEO*Fsf¯GR^*Og_hX�OgG�[�É�OyV³_N_]GÄ_hX�O>ORB7b´sG�\PAc_PAcGTB�F�O³ÏEAc_�¹�MPGTf _hX�OUXE@�B7b7\]OQ_�@�BEbm\]_]G*MPO9_hXEO9G/Ñ�\]OQ_�S�Ac_hX¤öJøQôxýc÷��Pô�öeùWø5ùJôJÿ « + 8'M9b*>9�8<� �7,)K���( ��F/S�X�OQMhO« + 8'M9b*>9�8<� �,7,)K���( � AW\HACBÄ_hX�O�Mh@�BED*O å î å l ;ª�Pô�öeùWø5ùJôJÿ « + 8'M9b*>9�8<� �,7,)K���( � MPOyVQ@*JWJW\H_hXEO�G/Ñ�\]OQ_QF�S�XEAWVvXËAW\bEOQÐ�BEOybÎACBË_hX�O,_P@�B�D*ORBT_�´�JW@�B�O*;

Ó i�h5i�ß ��� ? ÝMÝ0�Z�gq�l»UXEAW\mf¯G�bEOÄVvXE@�BED*Oy\m_hX�OÎ@*´sOQMP_hÅ�MPOÄG/Ñ�\POQ_¯ACB�_]OQMh@*V³_PAc^*OyJcI*;Ì×�_mAW\¤ACB�_]ORBEb7OybÆ_]G¡[�OÎÅE\]Oyb·_]G�\hXEAc¹�_m@�BºG�[�É�OyV³_m_]G@�BÝACBE\]_]MYÅ7fmORBT_�@*´sOQMP_hÅ�MhOg@RS¦@RIa¹�MPGTf _hX�O¤MPOQ¹�OQMPORBEV³Om´sG�\PAc_PAcGTB�;%»UXEOg@*´sOQMP_hÅ�MhOgV³G�G*Mhb7ACBE@/_]Oy\,fÃ@yIµ[sOgMPOyV³G*MhbEOyb¹�G*M>¹êÅ�_hÅ�MPOÄÅE\]O¯SUAc_hX3_hX�OÄV³GTfÃf¯@�B7b¶öJøQôxýc÷Âû���÷�ý�øU`�ýc÷�;$»UX�OÃACfÃ@/D*OËf¯GR^*Oy\gACB ¢ @�BEb Ä GTB¡_hX�OÄ»9á�@�BEb { G*MbEOQ_]OyV³_]G*My;N»!GÄ\]OQ_�ÅE´µ@ÄB�OQS @*´sOQMP_hÅEMPO*Fsf¯GR^*O>@�BµG�[�É0OyV³_�_]G(_hX�OgMPOQ¹ÈOQMhORBEV³O>´sG�\PAc_PAcGTB1ÅE\PACB�D%J KgF�:U< ã nje G*M<N?�» < o fmG�bEO*F5\]SUAc_PVYX1_]Gd<�²jZ�Þ|Þ�F!f¯GR^*OmAc_�_]GÎ_hX�O¯B�OQSï@*´sOQMP_hÅ�MhOËÁÜ\P´sOyV³_]MPG*D*Mv@*´�XÝ\PJWAc_�G*M�S�XE@/_]OQ^*OQMyÂPF$O³Ï�Ac_¹�MPGTf _hX�O¯XE@�BEb7\]OQ_�@�BEb1_�I�´sO¤öJøQôJý�÷Âû_�c÷�ý�øU`cý�÷ «�� + ��(�*,7'(�� �7�)�K���( ��FsS�X�OQMPO «�� + ��(�*,7'(�� �7,)K���( � AW\NACB_hX�O,Mv@�B�D*O l.î å l ;,öxøQôJý�÷Âû_�c÷®ýcøU`cý�÷LImMPOyb7OQÐ�B�Oy\j_hX�O,MhOQ¹ÈOQMPORB7V³O%´sG�\PAc_PAcGTB�;

»UXEOU<�²jZ�Þ|Þ3fmG�bEOUfÃ@yIm[sO�ÅE\]OybÃOQ^*ORB¯S�XEORBm_hX�ON@�Å�_]G*DTÅEAWbEOQMjJcG�G�´ÄAW\JcG�VP¶*Oyb$;»UXEAW\�AW\�ÅE\]OQ¹êÅEJE¹�G*M9f¯@/¶�ACB�D\hfÃ@*JWJsV³G*MhMPOyV³_PAcGTBE\%Á°GWF ±®F�_]GmG�´7_PACf¯AW\]O�@g_P@/MPD*OQ_U´sG�\PAc_PAcGTBÄGTBÄ_hX�O�\P´sOyV³_]MPG*D*Mv@*´�XË\PJWAc_³ÂP;»UXEON_]OyJcOy\hV³G�´�O�G/Ñ5\]OQ_U@�B7b_hX�OmMPOQ¹�OQMPORBEV³O(´7A�Ï�OyJ�V³G�G*Mhb7ACB7@/_]Oy\,GTBÝ_hX�O¯@�ÅE_]G*DTÅEAWbEOQM%@/MPO(VvXE@�B�D*Oyb3\PACf¤ÅEJc_P@�B�OQGTÅE\PJcIÝACB�\hÅ7VvX�@ËSj@yIÝ_hXE@/_,_hXEODTÅEAWb7ACBED(OQMPMhG*Mh\NMPORf¯@*ACBaÖQOQMPGE;,»UXEOgACfÃ@/D*O¤@*´�´�Oy@/Mv\U_]Gµf¯GR^*OmACBa_hX�Og\h@�fmOgS¦@RIa@*\�ACBa_hX�O�J K f¯G�bEO*;%ÚEfÃ@*JWJACBEV³MPORf¯ORB�_P\>Á « å @/MhVQ\]OyV�¦\hX�GTÅEJWbd[sO%ÅE\POyb5FEACBËG*MhbEOQMH_]G(@y^*G�AWb1JcG�\PACB�D¯_hX�O%DTÅEAWbEO,\]_P@/My;Ó i�h5iHG Ý ?�ÑzÏYØ �Z�gq�le XE@�BED*Oy\H_hX�O>_]OyJcOy\PV³G�´sO%¹�G�VyÅE\gÁêÅ7BEAc_P\�@/MPOgfÃAWJWJWACfmOQ_]MPOy\³ÂP;j<NJcS¦@RI�\�@*JWJcGRSâ_PACf¯O,¹ÈG*M�_hX�O,¹�G�VyÅ7\H_]G(\POQ_]_PJcOg@/¹�_]OQMN@�BACBEV³MPORf¯ORB�_QF�@*\�_hX�OUb7MhAc^*OUAW\�@,[�Ac_\]_PAWVP¶�I*;�×�_\hX�GTÅEJWb¯OQ^*ORB�_hÅE@*JWJcI¯\P_]G�´¯SUAc_hXEACB l ; l å f¯AWJWJWACf¯OQ_]MPOy\�G*¹s_hX�OHMPOyÇ�Å�Oy\]_]Oyb´sG�\PAc_PAcGTB�;

Ó i�h5icb � ?¤Ð � Ð@? � �Z�gq�l»UXEAW\jACBEV³MhORfmORBT_P\�_hXEO 毭�ç ´�G�\hAc_PAcGTB(@�BED�JcO�G*¹!_hX�O�MPG*_P@/_]G*MgÁêÅ7BEAc_P\j@/MPO,bEOQD*MPOQOy\QÂP;�×�_j_hX�OQMhOQ¹ÈG*MPO�GTBEJcI(S�G*Mh¶�\jS�XEORB_hX�O,MhG*_P@/_]G*M�AW\H_]Mv@*VP¶�ACB�DE;

� 7[­ +|�:¯! â���! A@!� )�����! ��»UX�OmÐ�Mh\]_�Ð7^*OmG*¹j_hX�OÃXE@�B7b7\]OQ_%fmG�bEOy\�VQ@�ÅE\POÃ@�B�ACf¯@/D*OÃ_]GafmG.^*OÃACBÝ_hX�Om¹�G�VQ@*J�´7JW@�B�O*;¯»UXEO¯\]ORBE\]O¯G*¹9fmG*_PAcGTB¹�G*M9_hX�O�¶*OQI�\UX7@*\9[�OQORBÄ\]OQ_H\PGg_hX7@/_9_hX�O=E[è ñ ±�G9fmG.^*Oy\HACBÄ_hX�O�G�[T^�AcGTÅE\jSj@yI*;¦»UX�O�b7AW\P´7JW@RI*OybÎVyÅ7f¤ÅEJW@/_PAc^*O�_]G*_P@*JW\¹�G*M�Oy@*VvX3f¯G�b7O>MPOQ¹�OQM,_]GÎ_hX�OÃf¯G*_PAcGTB1G*¹�_hXEO�á:G � G æ ¤ü¬®3PG³;¯»�XEAW\QF$V³GTÅE´7JcOyb¡SUAc_hX1_hX�Om^/@/MhAcOQ_�IÝG*¹�b�A�ÑsOQMPORBT_�x�XE@�B7b5íV³GTBT^*ORB�_PAcGTBE\�G*¹�@*\]_]MPGTB�GTfÃAWVQ@*J$V³G�G*Mhb7ACBE@/_]O%\PI�\]_]ORfÃ\QFEMPOyÇ�ÅEAcMPOy\9_hXEO,\PAcDTBdV³GTBT^*ORB�_PAcGTB7\�\hÅ�fÃf¯@/MvAW\]Oyb([sOyJcG.S,Ø| � ÖgÐ �Àk f¯G�bEO*;

��° ×0fÃ@/D*O>fmG.^*Oy\HJcOQ¹È_UGTBÎ_hX�O,\]¶�Isç��H@/ÖyACf¤Å�_hXËb7AW\P´�JW@yI*Oyb5ç� � ×0fÃ@/D*O>fmG.^*Oy\9MhAcDTXT_HGTBÎ_hX�O,\P¶�Isç&K�@/ÖyACf¤Å�_hXËb7AW\h´7JW@yI*Oyb5ç�²± ×0fÃ@/D*O%fmGR^*Oy\NÅE´ËGTBÎ_hXEO,\]¶�Isç��H@*Jc_PAc_hÅ7bEO%b7AW\P´�JW@yI*Oyb5ç�²³ ×0fÃ@/D*O%fmGR^*Oy\�bEGRSNBËGTBË_hX�O%\P¶�IsçK�@*Jc_PAc_hÅEbEO>b7AW\P´7JW@RI*Oyb5;

I æ

Page 86: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

| ��� Ó ² Ñ fmG�bEO*;

��° ×0fÃ@/D*O>fmG.^*Oy\9Oy@*\]_QçA�HMhAcDTX�_�@*\PV³ORBE\PAcGTBµb7AW\P´7JW@RI*Oyb5ç� � ×0fÃ@/D*O>fmG.^*Oy\9S�Oy\P_Qç5KNMhAcDTXT_H@*\PV³ORBE\hAcGTBdb7AW\P´�JW@yI*Oyb5ç�²± ×0fÃ@/D*O%fmGR^*Oy\NB�G*MP_hX�çK�bEOyVQJWACBE@/_PAcGTBdb�AW\P´7JW@yI*Oyb$ç�²³ ×0fÃ@/D*O%fmGR^*Oy\�\]GTÅ�_hX�ç��UbEOyVQJWACBE@/_PAcGTBab7AW\P´7JW@RI*Oyb5;| A � f¯G�bEO*;|»UX�ON\PAcDTBÄV³GTB�^*ORBT_PAcGTBdXE@*\¦[sOQORB(Å7\]OybÃ_]G¤[sO�V³GTBE\hAW\]_]ORB�_jSUAc_hX(_hXE@/_9ÅE\]Oyb(¹�G*M¦@*´sOQMP_hÅ�MhOy\NÁÜ\]OQ_

Å7´ÎSUAc_hXË_hX�O�÷�û®úeö#�gùSø�þ��Ã@�BEbÀ÷�ÿcøc÷�ý�û_�c÷®ýcøU`cý�÷¯V³GTfÃfÃ@�BEb7\³ÂP;��° ×0fÃ@/D*O>fmG.^*Oy\HJcOQ¹È_UGTBd»9ágç�� ¢ b�AW\P´7JW@yI*Oyb$ç� � ×0fÃ@/D*O>fmG.^*Oy\9MhAcDTXT_HGTBd»9ágçK ¢ b7AW\P´7JW@RI*Oyb5ç�²± ×0fÃ@/D*O%fmGR^*Oy\NÅE´ËGTBd»Há>ç�� Ä b7AW\P´�JW@yI*Oyb5ç�²³ ×0fÃ@/D*O%fmGR^*Oy\�bEGRSNBËGTBλ9ágç&K Ä b7AW\P´7JW@RI*Oyb5;| ? ÝMÝ Ø ² ÐÒf¯G�b7O*;|<N\H¹�G*M A � ;| ��� ? ÝMÝ fmG�bEO*;�<�\U¹ÈG*M A � ;| Ý ?�ÑzÏYØ¡fmG�bEO*;��° �HÞEG�VyÅE\Qç� � K�ÞEG�VyÅE\Q;| � ?¤Ð � Ð@? � f¯G�bEO*;

��° ��Ú�¶�IÄ´sG�\PAc_PAcGTBÎ@�BED�JcO*ç� � K,Ú�¶�IÄ´sG�\PAc_PAcGTBÎ@�BED�JcO*;

×�¹5_hX�O�ACfÃ@/D*ON@*´7´sOy@/Mh\_]G¤f¯GR^*O�ACBÃ@>b7AcMPOyV³_PAcGTB(G�´7´sG�\PAc_]ON_]G>_hX7@/_O³ÏE´�OyV³_]Oyb$F�VYX�OyVP¶(_hXE@/__hXEON»9á"\hVQ@�BÃ\]S�Ac_PVvX�Oy\@/MPO%ACBÎ_hX�OyAcMUV³G*MPMPOyV³_N´sG�\PAc_PAcGTBE\9¹�G*MH_hX�O,G�´7_PAWVQ@*J!V³GTB�Ð7DTÅEMh@/_PAcGTBdACBdÅ7\]O*;

� 7�ê F ��Æ�$#,���·��� ]��E�Ý#0���!� ����Ì�.-��R�*�� ���!� � > �*7�×]BµG*MvbEOQM�_]GË@*JWJcG.SïOy@*\]I1V³GTB�_]MPG�J|G*¹_]OyJcOy\PV³G�´sO¯@�BEbÝACB�_]MvÅ�fmORBT_P\N[�Iµ@Ë\PACB�D�JcO¯ÅE\POQMyF�_hX�O¤X7@�BEb7\]OQ_NSUAWJWJ|[sO¤fÃ@*bEO@y^/@*AWJW@*[7JcO�@*\Ã@3SUACBEbEG.SÍGTB¸_hX�O1ÅE\POQM]Õ�ACB�_]OQMh¹�@*V³O1á�@�Ï7Ú�_P@/_PAcGTB�;"<j_Ä´7MPOy\]ORBT_QF¦_hX7AW\ÃVQ@�B'GTBEJcI¸[sOdbEGTB�Oµ¹�MPGTf @´EMPG*D*Mv@�fÃfmOQMRí=\U@*VQV³GTÅ7BT_,GTBa_hX�Om» e ÚsF�[�Å�_N_hX�O¤MPOy\P´sGTBE\PO>G*¹�_hX�Om\]I�\P_]ORf _]GÎ_hX�O¯XE@�BEb7\]OQ_N¶*OQI�\�AW\�\hÅ�ÕÃVQAcORBT_PJcIMh@*´7AWbd_hXE@/_UAc_HSUAWJWJ5V³OQMh_P@*ACBEJcId[sONS¦G*MP_hXTS�XEAWJcO,_]GÄf¯@/¶*O,_hXEAW\H¹ÜÅ7B7V³_PAcGTBÎ@y^/@*AWJW@*[7JcOg¹ÈMPGTf _hX�O,\]_P@�BEb7@/Mvbd\]I�\]_]ORfÎ;

I è

Page 87: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO>Ô*Ô�Ø�»UX�O�_]OyJcOy\PV³G�´sO%ACB�¹�G*MvfÃ@/_PAcGTBÎb7AW\P´7JW@RI*;»UXEAW\9AW\H_hX�O,Ð7Mh\P_¦G*¹L_hX�O,b7AW\h´7JW@yIÎ\PV³MPOQORB7\H@�BEbÎAW\9_hX�O>bEOQ¹�@�Å7Jc_GTBÎ\]_P@/Mh_hÅE´5;

� ì ýL/ ì*Ê À � ±°+p�=Ë°)B4;�7:9 Í � 7���5�»UX�O,b�AW\P´7JW@yIÎXE@*\UÐ7^*O,\PV³MPOQORBE\yF�@/MPMh@�B�D*Oybµ@*\H¹�G�JWJcGRSU\QØ| Ú�GTÅ�MhV³O,@�BEbÎ_]OyJcOy\hV³G�´�OgACB�¹�G*Mvf¯@/_PAcGTB¡ÁÜ@*´�´�Oy@/Mv\9GTBÎ\]_P@/MP_hÅ7´�ÂPç| n BEV³G�bEOQMU@�BEbÎ_]Mv@�BE\Pb�ÅEV³OQM9MhOy@*b7ACB�D�\Qç| ?)ACf¯Ac_QF7V³GTfô�Å�_]OQM�f¯G�bEO�@�BEbËORf¯OQMPD*ORBEV³IË\]_]G�´µACB7b7AWVQ@/_]G*Mh\Qç| <NJW@/MvfÍACBEb7AWVQ@/_]G*Mh\Qç| `a@�B�ÅE@*J�G.^*OQMPMhAWbEOy\QFLbEGTfmO¯@�B7b3f¯AcMPMhG*M�V³G.^*OQMg\P_P@/_hÅE\QF)@*VQV³Oy\h\>´7@/Mh¶1ACBT_]OQMhJcG�VP¶�\>@�BEbݹ�G�VQ@*J\]_P@/_PAcGTB3ACB�¹ÈG*MPÕ

fÃ@/_PAcGTB�;»UXEOdÐ7Mh\]_¯\hV³MPOQORB¸AW\(ACB�_]ORBEb7Oyb¸¹�G*MÄB�G*MvfÃ@*JjG�´sOQMh@/_PAcGTB�Fj_hX�OdMPOy\P_¯¹ÈG*M(¹�@�Å7Jc_0Õ�Ð�BEb7ACB�DE; »UX�OaÅ7\]OQM]Õ�ACBT_]OQMP¹�@*V³O

V³GTfÃfÃ@�BEbP�®û�õ�÷aÁ�òWF��SF!Â>AW\HÅE\]OybÄ_]G¯V³I�VQJcO,_hX�MPGTÅEDTXÃ_hXEORfÎ;�»UX�O�¹�G�JWJcGRSUACB�D(\hÅE[�Õ�\]OyV³_PAcGTB7\9bEOy\PV³MhAW[sO�_hX�O�V³GTB�_]ORBT_P\G*¹|_hX�O,´7@/D*Oy\�ACBdfmG*MPO,b7OQ_P@*AWJÜ;

;�7[6 +L� > �T��º�5 ]â�*�����/���$�9Æ�� #0�$�T� �s�*���! »UX�O,JW@RI*GTÅ�_UG*¹|_hXEAW\yFE_hX�O%bEOQ¹Ü@�ÅEJc_H\PV³MPOQORB5F�AW\H\hX�G.S�BÎACBÎÞ|AcDTÅ�MhO>Ô*Ô�;×�_P\HV³GTBT_]ORB�_P\N@/MPO%@*\U¹ÈG�JWJcG.SU\QØ| »UACfmO*;

� ã�@/_]O� ìN»�´ ì�BEAc^*OQMh\h@*J5_PACfmOÃÁÜìN» e ¹�MPGTf _hXEO�_PACfmO,\]OQMP^�AWV³O*;� ÚE»�´ ?$G�VQ@*J$@*´7´�@/MPORB�_H\hAWbEOQMPOy@*J5_PACf¯O*;

I é

Page 88: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

� `YÚ�ã4´Ê`µG�b7AcÐ7Oyb�Ú�ÅEJWAW@�BÎb7@/_]O(Á�E�F�GHFZÚ�ÅEJWAW@�BÎb7@/_]O¤�àÔ�Ó l*l*l*l*l ;�æ�ÂPF$ACBÎb7@yI�\Q;| ×]BE´�ÅE_jb�@/_P@m¹ÈG*MU_hX�O%VyÅ�MPMhORB�_H\]GTÅEMhV³O*;� ÙN@�fmO*;� :�AcDTX�_N@*\PV³ORBE\PAcGTB5;� ãNOyVQJWACBE@/_PAcGTB5;� n Ç�Å7ACB�GyÏ,´Ê`µOy@�Bd´EMPO³Õ�×0<9ì�é/èµÁ i ÂPF�´sG�\]_0Õ�×0<9ì�é/èµÁ!Ú�ÂG*MN@*´7´7@/MPORBT_Q;� ã�A�Ñ�OQMPORBT_PAW@*J!_]Mh@*Vh¶�ACBEDÃMh@/_]Oy\gÁÜ[7JW@�B�¶ËAc¹|B�G*_�\P´sOyVQAcÐ7Oyb�ÂP;� ²MPG�´sOQM�fmG*_PAcGTB7\9@�BEbÎOy´sG�VYX¡ÁÜ[7JW@�B�¶ÎAc¹�B�G*_U\P´sOyVQAcÐ7Oyb5ÂP;� ²|@/Mh@*JWJW@�ϵ@�B7bÎMh@*b7AW@*J5^*OyJcG�VQAc_�I·ÁÜ[7JW@�B�¶ËAc¹�BEG*_H\P´sOyVQAcÐ7Oyb�ÂP;| <N´sOQMP_hÅ�MPOy\U@�BEbËG/Ñ�\POQ_P\Q;

� ²LG�\PAc_PAcGTB7@*J�G/Ñ5\]OQ_jVyÅ�MPMPORBT_PJcI¯ORBE@*[�JcOyb1ÁÜ[7JW@�BE¶¯Ac¹5ÖQOQMPG�ÂP;�×�¹5_hXEO&�Pô�öeùWø5ùJôJÿ¤V³GTfÃfÃ@�BEbmSj@*\¦ÅE\POyb5FT_hX�ORB_hXEOUG/Ñ5\]OQ_jB�Å7fg[sOQM�Á å î å l Â�AW\D�Ac^*ORBÄACBÃ_hX�OUÐ7Mv\]_�Ð7OyJWbÝÁ�_hXEAW\¦AW\�JcOQ¹�_�[7JW@�BE¶¯Ac¹5_hX�OVôxõ�õQö®÷®ø¤V³GTfÃfÃ@�BEbSj@*\ÃÅE\POyb·ACB7\]_]Oy@*b�ÂP;º»�X�OÄ\POyV³GTBEbÆ_�S¦G�Ð7OyJWb7\gD�Ac^*Od_hX�OËG/Ñ5\]OQ_¯V³GTf¯´sGTB�ORBT_P\¤ACBº_hX�Od:U<�@�B7bÌã�OyVb�AcMPOyV³_PAcGTBE\QF�ACBd@/MhVQ\]OyV/;

� <N´sOQMP_hÅ�MPOËG/Ñ5\]OQ_¯VyÅ�MPMhORB�_PJcIºORBE@*[7JcOyb"ÁÜ[7JW@�B�¶ÆAc¹UÖQOQMhG�ÂP;·×�¹H_hX�O½û��c÷®ýcø�`�ý�÷�V³GTfÃfÃfÃ@�BEb¡Sj@*\¯ÅE\]Oyb$F_hXEORB¯_hX�ONÐ7Mh\P_�Ð7OyJWb(D�Ac^*Oy\j_hX�ON@*´sOQMP_hÅEMPO�B�Å7fg[�OQMNÁ å î å l ÂPç7Ac¹�c÷�û�úQö��5ùSøPþ��gS¦@*\jÅE\]OybÄACBE\]_]Oy@*b$F�_hX�ORB_hXEOgÐ�OyJWbaAW\�JcOQ¹�_�[7JW@�B�¶s;N»UXEO¤B�O³Ï�_N_�S¦GÎÐ7OyJWb7\ND�Ac^*O¤_hX�O ¢Æ @�BEb ÄJÆ V³GTf¯´sGTB�ORBT_P\UG*¹�_hX�OgG/Ñ�\]OQ_QF$ACB@/MvVQ\]OyV/;

� :UOQ¹ÈOQMhORBEV³O%´sG�\PAc_PAcGTB3ÁÜ@*JWAW@*\N@*´sOQMP_hÅ�MPO l ¦G/Ñ�\]OQ_U¹ÈMPGTf _hX�O�MPG*_P@/_]G*M�V³ORB�_]MPO>ACB ¢Æ @�BEb ÄJÆ ÁÜ@/MvVQ\]OyV�ÂP;| »)OyJcOy\PV³G�´sO>\P_P@/_]O*;�»UX�O,´sG�\P\hAW[7JcO%fmOy\P\h@/D*Oy\H@/MPO*Ø

� n Ù�KÒ`1Z�ã n Ø)Á�_hX�O%\PI�\]_]ORf�AW\UACBËORB�D�ACBEOQOQMhACB�D(f¯G�bEO*;� ÚE»�Z�²² n ãgØE_hX�O�_]OyJcOy\PV³G�´sOgbEMhAc^*Oy\U@/MhO,\]_]G�´7´sOyb5;� `ÝZHá�×0Ù�K¤Ø�_hX�O�_]OyJcOy\PV³G�´sOgAW\UACBdf¯G*_PAcGTB�F7[�Å�_UXE@*\�B�G*_HI*OQ_HMPOy@*VYX�OybµAc_P\UMPOyÇ�ÅEAcMPOybδsG�\PAc_PAcGTB�;� »U:U< e Û�×0Ù�KgØE_hX�O�_]OyJcOy\PV³G�´sO%AW\9S�Ac_hXEACB å @/MhVQ\]OyV³GTBEbdG*¹LAc_P\Hb7ORf¯@�BEbEOybË´sG�\PAc_PAcGTBÎb�Å�MhACB�D¤@m\PAWbEOQMPOy@*J_]Mv@*VP¶s;

� »HáßK�ì�×0ã n Ø�@�Å�_]G*DTÅ7AWb7ACB�D¯GTBÎ\hAcDTBE@*JW\U´EMhGR^�AWbEOybd[�I(_hX�O>»9á \PI�\]_]ORfd;� < { K�ì�×�ã n Ø�@�Å�_]G*DTÅEAWb�ACB�D¯GTBÎ\PAcDTB7@*JW\U´EMPG.^�AWb7Oybd[TIË_hX�O eUe ãâ@�Å�_]G*DTÅEAWbEOQMy;� Ú { ¾ ?$×]` Á�Å�@*\hXEACBED�ÂPØ9_hX�Ogb7ORf¯@�BEbEOybµ´�G�\hAc_PAcGTBaAW\NACBE@*VQV³Oy\P\hAW[7JcO*;�»UXEAW\HS�AWJWJ!G�VQVyÅ�MNS�X�ORBµ_hX�O%_]OyJcO³Õ\hV³G�´�OÃ_]Mh@*VP¶�\>ACBT_]Ga@µ\]G*¹È_�S¦@/MhO(JWACf¯Ac_%G*MyF!GTB3\]GTÅ�MhV³OÃVYXE@�B�D*O*FLS�X�ORBÝ_hXEO(B�OQSïG�[�É0OyV³_>AW\>[sOyJcGRSÒ_hXEOXEG*MhAcÖQGTB�;

»�X�Oy\]O%fmOy\h\P@/D*Oy\HO³ÏEVQJCÅEbEO,_hXEO,ACBE\]_]MvÅ7f¯ORB�_jMPG*_P@/_]G*MNS�XEAWVYXÎAW\9_]MPOy@/_]Oyba\]Oy´7@/Mh@/_]OyJcId[sOyJcG.S,;| »)OyJcOy\PV³G�´sO>´sG�\PAc_PAcGTB5;

� :�AcDTX�_|@*\PV³ORBE\hAcGTB%G*M�X�GTÅ�M|@�B�D�JcOj@�BEb%b7OyVQJWACBE@/_PAcGTBÎÁÜb7AW\P´7JW@RI*OybgGTBEJcI�S�X�ORB%_hX�O_]OyJcOy\hV³G�´�O9AW\)_]Mh@*VP¶�ACB�D�ÂP;»�XEAW\�AW\jACB(_hX�O�V³G�G*Mvb7ACBE@/_]O�\]I�\]_]ORf \]OQ_¦[�I¯_hX�O& gù�ö��U��û_ö¤V³GTf(f¯@�BEb(@�BEbÄACBEb7AWVQ@/_]OybÎ[�Im_hX�O�OyÇ�ÅEACB�GRÏÐ�OyJWb3ÁÜ\]OQO>[sOyJcG.S�ÂP;

� n Ç�Å7ACB�GyÏ3ÁêÅE\hÅ7@*J5V³GTB�^*ORBT_PAcGTBE\³ÂP;� »)G�´sG�V³ORBT_]MhAWV>@/ÖyACfgÅE_hX¡ÁÜ<,¦@�BEbËOyJcOQ^�@/_PAcGTBÆÁ n ÂP;� ²LG�\PAc_PAcGTBÄOQMhMPG*Mh\¦ACBÃ@/ÖyACf¤Å�_hX(@�BEb(OyJcOQ^�@/_PAcGTB�;�ÙUG*_]O�_hXE@/_¦_hX�O�´�G�ACBT_PACB�D>OQMPMPG*MjACBÃ@/ÖyACf¤Å�_hXi¬Jà�á�âPG 毭�çAW\�£m<NV³G�\ n F�\PG¯@mMPOyJW@/_PAc^*OyJcIµJW@/MPD*O~£m<ßf¯@yIË[sO�_]G�JcOQMh@/_]Oyba@/_NXEAcDTXÎOyJcOQ^/@/_PAcGTB�;

Ù�G*_]OË_hXE@/_g_hX�O(V³G�G*Mhb7ACBE@/_]OË\]I�\]_]ORfäf¯@RI¡[�O(VvXE@�B�D*OybÌÅE\hACB�Dµ_hX�OO 5ùJö��U��ûUö�V³GTf(f¯@�BEb5;λUXEO(@y^/@*AWJW@*[7JcO gùJö��_�®û_öÃG�´7_PAcGTBE\H@/MPO*ØIJI

Page 89: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

� ùSÿ���`�ø3ÁÜbEOQ¹Ü@�ÅEJc_³Â/´ _hX�OmV³G�G*Mhb7ACBE@/_]O¤\]I�\]_]ORf ÅE\]Oyba_]GËACB7´�Å�_U_hXEOg\]GTÅEMhV³Ogb�@/_P@�;�<�BTIµ\P´7@*V³OmfmG*_PAcGTBE\X7@y^*O>[sOQORBËMhORfmGR^*Oyb$F�\]G¯_hX�O>´�G�\hAc_PAcGTBËMPOQ¹�OQMh\H_]G¯_hXEO%¤�¹�ïºï�GHàQájOy´sG�VYX�;�×�¹L´EMhG�´�OQMNfmG*_PAcGTBE\QF7´�@/Mh@*JWJW@�ÏG*MNMh@*b7AW@*J)^*OyJcG�VQAc_�IÝ@/MPO>\P´sOyVQAcÐ7Oyb$F�_hX�ORBµ_hX�O>´sG�\PAc_PAcGTBaSUAWJWJ)b7A�Ñ�OQM�¹�MPGTfÍ_hX�O>ACBE´�Å�_U´sG�\PAc_PAcGTBµOQ^*ORBaACB_hXEO%@*[7\]ORBEV³O%G*¹)G/Ñ5\]OQ_P\Q;

� ûúbH � Ib´Ê@y^/@*AWJW@*[7JcO%¹�G*MU´EMPO³Õ�×0<9ì�é/è¯fmOy@�BÎACB7´�Å�_9V³G�G*Mvb7ACBE@/_]Oy\HGTB7JcI*; e Å�MhMPORB�_jOy´sG�VvX�;� ~ � I,IIb´Ê@y^/@*AWJW@*[7JcO%¹�G*MU@�BTIËf¯Oy@�BÎACBE´�Å�_9V³G�G*Mhb7ACBE@/_]Oy\y; e Å�MhMPORB�_jOy´sG�VvX�;� û��_�®ûcýc÷�ÿcø�´ D*OQG�V³ORBT_]MhAWV,@*´7´7@/MhORB�_HV³G�G*Mhb7ACBE@/_]Oy\UG*¹|_hX�O,VyÅ�MPMPORBT_Hb7@/_]O*;¦<�JcSj@yI�\U@R^�@*AWJW@*[7JcO*;� �cû øPô���ô<´ _]G�´sG�V³ORB�_]MhAWV,XEGTÅ�MU@�B�D�JcO%@�B7bdbEOyVQJWACBE@/_PAcGTB�;¦<�JcSj@yI�\N@y^/@*AWJW@*[7JcO*;| »Há { @�ÅE_]G*DTÅEAWbEOQM�V³G�G*Mhb7ACB7@/_]Oy\� ×�¹�_hX�Og_]OyJcOy\PV³G�´sOgAW\�[sOyACB�DÃ@�ÅE_]G*DTÅEAWbEOyb�ÅE\PACB�DÄ@û9áïVQ@�f¯OQMh@(G*M eHe ãï@�Å�_]G*DTÅEAWbEOQMRF�_hX�ORBµ_hX�O¤´7A�Ï�OyJV³G�G*Mhb7ACB7@/_]Oy\HG*¹|_hX�O�MPOyÇ�Å�Oy\]_]Oyba´�G�\hAc_PAcGTBËG*¹|_hX�O�DTÅEAWbEO%\P_P@/MU@/MPO%b7AW\h´7JW@yI*Oyb5;| ?)ACf¯Ac_HACB�¹�G*MvfÃ@/_PAcGTB

� n JcOQ^�@/_PAcGTB'JWACf¯Ac_¤ACB�¹�G*Mvf¯@/_PAcGTBÊÁ�_hXEAW\mMhOQ¹ÈOQMh\g_]G�_hX�O æ ¬ .ºá9­ ñ ï�GÃJWACf¯Ac_gG*¹ å l � ÂP;3×�¹�_hX�OËG�[�É�OyV³_¯AW\¤VQAcM]ÕVyÅ�f¯´sG�JW@/MyF�_hXEO¤f¯Oy\P\P@/D*O¤b7AW\P´7JW@RI*Oyb1AW\Ëð]Ù�G n J!JWACfÃAc_Pñ�;�×�¹�Ac_�AW\�VyÅEMPMPORBT_PJcId^�AW\hAW[7JcOg@*[sG.^*Og_hXEOgJWACfÃAc_QF[�Å�_USUAWJWJ)OQ^*ORBT_hÅE@*JWJcIa\]OQ_QF�_hX�OmfmOy\h\P@/D*O1ðhÚ�OQ_P\NACB7ñ�F�_]G*D*OQ_hX�OQM�S�Ac_hXd_hX�O¤\PAWbEOQMhOy@*J!_PACf¯O%MPORfÃ@*ACBEACB�D(AW\\vX�GRS�B5;L×�¹5_hX�O�G�[�É�OyV³_9XE@*\¦\]OQ_QF�_hX�ONf¯Oy\P\P@/D*O�AW\>ð]:�AW\]Oy\�ACB7ñ�F�¹�G�JWJcGRS¦OybË[TIm_hXEO�\PAWbEOQMhOy@*J�_PACf¯O�ACBT_]OQMP^�@*JÅ�B�_PAWJ�Ac_�[sOyV³GTfmOy\N^�AW\PAW[7JcO¯@/D�@*ACB�;gÞLACB7@*JWJcI*F!¹�G*M�G�[�É�OyV³_P\�SNXEAWVvXÝ@/MPO¤_]G�Gι�@/M>Ú�GTÅ�_hXaOQ^*OQM,_]GÎ[�Om\]OQORB[�IË_hX�O�¾Ê¿�»�F�_hX�O%fmOy\P\h@/D*O%AW\¯ð]Ù�OQ^*OQM�MhAW\POy\Pñ�;µx

� Z�_hX�OQM_]OyJcOy\PV³G�´sONJWACf¯Ac_P\Q;�»UX�OQMhOU@/MPOH_�S�G>G*¹5_hX�Oy\]O*FTSNXEAWVvXÃVQ@�B7B�G*_[sG*_hXmG�VQVyÅ�M�¹�G*M_hXEOU\P@�fmOUG�[�É�OyV³_Q;»�X�O9Ð7Mh\]_�AW\�_hX�O9ÖQORBEAc_hX¯[�JWACBEbm\P´sG*_QFTS�X7AWVvXm@�Ñ�OyV³_P\�G�[�É0OyV³_P\�S�Ac_hXmãNOyVQJWACBE@/_PAcGTBE\j[sOQ_�S¦OQORBÃÔ I � æ*æ � @�B7bÔ I � ò é � ;�×�¹!_hX�O�G�[�É�OyV³_9S�AWJWJ�_]Mv@*VP¶ËACB�_]Gm_hX�O�[7JWACB7bÄ\h´�G*_QF�_hX�O,f¯Oy\P\P@/D*OÎð i JWACBEbÎ\P´sG*_¦ACB7ñ�FE¹ÈG�JWJcG.S�Oybd[�I_hXEO>\PAWbEOQMhOy@*J5_PACfmO,MhORf¯@*ACBEACB�DEF�AW\Ub7AW\P´�JW@yI*Oyb5;j»UX�O,\]OyV³GTB7baAW\U_hX�O%´sG�\PAc_PAc^*O>@/ÖyACf¤Å�_hXµ\]G*¹�_�Sj@/MPO>JWACfÃAc_G*¹ k æ*æ � ;�»UXEAW\�AW\NMh@/MPOyJcIaORBEV³GTÅ7BT_]OQMPOyb5F$\PACBEV³O¤Ac_�@�ÑsOyV³_P\,GTBEJcIµG�[�É0OyV³_P\�SUAc_hX1ãNOyVQJWACBE@/_PAcGTBE\,[sOQ_�S�OQORBé l�� è*è � @�BEb I æ � è*Ô � _]Mh@*VP¶*Oyb3[�OyJcG.Sà_hXEOg²LG�JcO*;�»UX�O¤fmOy\P\P@/D*O¤AW\Ëð]<UÖ¤JWACf¯Ac_�ACBEñ�F�@/D�@*ACB1¹ÈG�JWJcG.S�Oyb�[�I_hXEO%\PAWbEOQMPOy@*J$_PACfmO,ACBT_]OQMP^�@*JÜ;¦»UX�O�Ð7OyJWbµAW\HJcOQ¹È_�[7JW@�B�¶ËAc¹�BEOyAc_hX�OQMUJWACf¯Ac_HAW\HMPOyJcOQ^�@�BT_Q;

� :UG*_P@/_]G*M�JWACf¯Ac_P\Q;|»UXEAW\$@*´�´7JWAcOy\!_]G�_hX�O e @*\P\]OQD*Mh@*ACB>@�BEb%²MhACfmO�MhG*_P@/_]G*Mh\!GTB7JcIÃÁ�_hX�O�ÙN@*\hf>I�_hX,MPG*_P@/_]G*Mh\@/MhO�@*JWJcG.S�Oybd_]GgD*G¤MPGTÅ�BEbÃV³GTBT_PACB�ÅEGTÅE\PJcI�ÂP;�»UX�O e @*\P\]OQD*Mv@*ACBË\]G*¹È_�S¦@/MhO%fmGTÅ7BT_�´sG�\PAc_PAcGTBÄ@�B�D�JcO�JWACf¯Ac_P\@/MhO X Ô*æ l � ç�_hX�G�\]O>¹ÈG*M�²�MhACf¯O,@/MPO�� I æ � @�BEb1Ô�é k � ;j¾ÊXEAWVYXÆÁÜAc¹�@�B�I�Â�MPG*_P@/_]G*M�JWACfÃAc_UVQ@�Bµ[sO>X7Ac_�AW\N@V³GTfô7JWAWVQ@/_]OybݹêÅ7BEV³_PAcGTBaG*¹�X�GTÅ�M�@�B�D�JcO*F$ãNOyVQJWACBE@/_PAcGTB�@�B7b1\P_P@/MP_PACB�DË´�G�\hAc_PAcGTBÝ@�B�D�JcO*;�»UX�OmfmOy\P\P@/D*Oy\@/MhO¯ðÌK�:HG*_P@/_]G*MJWACfÃAc_�ACBEñ�F!ðu�H:UG*_P@/_]G*M�JWACf¯Ac_�ACBEñ�@�BEbÝð]Ù�G�MPG*_P@/_]G*M�JWACfÃAc_Pñ�F*¹ÈG�JWJcG.S�Oyb([TI>_hX�O9\PAWbEOQMPOy@*J_PACf¯O,ACB�_]OQMh^�@*J)ACBË_hX�O,Ð7Mv\]_j_�S¦G(VQ@*\]Oy\Q;jÚ�OQOgÚ�OyV³_PAcGTBaæ�;�Ôm¹�G*MU@m¹êÅEJWJcOQMUb7AW\PVyÅ7\P\PAcGTBËG*¹|JWACf¯Ac_H´EMhG�[7JcORf¯\Q;| »|Å�MvBT_P@*[7JcO%ACBE¹ÈG*MvfÃ@/_PAcGTB�;

� »�X�O>fmOy\h\P@/D*OgÚ�»�Z�²² n ãgF�`1ZHá�×0Ù�KgF�»H:�< e Û�×0Ù�KßG*M�Ú { ¾ ?!×0`½AW\Nb7AW\P´7JW@RI*Oyb5F�SUAc_hXÎ_hX�O>\P@�f¯Of¯Oy@�BEACB�D�\�@*\¹�G*M_hX�O�_]OyJcOy\PV³G�´sO*F�O³Ï�V³Oy´E_¦_hXE@/_�_hX�O�\]G*¹�_�Sj@/MPO�JWACf¯Ac_VQ@�BÃGTBEJcI¯[sOHORBEV³GTÅ�B�_]OQMPOybÄb�Å�MvACB�D_]Mv@*VP¶�ACB�DEF�B�OQ^*OQMÄGTB¸\]GTÅEMhV³OµVvX7@�B�D*O1@�B7b¸_hX�Oaf¯Oy@�BEACB�D¡G*¹�»H:�< e Û�×0Ù�K AW\Ã_hX7@/_Ã_hX�OdMhG*_P@/_]G*MËAW\S�Ac_hXEACB k/l @/MhVQ\]OyVHG*¹5Ac_P\¦bEORf¯@�B7bm´�G�\hAc_PAcGTBµÁ�OyÇ�ÅEAc^�@*JcORBT_¦_]G l ; å @/MvVQ\]OyVUACBô�G�\hAc_PAcGTB¯@/__hXEO�f¯@�ÏEACf¤Å7fÐ�OyJWbÎMh@*b7ACÅE\QÂP;

� »�X�O>¹�G�VQ@*JL\P_P@/_PAcGTBÝVyÅ�MPMPORBT_PJcIa\]OyJcOyV³_]Oyb$;%»UXEAW\�fmOy@�BE\�_hXE@/_�_hX�O¤\]G*¹�_�Sj@/MPOÃXE@*\�[sOQORBaV³GTBEÐ7DTÅ�MPOyba¹ÈG*M_hX7@/_9¹ÈG�VQ@*J�\]_P@/_PAcGTBÎ@�BEbÄ_hXE@/_j_hX�O�@*´7´EMhG�´EMhAW@/_]O�_hÅ�MvBT_P@*[7JcO�SUAWJWJ�[sONbEMvAc^*ORB�;�×�_9bEG�Oy\Và(¬Já�MPOQ¹�OQM¦_]Gm_hXEO´sG�\PAc_PAcGTB1G*¹_hX�OmÙ�@*\hf>I�_hX¥Å�@/_Q;,»UX�OgG�´E_PAcGTBE\�@/MPO e <�Ú7Ú n K�:U<�×�Ù ÁÜbEOQ¹�@�Å7Jc_³ÂPF)K�¿�:U×�?Ì@�B7b1ì n Ú�F_hXEO(JW@/_]_]OQM¤_�S¦G1@*JW\PG1ACBEb�AWVQ@/_PACB�D1ã n :9Z�»)<�»�Z�:ÛSNX�ORB�_hX�O(_hÅ�MvBT_P@*[7JcO(AW\%_]G1[sOÃb7MhAc^*ORB3@/_g@dMh@/_]O@*´�´EMPG�´EMhAW@/_]O%¹ÈG*MH_hXEO,bEOQMPG*_P@/_PAcGTBµG�´E_PAWVQ\HMh@/_hXEOQMH_hXE@�Bd@mb�AcMPOyV³_PJcITÕ�f¯GTÅ7BT_]OybµACBE\]_]MYÅ7fmORBT_Q;

� ãNORfÃ@�BEb�\]¶�I1´sG�\PAc_PAcGTB�@�BED�JcOaÁÜ@*\,ACBE´�ÅE_�Å7\PACB�D½ýQôJøcû�øQôxý ö�a_öa@�BEb¡f¯G�b7AcÐ�Oyb1\vÅE[7\]OyÇ�Å�ORBT_PJcI1ÅE\PACBED_hXEO>XE@�BEb7\POQ_Q; i JW@�BE¶ËAc¹L_hX�O,MhG*_P@/_]G*M�AW\�BEG*_9_]Mh@*VP¶�ACB�D1Á°GWF ±®Fݹ�G*MU@=ýQôJøcû�øQôxý�úeô�`cÿcø(V³GTf(f¯@�BEb�ÂP;

� `µGTÅ7BT_U´sG�\PAc_PAcGTBd@�BED�JcO*;

I*ò

Page 90: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO%Ô k ئ»UX�O�ORBEV³G�bEOQMUb7AW\h´7JW@yIÎ\PV³MPOQORB5;

� `µGTÅ7BT_¯OQMPMPG*MRFVE�F�GHF _hX�OÎOQMPMhG*M(ACB¸f¯GTÅ7B�_¯´sG�\PAc_PAcGTB¸@�B�D�JcO·Á�GTBEJcIÌb7AW\h´7JW@yI*Oyb S�X�ORB·_hX�OµMPG*_P@/_]G*MÄAW\_]Mv@*VP¶�ACB�D�ÂP;µÙ�G*_]O(_hXE@/_g@�B�OQMPMhG*M%G*¹ å @/MvVQ\]OyV³GTBEb·V³G*MPMPOy\P´sGTBEb7\,_]Ga@µb�AW\P´7JW@*V³ORfmORBT_%GTB¡_hX�O(\P¶�IÝG*¹l ; l*l�k @/MhVQ\]OyV³GTB7b7\H@/_�@¤_�I�´�AWVQ@*J)f¯@�ÏEACf¤Å7fÛÐ7OyJWbÎMh@*b�ACÅE\9G*¹ å l @/MhVyfÃACB�Å�_]Oy\y;

� ²|@/Mh@*JWJW@*V³_PAWV¤@�B�D�JcO*;| `aAW\PV³OyJWJW@�B�OQGTÅ7\Q;

� Þ7G�VyÅE\U´�G�\hAc_PAcGTB¡ÁêfÃfÎÂP;L»UX7AW\9AW\9@¤^�AcMP_hÅ7@*J�¹�G�VyÅE\9´sG�\PAc_PAcGTBËS�XEAWVYXË\hX�GTÅEJWbÎB�G*_Hb7Oy´�ORB7bÃGTBË_]ORfôsOQMh@�Õ_hÅEMPO*F�OyJcOQ^�@/_PAcGTBÝG*MN_hX�O¤´EMPOy\]ORB7V³O>G*¹�Ð�Jc_]OQMh\�ACBµ_hXEOg[sOy@�fÎ;U×�_�\hX�GTÅEJWb$FsACBa_hX�OQG*MPI*F�MPORfÃ@*ACBµV³GTB7\]_P@�B�_¹�G*MU@mD�Ac^*ORBµ¹�G�VQ@*J$\P_P@/_PAcGTB�;

� »�X�O�¹ÈG�VyÅE\9G/Ñ5\]OQ_QFs» e ÁêfÃfÎÂ�@*´�´7JWAcOybÎ_]GÃV³GTfô�ORB7\P@/_]O�¹ÈG*MUO³Ï�´7@�B7\PAcGTBËG*¹|_hX�O,\]_]MvÅ7V³_hÅ�MPO*;� »�X�OU¹�G�VyÅ7\�G/Ñ5\]OQ_QFEãNÞ ÁêfÃfÎÂ)ÅE\]Oyb¯_]G¤V³G*MPMPOyV³_¦¹�G*M¦@*b7b�Ac_PAcGTBE@*J�G�´7_PAWVQ@*J�OyJcORf¯ORB�_P\�Á°GHF�±xF7Ð�Jc_]OQMh\³Â|ACB¯_hXEO[sOy@�fd;

� ãNGTf¯OÃ@/ÖyACf¤Å�_hX�;Ë»UX�O¯JW@*[sOyJBÅ�@*\vX�Oy\,Ac¹j_hX�O(b7GTfmO¯AW\,GTÅE_,G*¹9´�G�\hAc_PAcGTB�;Ä»�XEAW\�SUAWJWJG�VQVyÅ�Mgb�Å�MhACBEDd@\hJcOQS�@�BEb5F7[EMvAcOuÅ7I*FEb�Å�MhACB�D¤_]Mh@*Vh¶�ACBEDE;×�¹!_hX�OTÅ�@*\vXEACB�DmAW\HV³GTBT_PACB�Å�GTÅ7\H@�BEbË_hX�O,bEGTf¯O�AW\UfmG*_HfmG.^�ACBED_]GÄ_hX�O¤V³G*MPMPOyV³_�@/ÖyACf¤Å�_hX�Fs_hX�ORBd_hXEOQMPO>AW\�JWAc¶*OyJcIµ_]GË[sO%@(¹�@�ÅEJc_�ACBµ_hX�O>bEGTf¯O%bEMhAc^*OÎÁêfmG�\P_�JWAc¶*OyJcIµ_hXEO» n `dÕ�?º\]I�\]_]ORfÎÂP;

� <NAcMNfÃ@*\P\,Á�MPOyJW@/_PAc^*Og_]G¯_hX�O�ÖQORBEAc_hX�ÂP;� <NJW@/Mvf�S¦@/MvB7ACB�DE;�»UXEAW\HACB7b7AWVQ@/_]Oy\H_hXE@/_UGTB�O,G*¹L_hX�O,G*_hX�OQMN\PV³MPOQORBE\H\vX�GRSU\U@�BÎ@*JW@/Mvf�V³GTB7b7Ac_PAcGTB�;

;�7[­ ; ����s]�7��]���.�¦���E-»UX�ON\]OyV³GTBEbÄ´7@/D*O�b7AW\P´7JW@RI�\¦_hX�O�ORBEV³G�b7OQM�MPOy@*b�ACB�D�\¦¹ÈG*Mj@*Jc_PAc_hÅEbEO*FE@/ÖyACf¤Å�_hX(@�BEb(@*JWJ�G*¹5_hX�O�ACBE\]_]MvÅ�fmORBT_�MPG*_P@/_]G*Mh\QF_]G*D*OQ_hX�OQMHS�Ac_hXÄMPOyJcOQ^�@�BT_Hb7AW\P´�JW@*V³ORfmORBT_¦_]Mv@�BE\Pb�ÅEV³OQMj^/@*JCÅ�Oy\Q;�×]BÄ@*b7b7Ac_PAcGTB�FE_hXEO�´sG�\PAc_PAcGTB7\jG*¹!_hX�O�bEGTf¯O*F�\vX�Å�_]_]OQMRFSUACBEb�\hXEAcOyJWb5F|´EMhACfÃ@/MPI¡f¯AcMPMPG*M>V³GR^*OQM¯@/MPOË\hX�G.S�B�;a»�X�OÃJW@yI*GTÅE_¯AW\>\hXEGRS�BºACB3Þ|AcDTÅ�MhOËÔ k ;1×0BºVQ@*\]OÄG*¹U´sG�ACB�_PACBED

ò l

Page 91: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

b7A�ÕÃVyÅ7Jc_PAcOy\QFEAc_¦AW\¦´7@/MP_PAWVyÅEJW@/MvJcI(ÅE\]OQ¹êÅEJE_]GmV³GTf¯´�@/MPOH_hX�O�@*[7\]G�JCÅ�_]O�@�BEbÝÁ�_P@*´sO�G*M¦D*Oy@/MQÂ�ACBEV³MPORfmORBT_P@*J�ORBEV³G�b7OQMh\GTB_hX�O%\h@�fmO�@�Ï�AW\y;�»UX�O�^/@*JCÅ�Oy\Ub�AW\P´7JW@yI*Oyba@/MPO%@*\9¹�G�JWJcGRS�\QØ| <�ÖyACf¤Å�_hX¡ÁêÅ7B7Ac_P\9@/MPO%bEOQD*MPOQOy\yØ�f¯ACB�Å�_]Oy\QØ=\]OyV³GTBEb�\³ÂP;»UX�O�ORBEV³G�bEOQMUV³GTfg[7ACB7@/_PAcGTBdÅE\]Oyb˹�G*MH_]Mh@*Vh¶�ACB�D(VQ@�Bd[sO

VYXE@�B�D*Oyb1ÅE\PACB�Dm_hX�Oz÷®ÿPþcô� P÷®ýÃ@�B7b½ý�ûcø�÷ÃV³GTfÃfÃ@�BEb7\Q;� <N[7\]G�JCÅE_]O(ÁÜ< o < i Ú�ÂP;� ×]BEV³MPORf¯ORB�_P@*J$D*Oy@/MgÁÜ< o K n <N:�ÂP;� ×]BEV³MPORf¯ORB�_P@*J$MPG�JWJcOQM>ÁÜ< o :HZ�?!?�Â/´ÊB�G*_HVyÅ�MhMPORB�_PJcIÎACBdÅ7\]O*;� ×]BEV³MPORf¯ORB�_P@*J5ACB7b�ÅEV³_PAc^*O,_P@*´sO�ORBEV³G�bEOQMy;»�X�OQMPO,@/MPO�Ó¯MhOy@*b7ACB�DÃX�Oy@*b7\>ÁÜ< o »L<N² n å î < o »L<N² n Ó�ÂP;| n JcOQ^�@/_PAcGTB·ÁêÅ7BEAc_P\U@/MPO%bEOQD*MPOQOy\yØ�f¯ACB�Å�_]Oy\QØ=\]OyV³GTBEb�\³ÂP;

� <N[7\]G�JCÅE_]O(Á n ?º< i Ú�ÂP;� ×]BEV³MPORf¯ORB�_P@*J$D*Oy@/MgÁ n ?ÆK n <N:�ÂP;� ×]BEV³MPORf¯ORB�_P@*J$MPG�JWJcOQM>Á n ?·:HZ�?!?�Â/´ÊB�G*_HVyÅ�MhMPORB�_PJcIÎACBdÅ7\]O*;| e @*\P\]OQD*Mh@*ACBdMPG*_P@/_]G*M¤ÁêÅ�BEAc_P\H@/MPO%b7OQD*MPOQOy\QØ�f¯ACB�Å�_]Oy\QØ=\POyV³GTBEb7\³ÂP;

� <N[7\]G�JCÅE_]O(Á e <â< i Ú�ÂP;� ×]BEV³MPORf¯ORB�_P@*J$D*Oy@/MgÁ e <à×�Ù e ÂP;| ²MhACfmO�¹�G�VyÅ7\9MPG*_P@/_]G*MmÁêÅ7BEAc_P\H@/MPO>bEOQD*MPOQOy\QØ�fÃACB�Å�_]Oy\yØ=\]OyV³GTBEb7\³ÂP;

� <N[7\]G�JCÅE_]O(ÁܲÞÌ< i Ú�ÂP;� ×]BEV³MPORf¯ORB�_P@*J$D*Oy@/MgÁܲÞÆ×0Ù e ÂP;| ÙN@*\hf>I�_hX ÁÜì n Ú { ãNMhAc^*Od\hAWbEO¶´ÊÅ7BEAc_P\g@/MPOËbEOQD*MPOQOy\QØ�fÃACB�ÅE_]Oy\QØ=\]OyV³GTBEb7\QÂP;1»UXEOQMPO(@/MPOÄ_�S¦G�b7AW\P´7JW@RI�\yF�S�XEAWVvX

@*´�´7JcI>_]G,ACB7\]_]MvÅ7f¯ORB�_P\�fmGTÅ�B�_]Oybmb7AcMhOyV³_PJcIgGTBg_hXEO9MPG*_P@/_]G*M�`P÷�ö�ýQôxø�ûcøPôxý%@�BEb¤_]G>\]_P@/_PAcGTBE@/MPImACBE\]_]MYÅ7fmORBT_P\JcG�G*¶�ACB�D%_hX�MhGTÅ�DTX¤_hX�ONbEOQMPG*_P@/_PAcGTBÃG�´E_PAWVQ\�`P÷Pö0 P÷�ýPôxø�ûcøQôJýsF/MPOy\P´sOyV³_PAc^*OyJcI*;»UX�O�JW@/_]_]OQM�SUAWJWJ�@*JCfmG�\]_@*JcSj@yI�\[sOÝ_hX�O¡VQ@*\]O3¹ÈG*Mdì n Ús;H»�X�O�\P@�fmO�´�XTI�\hAWVQ@*J�ORBEV³G�b7OQMh\d@/MPO�MPOy@*b¼ACB Oy@*VYX"VQ@*\]O*F,[�Å�_Ë_hX�O¡\PVQ@*JcOy\µ@�B7bÖQOQMhG�´�G�ACBT_P\U@/MhO%b7A�Ñ�OQMPORB�_�@�BEbÎ_hX�O[ø�÷®ýQôcöx÷�ø(V³GTf(f¯@�BEbÄGTBEJcIË@*´7´7JWAcOy\U_]G¯_hX�O,G�´E_PAcGTBdVyÅ�MPMPORBT_PJcIÎ\]OyJcOyV³_]Oyb5;� <N[7\]G�JCÅE_]O(ÁÜì n ÚË:HZ�»"< i Ú�ÂPç�ACBE\]_]MYÅ7fmORBT_jGTBË_hÅ�MvBT_P@*[7JcO*;� ×]BEV³MPORf¯ORB�_P@*J$D*Oy@/MgÁÜì n ÚË:HZ�»¼×0Ù e ÂPç�ACBE\]_]MYÅ7fmORBT_�GTBd_hÅ�MvBT_P@*[7JcO*;� <N[7\]G�JCÅE_]O(ÁÜì n ÚËã n :HZ�»à< i Ú�ÂPç�b7OQMPG*_P@/_PAcGTBÎG�´E_PAWVQ\y;� ×]BEV³MPORf¯ORB�_P@*J$D*Oy@/MgÁÜì n ÚËã n :HZ�»"×�Ù e ÂPç�bEOQMhG*_P@/_PAcGTBdG�´E_PAWVQ\y;| ÙN@*\hf>I�_hXÎÁ�K�¿�:U×�? { VQ@*[7JcO³Õ�SHMh@*´(\PAWbEO¶´ÊÅ�BEAc_P\�@/MPOHbEOQD*MPOQOy\yØ�f¯ACB�Å�_]Oy\QØ=\]OyV³GTBEb�\³ÂLÚ�OQO9_hX�OUB�G*_]Oy\�¹ÈG*M�_hXEOjì n Ú

MhG*_P@/_]G*MNACf(fmOyb7AW@/_]OyJcIË@*[sGR^*O*;

� <N[7\]G�JCÅE_]O(Á�K�¿N:H×0?º:HZ�»"< i Ú�ÂPç�ACBE\P_]MvÅ7fmORBT_jGTBË_hÅ�MvBT_P@*[7JcO*;� ×]BEV³MPORf¯ORB�_P@*J$D*Oy@/MgÁ�K�¿N:H×0?3:HZ�»�×�Ù e ÂPç7ACBE\]_]MYÅ7fmORBT_jGTBË_hÅ�MvBT_P@*[7JcO*;� <N[7\]G�JCÅE_]O(Á�K�¿N:H×0?ºã n :HZ�»�< i Ú�ÂPç�b7OQMPG*_P@/_PAcGTBdG�´7_PAWVQ\Q;� ×]BEV³MPORf¯ORB�_P@*J$D*Oy@/MgÁ�K�¿N:H×0?3ã n :HZ�»�×�Ù e ÂPç7bEOQMhG*_P@/_PAcGTBdG�´E_PAWVQ\y;| Ú�OyV³GTBEb7@/MPI¤f¯AcMPMPG*M|´sG�\PAc_PAcGTBg_]Mh@�BE\hb�ÅEV³OQMh\Q;|»UX�Oy\POj@/MhO9Å7\]Oybg_]G%fmOy@*\hÅ�MhO�_hX�Oj_PAWJc_�G*¹�_hX�OH\]OyV³GTBEb7@/MhIgf¯AcMhMPG*M

ACBÝAc_P\�V³OyJWJÜ;g»!Mv@*VP¶�ACB�DdV³G*MPMPOyV³_PAcGTBE\%@/MPO¯@*´7´7JWAcOyb1_]GdV³GTf¯´sORBE\h@/_]O>¹�G*M�_hX�O¤MPOy\hÅEJc_PACBEDËACfÃ@/D*O¯fmG*_PAcGTB�;,»UXEOMv@ySÊMPOy@*b7ACB�D�\j@/MPO�b7AW\P´�JW@yI*OybË@*\jACB�_]OQD*OQMh\9ACBÃ_hX�ONMh@�B�D*O X Ô l Ó�éÄÁ X å l*l ^!fËÂP;�»UX�O�MPOy@*b7ACB�D�\¦@/MPO�O³ÏE´�OyV³_]Oyb_]GzÅ�ÅEV³_hÅE@/_]OH[�I X æ�G*M\PG%b�Å�MhACBED�BEG*Mvf¯@*J�_]Mh@*Vh¶�ACBEDE;�¾ AWJWbÃO³Ï�VyÅ�Mv\PAcGTBE\�G*MjÅ7BEVvX7@�B�D�ACB�D�MPOy@*b7ACBED�\ACBEb7AWVQ@/_]O´7MPG�[7JcORf¯\9@�B7bd\hX�GTÅEJWbÎ[sO�MPOy´sG*MP_]Oyb$;

� Ú n¦e Z�ÙNãH<N:ßK å Øm_]Mh@�BE\Pb�ÅEV³OQM>VYXE@�B7B�OyJ9é¡ÁÜ[sG*_]_]GTfËÂPçO³Ï�´sOyV³_]Oyb·Mh@�B�D*O X å Ô l*l Å7BEAc_P\ËÁ X è l ^!fÎÂPçMhOy@*b7ACB�D�� å Ô l*l Å7BEAc_P\T�Uè l ^!f @/_HÖQORBEAc_hX�;

ò�å

Page 92: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO>Ô�ÓEئ»UX�O,JWACfÃAc_P\H\PV³MPOQORB�;

� Ú n¦e Z�ÙNãH<N:ßK"Ô�Ø|_]Mh@�B7\Pb�ÅEV³OQM�VYXE@�B7B�OyJ I Á�K�¿�:U×�?1\PAWbEO/ÂPç�O³Ï�´sOyV³_]Oyb¯Mv@�B�D*O X I l*l Å�BEAc_P\UÁ X Ó l ^!fÎÂPçMhOy@*b7ACB�D l @/_UÖQORBEAc_hX�;

� Ú n¦e Z�ÙNãH<N:ßK k Ø_]Mh@�BE\Pb�Å7V³OQMUVvXE@�B�B�OyJ ò ÁÜì n ÚÎ\hAWbEO/ÂPç7´7@/Mh@�f¯OQ_]OQMh\H@*\H¹�G*MNÚ nje Z�ÙNãH<N:�KÒÔ�;| ¿�G*MhAcÖQGTBT_P@*J9b7AW\P´7JW@*V³ORf¯ORB�_g_]Mh@�BE\hb�ÅEV³OQMh\Q;1»UX�Oy\]OÄ@/MPOdÅE\]Oybº_]G1V³G*MhMPOyV³_¤_hX�OÄ@/ÖyACf¤Å�_hX3D*Oy@/MmORBEV³G�bEOQMh\>¹ÈG*M_hXEOmO³ÑsOyV³_P\>G*¹¦\hAWbEOQS¦@RI�\gfmG.^*ORfmORBT_P\�G*¹�_hXEOm_]OyJcOy\PV³G�´sO*;ûUX�OQI1bEGµB�G*_%@�Ñ�OyV³_,_hX�Om_]Mh@*Vh¶�ACBEDaAc¹¦_hX�Om_P@*´sOORB7V³G�bEOQM¤AW\¤ÅE\]Oyb5;d»UXEOÃMh@RSÛMPOy@*b�ACB�D�\>@/MhO(b7AW\P´�JW@yI*OybÆ@*\>ACBT_]OQD*OQMh\¤ACB3_hX�OÃMh@�BED*O X Ô l Ó�é�;1Þ|JCÅEV³_hÅE@/_PAcGTBE\\vX�GTÅEJWbÄ[�O�@/MPGTÅ7B7b X ægÅ7BEAc_P\�S�X�ORBÃ_hX�ON_]OyJcOy\PV³G�´sO,AW\j\]_]G�´7´sOyb5;�»UX�O�O³Ï�´sOyV³_]OybËMh@�B�D*OLE�àA¤j¬xès3p¹cá:GHïTè�¬Hí®GAW\¦@*[sGTÅ�_ X å è l*l Å7BEAc_P\NÁ X å Ô l ^!fËÂP;�»UX�OHMv@�B�D*O�AW\�JWACf¯Ac_]OybÄ[TI¤_hX�O e @�f¯@*VH<Nã e ØT^/@*JCÅ�Oy\¦VQJcG�\]ON_]G X Ô l Ó�éACB7b7AWVQ@/_]O%\P@/_hÅ�Mv@/_PAcGTBd@�BEbÎ\hXEGTÅEJWbÎ[sONMhOy´�G*Mh_]Oyb5;�ÙUG*_]O%_hXE@/_9_hX�O�_]Mh@�BE\hb�ÅEV³OQMh\9@/MPO%BEG*Mvf¯@*JWJcIÄ\P@/_hÅ�Mh@/_]OybdACBORBED�ACB�OQOQMhACB�D(f¯G�b7O*;

� ¿�Z�:U× o Z�Ù�»L<�? å Ø�_]Mh@�BE\hb�ÅEV³OQMHVvX7@�B7B�OyJ!æ�;� ¿�Z�:U× o Z�Ù�»L<�?·Ô�Ø�_]Mh@�BE\hb�ÅEV³OQMHVvX7@�B7B�OyJ!è�;| Ú7X�Å�_]_]OQMR´ÊB�G*_HI*OQ_H¹êÅ7BEV³_PAcGTB7@*JÜ;| ?!GRS¦OQMUSUACB7b7\hXEAcOyJWb´¼B�G*_9I*OQ_H¹êÅ7BEV³_PAcGTBE@*JÜ;| ãNGTf¯O(ÁêÅ7BEAc_P\H@/MhO%bEOQD*MPOQOy\QØ�fÃACB�ÅE_]Oy\³ÂP;| `aAcMPMPG*M�V³GR^*OQM�´sG�\PAc_PAcGTBÎACBÎ@/Mh[�Ac_]Mh@/MPIÎÅ7BEAc_P\9¹�MPGTf l ÁÜVQJcG�\POyb�Â�_]G å l*l Á�¹ÜÅEJWJcIËG�´sORBsÂP;

;�7�ê � ���Ê���Ë���5¯$»UXEAW\´7@/D*O�b7AW\h´7JW@yI�\�_hX�O�\]_P@/_]O�G*¹�_hX�ONXE@/MhbESj@/MPOUJWACfÃAc_P\�@�BEbô7MPO³Õ�JWACf¯Ac_P\�¹�G*M_hXEOU@*Jc_PAc_hÅEbEO*FE@/ÖyACf¤Å�_hX�F�MhG*_P@/_]G*Mj@�B7b¹�G�VyÅE\¤bEMvAc^*Oy\QF�_]G*D*OQ_hX�OQM¯SUAc_hXºORf¯OQMPD*ORBEV³I3\]_]G�´$F´sGRS¦OQM¤@�B7bºORBED�ACB�OQOQMhACB�D { V³GTfô�Å�_]OQM¯fmG�bEO(ACB7b7AWVQ@/_]G*Mh\Q;¡»UXEOJW@yI*GTÅE_�AW\U\vX�GRS�BËACBdÞLAcDTÅEMPO>Ô�ÓE;

ò Ô

Page 93: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

| n fmOQMPD*ORB7V³I \]_]G�´$;�»UXEAW\Î\hX�G.SU\Î_hX�O¡\P_P@/_]O3G*¹g_hX�O�MPOyb¼ORf¯OQMPD*ORBEV³IÊ\]_]G�´"[�Å�_]_]GTB7\3ÁÜ< e »HìN<�» n ãäG*M: n ? n <�Ú n ã>ÂP;�ÙUGTB�O¤G*¹�_hXEOgbEMvAc^*Oy\�S�AWJWJ!¹êÅ7BEV³_PAcGTBÝÅ7BEJcOy\h\ ñ#�c� _hX�O¤[�Å�_]_]GTB7\�@/MPOgGTÅ�_QF$ACBµS�XEAWVYXaVQ@*\POg_hXEOb�AW\P´7JW@yIÎ\hXEGRSU\H: n ? n <�Ú n ãg;| »)OyJcOy\PV³G�´sO>´sG.S�OQMy;jÚEX�GTÅEJWbÎ[sO%Z�Ù>;| e GTf¯´�Å�_]OQM%MPOy\]OQ_>[�Å�_]_]GTB�;Ë»UXEAW\,AW\>_hX�OÃ[�ÅE_]_]GTB�GTB�_hXEOÃORB�D�ACB�OQOQMvACB�DabEOy\P¶1SNXEAWVvX3AW\%´EMPOy\h\]Oyb�_]Ga\PSUAc_PVvX¹�MPGTfÀORB�D�ACBEOQOQMhACB�DÝ_]G¡V³GTf¯´�ÅE_]OQMmf¯G�b7O*;1×�_mAW\ n ÙN< i ? n ã ÁÜJW@�f¯´·GTBsÂ�S�X�ORB·\]S�Ac_PVvX�Õ�G.^*OQM(AW\m@*JWJcGRS¦Oyb5çãN×PÚ�< i ? n ãßAc¹�B�G*_Q;| `µG�bEO%\]OyJcOyV³_]Oyb5; e Z�`a²ìN» n :�G*M n Ù�KN×0Ù n�n : ÁÜb�ÅE´7JWAWVQ@/_]OybµGTBË_hX�O,_]G�´�Õ�JcOQ^*OyJLb7AW\P´�JW@yI�ÂP;| <�ÖyACf¤Å�_hXÎJWACfÃAc_P\Q;»UX�Oy\PO,@/MPO=â ñ ï�í�­ ñ ïðGmJWACfÃAc_P\H@�BEbd\vX�GTÅEJWbµB�G*_H[sO�ORBEV³GTÅ�B�_]OQMPOybaACBdB�G*MvfÃ@*J�ÁÜV³GTf¯´�Å�_]OQMPÕV³GTBT_]MPG�JWJcOyb�Â9G�´sOQMh@/_PAcGTB�;H»�X�O%´EMPO³Õ�JWACfÃAc_P\U@/MPO¤XEAc_UÐ�Mh\]_QF�@�BEbaVQ@�ÅE\]O>_hX�O>\]I�\]_]ORfÍ_]GÃMPOQ^*OQMh_�_]G(ORB�D�ACB�OQOQMhACB�Df¯G�b7O*;N»UXEO>_]OyJcOy\PV³G�´sO¯VQ@�BaGTBEJcI1[�OgbEMhAc^*ORBaGTÅ�_�G*¹@Îf¯@*ACBaJWACf¯Ac_�[�IaXE@�BEb5;�»UXEO>b7AW\P´�JW@yIa\vX�GTÅEJWb1\hX�GRSe ? n <N:â¹�G*M�@*JWJ�JWACfÃAc_P\�@�BEbÝ´EMPO³Õ�JWACf¯Ac_P\�ACBÝB�G*MvfÃ@*J$G�´sOQMh@/_PAcGTBÝ@�BEb¡Ú n » Á�S�Ac_hX1_hX�O¯fmOy\P\P@/D*O¤ACBaMPOQ^*OQMh\]O^�AWbEOQG�ÂjAc¹)_hX�O,JWACfÃAc_�XE@*\H[sOQORBÎXEAc_Q;�»UX�O%B�GTfÃACBE@*J5XE@/MhbESj@/MPO,JWACf¯Ac_�´�G�\hAc_PAcGTBE\H@/MPO*Ø

� ?!×0`µ×0»2K k è*Ô � ç� ²�: n Õ�?$×]`d×0»2K k è l � ç� ²�: n Õ�?$×]`d×0»·�Ù� åHI l � ç� ?!×0`µ×0»·�Ù� åHI Ô � ;| <NJc_PAc_hÅEbEO1JWACf¯Ac_P\Q; <�\ùÈG*MÃ@/ÖyACf¤Å�_hX5F¦O³ÏEV³Oy´E_¯_hX7@/_Ã_hX�OdÐsBE@*J9JWACf¯Ac_mMPOQ¹�OQMh\Ã_]G¡_hX�Oµ<NVQV³Oy\P\IJL@/Mh¶ k ´�G�\hA�Õ

_PAcGTB5F�S�X7AWVvXdVQ@�BµGTBEJcIÎ[sO,MPOy@*VYX�Oyb1Å�BEbEOQMHORB�D�ACBEOQOQMhACB�D/Õ�fmG�bEO%V³GTBT_]MPG�J)¹ÈMhGTf _hX�Og[7@*JWV³GTB�I*;H»�X�O>B�GTfÃACBE@*J´sG�\PAc_PAcGTB7\U@/MPO*Ø

� ?!×0`µ×0»2K ò é � ç� ²�: n Õ�?$×]`d×0»2K ò æ � ç� ²�: n Õ�?$×]`d×0»·��è � ;�æ�ç� ?!×0`µ×0»·��è � ; l ç� ÞL×0Ù�<N?·?$×]`d×0»·� l � ;�é/æ�;| ²MhACfmOm¹�G�VyÅE\,_hÅ�MYB�_P@*[7JcOÄJWACf¯Ac_P\Q;Ë»UX�OQMhOÃ@/MPOÄBEGµ´EMPO³Õ�JWACfÃAc_P\%@�BEb3BEGaVQ@*[7JcO(SHMh@*´¡JWACfÃAc_P\Q;Ë×�¹9@µXE@/MvbES¦@/MhO

JWACfÃAc_HAW\�XEAc_QF�_hX�ORBË_hX�O,\]I�\]_]ORfÍ\]SUAc_PVvXEOy\H_]G¯ORB�D�ACBEOQOQMhACB�D(f¯G�bEO*;

� ?!×0`µ×0»2KßÔ�é.Ó � ç� ?!×0`µ×0»·�Ù� I è � ;| e @*\P\]OQD*Mh@*ACBµ_hÅ�MvBT_P@*[7JcO>JWACfÃAc_P\Q;9»UX�OQMPO>@/MPO>B�GÄ´EMPO³Õ�JWACf¯Ac_P\y;�×�¹�@ÃJWACf¯Ac_�AW\NXEAc_QF�_hX�O%bEMvAc^*O>AW\H_hÅEMvB�OybdG/Ñ3@�B7b

_hXEO�\]I�\]_]ORfï\PSUAc_PVvX�Oy\�_]G%ORBED�ACB�OQOQMhACB�D¤fmG�bEO*;)»UXEOH_hÅ�MvBT_P@*[7JcONf¤ÅE\P_�[�OHb7MhAc^*ORBmGTÅ�_G*¹5_hX�OUJWACf¯Ac_¦ÅE\PACB�D,_hXEOKà@�BEb��Ê[�Å�_]_]GTB7\GTBËAc_P\j[7@*\]O*;�»�X�O e @*\P\]OQD*Mh@*ACBËVQ@*[7JcO³Õ�SUMh@*´ÎAW\jbEMhAc^*ORBÄACBEbEOy´sORBEbEORBT_PJcIµÁêÅE\PACBEDg@¤\PACfô7JcOX7@/MhbESj@/MPO>\]OQMh^*G�Âj@�BEba_hX�OQMPOQ¹�G*MPO¤XE@*\�Ac_P\�GRSNBaJWACfÃAc_P\>ÁÜ@*V³_PAc^/@/_]Oyb¡Ac¹�Ac_�AW\�f¯G*MPO,_hXE@�B å � ;�é/æ¯GTÅE_UG*¹�´�XE@*\POS�Ac_hX�_hX�O¯_hÅEMvB�_P@*[�JcO*;(×�¹¦Ac_¤XEAc_P\,GTBEO*F!_hX�ORB¡_hX�O�á9¹�ï¡àeá ñ�·Ì� GÎf¤ÅE\]_,[sO¯bEMhAc^*ORB3Å7BEbEOQM,ORBED�ACB�OQOQMhACB�DµV³GTBT_]MPG�JÅ�B�_PAWJ5_hXEO,VQ@*[7JcO³Õ�SHMh@*´aJWACf¯Ac_UAW\HVQJcOy@/MhOyb5;

� ?!×0`µ×0»2KßÔ*æ k � ç� ?!×0`µ×0»·�Ù�UÔ*æ�Ó � ;| ÙN@*\hf>I�_hX�_hÅ�MvBT_P@*[7JcOÃJWACfÃAc_P\Q;ÃÙ�G*_>VyÅ�MhMPORB�_PJcI�ACfô7JcORfmORBT_]Oyb´ _hX�OmÙN@*\hf>I�_hX�_hÅ�MvBT_P@*[7JcOy\%@/MPOÄ@*JWJcGRS¦Oyb3_]G

MhG*_P@/_]O�V³GTBT_PACB�Å�GTÅ7\PJcI*F�@*\_hX�OQImB�G*Mvf¯@*JWJcI¤VQ@/MPMPI¤bEOQMPG*_P@/_PAcGTBÃG�´E_PAWVQ\QF�Ac¹s@�BTI�_hXEACB�DE;�»UX�O�K�¿�:U×�?$Õ�\PAWbEOHJWACf¯Ac_P\fÃ@yIÎ[sO%ÅE\]OybaACBË_hX�O,¹êÅ�_hÅ�MPO%¹ÈG*MUACB7\]_]MvÅ7f¯ORB�_P\H@/_]_P@*VYX�OybÝb7AcMPOyV³_PJcIË_]GÃ_hXEO,MPG*_P@/_]G*My;q¸ ñ ïºàQE�à�±�%¦_hXEO>\]_P@/_hÅE\[�Ac_P\�f¯@RIÄACB7b7AWVQ@/_]O,_hXE@/_U[sG*_hXÎJWACfÃAc_P\H@/MPO>Ú n »"Ac¹L_hX�OQIÎ@/MPO,b7AW\PV³GTB7BEOyV³_]Oyb5;�»UX7AW\9\hX�GTÅEJWbd[sO�AcDTB�G*MPOyb$;

ò k

Page 94: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO>Ô*æ�ئ»UX�O�@*JW@/MvfÃ\H\PV³MPOQORB�;

| Þ7G�VyÅE\gJWACf¯Ac_P\y;Ë¿NAc_]_PACB�DÝ@µJWACfÃAc_%\]_]G�´7\>_hX�Où�G�VyÅE\%bEMvAc^*O*FL[�ÅE_%bEG�Oy\>B�G*_gVQ@�ÅE\]O(@a\]SUAc_PVYX¡_]GaORB�D�ACB�OQOQMhACB�Df¯G�b7O*;

� ?!×0`µ×0»2K å Ô ò ;�æÃf(fÎç� ?!×0`µ×0»·� k ÓE; l f(fÎ;

;�7�� �������T�Ê�Ë��5¯$»UXEAW\(´7@/D*OaV³GTBT_P@*ACBE\Ë@*JW@/Mvf ACBEb7AWVQ@/_]G*Mh\(¹�G*M(\]OQMhAcGTÅ7\¯¹Ü@�ÅEJc_P\QFH´EMhACB7VQAW´7@*JWJcIÌACB¸_hX�O1X�I�bEMh@�ÅEJWAWVa\hÅE´7´sG*MP_¯\PI�\]_]ORfdFf¯AcMhMPG*M9\hÅE´7´sG*MP_9@�BEbd´sG.S�OQMU\vÅE´7´7JcI*;�<NJWJ�O³Ï�V³Oy´7_U_hX�O,V³GTBT_]MPG�J$MhG�GTf _]ORfôsOQMh@/_hÅ�MPO�@�BEbÎbEGTf¯O�ORfmOQMPD*ORB7V³IÄ\]_]G�´@*JW@/MvfÃ\HXE@y^*OgV³GTÅ7B�_]OQMv´7@/MP_P\9GTBË_hXEO%@*JW@/Mvf ´7@�BEOyJ5G*¹)_hXEO�ORB�D�ACB�OQOQMhACB�D(bEOy\]¶�Á�MPOybdJWAcDTXT_�Kâ@�ÅEb7AW[�JcO,@*JW@/MvfËÂP;�»UXEOJW@yI*GTÅE_�AW\U\vX�GRS�BËACBdÞLAcDTÅEMPO>Ô*æ�;| ¿�I�bEMh@�ÅEJWAWV,@�B7bÎJCÅE[EMhAWVQ@/_PAcGTBµ\]I�\P_]ORfÎ;

� Z�AWJ!´7@*b1@*JW@/MvfÎ;9×]BEb7AWVQ@/_]Oy\�XEAcDTXµG*MNJcG.Sß´EMPOy\P\hÅEMPO,@/_�GTBEO%G*¹�_hX�OmX�I�bEMh@�Å7JWAWV%\hÅE´�´�G*Mh_H´7@*b7\Q; e XEOyVP¶_hXEO,ORB�D�ACB�OQOQMhACBEDÃbEOy\]¶Ë_]GÃ@*\PV³OQMh_P@*ACBdS�X7AWVvXδ7@*b)ÁÜ\³Â�@/MPO%ACBT^*G�Jc^*Oyb5;¦¾¡@/MvBEACB�DÃGTBEJcI�´ÊbEG�Oy\NB�G*_HVQ@�ÅE\]O\PSUAc_PVvXd_]G¯ORB�D�ACB�OQOQMhACBED(fmG�bEO*;�Ù�G*Mvf¯@*J5\]_P@/_]O e ? n <�:%F7@*JW@/Mvf�\]_P@/_]OmÚ n »,;

� K�Oy@/Mh[sGyÏÃG�AWJ�@*JW@/MvfÎ;|×]BEb7AWVQ@/_]Oy\jACBEV³G*MPMPOyV³_�G�AWJ�´7MPOy\P\hÅ�MhOUACBm_hX�O�D*Oy@/M]Õ�[sGyÏ�Oy\Q;�¾¡@/MvB7ACB�D%GTBEJcI*;�Ù�G*MvfÃ@*J\P_P@/_]O e ? n <N:,F7@*JW@/MvfÍ\]_P@/_]O¤Ú n »�;

� Z�AWJ$´�Å7fô(@*JW@/Mvfd;Ù�G*Mvf¯@*J5\]_P@/_]O e ? n <�:%F7@*JW@/Mvf�\]_P@/_]OmÚ n »,;� <NJc_PAc_hÅEbEO>@�BEbd@/ÖyACf¤Å�_hXËG�AWJ5Ð�Jc_]OQM�@*JW@/MvfÃ\Q;�ÙUG*MYf¯@*J5\]_P@/_]O e ? n <�:%F7@*JW@/Mvf \]_P@/_]OmÚ n »�;� Z�AWJ5_]ORf¯´sOQMh@/_hÅ�MhO*;�Ú7X�GTÅEJWbËMPOy@*baÙ�Z�:N`µ<N?�F7@*JW@/MYf�\]_P@/_]Og¿U×PK�¿>;� Z�AWJ$´EMPOy\P\vÅ�MPO*;ÚEX�GTÅEJWbËMhOy@*bdÙ�Z�:�`a<�?F�@*JW@/Mvf�\P_P@/_]O>¿�×]K�¿>;| ²LG.S�OQMy;

ò Ó

Page 95: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

� `a@*ACBE\�@*JW@/MvfÎ;�Ù�G*Mvf¯@*J5\P_P@/_]O e ? n <N:,F7@*JW@/MvfÍ\]_P@/_]OgÚ n »�;� ²LG.S�OQM�@�f¯´7JWAcÐ�OQMy;�ÙUG*MvfÃ@*J5\]_P@/_]O%¾ Z�:NÛ�×0Ù�K¤F�@*JW@/Mvf�\P_P@/_]O>Þ�<9ì�?�»BK¤;| ²MhACf¯@/MhIÄf¯AcMhMPG*MH\hÅE´7´sG*MP_Q;

� ÙNAc_]MPG*D*ORBÊ´EMhOy\P\hÅ�MPO*; ÙUG*MYf¯@*JN\]_P@/_]O�Ù�Z�:N`µ<N?�F9@*JW@/Mvf4\]_P@/_]O�?|Z9¾ ;9< ¹�@*AWJCÅEMPOÝXEOQMPOaD*ORBEOQMh@*JWJcIf¯Oy@�BE\9_hXE@/_U_hX�O%BEAc_]MPG*D*ORBµ\hÅE´7´7JcIËXE@*\9MvÅ�BÄGTÅ�_Q;

� ?!G�@*bµV³OyJWJ$@*JW@/MYfÎ;�×]BEb7AWVQ@/_]Oy\H_hX7@/_H_hX�O�¹�G*MhV³Oy\HGTBË_hXEO�Mh@*b7AW@*J5G*MU@�ÏEAW@*J!JcG�@*baV³OyJWJW\HS�X7AWVvXÎV³GTBT_]MPG�J$_hXEO´sG�\PAc_PAcGTBdG*¹)_hXEO>f¯AcMPMhG*Mj@/MhO,O³Ï�V³Oy\h\PAc^*O*;¦Ù�G*MvfÃ@*J5\]_P@/_]O e ? n <N:,;

� `aAcMPMPG*MNX�OyAcDTX�_Q;¦ÙUG*MYf¯@*J5\]_P@/_]OgÙ�Z�:N`µ<N?�;| ¾�Oy@/_hXEOQMN@*JW@/MvfÃ\%ÁêB�GTB�O,V³GTB�B�OyV³_]Oyb5Ø�AcDTBEG*MPO/ÂP;� ¾ÊACBEbd\h´�OQOyb$;�ÙUG*MvfÃ@*J5\]_P@/_]O e ? n <N:,;� ×0V³O*;�Ù�G*MvfÃ@*J5\]_P@/_]O e ? n <N:,;� :�@*ACB�;Ù�G*Mvf¯@*J5\P_P@/_]O e ? n <N:,;� ã�ÅE\P_Q;ÙUG*MYf¯@*J5\]_P@/_]O e ? n <�:%;| e GTB�_]MPG�J)MPG�GTf _]ORfô�OQMv@/_hÅ�MPO%@*JW@/Mvfd;H»UXEAW\�AW\�ÅE\]Oybµ_]GÄb7OQ_]OyV³_N@ù�@*AWJCÅ�MhO%G*¹�_hX�O¤@*AcM]Õ�V³GTBEb7Ac_PAcGTB7ACB�DÄ\PI�\]_]ORf

@�B7ba_]GÎ_hÅEMvBdG/Ñ·_hX�Om´sGRS¦OQM,\hÅE´7´7JcIÎ_]GÎ_hXEOgV³GTfô�Å�_]OQMh\�Ac¹�_hX�OmV³GTBT_]MPG�J|MPG�GTf GR^*OQMvXEOy@/_P\Q;>Ù�G*Mvf¯@*J|\]_P@/_]Oe ? n <N:,ç7@*JW@/MYf�\]_P@/_]OmÚ n »�;| ÙN@*\hf>I�_hX¯D�@/_]O,@*JW@/Mvfd;�»UXEAW\¦AW\_]MhAcD*D*OQMhOybÎAc¹5GTB�O�G*¹!_hX�ONÙN@*\hf>I�_hXÃ@*VQV³Oy\P\jD�@/_]Oy\jGTBÃ_hX�O�[7@*JWV³GTBTI(AW\�G�´�ORB5F[�Å�_,_hX�OQMPO(AW\gB�GaÙ�@*\hf>I�_hX�´7JW@/_]¹�G*MvfÀB�O³Ï�_%_]GaAc_Q;Ë×�_>VQ@�ÅE\]Oy\g@µ\]SUAc_PVYX�_]GaORB�D�ACB�OQOQMhACB�DÝfmG�bEO*;(Ù�G*MvfÃ@*J\P_P@/_]O>Ù�Z�»àZ�² n Ù>;| ãNGTf¯O,ORfmOQMPD*ORB7V³IÄ\]_]G�´$;ÙUG*MYf¯@*J5\]_P@/_]O e ? n <N:,;

;�7�F ���!� ·�.�*�s� > �Î�5 C]Ò� �5 > �5�N�@!7���T�¼]���d��5¯$»UXEAW\%´7@/D*OÃV³GTBT_P@*ACBE\,_hX�OÃORB�D�ACB�OQOQMhACB�DµGR^*OQMPMhAWb7OÃACBEb7AWVQ@/_]G*Mh\%¹ÈG*MgACBEb7Ac^�AWb�ÅE@*J�fmOyVYXE@�BEAW\hfÃ\�@�BEb�_hX�O¯\P_P@/_hÅE\%[7Ac_P\V³GTBEV³OQMvB7ACB�DÃbEGTf¯O�@�B7bd\hX�Å�_]_]OQMh\Q;»�X�O�JW@yI*GTÅ�_�AW\H\hX�G.S�BÎACBÎÞ|AcDTÅ�MhO>Ô*è�;| n B�D�ACB�OQOQMhACBEDUGR^*OQMhMhAWbEOy\Q;|»UX�Oy\]O�VQ@�ÅE\]O�V³GTfô�Å�_]OQM!V³GTBT_]MPG�JT¹ÈG*MLACBEb7Ac^�AWb�ÅE@*JTf¯OyVvXE@�BEAW\vf¯\�_]G�[sOb�AW\P@*[7JcOyb%@�B7b

@/MhOHV³GTB�_]MPG�JWJcOyb([TI¤JW@/_PVvX7ACB�D%[�Å�_]_]GTB7\|GTBg_hX�O9ORB�D�ACB�OQOQMhACBED,bEOy\]¶s;�ZN^*OQMhMhAWbEOy\�@/MPO9GTBgS�XEORBg_hX�OH[�Å�_]_]GTBE\�@/MhOJW@/_PVYX�OybÃb7GRS�B�;�»UXEO¦I*OyJWJcG.S JW@�fô7\|SUAWJWJE[sO9JWAc_�S�X�ORBg_hXEOUfmOyVvX7@�BEAW\hf¯\|V³GTBEV³OQMYB�Oyb¯@/MPOUÅ7B7bEOQM|ORB�D�ACB�OQOQMhACB�DV³GTBT_]MPG�JÜF$OyAc_hXEOQM,[�OyVQ@�Å7\]O>_hXEO¤\PI�\]_]ORf @*\�@ÄS�X�G�JcO¤AW\�ACBaORB�D�ACB�OQOQMhACBEDÎf¯G�b7O%G*M�@*\�@ÄMPOy\hÅEJc_NG*¹G.^*OQMPMhAWbEOy\Q;»�X�O¡b7AW\P´7JW@RI \vX�GRSU\ n Ù�KN×�Ù nn :ëSNX�ORB _hX�O3fmOyVYXE@�BEAW\hf AW\ÎGR^*OQMPMvAWb7bEORB�ç e Z�`a²ìN» n : G*_hX�OQMPSUAW\]O*;`µOyVvX7@�BEAW\hf¯\S�XEAWVYXÃf¯@RIm[�OUGR^*OQMPMhAWb�bEORBÃ@�B7bm_hX�OyAcMj\]_P@/_]Oy\�ACB(B�G*MvfÃ@*J!ÁÜV³GTf¯´�ÅE_]OQM]Õ�V³GTB�_]MhG�JWJcOyb�Â)G�´sOQMh@/_PAcGTB@/MhO*Ø

� ãNGTf¯O(ÁêB�G*MvfÃ@*JWJcI e Z,`µ²�ì�» n :�ÂPç� Þ7G�VyÅE\gÁêB�G*MvfÃ@*JWJcI e Z,`µ²�ì�» n :,ç�B�G*_]O%_hXE@/_H_hX�O�¹�G�VyÅ7\HbEMhAc^*O%b7G�Oy\UBEG*_9S�G*MP¶dÅ7B7bEOQM9GR^*OQMPMvAWbEO/ÂPç� Ú7X�Å�_]_]OQMv\%ÁêB�G*MvfÃ@*JWJcI n Ù�KN×0Ù nn :,ÂPç� `aAcMPMPG*M�V³GR^*OQM¯ÁêB�G*MvfÃ@*JWJcI n Ù�KN×0Ù n�n :,ÂP;| e GTB�_]MPG�J�JcG�VQ@/_PAcGTBE\y;»UX�Oy\]OH\vX�GRS¸_hXEOU\]_P@/_]OHG*¹�_hX�O9MPORf¯G*_]O { JcG�VQ@*J { G/Ña¶*OQI�\]S�Ac_PVvX�Oy\�GTB¤_hX�OHD�@*JWJcOQMhI¤V³GTBT_]MPG�J

´�@�B�OyJÜ;: n `1Z�» n fmOy@�B7\j_hXE@/_H_hX�O%f¯OyVvXE@�BEAW\vf VQ@�BÎ[sO,bEMhAc^*ORBĹ�MPGTf _hX�O,V³GTBT_]MPG�J!MPG�GTfdçE?LZ e <N?�_hXE@/_Ac_NfgÅ7\]_9[�O,b7MhAc^*ORB˹�MPGTf _hX�O%[�@*JWV³GTB�Iδ7@�B�OyJW\y;

� ãNGTf¯O(ÁêB�G*MvfÃ@*JWJcIÄ: n `ÝZ�» n ÂPç� Ú7X�Å�_]_]OQMgÁêB�G*Mvf¯@*JWJcIË?LZ e <�?�ÂPç� ¾ÊACBEb7\vXEAcOyJWb3ÁêB�G*MvfÃ@*JWJcIÄ?|Z e <N?�ÂP;

ò æ

Page 96: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

Þ|AcDTÅ�MPO>Ô*è�ئãNGTfmO,\]_P@/_hÅE\�@�BEbµfÃ@�B�ÅE@*JsG.^*OQMPMhAWbEOy\N\PV³MPOQORB�;

| ²LG.S�OQMy;¦ÙUG*MYf¯@*JWJcIµZ�Ù>ç7@*JW@/Mvf�\]_P@/_]OmZ�Þ|Þ¦;

� ãNGTf¯O*ç� Ú7X�Å�_]_]OQMRç� ¾ÊACBEb7\vXEAcOyJWb5;| Z�^*OQMP_]Mh@y^*OyJL@*JW@/MvfÃ\Q;�ÙUG*MYf¯@*JWJcI e ? n <�:%ç7@*JW@/Mvf�\]_P@/_]OmÚ n »,;

� Ú7X�Å�_]_]OQMRç� ¾ÊACBEb7\vXEAcOyJWb5;| »)G*MhÇ�Å�O1_]MhAW´ @*JW@/MYf¯\Q;ßÚEX�ÅE_ÃbEGRSNB¸_hX�OÝbEMhAc^*O�Å7BT_PAWJUMhOy\]OQ_(GTB'_hX�O1D�@*JWJcOQMPI V³GTBT_]MPG�J�´7@�B�OyJÜ; ÙUG*MYf¯@*JWJcI

e ? n <N:,ç7@*JW@/MYf�\]_P@/_]Og»H:H×0²² n ãg;

� Ú7X�Å�_]_]OQMRç� ¾ÊACBEb7\vXEAcOyJWb5;| ¾ÊACBEb7\vXEAcOyJWbd´7@/MP¶*OybµACBEb7AWVQ@/_]G*Myئ²s<N:NÛ n ã G*M�Ù�Z�»"²�<N:NÛ n ã>;| Ú7X�Å�_]_]OQM�@�BEbÎSUACBEb�\hXEAcOyJWbµZ�² n Ù { e ?LZ,Ú n ãg;| ²�JW@/_]¹ÈG*MYf�´7ACB�;�×�¹L×�Ù>FE_hXEAW\Ub�AW\P@*[7JcOy\HbEGTf¯O�MPG*_P@/_PAcGTB�;¦ÙUG*MvfÃ@*JWJcIÎZ�ì�»�;| ãNGTf¯O%ACB�_]OQMvJcG�Vh¶�;¦ÙUG*MvfÃ@*JWJcIÄãN×PÚ�< i ? n ãgç�@*JW@/MvfÍ\]_P@/_]O n Ù�< i ? n ã>;| Þ7G�VQ@*J)\]_P@/_PAcGTBµACBµÅE\]OÃÁÜb7AW\P´�JW@yI�\NÚ n ? n¦e » n ã>ÂP;

� e @*\P\]OQD*Mh@*ACBºÁÜ\]OyV³GTBEb7@/MPIdfÃAcMPMPG*MjGTB�ç�ÙN@*\hf>I�_hX½Å�@/_H\]_]GRS¦Oyb�ÂP;� ²MhACfmO¯ÁÜ´EMvACfmO�¹�G�VyÅE\HÅ�BEAc_9GTBsÂP;� K�¿�:U×�?·Ù�@*\vf%I�_hX˹�G�VyÅ7\,ÁÜ\]OyV³GTBEb7@/MPIdfÃAcMPMPG*M9GTB�ç7ÙN@*\hf>I�_hX½Å�@/_UACBµK�¿N:H×0?3´sG�\PAc_PAcGTB�ÂP;

ò è

Page 97: TCS PAPER RL - Isaac Newton Group of Telescopesdocs/tcs/software/TCS_PAPER_RL.pdf · 2012. 5. 23. · #0 $ 1* 324 5 63 7 8 / $ 9 :,;=; ?!@*ACBEDEF:HG.I@*JLKNMPOQORBTSUAWVYX1Z

� ì n ÚÎÙ�@*\hf>I�_hX˹�G�VyÅE\>ÁÜ\]OyV³GTBEb7@/MPIdfÃAcMPMPG*MjGTB�ç�ÙN@*\hf>I�_hX½Å�@/_HACBÎì n ÚË´sG�\PAc_PAcGTBsÂP;� Þ7G�JWbEOyb e @*\P\]OQD*Mh@*ACB1ÁÜ\]OyV³GTBEb�@/MPIÃf¯AcMPMhG*M�GTB�ç�Ù�@*\hf>I�_hX=Å�@/_¦ACBm¹�G�JWbEOyb e @*\P\]OQD*Mh@*ACB(´sG�\PAc_PAcGTB�çEB�G*_I*OQ_ACBµÅE\]O/ÂP;| ²MhACf¯@/MhIÄf¯AcMhMPG*MHV³GR^*OQMy;

� e ?LZ,Ú n ã { Ù�Z�» e ?LZ,Ú n ãg;|:UOy@*b7\ e ?|Z,Ú n ãÍS�XEORB·_hX�OdV³GR^*OQMÄAW\N. ¹ �c� ç \hX�Å�_QçHÙ�Z�» e ?LZ,Ú n ãG*_hXEOQMPSUAW\]O*;

� Z�² n Ù { Ù�Z�»àZ�² n Ù>;7:HOy@*b7\�Z�² n Ù�S�XEORBÄ_hX�O%V³GR^*OQM�AW\�.̹ ����ç G�´sORB�ç7Ù�Z�»àZ�² n ÙàG*_hX�OQMPSUAW\PO*;| ÙN@*\hf>I�_hXrÅ�@/_Q;ßÚ�»�ZH¾ n ã AW\Ä_hX�Oa@*´�´EMPG�´EMhAW@/_]OÝ´sG�\PAc_PAcGTB'¹ÈG*M e @*\P\]OQD*Mv@*ACB @�B7b ´EMvACfmOι�G�VQAÜç�Ù�Z�» Ú�Õ»NZ9¾ n ãß¹�G*M�ÙN@*\hf>I�_hXd@�BEbµ¹ÈG�JWbEOyb e @*\P\]OQD*Mv@*ACB�;H»UX�O·Å�@/_U\hX�GTÅEJWba@*JcS¦@RI�\�[sOgÚ�»NZ9¾ n ãâS�XEORBµB�G*_UACBÅ7\]O*;| Ú�OyV³GTBEb7@/MPIÎf¯AcMPMhG*MjV³G.^*OQMy;�<NJcSj@yI�\NZ�Þ|Þ¦F7\PACBEV³O�_hX�O,V³G.^*OQMNAW\HGTBEJcIËÅ7\]OybËS�X�ORB(_hX�O%fÃAcMPMPG*M9AW\UB�G*_9GTBË_hXEO_]OyJcOy\hV³G�´�O*;| <�ÖyACf¤Å�_hX�ÖQGTBEO*;L»UX7AW\5D�Ac^*Oy\!_hXEO�´sG�\PAc_PAcGTB�G*¹�_hX�O�\]SUAc_PVvX,_hXE@/_)AW\!MPOy@*b,GTB%\]_P@/MP_hÅE´,_]GUMPOy\]G�Jc^*O�_hX�O�@�fg[7AcDTÅ7Ac_�IACB1_hXEOg@/ÖyACf¤Å�_hXÝ@*[7\PG�JCÅ�_]O¤ORBEV³G�b7OQMy;,: n ã � � åHI l ��« @/ÖyACf¤Å�_hX « K å Ô l � @�BEbAK n ?!?LZH¾ � K å Ô l �« @/ÖyACfgÅE_hX « K k è l � F7@*´�´EMPGyÏEACf¯@/_]OyJcI*;| <NVQV³Oy\P\ { ÖQORB7Ac_hX(´�@/MP¶¤_PAcOy\Q;�»UX�Oy\]OH@/MhO�ACBE\]OQMh_]Oybm_]G>\]_]G�´Ã_hX�OH_]OyJcOy\PV³G�´sO�fmG.^�ACB�D�SNX�ORBmAc_�AW\GTÅ�_�G*¹5[7@*JW@�BEV³OÁ°GWF ±®FïSNX�ORBº_hX�Oµf¯AcMPMhG*MgV³OyJWJHXE@*\m[sOQORB·MPORf¯GR^*OybÆG*M¯b�ÅEMhACB�DÝ@�BÆORBEbÆVvXE@�BED*O/Â>@�BEb·¹ÈG*MvV³OÎORB�D�ACB�OQOQMhACB�Df¯G�b7O*;�ÙUG*MvfÃ@*J5\]_P@/_]OgZ�ìN»�ç7@*JW@/MvfÍ\]_P@/_]O%×0Ù>;| :UOQ^*G�Jc^�ACBED�Å�G�G*M|JW@/_PVvX�;�»UX7AW\)\]_]G�´�\!_hX�O¦_]OyJcOy\PV³G�´sO9fmGR^�ACB�DNACB%@/ÖyACf¤Å�_hX%S�X�ORB>Ac_LAW\L@/_L_hX�O�V³G*MPMhOyV³_|´sG�\PAc_PAcGTB¹�G*M¤_hX�OÄfÃAcMPMPG*M>_]G1[sOÃMhORfmGR^*Oyb¼Á�E�F�GWFàSUAc_hX¡_hXEO(ÐEÏ�Oyb·@�BEb·f¯GR^�ACB�Da´�@/MP_P\gG*¹9_hX�OËfÃAcMPMPG*M>_]MPG�JWJcOQI3Mh@*AWJW\JWACBEOybµÅE´�ÂP;Ù�G*MvfÃ@*J5\]_P@/_]O e ? n <N:,ç7@*JW@/MvfÍ\]_P@/_]O¤Ú n »�;| <N² k @*VQV³Oy\P\[7@/MhMhAcOQMy;|»UXEAW\�\]_]G�´7\�_hX�O9_]OyJcOy\PV³G�´sO�[sOyACB�D�bEMhAc^*ORB¯ACBm@/ÖyACf¤Å�_hXgS�X�ORBg_hX�O�[7@/MPMhAcOQM�AW\�MhORfmGR^*Oyb_]GÃD�Ac^*O>@*VQV³Oy\P\�_]G¯_hX�O,_]G�´EÕ�ORBEbÎMhACB�DE;�Ù�G*MvfÃ@*J5\]_P@/_]O¤Ú�»NZ9¾ n ãgç�@*JW@/MvfÍ\]_P@/_]O%ã n ²�?LZMK n ãg;

ò é