45
Jubatusにおける 規模分散オンライン機械学習 海野 裕也 (株) Preferred Infrastructure 研究開発部 <[email protected]> 2012/6/1先端融テクノロジー研究会

Jubatusにおける大規模分散オンライン機械学習@先端金融テクノロジー研究会

Embed Size (px)

DESCRIPTION

 

Citation preview

  • 1. Jubatus) Preferred Infrastructure2012/6/1

2. Preferred Infrastructurel PFIl 20063l l 26(2012/4)l 113-0033 2-40-1lURL http://preferred.jp/l /2 3. l l 3Basic TechnologiesAcademic ResearchesProductsServices 4. l BP asahi.com NHK XAPPYlEC/Web Webcat Plus 4 5. l l l l l Jubatusl l 5 6. 6 7. Big Data !l l l l l 7 PC EC 8. l l Google, Amazon, Facebookl l l l l l l 8 9. 3STEPSTEP 1. STEP 2. STEP 3. lStep1 Step2 99 3030 10. l l l l l l l 10 11. 12. l l l 12 13. 13 (0, 1, 0, 2.5, -1, )(1, 0.5, 0.1, -2, 3, )(0, 1, 0, 1.5, 2, )/SVM, LogReg, PA, CW, ALOW, Nave BayesCNB, DT, RF, ANN, K-means, Spectral Clustering, MMC, LSI, LDA, GM, HMM, MRF, CRF, 14. l l l l l l 14 15. l l 15 1 1 0.7 1500 2 1 1 1IT 16. l l xyy yl l l l /l l l l l l 16 17. l l 17 18. l twitter18Johan Bollen and Huina Mao, Twitter Mood as a Stock Market Predictor,in Computer, vol. 44, no. 10, 2011. 19. 1EC19l l l l l l l l l 20. 2l l l l l l l l 20 21. 3l l l l l l l l l 21 22. 4l SNSl l l //l l l l l l 22 23. Jubatus23 24. Jubatusl l 1)l 2)l 3)l (MapReduce/Hadoopl l l l / (CEPl l 24 25. Jubatus25 l NTT SIC*Preferred Infrastructurel 201110OSS http://jubat.us/* NTT SIC: NTT 26. 1: / l l /l twitter6000QPSl l l 26 27. 2: l l l l l 27 28. l l l l l 28 29. Jubatusl l l l l l 29 30. l l l l Jubatusl l Perceptron (1958)l Passive Aggressive (PA) (2003)l Confidence Weighted Learning (CW) (2008)l AROW (2009)l Normal HERD (NHERD) (2010)30 31. l l 31 32. l Jubatusl l l l l 32mix 33. Jubatusl l l 33 34. l Jubatusl l c.f. MapReduceMapReducel UPDATEl l ANALYZEl l MIXl 34 35. UPDATEl l 35 36. ANALYZEl l 36 37. MIXl l l 37 38. l l (sum)(count)l UPDATEl sum += xl count += 1l ANALYZEl return (sum / count)l MIXl sum = sum1 + sum2l count = count1 + count238 39. l l l 100%l l l MIX39 40. Jubatusl , l l :Perceptron, PA, CW, AROWl l :PAl l Inverted File Index, LSHl l l l 40 41. Jubatusl Jubatusl C++l Pythonl Rubyl Javal Haskell l IDL41 42. 42 43. 43 44. Jubatusl l l l l l l l l l l Jubatus44 45. Copyright 2006-2012Preferred Infrastructure All Right Reserved.