1. Deep LearningPreferred Infrastructurehillbig@preferred.jpPFI 2013/5/30 @ PFI

2. DeepLearningl l DeepLearning.netl Google+ DeepLearning Groupl Deep Learningl l 3l Deep Learningl Deep Learning2 3. 37 4. 2012l DNNl 2l 100ml l 4 5. Deep Learningl l l ICML, ACL, CVPRl ICLR (snowbird workshop)l l MicrosoftDeepLearningl Googlel Hinton+Googlel GoogleJeff Deanl 5 6. LSVRC20126tape playerhttp://www.image-net.org/challenges/LSVRC/2012/ilsvrc2012.pdf 7. (NN) (1/2)l 1940l Perceptron, BackPropagation, l 90l 2006Deep Neural Netl Hinton, BengioPreTraining AutoEncoderl l Ngl l 7 8. (NN) (2/2)l 2010l l l state-of-the-artl NNl Google1000NN2000160001l 8 9. l HintonBengio90+ + DropOutl l l PreTraning, AutoEncoder, Dropout, Maxoutl l GPGPUl + l 9 10. l l l l 10 11. 1111 (0, 1, 0, 2.5, -1, )(1, 0.5, 0.1, -2, 3, )(0, 1, 0, 1.5, 2, )/SVM, LogReg, PA, CW, ALOW, Nave Bayes, CNB, DT, RF, ANNK-means, Spectral Clustering,NNF, MMC, LSI, LDA, GM, DPHMM, MRF, CRF, l 12. l l l 12 1 1 0.7 1500 2 1 1 1IT 13. DeepLearningl l STEP1 l STEP2 l l l Feature Engineeringl l l l 13 14. lll l l l l 142562 15. (PCA: Principal Component Analysis)l l XX = UVT U, VTl l redsvd1PCA15 16. l ll llBurrows Wheelerl l 16 17. 17 18. 18l l 19. DistBelief [J. Dean+, NIPS 13]19- (SGD- (L-BFGS)- 16000Youtube 200 x 200 1000AutoEncoderRICADNN 20. 20 21. 21 22. [Richard+ ]l PDF22 23. l NN//l l l l l 23 24. Disentaglingl l l l GoogleImage netl l 24 25. 2DNN25 26. DNN = Principal of Compositionalityl l l l DNNPrincipal of Compositionalityl l l 26 27. 27 28. = l DNNl l , Sentiment Analysisl l l l l DNNl 3fully-connected NN + dropout + maxoutl http://rodrigob.github.io/l DNN28