Upload
others
View
32
Download
0
Embed Size (px)
Citation preview
CSCE636NeuralNetworks(DeepLearning)
Lecture1:IntroductiontoDeepLearning
Anxiao (Andrew)Jiang
AI,MachineLearning,andDeepLearning
Coming up: Prerequisites forthecourse
Prerequisitesforthecourse
• FamiliarwiththePythonprogramminglanguage• Basicbackgroundinmachinelearning,linearalgebra,calculus.
Coming up: coursewebsite
Coursewebsite
• http://faculty.cse.tamu.edu/ajiang/636.html
Coming up: textbook
Textbook:DeepLearningwithPython(required)
Coming up: textbook
Textbook:DeepLearning(recommended)
Coming up: textbook
Textbook:DeepLearningQuickReference(recommended)
Coming up: textbook
Textbook:NeuralNetworksandDeepLearning(recommended)
Coming up: textbook
Textbook:LearningfromData(recommended)
Coming up: deep learning andneural network
DeepLearningandNeuralNetwork
NeuralNetworkInput Output
Whatneuralnetworkisdoing:computing(oftentransformationoffeatures/representations,andmakingafinaldecision).
Coming up: example oftransformation
Exampleoftransformation
Coming up: example oftransformation
Exampleoftransformation
Coming up: example ofdeepneural network (DNN)
ExampleofDeepNeuralNetwork(DNN)
Coming up: example ofDNN(continued)
ExampleofDNN(continued)
Coming up: example ofDNN
ExampleofDNN
Coming up:whataneural network does: learnafunction
Whataneuralnetworkdoes:learnafunction
NeuralNetworkx
valueoff(x)
Theneuralnetworklearnsthefunctionf(x),eitherexactlyorapproximately.
Coming up:whatisaneuron
Whatisaneuron
Coming up:whatisaneural network (NN)
Whatisaneuralnetwork
Coming up: how totrainaneural network
Howtotrainaneuralnetwork
NeuralNetworkx
valueoff(x)
Theneuralnetworklearnsthefunctionf(x),eitherexactlyorapproximately.
1.Usealotof(input,output)pairstotraintheneuralnetwork.2.Adjustweightstominimize thedifferencebetween f(x)andtheneuralnetwork’spredicted valuesoff(x)
Coming up: applications ofdeep learning
ApplicationsofDeepLearning
• Computervision(smartcamera,robot,self-drivingcars,etc.)• Naturallanguageprocessing(machinetranslation,chatbot,etc.)• Gameplaying(alphaGo,videogames,etc.)• Createartorproducts(painting,music,poem,fashion,etc.)• Datastorageandtransmission(datacompression,transmission,etc.)• Financeandeconomy(trading,recommendation,economysurvey,etc.)• Healthcare(readX-raypictures,diagnosis,drugdesign,etc.)• Physics,business,education,smarthomes,etc.(Moreandmoreapplicationseveryday.)
Coming up:whydeep learning now?
Whydeeplearningnow?
• Hardware:GPU,CUDA,parallelcomputing• Data:ImageNetandmanymore• Algorithms:activationfunctions,weight initializationschemes,optimizationschemesfortraining.
Coming up: homework (without submission)
Homework(withoutsubmission)
ReadChapter2BeforeNextClass
Coming up: Videos ondeep learning
Videosondeeplearning
• Howweteachcomputerstounderstandpictures,https://www.youtube.com/watch?v=40riCqvRoMs• ArtisticStyleTransferForVideos,https://www.youtube.com/watch?v=Uxax5EKg0zA• ChopinMusicGenerationwithRNN(RecurrentNeuralNetworks)andDeepLearning,https://www.youtube.com/watch?v=j60J1cGINX4