41
Deep Learning with Convolutional Neural Network ujava.org Workshop 2015-04-06 www.idosi.com CEO 강신동 Shindong KANG (주)지능도시

ujava.org Deep Learning with Convolutional Neural Network

  • Upload
    -

  • View
    250

  • Download
    2

Embed Size (px)

Citation preview

Page 1: ujava.org Deep Learning with Convolutional Neural Network

Deep Learning with Convolutional Neural Network

ujava.org Workshop

2015-04-06

www.idosi.com

CEO 강신동

Shindong KANG

(주)지능도시

http://www.idosi.com/
Page 2: ujava.org Deep Learning with Convolutional Neural Network

www.idosi.comujava.org

Page 3: ujava.org Deep Learning with Convolutional Neural Network

www.idosi.comspaceapi.org

Page 4: ujava.org Deep Learning with Convolutional Neural Network

SVM (Support Vector Machine)

Page 5: ujava.org Deep Learning with Convolutional Neural Network

SVM : add features

Page 6: ujava.org Deep Learning with Convolutional Neural Network

SVM : linear separable

https://www.youtube.com/watch?v=3liCbRZPrZA
Page 7: ujava.org Deep Learning with Convolutional Neural Network

SVM : Kernel functions

Page 8: ujava.org Deep Learning with Convolutional Neural Network

SVM : Margin & Support Vectors

Page 9: ujava.org Deep Learning with Convolutional Neural Network

SVM : Soft Margin

Page 10: ujava.org Deep Learning with Convolutional Neural Network

Differential Equation

F = ma F = mg (g=9.8m/sec2, 10m/sec2)

ma = mg a = g y'' = g

y'' – g = 0

Page 11: ujava.org Deep Learning with Convolutional Neural Network

Differential Equation

Page 12: ujava.org Deep Learning with Convolutional Neural Network

Laplace Transform

Laplace Transform > Fourier Transform

Time domain → Frequency domain

Linearity

Page 13: ujava.org Deep Learning with Convolutional Neural Network

Solving DiffEq with Laplace Transform

Page 14: ujava.org Deep Learning with Convolutional Neural Network

Linear System

Page 15: ujava.org Deep Learning with Convolutional Neural Network

Dirac delta function

Physicist Dirac's function for Quantum Physics

Page 16: ujava.org Deep Learning with Convolutional Neural Network

Impulse Diagnosis

https://www.youtube.com/watch?v=sI9pC5lPc-8
https://www.youtube.com/watch?v=y_WT0MTA0gI
Page 17: ujava.org Deep Learning with Convolutional Neural Network

Impulse Response

Page 18: ujava.org Deep Learning with Convolutional Neural Network

www.idosi.comImpulse Response

Page 19: ujava.org Deep Learning with Convolutional Neural Network

Time-invariant System

Page 20: ujava.org Deep Learning with Convolutional Neural Network

Convolution

Page 21: ujava.org Deep Learning with Convolutional Neural Network

Convolution (합성곱)

Page 22: ujava.org Deep Learning with Convolutional Neural Network

Convolution function graph

http://commons.wikimedia.org/wiki/File:Convolution_of_spiky_function_with_box.gif
Page 23: ujava.org Deep Learning with Convolutional Neural Network

Solving Convolution equation

Page 24: ujava.org Deep Learning with Convolutional Neural Network

Convolution in 2D

Page 25: ujava.org Deep Learning with Convolutional Neural Network

Convolution in 2D

Page 26: ujava.org Deep Learning with Convolutional Neural Network

www.idosi.comConvolution in Neural Network

Page 27: ujava.org Deep Learning with Convolutional Neural Network

www.idosi.comConvolution with Kernel

Page 28: ujava.org Deep Learning with Convolutional Neural Network

www.idosi.comImage Convolution

Page 29: ujava.org Deep Learning with Convolutional Neural Network

www.idosi.com3D Kernel

Page 30: ujava.org Deep Learning with Convolutional Neural Network

www.idosi.comFully connected neural network

Page 31: ujava.org Deep Learning with Convolutional Neural Network

www.idosi.comMax pooling, Avg pooling

Page 32: ujava.org Deep Learning with Convolutional Neural Network

www.idosi.comPooling effect

Page 33: ujava.org Deep Learning with Convolutional Neural Network

www.idosi.comCNN

Page 34: ujava.org Deep Learning with Convolutional Neural Network

www.idosi.comCNN

Page 35: ujava.org Deep Learning with Convolutional Neural Network

www.idosi.comOverfitting

Page 36: ujava.org Deep Learning with Convolutional Neural Network

www.idosi.comDrop-out

Page 37: ujava.org Deep Learning with Convolutional Neural Network

www.idosi.comDrop-out effect

Page 38: ujava.org Deep Learning with Convolutional Neural Network

www.idosi.comNeuroph

http://neuroph.sourceforge.net

Page 39: ujava.org Deep Learning with Convolutional Neural Network

www.idosi.comGitHub ivan NeuralNetworks

Page 40: ujava.org Deep Learning with Convolutional Neural Network

www.idosi.comDL4J

Page 41: ujava.org Deep Learning with Convolutional Neural Network

Thank you !

(주)지능도시

Intelligent City Ltd.

강신동

Shindong KANG

[email protected]

mailto:[email protected]

Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Documents
Deep Convolutional Neural Network for Image …papers.nips.cc/paper/5485-deep-convolutional-neural...Deep Convolutional Neural Network for Image Deconvolution Li Xu ∗ LenovoResearch

Deep Convolutional Neural Network for Image …papers.nips.cc/paper/5485-deep-convolutional-neural...Deep Convolutional Neural Network for Image Deconvolution Li Xu ∗ LenovoResearch

Documents
CONVOLUTIONAL NEURAL NETWORKS: MOTIVATION, …

CONVOLUTIONAL NEURAL NETWORKS: MOTIVATION, …

Documents
Convolutional neural networks for direct inference of ...eprints.whiterose.ac.uk/142937/1/Convolutional Neural Networks for... · This is a repository copy of Convolutional neural

Convolutional neural networks for direct inference of ...eprints.whiterose.ac.uk/142937/1/Convolutional Neural Networks for... · This is a repository copy of Convolutional neural

Documents
Convolutional Neural Fabrics - arXiv

Convolutional Neural Fabrics - arXiv

Documents
Using Support Vector Machines, Convolutional … Support Vector Machines, Convolutional Neural Networks and ... Using Support Vector Machines, Convolutional Neural ... orcircuit ,andmuchANNresearch

Using Support Vector Machines, Convolutional … Support Vector Machines, Convolutional Neural Networks and ... Using Support Vector Machines, Convolutional Neural ... orcircuit ,andmuchANNresearch

Documents
ImageNet Classification with Deep Convolutional Neural ... · Convolutional neural networks Output Hidden Data Here's a one-dimensional convolutional neural network Each hidden neuron

ImageNet Classification with Deep Convolutional Neural ... · Convolutional neural networks Output Hidden Data Here's a one-dimensional convolutional neural network Each hidden neuron

Documents
ImageNet Classification with Deep Deep Convolutional …rita/visual_recog_course/talks/ImageNet... · ImageNet Classification with Deep Deep Convolutional Convolutional Neural Neural

ImageNet Classification with Deep Deep Convolutional …rita/visual_recog_course/talks/ImageNet... · ImageNet Classification with Deep Deep Convolutional Convolutional Neural Neural

Documents
Constrained Convolutional Neural Networks for …vgg/rg/slides/ccnn1.pdf · Constrained Convolutional Neural Networks for Weakly Supervised Segmentation ... [CCNN] Convolutional Neural

Constrained Convolutional Neural Networks for …vgg/rg/slides/ccnn1.pdf · Constrained Convolutional Neural Networks for Weakly Supervised Segmentation ... [CCNN] Convolutional Neural

Documents
Convolutional Neural Networksimft.ftn.uns.ac.rs/ssip2017/wp-content/uploads/... · Convolutional Neural Networks for Semantic ... Shelhamer, Darrell, Fully Convolutional Networks

Convolutional Neural Networksimft.ftn.uns.ac.rs/ssip2017/wp-content/uploads/... · Convolutional Neural Networks for Semantic ... Shelhamer, Darrell, Fully Convolutional Networks

Documents
Detecting Object Affordances with Convolutional Neural ...dkanou.github.io/publ/P9__Nguyen_Kanoulas_Caldwell_Tsagarakis__… · Detecting Object Affordances with Convolutional Neural

Detecting Object Affordances with Convolutional Neural ...dkanou.github.io/publ/P9__Nguyen_Kanoulas_Caldwell_Tsagarakis__… · Detecting Object Affordances with Convolutional Neural

Documents
Shepard Convolutional Neural Networks - Neural Information …papers.nips.cc/paper/5774-shepard-convolutional-neural... · 2016-02-16 · Shepard Convolutional Neural Networks (ShCNN)

Shepard Convolutional Neural Networks - Neural Information …papers.nips.cc/paper/5774-shepard-convolutional-neural... · 2016-02-16 · Shepard Convolutional Neural Networks (ShCNN)

Documents
Convolutional Neural Networks Analyzed via Convolutional ...yromano/posters/ml_csc_poster.pdf · Convolutional Neural Networks ... Recently, convolutional sparse coding (CSC)

Convolutional Neural Networks Analyzed via Convolutional ...yromano/posters/ml_csc_poster.pdf · Convolutional Neural Networks ... Recently, convolutional sparse coding (CSC)

Documents
Convolutional Neural Networks (CNN)

Convolutional Neural Networks (CNN)

Data & Analytics
Visualizing and Understanding Convolutional Neural ... - arXiv and Understanding Convolutional Neural ... - arXiv

Visualizing and Understanding Convolutional Neural ... - arXiv and Understanding Convolutional Neural ... - arXiv

Documents
Convolutional Neural Networks (CNNs) and Recurrent Neural

Convolutional Neural Networks (CNNs) and Recurrent Neural

Documents
Convolutional Neural Network

Convolutional Neural Network

Documents
Interpretable Convolutional Neural Networksopenaccess.thecvf.com/content...Convolutional_Neural_CVPR_2018_… · Interpretable Convolutional Neural Networks Quanshi Zhang, Ying Nian

Interpretable Convolutional Neural Networksopenaccess.thecvf.com/content...Convolutional_Neural_CVPR_2018_… · Interpretable Convolutional Neural Networks Quanshi Zhang, Ying Nian

Documents
Convolutional Neural Networks Analyzed via Convolutional ... · PDF fileConvolutional Neural Networks Analyzed via Convolutional Sparse Coding ... Deep Learning, Convolutional Neural

Convolutional Neural Networks Analyzed via Convolutional ... · PDF fileConvolutional Neural Networks Analyzed via Convolutional Sparse Coding ... Deep Learning, Convolutional Neural

Documents
Convolutional Neural Networks

Convolutional Neural Networks

Documents
CONVOLUTIONAL NEURAL NETWORK - UNNES

CONVOLUTIONAL NEURAL NETWORK - UNNES

Documents
Neural Predictive Coding using Convolutional Neural ...Neural Predictive Coding using Convolutional Neural Networks towards Unsupervised Learning of Speaker Characteristics Arindam

Neural Predictive Coding using Convolutional Neural ...Neural Predictive Coding using Convolutional Neural Networks towards Unsupervised Learning of Speaker Characteristics Arindam

Documents
Convolutional Neural Networks - Virginia Techjbhuang/teaching/ece5554-4554/fa17/... · Convolutional Neural Networks Computer Vision ... ImageNet Classification with Deep Convolutional

Convolutional Neural Networks - Virginia Techjbhuang/teaching/ece5554-4554/fa17/... · Convolutional Neural Networks Computer Vision ... ImageNet Classification with Deep Convolutional

Documents
Hyperbolic Graph Convolutional Neural Networkspapers.nips.cc › paper › 8733-hyperbolic-graph-convolutional-neural-networks.pdfGraph Convolutional Neural Networks (GCNs) are state-of-the-art

Hyperbolic Graph Convolutional Neural Networkspapers.nips.cc › paper › 8733-hyperbolic-graph-convolutional-neural-networks.pdfGraph Convolutional Neural Networks (GCNs) are state-of-the-art

Documents
IMPLEMETASI ALGORITMA CONVOLUTIONAL NEURAL …

IMPLEMETASI ALGORITMA CONVOLUTIONAL NEURAL …

Documents
Convolutional Neural Network · Convolutional Neural Networks (CNN) •A.k.a. CNN or ConvNet Adit Deshpande, A Beginner's Guide To Understanding Convolutional Neural Networks. Digital

Convolutional Neural Network · Convolutional Neural Networks (CNN) •A.k.a. CNN or ConvNet Adit Deshpande, A Beginner's Guide To Understanding Convolutional Neural Networks. Digital

Documents
Convolutional neural networks deepa

Convolutional neural networks deepa

Technology
Convolutional Neural Networks Arise From Ising Models and ...web.stanford.edu/~sunilpai/convolutional-neural-networks.pdf · Convolutional neural networks are an attractive option

Convolutional Neural Networks Arise From Ising Models and ...web.stanford.edu/~sunilpai/convolutional-neural-networks.pdf · Convolutional neural networks are an attractive option

Documents
Convolutional Neural Networkscis581/Lectures/Fall2018/CNN-intr… · Convolutional Neural Network (CNN) Pipeline: A Monitor. Convolutional Neural Nets (CNNs) in a nutshell: • A

Convolutional Neural Networkscis581/Lectures/Fall2018/CNN-intr… · Convolutional Neural Network (CNN) Pipeline: A Monitor. Convolutional Neural Nets (CNNs) in a nutshell: • A

Documents
Neural Network Part 3: Convolutional Neural Networkspages.cs.wisc.edu/.../lecture12-neural-networks-3.pdf · Convolutional neural networks •Strong empirical application performance

Neural Network Part 3: Convolutional Neural Networkspages.cs.wisc.edu/.../lecture12-neural-networks-3.pdf · Convolutional neural networks •Strong empirical application performance

Documents