• Home

  • Documents

  • A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction...
58
A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets

A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations

A Brief Introduction to Convolutional Networks

Yingbo Zhou

Intro to Conv Nets

Page 2: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations

Neural science inspirations

(Image from Carandini 2006)

Visual receptive fields in cat brain (simple cell)

(Image from DeAngelis et al. 1999)

Intro to Conv Nets

Page 3: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations

Following slides are from DR. Rob Fergus Tutorial slides in NIPS2013

Intro to Conv Nets

Page 4: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 5: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 6: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 7: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 8: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 9: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 10: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 11: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 12: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 13: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 14: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 15: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 16: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 17: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 18: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 19: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 20: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 21: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 22: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 23: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 24: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 25: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 26: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 27: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 28: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 29: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 30: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 31: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 32: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 33: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 34: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 35: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 36: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 37: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 38: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 39: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 40: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 41: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 42: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 43: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 44: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 45: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 46: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 47: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 48: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 49: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 50: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 51: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 52: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 53: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 54: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 55: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 56: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 57: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations
Page 58: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations

Convolutional Code

Convolutional Code

Documents
Convolutional Code Performance

Convolutional Code Performance

Documents
Convolutional Networks

Convolutional Networks

Documents
02 Convolutional Codes

02 Convolutional Codes

Documents
Convolutional Neural Networks Analyzed via Convolutional ...yromano/posters/ml_csc_poster.pdf · Convolutional Neural Networks ... Recently, convolutional sparse coding (CSC)

Convolutional Neural Networks Analyzed via Convolutional ...yromano/posters/ml_csc_poster.pdf · Convolutional Neural Networks ... Recently, convolutional sparse coding (CSC)

Documents
Deep Convolutional Inverse Graphics Networkpapers.nips.cc/paper/5851-deep-convolutional-inverse-graphics-network.pdfDeep Convolutional Inverse Graphics Network Tejas D. Kulkarni*1,

Deep Convolutional Inverse Graphics Networkpapers.nips.cc/paper/5851-deep-convolutional-inverse-graphics-network.pdfDeep Convolutional Inverse Graphics Network Tejas D. Kulkarni*1,

Documents
Very Deep Convolutional Neural Networks for Noise …...convolutional layers with carefully tuned architecture. •ASR: Very Deep Convolutional Neural Networks uses up to 10 convolutional

Very Deep Convolutional Neural Networks for Noise …...convolutional layers with carefully tuned architecture. •ASR: Very Deep Convolutional Neural Networks uses up to 10 convolutional

Documents
Simulation of Convolutional

Simulation of Convolutional

Documents
Bidirectional Recurrent Convolutional Networks for …papers.nips.cc/paper/5778-bidirectional-recurrent-convolutional... · Bidirectional Recurrent Convolutional Networks for Multi-Frame

Bidirectional Recurrent Convolutional Networks for …papers.nips.cc/paper/5778-bidirectional-recurrent-convolutional... · Bidirectional Recurrent Convolutional Networks for Multi-Frame

Documents
Using Support Vector Machines, Convolutional Neural ... · Using Support Vector Machines, Convolutional Neural Networks and ... Using Support Vector Machines, Convolutional Neural

Using Support Vector Machines, Convolutional Neural ... · Using Support Vector Machines, Convolutional Neural Networks and ... Using Support Vector Machines, Convolutional Neural

Documents
Convolutional Neural Networks Analyzed via Convolutional ... · PDF fileConvolutional Neural Networks Analyzed via Convolutional Sparse Coding ... Deep Learning, Convolutional Neural

Convolutional Neural Networks Analyzed via Convolutional ... · PDF fileConvolutional Neural Networks Analyzed via Convolutional Sparse Coding ... Deep Learning, Convolutional Neural

Documents
CONVOLUTIONAL CODES

CONVOLUTIONAL CODES

Documents
ImageNet Classification with Deep Deep Convolutional …rita/visual_recog_course/talks/ImageNet... · ImageNet Classification with Deep Deep Convolutional Convolutional Neural Neural

ImageNet Classification with Deep Deep Convolutional …rita/visual_recog_course/talks/ImageNet... · ImageNet Classification with Deep Deep Convolutional Convolutional Neural Neural

Documents
Convolutional Neural Networks Arise From Ising Models and ...web.stanford.edu/~sunilpai/convolutional-neural-networks.pdf · Convolutional neural networks are an attractive option

Convolutional Neural Networks Arise From Ising Models and ...web.stanford.edu/~sunilpai/convolutional-neural-networks.pdf · Convolutional neural networks are an attractive option

Documents
Using Support Vector Machines, Convolutional … Support Vector Machines, Convolutional Neural Networks and ... Using Support Vector Machines, Convolutional Neural ... orcircuit ,andmuchANNresearch

Using Support Vector Machines, Convolutional … Support Vector Machines, Convolutional Neural Networks and ... Using Support Vector Machines, Convolutional Neural ... orcircuit ,andmuchANNresearch

Documents
Convolutional Neural Networks for Language•Convolutional Neural Networks: A brief history •The two operations in a CNN –Convolution –Pooling •Convolution + Pooling as a building

Convolutional Neural Networks for Language•Convolutional Neural Networks: A brief history •The two operations in a CNN –Convolution –Pooling •Convolution + Pooling as a building

Documents
Doubly Convolutional Neural Networks - papers.nips.ccpapers.nips.cc/paper/6340-doubly-convolutional-neural-networks.pdf · convolutional neural network (DCNN). In Figure 3 we have

Doubly Convolutional Neural Networks - papers.nips.ccpapers.nips.cc/paper/6340-doubly-convolutional-neural-networks.pdf · convolutional neural network (DCNN). In Figure 3 we have

Documents
Richer Convolutional Features for Edge Detectionopenaccess.thecvf.com/...Richer_Convolutional_Features_CVPR_2017… · Richer Convolutional Features for Edge Detection ... convolutional

Richer Convolutional Features for Edge Detectionopenaccess.thecvf.com/...Richer_Convolutional_Features_CVPR_2017… · Richer Convolutional Features for Edge Detection ... convolutional

Documents
Convolutional Neural Networksimft.ftn.uns.ac.rs/ssip2017/wp-content/uploads/... · Convolutional Neural Networks for Semantic ... Shelhamer, Darrell, Fully Convolutional Networks

Convolutional Neural Networksimft.ftn.uns.ac.rs/ssip2017/wp-content/uploads/... · Convolutional Neural Networks for Semantic ... Shelhamer, Darrell, Fully Convolutional Networks

Documents
Convolutional Codes (1)

Convolutional Codes (1)

Documents
Convolutional Neural Networks - Virginia Techjbhuang/teaching/ece5554-4554/fa17/... · Convolutional Neural Networks Computer Vision ... ImageNet Classification with Deep Convolutional

Convolutional Neural Networks - Virginia Techjbhuang/teaching/ece5554-4554/fa17/... · Convolutional Neural Networks Computer Vision ... ImageNet Classification with Deep Convolutional

Documents
Convolutional encoding

Convolutional encoding

Documents
Accelerating Convolutional Neural Network Systemshgrg1/publications/honours.pdf · 2015-07-29 · Accelerating Convolutional Neural Network Systems ... Convolutional Neural Networks

Accelerating Convolutional Neural Network Systemshgrg1/publications/honours.pdf · 2015-07-29 · Accelerating Convolutional Neural Network Systems ... Convolutional Neural Networks

Documents
Convolutional Codes R-J Chen. p2. OUTLINE [1] Shift registers and polynomials [2] Encoding convolutional codes [3] Decoding convolutional codes

Convolutional Codes R-J Chen. p2. OUTLINE [1] Shift registers and polynomials [2] Encoding convolutional codes [3] Decoding convolutional codes

Documents
Shepard Convolutional Neural Networks - Neural Information …papers.nips.cc/paper/5774-shepard-convolutional-neural... · 2016-02-16 · Shepard Convolutional Neural Networks (ShCNN)

Shepard Convolutional Neural Networks - Neural Information …papers.nips.cc/paper/5774-shepard-convolutional-neural... · 2016-02-16 · Shepard Convolutional Neural Networks (ShCNN)

Documents
Convolutional Phase Retrievalpapers.nips.cc/paper/7189-convolutional-phase-retrieval.pdf · 2018-02-13 · Convolutional Phase Retrieval Qing Qu Columbia University qq2105@columbia.edu

Convolutional Phase Retrievalpapers.nips.cc/paper/7189-convolutional-phase-retrieval.pdf · 2018-02-13 · Convolutional Phase Retrieval Qing Qu Columbia University [email protected]

Documents
Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Convolutional Neural Networks for Object Recognition...Overview •What is Computer Vision ? •Convolutional Neural Networks •Convolutional Networks for Visual Object Recognition

Documents
Convolutional Neural Networks

Convolutional Neural Networks

Documents
Training Convolutional Neural Networksraul/RS/Training Convolutional... · • Data-dependent Initializations of Convolutional Neural Networks by Krähenbühl et al., ... In practice,

Training Convolutional Neural Networksraul/RS/Training Convolutional... · • Data-dependent Initializations of Convolutional Neural Networks by Krähenbühl et al., ... In practice,

Documents
Kwa Sey, PhD, MPH Yingbo Ma, MS Nannie Song, MPH

Kwa Sey, PhD, MPH Yingbo Ma, MS Nannie Song, MPH

Documents