22
Recurrent Neural Networks Mohsen Afsharchi

Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

  • Upload
    others

  • View
    8

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

Recurrent Neural NetworksMohsen Afsharchi

Page 2: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized
Page 3: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

Basic Structure

Page 4: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

Sentiment Analysis

Page 5: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

English to Slang English

Page 6: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

English to Slang English

Page 7: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized
Page 8: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

CNN vs RNN

Page 9: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

Language Model

Page 10: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

Vanilla RNN

Page 11: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

Vanilla RNN

Page 12: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

Vanilla RNN

Page 13: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

Vanilla RNN

Page 14: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

Vanilla RNN

Page 15: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

Vanilla RNN

Page 16: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

Forward propagation and backpropagation

Page 17: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized
Page 18: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized
Page 19: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

One-to-One Sequence Problems with a Single Feature

Page 20: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

Stacked RNN

Page 21: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

One-to-One Sequence Problems with Multiple Features

Page 22: Recurrent Neural Networks - znu.ac.ircv.znu.ac.ir/afsharchim/DeepL/RNN1.pdf · Summary of RNN types (1) Vanilla mode of processing without RNN, from fixed-sized input to fixed-sized

One-to-One Sequence Problems with Multiple Features