19
Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural Networks in Matlab and Applications in Biomedical Research Contact: [email protected] Web: https://web.math.princeton.edu/~mw25/about/

From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

  • Upload
    others

  • View
    11

  • Download
    0

Embed Size (px)

Citation preview

Page 1: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Melanie Weber

From Hopfield Models to the Neural Networks Toolbox: Implementing Neural Networks in Matlab and Applications in Biomedical Research

Contact: [email protected]: https://web.math.princeton.edu/~mw25/about/

Page 2: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Outline

❖ Introduction

❖ Matlab’s Neural Networks Toolbox

❖ How to build a Neural Network from scratch

❖ Hopfield Networks and Hebbian Learning

❖ Implementation

❖ Biomedical applications

Page 3: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Introduction: Neural Networks

Page 4: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Input Hidden Outputinput variables

Page 5: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Input Hidden Outputweights

Page 6: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Input Hidden Output

update network states

Page 7: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Input Hidden Output

activation function

Page 8: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Matlab’s Neural Networks Toolbox

Page 9: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Neural Networks ToolboxNetwork Architectures

Supervised UnsupervisedFeedforward Networks

Dynamic Networks

Learning Vector Quantification (LVQ)

- Perceptrons- Backpropagation- Nonlinear Feedforward* Prediction* Pattern Recognition* Fitting nonlinear functions

- Nonlinear Autoregression(NARX)- Recurrent Feedback Models- Hopfield Networks* Spatial-temporal Patterns* Learning & Control

Classification of not linearly separable patterns

Competitive LayersCategorization* Classification tasks* Pattern recognition

Self-organizing Mapstopology-preserving categorization* Classification tasks* Pattern recignition

Page 10: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

How to build a Neural Network from scratch

Page 11: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Hopfield Networks (Hebbian Learning)

Page 12: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Hopfield Networks (Hebbian Learning)

Matlab

Page 13: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Biomedical Application Modeling brain disorders with Hopfield Networks

Page 14: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

[Weber, Maia, Kutz (2016); submitted]

Focal Axonal Swellings as cause of Brain disorders

Page 15: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

[Weber, Maia, Kutz (2016); submitted]

Modelling FAS

Page 16: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Distribution of FAS mechanisms

[Weber, Maia, Kutz (2016); submitted]

Page 17: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

[Weber, Maia, Kutz (2016); submitted]

Implementation with Hopfield Networks

Page 18: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

[Weber, Maia, Kutz (2016); submitted]

Implementation with Hopfield Networks

Page 19: From Hopfield Models to the Neural Networks Toolbox ...mw25/files/MWeber_PICSciE-talk.pdf · Melanie Weber From Hopfield Models to the Neural Networks Toolbox: Implementing Neural

Thank you for your attention!

- Questions?