15
Jeanna Nikolov-Ramirez . MEi:CogSci 2015 Supervisor: T.Schöberl. June 2015 CONNECTIONIST AND DYNAMICAL SYSTEMS APPROACHES TO COGNITION Based on: “Letting structure emerge: Connectionist and dynamical systems approaches to cognition” (McClell and, et al., 2010)

Connectionist and dynamical systems approaches to cognition, based on McClelland et al 2010

Embed Size (px)

Citation preview

Page 1: Connectionist and dynamical systems approaches to cognition, based on McClelland et al 2010

J e a n n a N i k o l o v - R a m i r e z . M E i : C o g S c i 2 0 1 5 S u p e r v i s o r : T. S c h ö b e r l . J u n e 2 0 1 5

CONNECTIONIST AND DYNAMICAL SYSTEMS APPROACHES TO COGNITION

Based on: “Letting structure emerge: Connectionist and dynamical systems approaches to cognition” (McClelland, et al., 2010)

https://lh3.googleusercontent.com/-Cbr3OJ-Wqq0/U8vLJB5r4XI/AAAAAAAAAGU/4-lrLwF_aG4/s150-c/photo.jpg

Page 2: Connectionist and dynamical systems approaches to cognition, based on McClelland et al 2010

OUTLINE

•  Authors •  Definitions •  Emergence •  Connectionism •  Semantic Cognition •  Universal Grammar •  A-not-B error

•  Structured Probabilistic Approaches

•  Arguments against Structured Probabilistic Models

•  Pending Questions

https://s-media-cache-ak0.pinimg.com/236x/e2/c1/c7/e2c1c71f4bf666c327d5aa5f55c42773.jpg

Page 3: Connectionist and dynamical systems approaches to cognition, based on McClelland et al 2010

AUTHORS

•  James L McClelland, Psychology, Stanford

•  Matthew M. Botvinick, Psychology, Princeton/Cornell etc.

•  David C. Noelle, Associate Professor, School of Social Sciences, Humanities, and Arts, Merced

•  David C. Plout, Computational Psycholinguist

•  Timothy T. Rogers, Psychologist •  Mark S. Seidenberg, Psychologist •  Linda B. Smith, Distinguished

Professor and Chancellor's Professor of Psychological and Brain Sciences

Page 4: Connectionist and dynamical systems approaches to cognition, based on McClelland et al 2010

EMERGENT ANT HILLS

“Ants are sensitive to certain gasses within their nests; when these gasses build up they move grains of dirt to the outside. This activity lets the gasses escape and has the byproduct of creating the elaborate structure of the nest.”

Page 5: Connectionist and dynamical systems approaches to cognition, based on McClelland et al 2010

EMERGENCE

“Human thoughts, language and behavior have a rich and complex structure that is the emergent consequence of a large number of simpler processes.”

Page 6: Connectionist and dynamical systems approaches to cognition, based on McClelland et al 2010

CONNECTIONISM

•  Neurons basic information processing structures in the brain

•  Every sort of information the brain processes occurs in networks of interconnected neurons.

•  Models knowledge and knowledge acquisition as adjusting strengths on connections of networks of “neuron-like processing units”

Neural Networks http://www.iep.utm.edu/wp-content/media/Figure-4-Backprop-Net.gif

Page 7: Connectionist and dynamical systems approaches to cognition, based on McClelland et al 2010

SEMANTIC COGNITION

UNIVERSAL GRAMMAR

http://www.uark.edu/misc/lampinen/sm.html

Page 8: Connectionist and dynamical systems approaches to cognition, based on McClelland et al 2010

A-NOT-B ERROR

Page 9: Connectionist and dynamical systems approaches to cognition, based on McClelland et al 2010

STRUCTURED PROBABILISTIC APPROACHES TO COGNITION

Page 10: Connectionist and dynamical systems approaches to cognition, based on McClelland et al 2010

MARR’S TRI-LEVEL HYPOTHESIS

•  Computational Level WHAT?

•  Algorithmic Level HOW?

•  Implementational Level PHYSICALLY REALIZED?

http://academic.reed.edu/biology/courses/BIO342/2012_syllabus/2012_WEBSITES/Erin_A_and_Ryan_S%2011-20final/images/Seed%20at%20al%202009%20fig%202%20morphpsychmodel.jpeg

Page 11: Connectionist and dynamical systems approaches to cognition, based on McClelland et al 2010

ARGUMENTS AGAINST PROBABILISTIC MODELS

•  No real basis – not representative of the actual processes – use of probabilistic models is unnecessary and dangerous

•  Don’t account for (explain) the development of cognitive abilities •  What if the high-level models are wrong? •  NOT about probabilities – both approaches emphasize statistics •  NOT about bottom-up over top-down – both are important •  IS about cognition being a choice of statistical models

Page 12: Connectionist and dynamical systems approaches to cognition, based on McClelland et al 2010

COGNITIVE MODEL: DEVELOPMENT

•  Probabilistic: •  Stages of development (Piaget) •  Object permanence

•  A-not-B •  Objects exist independent of one’s own action •  Not an explicit focus of research in probabilistic modeling

•  Connectionist: •  Dynamic Field Theory – integrates multiple sources of relevant

information •  Situation (events, past reaches, object positions) •  Motor planning (direction of next reach)

Page 13: Connectionist and dynamical systems approaches to cognition, based on McClelland et al 2010

CONCLUSIONS

•  Cognition depends fundamentally on underlying mechanism – abstract models will miss important aspects

•  Connectionist modeling efforts have led to advances in cognitive theories

•  Authors advocate an integrated approach where high-level models are informed by knowledge about underlying neural mechanisms

Page 14: Connectionist and dynamical systems approaches to cognition, based on McClelland et al 2010

PENDING QUESTIONS

1.  Why is there a need to model cognition? 2.  Are there other types of symbolic models

(other than probabilistic) that may be appropriate for cognitive modeling?

3.  Is there always a need to choose one modeling approach over the other?

4.  Did the authors convincingly demonstrate that higher cognitive abilities can be modeled at the connectionist level?

5.  “Understanding how each and every neuron functions still tells us absolutely nothing about how the brain manufactures a mental state.” (Gazzaniga, 2010)

6.  Problem of Consciousness

Page 15: Connectionist and dynamical systems approaches to cognition, based on McClelland et al 2010

THANK YOU! Questions?

[email protected]