인공지능 딥러닝 (Etri) 20160811 short deck

aidentify

인공지능 역사와

딥러닝 기술 소개2016. 8. 11

김 의 중

아이덴티파이

aidentify

Reinforcement Learning (RL)

aidentify

Alan Turing (1912 ~ 1954)

• 1936: Turing Machine

• 1941: Bombe (German Enigma Breaker)

• 1950: Turing Test

aidentify

Turing Machine (1936)

"On computable numbers, with an application to the Entscheidungsproblem“

Proceedings of the London Mathematical Society (1936)

aidentify

Z3 computer (1941)

First German

Programmable computer

that satisfied Turing

completeness

Konrad Zuse (1910 ~ 1995)

aidentify

Colossus Computer (1943)

Tommy Flowers, British

Engineer designed

Colossus with a collegue,

Max Newman to improve

Bombe that Turing

designed.

Tommy Flowers Max Newman

Colossus Mark2

aidentify

ENIAC (1945)

ENIAC (Electronic Numerical Integratorn And Computer)

developed by John Mauchly and J. Presper Eckert

at the University of Pennsylvania

with John von Neumann

Number of vacuum tubes : 17,480

ENIAC (1945)

John Mauchly J. Presper Eckert

aidentify

John von Neumann (1903 ~ 1957)

Computer by Institute for Advanced Study (1951)Report on EDVAC project (1945)

aidentify

IBM• Aiken Mark 1: Electromechanical computer (1944)

• IBM 603: First commercial computer (1946)

• IBM 701: First commercial scientific computer (1952)

• IBM 650: First mass-produced computer (1953)

• IBM 7000 series: First transistorized computer (1961)

• IBM System/360: IC-based Mainframe (1965)

• IBM PC: First personal computer (1981)

• IBM RS/6000: PowerPC-based HPC (1990)

• IBM BlueGene: Fastest computer (2004)

• IBM BlueGene/Q: Massively Parallel Computer (2013)

aidentify

Artificial IntelligenceDartmouth Conference (1946)

John McCarthy Marvin Minsky

Claude Shannon Nathaniel Rochester

Arthur Samuel

Ray SolomonoffOliver Selfridge

Hernert Simon Allen Newell

aidentify

Key members in AI inner circle

John McCarthy

Marvin Minsky

Nathaniel Rochester

Arthur Samuel

Hernert Simon

Allen Newell

LISP language, MIT AI LabMachine Learning, checker program on IBM 701

SNARC, MIT AI Lab

Designed IBM 701

Logic Theorist

General Problem Solver

Computational Cognitive

Psychology

aidentify

What is Artificial Intelligence?

Stuart Russel & Peter Norvig

“Artificial Intelligence: A Modern Approach”

1994 2003 2009

aidentify

AI Tree

Michael Mills, co-founder and chief strategy officer, Neota Logic

aidentify

Artificial Neural Network

대뇌피질

뉴런

시냅스

수상돌기

신경세포체

축색돌기

축색종말

Threshold Logic Unit (1943)

Warren McCullock Walter Pitts

aidentify

TLU

aidentify

Perceptron (1958)

Frank Rosenblatt’s Perceptron = TLU + Hebb’s Rule

weight factor

aidentify

SLP vs MLPx1

x2

yΣ |

x1

x2

y

Σ|θ=1

Σ|θ=1

Σ|θ=1

AND

OR

(1) (2) (3)

vs

aidentify

Deep Learning

Neuron = 1010

Synapse = 1014 (at birth) ~ 1013 (as growth)

Human Brain

aidentify

Feedforward Neural Network

. . .

. . .

. . .

. . .

. . .

입력층 출력층

은닉층

As being fed forward from input layer to output layer,

data become more unique value by weight factors

aidentify

Back Propagation

강아지 n

강아지 4

강아지 3

강아지 2

강아지 1

고양이?(예측값)

강아지(레이블)

피드포워드 (가중치 적용)

역전파 (가중치 수정)

비교

Paul Werbos (PhD thesis, Harvard University, 1974)

“Beyond Regression: New Tools for Prediction and Analysis in the Behavioral Sciences”

Adjustment process of weight factors by propagating error

from output layer to input layer as backward

aidentify

Gradient Descent

★

★

Min.

2D 3D

Find optimal weight factors minimizing quadratic objective function

aidentify

Convolution Neural Network

원본 이미지 컨볼루션 풀링 컨볼루션 풀링전체 연결된

신경망

강아지 (90%)

고양이 (30%)

인형 (10%)

비둘기 (0.5%)

컨볼루션 필터

aidentify

Regularization

★

★

L2 규제화 L1 규제화

aidentify

Use cases

image text

sound 𝑓(𝑡)

aidentify

Deep Learning Leaders

aidentify

Thank You

감사합니다