1
Rabindra Nath Sen (1896-1974) dual parallel transports (ca 1945-1950) Pythagoras of Samos (c. 570-495 BC) Pythagoras’ theorem Georg F. B. Riemann (1826–1866) metric tensor (1854) g = g ij dθ i dθ j Riemannian manifold (M,g) Harold Hotelling (1895-1973) Econometrician Fisher metric (1930) Sir Ronald Aylmer Fisher (1890-1962) Mathematical statistics Fisher information, MLE Euclid (ca 365-300 BC) Elements, math. proof Playfair axiom, Euclidean geometry a b c c 2 = a 2 + b 2 Nikolai Ivanovich Lobachevsky (1792-1856) Hyperbolic geometry (-many lines passing through a point and // to another line) 2021 Frank Nielsen, All rights reserved Christian Felix Klein (1849-1925) Projective geometry & symmetry group Erlangen program ´ Elie Joseph Cartan (1869-1951) affine connections differential forms ω dx 1 dx 2 ds 2 = g ij dx i dx j Sir Harold Jeffreys (1891-1989) Jeffreys prior q |g| J -divergence Alexander Petrovich Norden (1904-1993) conjugate connections wrt g Affinely connected spaces Images Wikipedia Calyampudi Radhakrishna Rao (1920-) Fisher-Rao distance Cram´ er-Rao lower bound (1945) Wilhelm Johann E. Blaschke (1885-1962) Affine differential geometry Claude Elwood Shannon (1916-2001) Information theory Entropy: h(p)= - R p log pdμ Solomon Kullback (1907-1994) Richard A. Leibler (1914-2003) KL divergence D KL [p : q]= R p log p q dμ Ernest Borisovich Vinberg (1937-2020) characteristic functions on Homogeneous cones Nikolai Nikolaevich Chentsov (1930-1992) statistical invariance geometrostatistics Category theory, connections ImreCsisz´ar (1938-) information projections f -divergences I f [p : q]= R pf ( q p )dμ Bradley Efron (1938-) statistical curvature E-connection Ole E. Barndorff-Nielsen (1935-) Exponential families observed information geometry Shun-ichi Amari (1936-) Information geometry dual ±α-connections (M,g F , -α , α ) Steffen Lauritzen (1947-) statistical manifold (M,g,C ) Jean-Louis Koszul (1921-2018) Hirohiko Shima homogeneous bounded domains (incomplete & partial due to space limitation) D(P : Q)+ D(Q : R)= D(P : R) Generalized Pythagoras’ theorem in dually flat space (M,g, , * ) g * Q P R Genesis of Information Geometry Information geometry journal (2018-)

Genesis of Information Geometry

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Genesis of Information Geometry

Rabindra Nath Sen(1896-1974)

dual parallel transports(ca 1945-1950)

Pythagoras of Samos(c. 570-495 BC)

Pythagoras’ theorem

Georg F. B. Riemann(1826–1866)

metric tensor (1854)g = gijdθi ⊗ dθj

Riemannian manifold (M, g)

Harold Hotelling(1895-1973)

EconometricianFisher metric

(1930)

Sir Ronald Aylmer Fisher(1890-1962)

Mathematical statisticsFisher information, MLE

Euclid(ca 365-300 BC)

Elements, math. proofPlayfair axiom, Euclidean geometry

a

b

c

c2 = a2 + b2

Nikolai Ivanovich Lobachevsky(1792-1856)

Hyperbolic geometry(∞-many lines passing through a point and

// to another line)

© 2021 Frank Nielsen, All rights reserved

Christian Felix Klein(1849-1925)

Projective geometry & symmetry groupErlangen program

Elie Joseph Cartan(1869-1951)

affine connectionsdifferential forms ω

dx1

dx2

ds 2=gij dx idx j

Sir Harold Jeffreys(1891-1989)

Jeffreys prior ∝√|g|

J-divergence

Alexander Petrovich Norden(1904-1993)

conjugate connections wrt gAffinely connected spaces

Images© Wikipedia

Calyampudi Radhakrishna Rao(1920-)

Fisher-Rao distanceCramer-Rao lower bound

(1945)

Wilhelm Johann E. Blaschke(1885-1962)

Affine differential geometry

Claude Elwood Shannon(1916-2001)

Information theoryEntropy:

h(p) = −∫p log pdµ

Solomon Kullback(1907-1994)

Richard A. Leibler(1914-2003)

KL divergenceDKL[p : q] =

∫p log p

qdµ

Ernest Borisovich Vinberg(1937-2020)

characteristic functionson Homogeneous cones

Nikolai Nikolaevich Chentsov(1930-1992)

statistical invariancegeometrostatistics

Category theory, connections

Imre Csiszar(1938-)

information projectionsf -divergences

If [p : q] =∫pf( q

p)dµ

Bradley Efron(1938-)

statistical curvatureE-connection

Ole E. Barndorff-Nielsen(1935-)

Exponential familiesobserved information geometry

Shun-ichi Amari(1936-)

Information geometrydual ±α-connections

(M, gF ,∇−α,∇α)

Steffen Lauritzen(1947-)

statistical manifold (M, g, C)

Jean-Louis Koszul(1921-2018)

Hirohiko Shimahomogeneous bounded domains

(incomplete & partial due to space limitation)

D(P : Q) +D(Q : R) = D(P : R)Generalized Pythagoras’ theoremin dually flat space (M, g,∇,∇∗)

g ∇∗∇

Q

P

R

Genesis of Information Geometry

Information geometryjournal (2018-)