88
Unbalanced optimal transport and H div minimizing geodesics Fran¸ cois-Xavier Vialard LIGM, Univ. Gustave Eiffel Stochastic Differential Geometry and Mathematical Physics, Rennes , 2021

Unbalanced optimal transport and Hdiv minimizing geodesics

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Unbalanced optimal transport and Hdiv

minimizing geodesics

Francois-Xavier Vialard

LIGM, Univ. Gustave Eiffel

Stochastic Differential Geometry and Mathematical Physics, Rennes ,2021

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Contents

1 Unbalanced optimal transport

2 Link to fluid dynamics

3 Relaxation of geodesics

4 About tightness

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Unbalanced optimal transport

Optimal transport applications: Imaging, machine learning, gradientflows, ...

Bottleneck in optimal transport: data has fixed total mass.

• Relax the mass constraint to extend OT distance between positivemeasures of arbitrary mass.

• Develop associated numerical algorithms.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Unbalanced optimal transport

Figure – Optimal transport between bimodal densities

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Unbalanced optimal transport

Figure – Another transformation

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Bibliography before (june) 2015

Taking into account locally the change of mass:

Two directions: Static and dynamic.

• Bounded Lipschitz distance...

• Static, Partial Optimal Transport [Figalli & Gigli, 2010]

• Static, Hanin 1992, Benamou and Brenier 2001.

• Dynamic, Numerics, Metamorphoses [Maas et al. , 2015]

• Dynamic, Numerics, Growth model [Lombardi & Maitre, 2013]

• Dynamic and static, [Piccoli & Rossi, 2013, Piccoli & Rossi, 2014]

• . . .

No equivalent of L2 Wasserstein distance on positive measures.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Bibliography before (june) 2015

Taking into account locally the change of mass:

Two directions: Static and dynamic.

• Bounded Lipschitz distance...

• Static, Partial Optimal Transport [Figalli & Gigli, 2010]

• Static, Hanin 1992, Benamou and Brenier 2001.

• Dynamic, Numerics, Metamorphoses [Maas et al. , 2015]

• Dynamic, Numerics, Growth model [Lombardi & Maitre, 2013]

• Dynamic and static, [Piccoli & Rossi, 2013, Piccoli & Rossi, 2014]

• . . .No equivalent of L2 Wasserstein distance on positive measures.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Bibliography after june 2015

More than 300 pages on the same model!

Starting point: Dynamic formulation

• Dynamic, Numerics, Imaging [Chizat et al. , 2015]

• Dynamic, Geometry and Static [Chizat et al. , 2015]

• Dynamic, Gradient flow [Kondratyev et al. , 2015]

• Dynamic, Gradient flow [Liero et al. , 2015b]

• Static and more [Liero et al. , 2015a]

• Optimal transport for contact forms [Rezakhanlou, 2015]

• Static relaxation of OT, machine learning [Frogner et al. , 2015]

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Two possible directions

Pros and cons:

• Extend static formulation: Frogner et al.

minλKL(Proj1∗ γ, ρ1) + λKL(Proj2∗ γ, ρ2)

+

∫M2

γ(x , y)d(x , y)2 dx dy (1)

Good for numerics, but is it a distance ?

• Extend dynamic formulation: on the tangent space of a density,choose a metric on the transverse direction.Built-in metric property but does there exist a static formulation ?

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

An extension of Benamou-Brenier formulation

Add a source term in the constraint: (weak sense)

ρ = −∇ · (ρv) + αρ ,

where α can be understood as the growth rate.

WF2 def.= inf

(v ,α)

1

2

∫ 1

0

∫M

|v(x , t)|2ρ(x , t) dx dt

+δ2

2

∫ 1

0

∫M

α(x , t)2ρ(x , t) dx dt .

where δ is a length parameter.

Remark: very natural and not studied before.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

An extension of Benamou-Brenier formulation

Add a source term in the constraint: (weak sense)

ρ = −∇ · (ρv) + αρ ,

where α can be understood as the growth rate.

WF2 def.= inf

(v ,α)

1

2

∫ 1

0

∫M

|v(x , t)|2ρ(x , t) dx dt

+δ2

2

∫ 1

0

∫M

α(x , t)2ρ(x , t) dx dt .

where δ is a length parameter.Remark: very natural and not studied before.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Convex reformulation

Add a source term in the constraint: (weak sense)

ρ = −∇ ·m + µ .

The Wasserstein-Fisher-Rao metric:

WF2 def.= inf

(v ,α)

1

2

∫ 1

0

∫M

|m(x , t)|2

ρ(x , t)dx dt +

δ2

2

∫ 1

0

∫M

µ(x , t)2

ρ(x , t)dx dt .

• Fisher-Rao metric: Hessian of the Boltzmann entropy/Kullback-Leibler divergence and reparametrization invariant.Wasserstein metric on the space of variances in 1D.

• Convex and 1-homogeneous: convex analysis (existence and more)

• Numerics: First-order splitting algorithm: Douglas-Rachford.

• Code available athttps://github.com/lchizat/optimal-transport/

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Convex reformulation

Add a source term in the constraint: (weak sense)

ρ = −∇ ·m + µ .

The Wasserstein-Fisher-Rao metric:

WF2 def.= inf

(v ,α)

1

2

∫ 1

0

∫M

|m(x , t)|2

ρ(x , t)dx dt +

δ2

2

∫ 1

0

∫M

µ(x , t)2

ρ(x , t)dx dt .

• Fisher-Rao metric: Hessian of the Boltzmann entropy/Kullback-Leibler divergence and reparametrization invariant.Wasserstein metric on the space of variances in 1D.

• Convex and 1-homogeneous: convex analysis (existence and more)

• Numerics: First-order splitting algorithm: Douglas-Rachford.

• Code available athttps://github.com/lchizat/optimal-transport/

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

A general framework

Definition (Infinitesimal cost)

An infinitesimal cost is f : M ×R×Rd ×R→ R+ ∪ +∞ such that forall x ∈ M, f (x , ·, ·, ·) is convex, positively 1-homogeneous, lowersemicontinuous and satisfies

f (x , ρ,m, µ)

= 0 if (m, µ) = (0, 0) and ρ ≥ 0

> 0 if |m| or |µ| > 0

= +∞ if ρ < 0 .

Definition (Dynamic problem)

For (ρ,m, µ) ∈M([0, 1]×M)1+d+1, let

J(ρ,m, µ)def.=

∫ 1

0

∫M

f (x , dρdλ ,

dmdλ ,

dµdλ ) dλ(t, x) (2)

The dynamic problem is, for ρ0, ρ1 ∈M+(M),

C (ρ0, ρ1)def.= inf

(ρ,ω,ζ)∈CE10(ρ0,ρ1)

J(ρ, ω, ζ) . (3)

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Existence of minimizers

Proposition (Fenchel-Rockafellar)

Let B(x) be the polar set of f (x , ·, ·, ·) for all x ∈ M and assume it is alower semicontinuous set-valued function. Then the minimum of (3) isattained and it holds

CD(ρ0, ρ1) = supϕ∈K

∫M

ϕ(1, ·)dρ1 −∫M

ϕ(0, ·) dρ0 (4)

withK

def.=ϕ ∈ C 1([0, 1]×M) : (∂tϕ,∇ϕ,ϕ) ∈ B(x), ∀(t, x) ∈ [0, 1]×M

.

WF(x , y , z) =

|y |2+δ2z2

2x if x > 0,

0 if (x , |y |, z) = (0, 0, 0)

+∞ otherwise

and the corresponding Hamilton-Jacobi equation is

∂tϕ+1

2

(|∇ϕ|2 +

ϕ2

δ2

)≤ 0 .

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Existence of minimizers

Proposition (Fenchel-Rockafellar)

Let B(x) be the polar set of f (x , ·, ·, ·) for all x ∈ M and assume it is alower semicontinuous set-valued function. Then the minimum of (3) isattained and it holds

CD(ρ0, ρ1) = supϕ∈K

∫M

ϕ(1, ·)dρ1 −∫M

ϕ(0, ·) dρ0 (4)

withK

def.=ϕ ∈ C 1([0, 1]×M) : (∂tϕ,∇ϕ,ϕ) ∈ B(x), ∀(t, x) ∈ [0, 1]×M

.

WF(x , y , z) =

|y |2+δ2z2

2x if x > 0,

0 if (x , |y |, z) = (0, 0, 0)

+∞ otherwise

and the corresponding Hamilton-Jacobi equation is

∂tϕ+1

2

(|∇ϕ|2 +

ϕ2

δ2

)≤ 0 .

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Numerical simulations

Figure – WFR geodesic between bimodal densities

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Numerical simulations

•t = 0 t = 1t = 0.5

ρ0 ρ1

•t = 0 t = 1t = 0.5

ρ0 ρ1

Figure – Geodesics between ρ0 and ρ1 for (1st row) Hellinger, (2nd row) W2,(3rd row) partial OT, (4th row) WF.

An Interpolating Distance between Optimal Transport and Fisher-Rao, L.Chizat, B. Schmitzer, G. Peyre, and F.-X. Vialard, FoCM, 2016.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Numerical simulations

•t = 0 t = 1t = 0.5

ρ0 ρ1

•t = 0 t = 1t = 0.5

ρ0 ρ1

Figure – Geodesics between ρ0 and ρ1 for (1st row) Hellinger, (2nd row) W2,(3rd row) partial OT, (4th row) WF.

An Interpolating Distance between Optimal Transport and Fisher-Rao, L.Chizat, B. Schmitzer, G. Peyre, and F.-X. Vialard, FoCM, 2016.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Numerical simulations

•t = 0 t = 1t = 0.5

ρ0 ρ1

•t = 0 t = 1t = 0.5

ρ0 ρ1

Figure – Geodesics between ρ0 and ρ1 for (1st row) Hellinger, (2nd row) W2,(3rd row) partial OT, (4th row) WF.

An Interpolating Distance between Optimal Transport and Fisher-Rao, L.Chizat, B. Schmitzer, G. Peyre, and F.-X. Vialard, FoCM, 2016.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Numerical simulations

•t = 0 t = 1t = 0.5

ρ0 ρ1

•t = 0 t = 1t = 0.5

ρ0 ρ1

Figure – Geodesics between ρ0 and ρ1 for (1st row) Hellinger, (2nd row) W2,(3rd row) partial OT, (4th row) WF.

An Interpolating Distance between Optimal Transport and Fisher-Rao, L.Chizat, B. Schmitzer, G. Peyre, and F.-X. Vialard, FoCM, 2016.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Numerical simulations

•t = 0 t = 1t = 0.5

ρ0 ρ1

•t = 0 t = 1t = 0.5

ρ0 ρ1

Figure – Geodesics between ρ0 and ρ1 for (1st row) Hellinger, (2nd row) W2,(3rd row) partial OT, (4th row) WF.

An Interpolating Distance between Optimal Transport and Fisher-Rao, L.Chizat, B. Schmitzer, G. Peyre, and F.-X. Vialard, FoCM, 2016.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

A relaxed static OT formulation

Define

KL(γ, ν) =

∫dγ

dνlog

(dγ

)dν + |ν| − |γ|

WF 2(ρ1, ρ2) = infγ

KL(Proj1∗ γ, ρ1) + KL(Proj2∗ γ, ρ2)

−∫M2γ(x , y) log(cos2(d(x , y)/2 ∧ π/2))dx dy

TheoremOn a Riemannian manifold (compact without boundary), the static and dynamicformulations are equal.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

From dynamic to static

Group action

Mass can be moved and changed: consider m(t)δx(t).

Infinitesimal action

ρ = −∇ · (vρ) + µ ⇔

x(t) = v(t, x(t))

m(t) = µ(t, x(t))

A cone metric

WF2(x ,m) ((x , m), (x , m)) =1

2(mx2 +

m2

m) ,

Change of variable: r 2 = m...

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

From dynamic to static

Group action

Mass can be moved and changed: consider m(t)δx(t).

Infinitesimal action

ρ = −∇ · (vρ) + µ ⇔

x(t) = v(t, x(t))

m(t) = µ(t, x(t))

A cone metric

WF2(x ,m) ((x , m), (x , m)) =1

2(mx2 +

m2

m) ,

Change of variable: r 2 = m...

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

From dynamic to static

Group action

Mass can be moved and changed: consider m(t)δx(t).

Infinitesimal action

ρ = −∇ · (vρ) + µ ⇔

x(t) = v(t, x(t))

m(t) = µ(t, x(t))

A cone metric

WF2(x ,m) ((x , m), (x , m)) =1

2(mx2 +

m2

m) ,

Change of variable: r 2 = m...

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Riemannian cone

Definition

Let (M, g) be a Riemannian manifold. The cone over (M, g) is theRiemannian manifold (M × R∗+, r 2g + dr 2).

r

α

For M = S1(r), radius r ≤ 1. One has sin(α) = r .

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Riemannian cone

Definition

Let (M, g) be a Riemannian manifold. The cone over (M, g) is theRiemannian manifold (M × R∗+, r 2g + dr 2).

r

α

For M = S1(r), radius r ≤ 1. One has sin(α) = r .

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Geometry of a cone• Change of variable: WF2 = 1

2 r 2g + 2 dr 2.

• Non complete metric space: add the vertex M × 0.• The distance:

d((x1,m1), (x2,m2))2 =

m2 + m1 − 2√

m1m2 cos

(1

2dM(x1, x2) ∧ π

). (5)

• M = R then (x ,m) 7→√

me ix/2 ∈ C local isometry.

Proposition

If (M, g) has sectional curvature greater than 1, then(M × R∗+,m g + 1

4m dm2) has non-negative sectional curvature.For X ,Y two orthornormal vector fields on M,

K (X , Y ) = (Kg (X ,Y )− 1) (6)

where K and Kg denote respectively the sectional curvatures of M × R∗+and M.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Visualize geodesics for r 2g + dr 2

Figure – Geodesics on the cone

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Distance between Diracs

x

y

P1

P2

P3

1

4WF (m1δx1 ,m2δx2 )2 = m2 + m1 − 2

√m1m2 cos

(1

2dM(x1, x2) ∧ π/2

).

Proof: prove that an explicit geodesic is a critical point of the convexfunctional.

Properties: positively 1-homogeneous and convex in (m1,m2).

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Idea: Generalize Otto’s Riemannian submersion

SDiff(M): Isotropy

subgroup of µ

(Densp(M),W2) µ

Diff(M)

L2(M,M)

π(ϕ) = ϕ∗(µ)

Figure – A Riemannian submersion.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Idea: Generalize Otto’s Riemannian submersion

Isotropy

subgroup of µ

(Dens(M),WFR) µ

Diff(M) n C∞(M,R∗+)

L2(M, C(M))

π(ϕ, λ) = ϕ∗(λ2µ)

Figure – Similar picture in the unbalanced case.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Generalization of Otto’s Riemannian submersionIdea of a left group action:

π :(Diff(M) n C∞(M,R∗+)

)× Dens(M) 7→ Dens(M)

π ((ϕ, λ), ρ) := ϕ∗(λ2ρ)

Group law:

(ϕ1, λ1) · (ϕ2, λ2) = (ϕ1 ϕ2, (λ1 ϕ2)λ2) (7)

Theorem

Let ρ0 ∈ Dens(M) and π0 : Diff(M) n C∞(M,R∗+) 7→ Dens(M) definedby π0(ϕ, λ) := ϕ∗(λ

2ρ0). It is a Riemannian submersion

(Diff(M) n C∞(M,R∗+), L2(M,M × R∗+))π0−→ (Dens(M),WF)

(where M × R∗+ is endowed with the cone metric).

O’Neill’s formula: sectional curvature of (Dens(M),WF).

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Generalization of Otto’s Riemannian submersionIdea of a left group action:

π :(Diff(M) n C∞(M,R∗+)

)× Dens(M) 7→ Dens(M)

π ((ϕ, λ), ρ) := ϕ∗(λ2ρ)

Group law:

(ϕ1, λ1) · (ϕ2, λ2) = (ϕ1 ϕ2, (λ1 ϕ2)λ2) (7)

Theorem

Let ρ0 ∈ Dens(M) and π0 : Diff(M) n C∞(M,R∗+) 7→ Dens(M) definedby π0(ϕ, λ) := ϕ∗(λ

2ρ0). It is a Riemannian submersion

(Diff(M) n C∞(M,R∗+), L2(M,M × R∗+))π0−→ (Dens(M),WF)

(where M × R∗+ is endowed with the cone metric).

O’Neill’s formula: sectional curvature of (Dens(M),WF).

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Consequences

Monge formulation

WF (ρ0, ρ1) = inf(ϕ,λ)

‖(ϕ, λ)− (Id, 1)‖L2(ρ0) : ϕ∗(λ

2ρ0) = ρ1

(8)

Under existence and smoothness of the minimizer, there exists a functionp ∈ C∞(M,R) such that

(ϕ(x), λ(x)) = expC(M)x

(1

2∇p(x), p(x)

), (9)

Equivalent to Monge-Ampere equation

With zdef.= log(1 + p) one has

(1 + |∇z |2)e2zρ0 = det(Dϕ)ρ1 ϕ (10)

and

ϕ(x) = expM(x,1)

(arctan

(1

2|∇z |

)∇z(x)

|∇z(x)|

).

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Yet another equivalent formulation

Liero, Mielke, Savare, Invent. Math.

WFR is Wasserstein 2 on P(M × R+) with second moment constraint.

WFR(µ, ν) = minµ,ν

W2(µ, ν) (11)

with the constraint: ∫R+

r 2 dµ(x , r) = µ(x) , (12)

and ∫R+

r 2 dν(x , r) = ν(x) , (13)

Here r 2 = m.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Contents

1 Unbalanced optimal transport

2 Link to fluid dynamics

3 Relaxation of geodesics

4 About tightness

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Incompressible Euler and optimal transport

Optimal transport appears in the projection onto SDiff in Brenier’s work.

What is the corresponding fluid dynamic equation?

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Arnold’s remark on incompressible Euler

Sur la geometrie differentielle des groupes de Lie de dimension infinie etses applications a l’hydrodynamique des fluides parfaits, Ann. Inst.Fourier, 1966.

TheoremThe incompressible Euler equation is the geodesic flow of the(right-invariant) L2 Riemannian metric on SDiff(M) (volume preservingdiffeomorphisms).

• An intrinsic point of view by Ebin and Marsden, Groups ofdiffeomorphisms and the motion of an incompressible fluid, Ann. ofMath., 1970. Short time existence results for smooth initialconditions.

• An extrinsic point of view by Brenier, relaxation of the variationalproblem, optimal transport, polar factorization.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Arnold’s remark on incompressible Euler

Sur la geometrie differentielle des groupes de Lie de dimension infinie etses applications a l’hydrodynamique des fluides parfaits, Ann. Inst.Fourier, 1966.

TheoremThe incompressible Euler equation is the geodesic flow of the(right-invariant) L2 Riemannian metric on SDiff(M) (volume preservingdiffeomorphisms).

• An intrinsic point of view by Ebin and Marsden, Groups ofdiffeomorphisms and the motion of an incompressible fluid, Ann. ofMath., 1970. Short time existence results for smooth initialconditions.

• An extrinsic point of view by Brenier, relaxation of the variationalproblem, optimal transport, polar factorization.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Arnold’s remark continuedRewritten in terms of the flow ϕ, the action reads∫ 1

0

∫M

|∂tϕ(t, x)|2 dx dt , (14)

under the constraint

ϕ(t) ∈ SDiff(M) for all t ∈ [0, 1] . (15)

Riemannian submanifold point of view:

Let M → Rd be isometrically embedded: A smooth curve c(t) ∈ M is ageodesic if and only if c ⊥ TcM.

Incompressible Euler in Lagrangian form:ϕ = −∇p ϕϕ(t) ∈ SDiff(M) .

(16)

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Arnold’s remark continuedRewritten in terms of the flow ϕ, the action reads∫ 1

0

∫M

|∂tϕ(t, x)|2 dx dt , (14)

under the constraint

ϕ(t) ∈ SDiff(M) for all t ∈ [0, 1] . (15)

Riemannian submanifold point of view:

Let M → Rd be isometrically embedded: A smooth curve c(t) ∈ M is ageodesic if and only if c ⊥ TcM.

Incompressible Euler in Lagrangian form:ϕ = −∇p ϕϕ(t) ∈ SDiff(M) .

(16)

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

A geometric picture: Otto’s Riemannian submersion

SDiff(M): Isotropy

subgroup of µ

(Densp(M),W2) µ

Diff(M)

L2(M,M)

π(ϕ) = ϕ∗(µ)

Figure – A Riemannian submersion: SDiff(M) as a Riemannian submanifold ofL2(M,M): Incompressible Euler equation on SDiff(M)

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Riemannian submersionLet (M, gM) and (N, gN) be two Riemannian manifolds and f : M 7→ N adifferentiable mapping.

DefinitionThe map f is a Riemannian submersion if f is a submersion and for anyx ∈ M, the map dfx : Ker(dfx)⊥ 7→ Tf (x)N is an isometry.

• Vertx := Ker(df (x)) is the vertical space.

• Horxdef.= Ker(df (x))⊥ is the horizontal space.

• Geodesics on N can be lifted ”horizontally” to geodesics on M.

Theorem (O’Neill’s formula)

Let X ,Y be two orthonormal vector fields on M with horizontal lifts Xand Y , then

KN(X ,Y ) = KM(X , Y ) +3

4‖ vert([X , Y ])‖2

M . (17)

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Consequences

SDiff(M)

Id

g1

(Densp(M),W2) µ

Diff(M)

L2(M,M)

π(ϕ) = ϕ∗(µ)

Figure – A Riemannian submersion: SDiff(M) as a Riemannian submanifold ofL2(M,M): Incompressible Euler equation on SDiff(M)

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Consequences

SDiff(M)

Id

g1

(Densp(M),W2) µ π(g1) = µ1

Diff(M)

L2(M,M)

π(ϕ) = ϕ∗(µ)

Figure – A pre polar factorization

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Consequences

SDiff(M)

Id

g1

g0

(Densp(M),W2) µ π(g1) = µ1

Diff(M)

L2(M,M)

π(ϕ) = ϕ∗(µ)

Figure – Polar factorization: g0 = arg ming∈SDiff ‖g1 − g‖L2

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

The Riemannian submersion for WFR

Isotropy

subgroup of µ

(Dens(M),WFR) µ

Diff(M) n C∞(M,R∗+)

L2(M, C(M))

π(ϕ, λ) = ϕ∗(λ2µ)

Figure – The same picture in our case: what is the corresponding equation toEuler?

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

The isotropy subgroup for unbalanced optimal transport

Recall that

π−10 (ρ0) = (ϕ, λ) ∈ Diff(M) n C∞(M,R∗+) : ϕ∗(λ

2ρ0) = ρ0

π−10 (ρ0) = (ϕ,

√Jac(ϕ)) ∈ Diff(M) n C∞(M,R∗+) : ϕ ∈ Diff(M) .

The induced metric is

G (v , div v) =

∫M

|v |2 dµ+1

4

∫M

| div v |2 dµ . (18)

The Hdiv right-invariant metric on the group of diffeomorphisms.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

The isotropy subgroup for unbalanced optimal transport

Recall that

π−10 (ρ0) = (ϕ, λ) ∈ Diff(M) n C∞(M,R∗+) : ϕ∗(λ

2ρ0) = ρ0

π−10 (ρ0) = (ϕ,

√Jac(ϕ)) ∈ Diff(M) n C∞(M,R∗+) : ϕ ∈ Diff(M) .

The induced metric is

G (v , div v) =

∫M

|v |2 dµ+1

4

∫M

| div v |2 dµ . (18)

The Hdiv right-invariant metric on the group of diffeomorphisms.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Degenerate distances

Theorem (Michor and Mumford, 2005)

If V = L2, then dist is degenerate, that is dist(ϕ0, ϕ1) = 0.If V = Hdiv, then the distance is NOT degenerate.

Theorem (Case of Sobolev metrics H s)

If d = 1, dist is not degenerate iif s > 1/2. [Bauer et al., 2012]If d ≥ 2, dist is not degenerate iif s ≥ 1. [Jerrard et al., 2018].

Main point of the talk: closer look at the critical case: (Diff,Hdiv).Embed Hdiv flow isometrically in L2 + generalized flow a la Brenier

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Degenerate distances

Theorem (Michor and Mumford, 2005)

If V = L2, then dist is degenerate, that is dist(ϕ0, ϕ1) = 0.If V = Hdiv, then the distance is NOT degenerate.

Theorem (Case of Sobolev metrics H s)

If d = 1, dist is not degenerate iif s > 1/2. [Bauer et al., 2012]If d ≥ 2, dist is not degenerate iif s ≥ 1. [Jerrard et al., 2018].

Main point of the talk: closer look at the critical case: (Diff,Hdiv).Embed Hdiv flow isometrically in L2 + generalized flow a la Brenier

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

CH embeds in incompressible Euler (IE)

Interpret CH as incompressible Euler

Simple idea: replaceminx

f (x) + g(x) , (19)

withminx,y

f (x) + g(y) , (20)

under the constraint x = y .

Introduce div(v) = λ, obtain

infv(t),α

∫ 1

0

∫M

|v(t, x)|2 + δ2α(t, x)2 dx dt . (21)

under the constraint that div(v) = α.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

CH embeds in incompressible Euler (IE)

Interpret CH as incompressible Euler

Simple idea: replaceminx

f (x) + g(x) , (19)

withminx,y

f (x) + g(y) , (20)

under the constraint x = y .

Introduce div(v) = λ, obtain

infv(t),α

∫ 1

0

∫M

|v(t, x)|2 + δ2α(t, x)2 dx dt . (21)

under the constraint that div(v) = α.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Rewrite in Lagrangian coordinates

Compute flows of (v , α) from (Id, 1) : M ×M 7→ M × R>0.

Aut(M×R>0) = (ϕ, λ) |ϕ ∈ Diff(M), λ ∈ C (M,R>0) ⊂ Diff(M×R>0)(22)

It is a group.

infϕ,λ

∫ 1

0

∫M

(|∂t(ϕ)(t, x)|2 + δ2(∂t log(λ)(t, x)2)2)λ(t, x)dx dt , (23)

under the constraint that Jac(ϕ) = λ or equivalently

ϕ∗(λ Leb) = Leb . (24)

Also equivalent to

(ϕ, λ)∗[(1/r 3)dr d Leb] = (1/r 3)dr d Leb . (25)

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

An isometric embedding in L2(M ,M × R>0)

Up to a change of variable, λ = r 2, we get

infϕ,r

∫ 1

0

∫M

r(t, x)2|∂t(ϕ)(t, x)|2 + 4δ2(|∂tr(t, x)|2)dx dt , (26)

under the constraint Jac(ϕ) = r 2.If δ = 1/2, then M × R>0 with (M, g), then

r 2g + dr 2 (27)

is a cone metric.If M = S1 and δ = 1/2, then the metric is std Euclidean on R2

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

An isometric embedding in L2(M ,M × R>0)

Up to a change of variable, λ = r 2, we get

infϕ,r

∫ 1

0

∫M

r(t, x)2|∂t(ϕ)(t, x)|2 + 4δ2(|∂tr(t, x)|2)dx dt , (26)

under the constraint Jac(ϕ) = r 2.If δ = 1/2, then M × R>0 with (M, g), then

r 2g + dr 2 (27)

is a cone metric.If M = S1 and δ = 1/2, then the metric is std Euclidean on R2

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

A new geometric picture

Autvol(C(M))

(Dens(M),WFR) vol

Aut(C(M))

L2(M, C(M))

π(ϕ, λ) = ϕ∗(λ2 vol)

Aut(C(M))

Diff(C(M))

L2(C(M))

(Dens(C(M)),W2) ν = r−3 dvol dr

Diff ν(C(M))

Autvol(C(M))

π(ψ) = ψ∗(ν)

Figure – Generalization of Otto’s riemannian submersion. (with Tho. Gallouet)

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

CH as IE

Theorem

Solutions to the Hdiv Euler-Arnold equations are particular solutions tothe incompressible Euler equation on M × R>0 × S1 for the metricr 2g(x) + ( dr)2 + r−2(3+d)(dy)2, where (x , r , y) ∈ M × R>0 × S1.

Embedding CH equations into incompressible Euler. (arxiv 2018,Natale, FXV)

On the universality of the incompressible Euler equation on compactmanifolds, (arxiv 2017, T. Tao)

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Results

TheoremLet ϕ be the flow of a smooth solution to the Camassa-Holm equation

then Ψ(θ, r)def.= (ϕ(θ),

√Jac(ϕ(θ))r) is the flow of a solution to the

incompressible Euler equation for the density 1r4 r dr dθ.

Case where M = S1, M(ϕ) = [(θ, r) 7→ r√∂xϕ(θ)e iϕ(θ)] then the CH

equation is∂tu − 1

4∂txxu u + 3∂xu u − 12∂xxu ∂xu − 1

4∂xxxu u = 0

∂tϕ(t, x) = u(t, ϕ(t, x)) .(28)

The Euler equation on the cone, C(M) = R2 \ 0 for the densityρ = 1

r4 Leb is v +∇vv = −∇p ,

∇ · (ρv) = 0 .(29)

where v(θ, r)def.=(u(θ), r2∂xu(θ)

).

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Results

TheoremLet ϕ be the flow of a smooth solution to the Camassa-Holm equation

then Ψ(θ, r)def.= (ϕ(θ),

√Jac(ϕ(θ))r) is the flow of a solution to the

incompressible Euler equation for the density 1r4 r dr dθ.

Case where M = S1, M(ϕ) = [(θ, r) 7→ r√∂xϕ(θ)e iϕ(θ)] then the CH

equation is∂tu − 1

4∂txxu u + 3∂xu u − 12∂xxu ∂xu − 1

4∂xxxu u = 0

∂tϕ(t, x) = u(t, ϕ(t, x)) .(28)

The Euler equation on the cone, C(M) = R2 \ 0 for the densityρ = 1

r4 Leb is v +∇vv = −∇p ,

∇ · (ρv) = 0 .(29)

where v(θ, r)def.=(u(θ), r2∂xu(θ)

).

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

CH as incompressible Euler

Proposition

Solutions to the Hdiv Euler-Arnold equations are solutions to theincompressible Euler equation on M × R>0 × S1 for the metricr 2g(x) + ( dr)2 + r−2(3+d)(dy)2, where (x , r , y) ∈ M × R>0 × S1.

Generalization to similar equations:∂tm + umx + 2mux = −gρ∂xρ

m = u − ∂xxu

∂tρ+ ∂x(ρu) = 0 ,

(30)

where ρ(t = 0) is a positive density and g is a positive constant.

Theorem

The Hdiv2 equations on M can be isom. embedded in the Hdiv geodesicflow on M × S1.Solutions to the Hdiv2 equations can be mapped to particular solutions ofthe Hdiv(M × S1) geodesic flow.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Contents

1 Unbalanced optimal transport

2 Link to fluid dynamics

3 Relaxation of geodesics

4 About tightness

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Generalized flows a la Brenier

Allow particles to split.

Similar to Young measures.

Embed

infϕ

∫ 1

0

∫M

|∂tϕ(t, x)|2 dx dt (31)

under the constraint ϕ∗(Leb) = Leb intoLet µ ∈ P(C ([0, 1],M)),

infµ〈µ, ‖ω‖2

L2〉 (32)

under the constraint [e0,1]∗µ = δx,ϕ(x) and marginal constraints[et ]∗µ = Leb.

1 Short time smooth solutions of inc. Euler are unique minimizers(Brenier).

2 Tightness by Schnirelman (≥ 3D, but not in 2D).

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Relaxation of Hdiv

With A. Natale.

Optimization set: P(Ω) where Ω = C ([0, 1],M ×R>0) and minimize〈µ, ‖ω‖2

L2〉.Marginal constraints:

∫r

r 2[et ]∗(µ) = Leb.

Particular boundary constraints.

1 Existence of generalized solutions.

2 Smooth solutions for short times are unique minimizers (up todilation).

3 Uniqueness of the pressure.

4 If M = S1, then every rotation by θ ≤ π is a minimizer.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

What boundary conditions ?

Deterministic problem z = (x , 1)→ (ϕ(x), λ(x)).

Strong constraint

∀f ∈ Cb((M × R>0)2,R)∫Ω

f (z(0), z(1))dµ =

∫M

f ((x , 1), (ϕ(x), λ(x))) dx (33)

Marginal constraints not stable w.r.t. narrow convergence.Paths with unbounded jacobian can be charged/mass can escape.

Homogeneous constraints

∀f ∈ C ((M × R>0)2,R) positively 2-homogeneous,

f ((x1, δr1), (x2, δr2)) = δ2f ((x1, r1), (x2, r2)) (34)

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

What boundary conditions ?

Deterministic problem z = (x , 1)→ (ϕ(x), λ(x)).

Strong constraint

∀f ∈ Cb((M × R>0)2,R)∫Ω

f (z(0), z(1))dµ =

∫M

f ((x , 1), (ϕ(x), λ(x))) dx (33)

Marginal constraints not stable w.r.t. narrow convergence.Paths with unbounded jacobian can be charged/mass can escape.

Homogeneous constraints

∀f ∈ C ((M × R>0)2,R) positively 2-homogeneous,

f ((x1, δr1), (x2, δr2)) = δ2f ((x1, r1), (x2, r2)) (34)

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Invariance property: dilations

θ : Ω 7→ R.

On Ω, consider divθ : ω = (x , r)→ (x , r/θ(ω)).

Define

dilθ :M(Ω) 7→ M(Ω)

µ→ [divθ]∗(θ2µ) .

then

Lemma

Let θ be pos. 1-homogeneous, θ(δ · ω) = δθ(ω). Consider µ ∈ P(Ω) andassume C = (

∫Ωθ2 dµ)1/2 <∞ then, dilθ/C (µ) ∈ P(Ω),

1 〈f , dilθ/C (µ)〉 = 〈f , µ〉 for all 2-homogeneous f .

2 Supp(dilθ/C (µ)) ⊂ θ(ω) = C.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

First results

Theorem

Existence of generalized flows for Hdiv.

Sketch of proof.

Rescale a minimizing sequence, dilθ/Cn(µn) with

θ(ω) = (∫ 1

0r 2 dt + r(0)2 + r(1)2)1/2, in fact Cn =

√3.

By Lemma,Supp(dilθ/C (µn)) ⊂ θ(ω) =

√3 (35)

Uniform integrability of homogeneous constraints.

Lemma (Decomposition result)

Any µ satisfying the deterministic homogeneous coupling constraint canbe decomposed into µ = µ0 + µ with µ charging paths ω s.t.ω(0) = ω(1) = 0 and µ0(ω | 0 /∈ ω(0), ω(1), ) = 0.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Other results

1 Smooth solutions for short times are unique minimizers (up todilation).

2 Uniqueness of the pressure.

3 If M = S1, then every rotation by θ ≤ π is a minimizer.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Contents

1 Unbalanced optimal transport

2 Link to fluid dynamics

3 Relaxation of geodesics

4 About tightness

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Generalized energy diameter bounded by π2

Lemma (A mixture)

Let ϕ ∈ Diff(M) then

µ =1

2δ(id,s(t))∗ Leb +

1

2δ(ϕ(t),c(t))∗ Leb (36)

where s(t) =√

2 sin(πt) and

c(t) =

√2 cos(πt) if t < 1/2√2 Jac(ϕ(x))| cos(πt)| otherwise.

ϕ(t) =

id if t < 1/2

ϕ(x)otherwise..

Then, its cost is π2.

Consequence: no tightness in 1D.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Scaling argumentAt small scales, cost driven by the L2 norm of div: Hunter-Saxton limit.

Figure – Peakons for the Hunter-Saxton equations

Figure – Approximation using lots of peakon-antipeakon collision

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Result on the torus

Proposition

On R2/Z2, for (x , y)→ (x + π, y + π) the singular flow is a limit ofdeterministic flows and it is a minimizer. (Whereas constant speedrotation is not).

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Approximation sequence

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Approximation sequence

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Approximation sequence

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Approximation sequence

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Approximation sequence

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Approximation sequence

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Approximation sequence

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Approximation sequence

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Approximation sequence

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

Questions

For the generalized geodesics1 Tightness in general for d ≥ 2.

2 What about d = 1: partial answer in a recent paper.

3 Regularity of the pressure.

For the unbalanced optimal transport1 Regularity theory is not known.

2 Quasi-Linear time algorithms in 1D open (keyword: slicedWasserstein)

3 Some extensions to matrix valued OT have been proposed inconnection with the Bures-Wasserstein metric.

4 Extension of the Schrodinger problem to unbalanced OT completelyopen.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

References I

Chizat, L., Schmitzer, B., Peyre, G., & Vialard, F.-X. 2015.An Interpolating Distance between Optimal Transport andFisher-Rao.ArXiv e-prints, June.

Figalli, A., & Gigli, N. 2010.A new transportation distance between non-negative measures, withapplications to gradients flows with Dirichlet boundary conditions.Journal de mathematiques pures et appliquees, 94(2), 107–130.

Frogner, C., Zhang, C., Mobahi, H., Araya-Polo, M., & Poggio, T.2015.Learning with a Wasserstein Loss.Preprint 1506.05439. Arxiv.

Kondratyev, S., Monsaingeon, L., & Vorotnikov, D. 2015.A new optimal trasnport distance on the space of finite Radonmeasures.Tech. rept. Pre-print.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

References II

Liero, M., Mielke, A., & Savare, G. 2015a.Optimal Entropy-Transport problems and a newHellinger-Kantorovich distance between positive measures.ArXiv e-prints, Aug.

Liero, M., Mielke, A., & Savare, G. 2015b.Optimal transport in competition with reaction: theHellinger-Kantorovich distance and geodesic curves.ArXiv e-prints, Aug.

Lombardi, D., & Maitre, E. 2013.Eulerian models and algorithms for unbalanced optimal transport.<hal-00976501v3>.

Maas, J., Rumpf, M., Schonlieb, C., & Simon, S. 2015.A generalized model for optimal transport of images includingdissipation and density modulation.arXiv:1504.01988.

Unbalanced optimal transport Link to fluid dynamics Relaxation of geodesics About tightness

References III

Piccoli, B., & Rossi, F. 2013.On properties of the Generalized Wasserstein distance.arXiv:1304.7014.

Piccoli, B., & Rossi, F. 2014.Generalized Wasserstein distance and its application to transportequations with source.Archive for Rational Mechanics and Analysis, 211(1), 335–358.

Rezakhanlou, F. 2015.Optimal Transport Problems For Contact Structures.