43
03/29/2006, City U niv 1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou Department of Mathematics The Chinese University of Hong Kong http://www.math.cuhk.edu.hk/~zou Joint work with Qiya Hu (CAS, Beijing)

03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

Embed Size (px)

Citation preview

Page 1: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

03/29/2006, City Univ 1

Iterative Methods with Inexact Preconditioners

and Applications to Saddle-point Systems &

Electromagnetic Maxwell Systems

Jun Zou Department of Mathematics

The Chinese University of Hong Kong

http://www.math.cuhk.edu.hk/~zou

Joint work withQiya Hu (CAS, Beijing)

Page 2: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

2

Outline of the Talk

Page 3: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

3

Inexact Uzawa Methods for SPPs

• Linear saddle-point problem:

where A, C : SPD matrices ; B : n x m ( n > m )

• Applications:

Navier-Stokes eqns, Maxwell eqns, optimizations, purely algebraic systems , … …

• Well-posedness : see Ciarlet-Huang-Zou, SIMAX 2003

• Much more difficult to solve than SPD systems

• Ill-conditioned: need preconditionings, parallel type

Page 4: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

4

Why need preconditionings ?

• When solving a linear system

• A is often ill-conditioned if it arises from discretization of PDEs

• If one finds a preconditioner B s.t. cond(BA) is small, then we solve

• If B is optimal, i.e. cond (BA) is independent of h, then the number of iterations for solving a system of h=1/100 will be the same as for solving a system of h=1/10 • Possibly with a time difference of hours & days, or days & months,

especially for time-dependent problems

Page 5: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

5

Schur Complement Approach

A simple approach: first solve for p ,

Then solve for u ,

We need other more effective methods !

Page 6: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

6

Preconditioned Uzawa Algorithm

Given two preconditioners:

Page 7: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

7

Preconditioned inexact Uzawa algorithm

• Algorithm

• Randy Bank, James Bramble, Gene Golub, ... ...

Page 8: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

8

Preconditioned inexact Uzawa algorithm

• Algorithm

• Question :

Page 9: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

9

Uzawa Alg. with Relaxation Parameters(Hu-Zou, SIAM J Maxtrix Anal, 2001)

• Algorithm I

• How to choose

Page 10: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

Uzawa Alg with Relaxation Parameters

• Algorithm with relaxation parameters:

• Implementation

• Unfortunately, convergence guaranteed under

But ensured for any preconditioner for C ; scaling invariant

Page 11: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

11

(Hu-Zou, Numer Math, 2001)

• Algorithm with relaxation parameter

• This works well only when both

• This may not work well in the cases

Page 12: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

12

(Hu-Zou, Numer Math, 2001)

• Algorithm with relaxation parameter

• For the case :

more efficient algorithm:

• Convergence guaranteed if

Page 13: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

13

(Hu-Zou, SIAM J Optimization, 2005)

Page 14: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

Inexact Preconditioned Methods for NL SPPs

• Nonlinear saddle-point problem:

• Arise from NS eqns, or nonlinear optimiz :

Page 15: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

Time-dependent Maxwell System

● The curl-curl system: Find u such that

● Eliminating H to get the E - equation:

● Eliminating E to get the H - equation:

● Edge element methods (Nedelec’s elements) : see Ciarlet-Zou : Numer Math 1999; RAIRO Math Model & Numer Anal 1997

Page 16: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

16

Time-dependent Maxwell System

● The curl-curl system: Find u such that

● At each time step, we have to solve

Page 17: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

17

Non-overlapping DD Preconditioner I (Hu-Zou, SIAM J Numer Anal, 2003)

● The curl-curl system: Find u such that

● Weak formulation: Find

● Edge element of lowest order :

● Nodal finite element :

Page 18: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

18

Edge Element Method

Page 19: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

19

Additive Preconditioner Theory

● Additive Preconditioner Theory

● Given an SPD S, define an additive Preconditioner M :

Page 20: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

20

DDMs for Maxwell Equations

• 2D, 3D overlapping DDMs: Toselli (00), Pasciak-Zhao (02), Gopalakrishnan-Pasciak (03)

• 2D Nonoverlapping DDMs : Toselli-Klawonn (01), Toselli-Widlund-Wohlmuth (01)

• 3D Nonoverlapping DDMs : Hu-Zou (2003), Hu-Zou (2004)

• 3D FETI-DP: Toselli (2005)

Page 21: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

21

Nonoverlapping DD Preconditioner I (Hu-Zou, SIAM J Numer Anal, 2003)

Page 22: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

22

Interface Equation on

Page 23: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

23

Page 24: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

24

Global Coarse Subspace

Page 25: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

25

Two Global Coarse Spaces

Page 26: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

26

Page 27: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

27

Nonoverlapping DD Preconditioner I

Page 28: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

28

Nonoverlapping DD Preconditioner II(Hu-Zou, Math Comput, 2003)

Page 29: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

29

Variational Formulation

Page 30: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

30

Equivalent Saddle-point System

can not apply Uzawa iteration

Page 31: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

31

Equivalent Saddle-point System

Write the system

into equivalent saddle-point system :

Convergence rate depends on

Important : needed only once in Uzawa iter.

Page 32: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

32

DD Preconditioners

Let

Theorem

Page 33: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

33

DD Preconditioner II

Page 34: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

34

Local & Global Coarse Solvers

Page 35: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

35

Stable Decomposition of VH

Page 36: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

36

Condition Number Estimate

The additive preconditioner

Condition number estimate:

Independent of jumps in coefficients

Page 37: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

37

Mortar Edge Element Methods

Page 38: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

38

Mortar Edge Element Methods

See Ciarlet-Zou, Numer Math 99:

Page 39: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

39

Mortar Edge M with Optim Convergence(nested grids on interfaces)

Page 40: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

40

Local Multiplier Spaces: crucial !

Page 41: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

41

Near Optimal Convergence

Page 42: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

42

Auxiliary Subspace Preconditioner(Hiptmair-Zou, Numer Math, 2006)

Solve the Maxwell system :

by edge elements on unstructured meshes

Page 43: 03/29/2006, City Univ1 Iterative Methods with Inexact Preconditioners and Applications to Saddle-point Systems & Electromagnetic Maxwell Systems Jun Zou

43

Optimal DD and MG Preconditioners

• Edge element of 1st family for discretization

• Edge element of 2nd family for preconditioning

• Mesh-independent condition number

• Extension to elliptic and parabolic equations

Thank You !