56
NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen [email protected] Multi-model Super- Ensembles Applied to Dynamics of the Adriatic

NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen [email protected] Multi-model

Embed Size (px)

Citation preview

Page 1: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

NATO UNCLASSIFIED

NATO Undersea Research Centre Partnering for Maritime Innovation

NRL Stennis15-17 November 2006

Michel Rixen

[email protected]

Multi-model Super-Ensembles Applied to

Dynamics of the Adriatic

Page 2: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

2 NATO UNCLASSIFIED

Ensembles…

2 particular research lines relevant to MILOC/EOS/NURC/NATO• Acoustic properties• Surface drift

• Ensemble (single model)– Initial conditions– Boundary conditions– Statistics/parameterization

• Super-ensemble (multi-model of the same kind)– Least-squares: weather+climate (Krishnamurti 2000, Kumar 2003)– Max likelihood+ regularization by climatology : tropical cyclones (Rajagopalan 2002)– Kalman filters: precipitation (Shin 2003)– Probabilistic: precipitation (Shin 2003)

• ‘Hyper’-ensemble (multi-model of different kinds)– e.g. combination of ocean+atmospheric+wave models?

• General aim: forecast + [uncertainty/error/confidence estimation]

Page 3: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

3 NATO UNCLASSIFIED

Models DataWeights

• Simple ensemble-mean• Individually bias-corrected ens.-mean• Linear regression (least-squares)• Non-linear regression (least-squares)

– Neural networks (+regularisation)– Genetic algorithms

Super-Ensembles (SE)…

Compute optimal combination from past model-data regression,then use in forecast-mode

Page 4: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

4 NATO UNCLASSIFIED

MREA04: sound velocity (100m)

Page 5: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

5 NATO UNCLASSIFIED

SE Weights

Page 6: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

6 NATO UNCLASSIFIED

SE

Single models

Analysis

Forecast errors on sound velocity

HOPS IHPO HOPS HRV NCOM COARSE NCOM FINE

HOPS HRV FINE NCOM 2 HOPS 2 NCOM 4 models

Page 7: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

7 NATO UNCLASSIFIED

SE Sound speed profile errors

Page 8: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

8 NATO UNCLASSIFIEDHO

PS

-IH

PO

(1)

HO

PS

-Har

v. (

2)C

oars

e N

CO

M (

3)

Fin

e N

CO

M (

4)S

E (

2)S

E (

4)S

E (

1, 2

)S

E (

3, 4

)S

E (

1 to

4)

HO

PS

-IH

PO

(1)

HO

PS

-Har

v. (

2)C

oars

e N

CO

M (

3)

Fin

e N

CO

M (

4)S

E (

2)S

E (

4)S

E (

1, 2

)S

E (

3, 4

)S

E (

1 to

4)

Page 9: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

9 NATO UNCLASSIFIED

MREA04: DRIFTERS

Page 10: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

10 NATO UNCLASSIFIED

Hyper-ens.Ocean Meteo

Hyper-ensembles

HOPS

NCOM

ALADIN FR

COAMPS

Linear HE

Non-linear HE

Page 11: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

11 NATO UNCLASSIFIED

Drifter tracks

Ocean advection

Rule of thumb

Hyper-ensembles

True drifter

48 h forecast

Page 12: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

12 NATO UNCLASSIFIED

Hyper-ensemble statistics

Julian day

Page 13: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

13 NATO UNCLASSIFIED

Strong Wind Event (Bora)

R. Signell

Page 14: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

14 NATO UNCLASSIFIED

Standard vs refined turbulence scheme

R. Signell

Page 15: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

15 NATO UNCLASSIFIED

ADRIA02-03 drifters (Jan-Feb)

Page 16: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

16 NATO UNCLASSIFIED

Analysis: 14 Feb 2003

Page 17: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

17 NATO UNCLASSIFIED

ADV WIND RoT

ADV+WIND RoT ADV+WIND+STOKES

Indiv. Forecast err.: 14 Feb 2003 (12 Feb 2003+ 48h)

Page 18: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

18 NATO UNCLASSIFIED

ADV WIND RoT

ADV+WIND RoT ADV+WIND+STOKES

SEs forecast err: 14 Feb 2003 (12 Feb 2003+ 48h)

Page 19: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

19 NATO UNCLASSIFIED

SE 5, 10, 25 and 50 daysIndiv. Mod.

ADVWINDADV+WINDADV+WIND+STK

Page 20: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

20 NATO UNCLASSIFIED

Page 21: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

21 NATO UNCLASSIFIED

Drifter tracks

Ocean advection

Ocean+Stokes

SE

True

Stokes

Unbiased single models

24 h forecast

Page 22: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

22 NATO UNCLASSIFIED

ADV WIND RoT

ADV+WIND RoT ADV+WIND+STOKES

Indiv. mod. uncertainty: 14 Feb 2003 (cross-validation)

Page 23: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

23 NATO UNCLASSIFIED

ADV WIND RoT

ADV+WIND RoT ADV+WIND+STOKES

SEs uncertainty on 14 Feb 2003 (cross-validation)

Page 24: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

24 NATO UNCLASSIFIED

Page 25: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

25 NATO UNCLASSIFIED

Page 26: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

26 NATO UNCLASSIFIED

INDIV SEs

Page 27: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

27 NATO UNCLASSIFIED

MS-EVA (JRP Harvard)

• multi-scale interactive• nonlinear• intermittent in space• episodic in time

E.g. wavelet

Selecting the right processes at the right time…

New methodology utilizing multiple scale window decomposition in space and time of a model

Page 28: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

28 NATO UNCLASSIFIED

Note: Energy/vorticity/mass conservation issues

SE and MS-EVA=MSSE

Model 1

Model 2

Model N

MSSE combines optimally the strengths of all models at any time at different scales

Selecting the right processes from the right models at the right time…

Page 29: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

29 NATO UNCLASSIFIED

Lorenz equations

Page 30: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

30 NATO UNCLASSIFIED

Page 31: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

31 NATO UNCLASSIFIED

Page 32: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

32 NATO UNCLASSIFIED

SEs MSSEs SEs MSSEs SEs MSSEs

Page 33: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

33 NATO UNCLASSIFIED

• Gulf of Manfredonia & Gargano Peninsula

• Mid-Adriatic• Whole Adriatic

• Critical mass of research and ressources

Dynamics of the Adriatic in Real-Time

Page 34: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

34 NATO UNCLASSIFIED

NURC-NRLSSC JRP GOALS

• Assess real-time capabilities of monitoring (data) and prediction (models) of small-scale instabilities in a controlled environment (operational framework)

• Produce a comprehensive data-model set of ocean and atmosphere properties (validation of fusion methods)

• 1A5: ensemble modeling+uncertainty• 1A2: air-sea interaction, coupling/turbulence• 1D1: data fusion & remote sensing• 1D3: geospatial data services

• ONR projects:– NRL-HRV on internal tides– NICOP program on turbulence

• EOREA ESA (SatObSys/Flyby/ITN/NURC)

Page 35: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

35 NATO UNCLASSIFIED

PARTNERS• 33 institutions (on board+home institutions): • 10 USA, 15 ITA, 1 GRC, 1 DEU, 1 BEL, 2 FRA PfP : 4 HRV, (1 ALB)

Page 36: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

36 NATO UNCLASSIFIED

Highlights

IN-SITU• SEPTR (1 NURC, 3 NRL)• BARNY (2 NURC, 13 NRL, 2HRV)• Wave rider, meteo stations • CTD chain• +Aquashuttle (NRL, Universitatis)

MODELS• Ocean (6+3 to come)• Atmospheric (7)• Wave (4)

REMOTE SENSING• NURC: HRPT, Ground station• NRL: MODIS• SatObSys: SLA

Page 37: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

37 NATO UNCLASSIFIED

SEPTR

Page 38: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

38 NATO UNCLASSIFIED

SEPTR data in NRT on the webHigh bandwidth Ship-NURC satellite link

NURNURCC

GEOS II Mirror

GEOS II

Time based scheduled synchronizations

Page 39: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

39 NATO UNCLASSIFIED

Common box

Page 40: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

40 NATO UNCLASSIFIED

Data and models: sound velocity

Page 41: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

41 NATO UNCLASSIFIED

Multi-scale super-ensemble (MSSE)

NCOM TEMP

ROMS TEMP

‘Standard’ Super-ensemble

(SE)

Multi-scale Super-ensemble

(MSSE)

Optimal combination of processes instead of models

SEPTRTEMP

S-transform,multiple filter,

wavelet

Errors on sound velocity profile

4-5 m/s

1-2 m/s

Courtesy Paul Martin (NRLSSC)

Courtesy Jacopo Chiggiato (ARPA)

Page 42: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

42 NATO UNCLASSIFIED

S-TRANSFORM (SVP, 20m depth)

SEPTR

ADRICOSM HOPS

NCOM ROMS

Page 43: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

43 NATO UNCLASSIFIED

Sound velocity at 20m

SE

MSSE

Page 44: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

44 NATO UNCLASSIFIED

Hindcast skills: SE vs MSSE

SEPTR OBS.

MSSE

SE

Skill 0.1 Skill 0.9

STD

Correlation

Page 45: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

45 NATO UNCLASSIFIED

Forecast skills: SE vs MSSE

SEPTR OBS.

MSSE

SE

Skill 0.1Skill 0.9

Page 46: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

46 NATO UNCLASSIFIED

Forecast: error on sound velocity

SE

MSSE

Page 47: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

47 NATO UNCLASSIFIED

Forecast: dynamic SE = KF+DLM

KF+uncertaintyForecast

Indiv models

KF+uncertainty

Sound velocity anomaly (m/s)

Page 48: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

48 NATO UNCLASSIFIED

Forecast: error on sound velocity

ENSMEAN UNBIASEDENSMEAN

SE Kalman filterDLM+error evolution

Page 49: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

49 NATO UNCLASSIFIED

A priori forecast uncertainties

ENSMEAN UNBIASEDENSMEAN

Kalman filterDLM+error evolution

Page 50: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

50 NATO UNCLASSIFIED

Forecast skill on sound velocityWhole period and water column

KF

SE

UEM

EMBest indiv.model

Page 51: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

51 NATO UNCLASSIFIED

Conclusions

• SE = paradigm for improved reliability and accuracy

• NATO framework: cheap (i.e. marginal cost) because model forecasts are available

• “Relocatable science”: [ocean, atmosphere, wave, surf], [shallow, deep], [in-situ,

remote], [linear, non-linear]

• Information fusion per-se, Recognized environmental picture

• Uncertainty as a direct by-product (e.g. std of models)

• Interoperability, network enabled capability

• Information and decision superiority

Page 52: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

52 NATO UNCLASSIFIED

Questions ?

At the risk of repeating myself, WRT DART

Thanks to NRL !Thanks Jeff !

Page 53: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

53 NATO UNCLASSIFIED

Page 54: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

54 NATO UNCLASSIFIED

Page 55: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

55 NATO UNCLASSIFIED

Operational Models - no CTD data ass. - two grids (coarse, fine)

Analysis

Forecast errors

COARSE NCOM

SEFINE NCOM

FINE NCOM

SE COARSE+FINE

NCOM

Page 56: NATO UNCLASSIFIED NATO Undersea Research Centre Partnering for Maritime Innovation NRL Stennis 15-17 November 2006 Michel Rixen rixen@nurc.nato.int Multi-model

56 NATO UNCLASSIFIED

Operational Models - with CTD data ass. - two training options

Single HOPS Model Runs

Data Ass. SE I(using 2 models)

Overall SE II (using 4 models)

+2 NCOM models

Forecast errors