28
NIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom Henderson NOAA Earth System Research Laboratory 1

NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

  • Upload
    phamdan

  • View
    218

  • Download
    2

Embed Size (px)

Citation preview

Page 1: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

NIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom Henderson NOAA Earth System Research Laboratory

1

Page 2: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

2

NIM Model Design • NIM (and FIM) Description

• Primary design driver: Cloud and precipitation prediction.

• Design driver: Earth Analysis and short range prediction.

• Design driver: Extend prediction to sub-seasonal.

Page 3: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

2001: We began design of a new generation of global models.

Initial Design: Alexander MacDonald and Jin Luen Lee. Key decision: Icosahedral grid point model, finite volume (D Randall, SJ Lin) Key Innovation: Method for coding on irregular grids – MacDonald et al 3

Page 4: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

Side number 1 of polygon(ipn) 6: • prox(isn=1,ipn=6)=3 -polygon number 3 is on

polygon number 6 side 1

• proxs(1,6)=4 -polygon number 3 side

number to polygon number 6 is side 4

16

MacDonald, Middlecoff, Henderson, Lee; 2011. A general method for modeling on irregular grids. International Journal of High Performance Computing Applications. Vol 25, Issue 4.

Side number 5 of polygon(ipn) 6: • prox(isn=5,ipn=6)=4 -polygon number 4 is on

polygon number 6 side 5

• proxs(5,6)=3 -polygon number 4 side

number to box polygon 6 is side 3

Grid Numbering Description

side 6

nprox(ipn=6) = 5

nprox(ipn=4) = 6

Page 5: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

ESRL finite-volume Icos- models (FIM/NIM)

ESMF

19 Apr 2011 5 Global Modeling Program Review

NIM

Nonhydrostatic Icosahedral Model

• Target resolution : O (1 km) and beyond • Extension of 2-D finite-volume integration into 3-D integration on control volume defined on the height coordinate. • Use the latest GPU technology to speed up high-resolution model calculations.

FIM

Flow-following Icosahedral Model

• Target resolution ≥ 10 km • A hydrostatic model consists of 2-D finite-volume SWM coupled with hybrid σ-θ vertical solver. • Produce accurate medium-range weather forecasts

Hydrostatic Non-Hydrostatic

Page 6: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

atmosphere

ocean

Flow-following* finite volume Icosahedral Model (FIM)

Icosahedral Ocean Model (iHYCOM)

Coupled Atmospheric-Ocean Modeling on an

Icosahedral Grid at NOAA/ESRL

* flow-following = vertically quasi-Lagrangian

Page 7: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

Wednesday, October 24: ESRL’s FIM predicts 948 mb low into northern New Jersey. 7

Page 8: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

TC track error - 2013 hurricanes – Atlantic and E. Pacific basins combined (Smaller is better)

8

Page 9: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

9

Page 10: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

𝜕𝑈

𝜕𝑡 +

𝜕(𝑈𝑢)

𝜕𝑥+𝜕(𝑉𝑢)

𝜕𝑦+𝜕(𝑊𝑢)

𝜕𝑧 + 𝛾𝑅𝜋

𝜕Θ′

𝜕𝑥- 𝑓𝑉 = 𝑆𝑢

𝜕𝑉

𝜕𝑡 +

𝜕(𝑈𝑣)

𝜕𝑥+𝜕(𝑉𝑣)

𝜕𝑦+𝜕(𝑊𝑣)

𝜕𝑧 + 𝛾𝑅𝜋

𝜕Θ′

𝜕𝑦+ 𝑓𝑈 = 𝑆𝑣

𝜕𝑊

𝜕𝑡 +

𝜕(𝑈𝑤)

𝜕𝑥+𝜕(𝑉𝑤)

𝜕𝑦+𝜕(𝑊𝑤)

𝜕𝑧+ 𝛾𝑅𝜋

𝜕Θ′

𝜕𝑦- 𝑔𝑅

𝐶𝑣𝜃 Θ′+𝜌′𝑔= 𝑆𝑤

𝜕Θ

𝜕𝑡 +

𝜕(𝑈Ө)

𝜕𝑥+𝜕(𝑉Ө)

𝜕𝑦+𝜕(𝑊Ө)

𝜕𝑧 = 𝑆Θ

𝜕ρ

𝜕𝑡 +

𝜕𝑈

𝜕𝑥 +

𝜕𝑉

𝜕𝑦 +

𝜕𝑊

𝜕𝑧 = 𝑆ρ

NIM Solution Components

(𝑈,𝑊, Θ, 𝜌)=(𝜌𝑢, 𝜌𝑤, 𝜌𝜃, 𝜌); Θ(𝑥, 𝑧, 𝑡)=Θ (𝑧)+ Θ′(𝑥, 𝑧, 𝑡);

𝜌(𝑥, 𝑧, 𝑡)= 𝜌 (𝑧)+ 𝜌′(𝑥, 𝑧, 𝑡); 𝛻𝑝=𝛾𝑅𝜋𝛻Θ 𝑝=𝑝0𝑅Θ

𝑝0

𝛾 𝑆Θ=

Θ𝐻

𝐶𝑝𝑇

Time tendency Flux terms Forcing Terms Source Terms

Page 11: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

NIM Strategy • Use of exact same (divergent) equation form for all

variables participating in Reversible Isentropic Processes (Pressure, potential temperature, and water vapor). • No diffusion for thermodynamic variables.

• Finite volume formulation with fixed control volumes. • Full three dimensional advection (Gauss divergence

theorem on the control volume).

• High resolution in the vertical (192 levels).

11

Page 12: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

NIM: Flux Uses Gauss Divergence Theorem

=𝝏

𝝏𝒙(𝑼𝜽)+

𝝏

𝝏𝒚(𝑽𝜽)+

𝝏

𝝏𝒛𝑾𝜽 = (

𝑺

𝑽𝟑𝜽 ∙ 𝒏)𝒅𝒔

Momentum vector: 𝑽𝟑 = 𝑼𝒊 + 𝑽𝒋 + 𝑾𝒌

𝑼,𝑽,𝑾 = (𝒖𝝆, 𝒗𝝆,𝒘𝝆)

(𝜵 ∙

𝑽

𝑽𝟑𝜽)𝒅𝑽

where scalars are: 𝒖, 𝒗,𝒘, 𝜽

𝑽𝒃𝟒 = (𝑼𝒃𝟒Ө𝒃𝟒𝒊 + 𝑽𝒃𝟒 Ө𝒃𝟒𝒋 + 𝑾𝒃𝟒Ө𝒃𝟒𝒌 )

𝑽𝒃𝟔 = (𝑼𝒃𝟔Ө𝒃𝟔𝒊 + 𝑽𝒃𝟔Ө𝒃𝟔𝒋 + 𝑾𝒃𝟔Ө𝒃𝟔𝒌 )

Page 13: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

Definition of: vdns and vdnb

vdns(k,isn,ipn)

vdnb(k,isn,ipn,ivar)

vdnb(0:nz,npp,np,nvar): v dot n at center of bottom vdns(nz,npp,np): v dot n at center of each side Example: vdns = nvecs * uv8s

k = vertical index : nz = # of z levels isn = index number of side : npp = # of proximity points ipn = index point number : np = # of horizontal points

vdns(k,isn,ipn)

vdnb(k,isn,ipn,ivar)

Page 14: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

14

NIM Model Design • NIM (and FIM) Description

• Primary design driver: Cloud and precipitation prediction.

• Design driver: Earth Analysis and short range prediction.

• Design driver: Extend prediction to sub-seasonal.

Page 15: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

Observed Radar Model Prediction

High Resolution Rapid Refresh Model run at ESRL . 15

Page 16: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

1963 y,Smagorinsk

:4 , :2

212222

242

/

xyyxsh

h

th

h

nd

vuvulCk

kk

km 30 ~x

order 4 The :

order 2 The :

th

B

A nd

No divergence damping, high effective resolution.

16

Page 17: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

17

32 Levels 96 Levels

T Tendency from physics (K/6hr)

NIM will have 192 layers to resolve thin cloud layers, like western ocean stratus.

Page 18: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

18

NIM Model Design • NIM (and FIM) Description

• Primary design driver: Cloud and precipitation prediction.

• Design driver: Earth Analysis and short range prediction.

• Design driver: Extend prediction to sub-seasonal.

Page 19: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

Constituent Volumes:

OCEAN ATMOSPHERE

ICE LAND

Page 20: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

OLD

~ 8 m

0 (cm)

5

20

40

160

300

NEW

~ 8 m

0 (cm)

1

4

10

30

60

100

160

300

RUC Land Surface Model (LSM) increased from 6 to 9 levels

Changed PBL scheme from MYJ (Mellor-Yamada-Janjic) to MYNN (Mellor-Yamada-Nakanishi-Niino)

Increased surface roughness lengths

ESRL Land Surface 2013 Model Update

WRF Users’ Workshop 25 June 2013 Rapid Refresh and HRRR 20

Tanya Smirnova - GSD

Tanya Smirnova

Page 21: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

Biology:

The most

complex

part of the

Earth

System.

Page 22: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

Chemistry:

There are

about a

hundred

atmospheric

constituents

that need to be

tracked.

Black carbon (blue) and sulfates (green).

Page 23: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

23

NIM Model Design • NIM (and FIM) Description

• Primary design driver: Cloud and precipitation prediction.

• Design driver: Earth Analysis and short range prediction.

• Design driver: Extend prediction to sub-seasonal.

Page 24: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

Equatorial Waves

Wavenumber-Frequency Spectral Analysis

• Decompose into Symmetric and Antisymmetric Fields about the Equator

Matsuno, 1967. Could we make the FIM/NIM Matsuno Compliant?

Page 25: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

Atmospheric Kelvin Wave/MJO propagates across the American Tropics (blue line).

25 Our thanks to George Kiladis of ESRL for this analysis.

Page 26: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

from Wheeler and Kiladis, 1999

Kelvin

Westward Inertio-Gravity

Equatorial Rossby

Madden-Julian Oscillation

OLR total/background power spectrum, 15ºS-15ºN, 1983–2005 (Symmetric)

26

Page 27: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

27

Observed Outgoing Longwave Radiation

FIM – Grell Physics Outgoing Longwave Radiation

Page 28: NIM Model Design ECMWF HPC Conference October 2014 · PDF fileNIM Model Design ECMWF HPC Conference October 2014 Alexander E. MacDonald Jin Lee Mark Govett Jacques Middlecoff Tom

NOAA Earth System Research Laboratory

Boulder, Colorado

[email protected]