1
Data-Driven Inference and Investigation of Thermosphere Dynamics and Variations Piyush M. Mehta 1 , Richard Linares 1 , and Eric K. Sutton 2 1 Department of Aerospace Engineering and Mechanics, University of Minnesota, 2 Air Force Research Laboratory Major Contributions X New methodology for data-driven inference and investigation of thermosphere dynamics and variations. X Reduced order modeling and self-consistent calibration using mass and number density observations simultaneously. Introduction Modal decomposition or variance reduction methods offer an opportunity for data-driven investigation of thermosphere dynamics and variations and for self-consistent calibration of the thermosphere models. We develop the methodology using the MSIS model and infer oxygen-to-helium transi- tion as a validation by simultaneously assimilating discrete TIMED/GUVI and CHAMP/GRACE observations [1,2,3]. Methodology We generate hourly model output (snapshots), x i , for each input sample generated using a latin-hypercube (F 10.7 [60, 250],A p [0, 50], DOY [1, 365]) to cover the full range of inputs. We use a total of 365 + 8 (corner samples of the latin-hypercube) = 373 samples. A SVD decomposition is performed on the snapshot matrix, X = [x 1 , x 2 ,..., x m ], to derive the optimal set of basis vectors, U (X = USV T ), for O , O 2 , N 2 , and He. We do not tune N and H under the as- sumption that the CHAMP and GRACE observations do not contain any signal about the minor species and that the par- tial pressure of H is negligible. The spatial basis vectors or modes, U, can then be combined with time-dependent coef- ficients, c, such that x(s,t)= r i=1 c i (t)U i (s), where r is the order or rank of truncation. The first (r = 3) modes for each species captures more than 98% of the total variance. The coefficients, c, are derived by projecting the data, x, onto the spatial modes, U. We model their daily temporal variations using a sum of three cosine terms c(t)= 3 i=1 a i cos(ω i t + ζ i ) and fit a, ω , ζ for each mode and species using Gaussian Pro- cess Regression for prediction at any new set of inputs. (a) Mean 0 5 10 15 20 Local Time -50 0 50 Latitude 3 4 5 6 10 12 1 2 3 4 5 6 7 8 9 10 Mode 10 -2 10 0 10 2 % (b) 96.24 2.16 0.38 0.32 0.30 0.25 0.10 0.10 0.08 (c) Mode 1 0 5 10 15 20 -50 0 50 Latitude -0.0112 -0.0111 -0.011 -0.0109 50 100 150 200 250 -2700 -2650 -2600 -2550 (d) Mode 1 0 10 20 30 40 50 -2700 -2650 -2600 -2550 (e) Mode 1 0 100 200 300 400 -2700 -2650 -2600 -2550 (f) Mode 1 (g) Mode 2 0 5 10 15 20 -50 0 50 Latitude -0.01 0 0.01 50 100 150 200 250 -200 -100 0 100 200 (h) Mode 2 0 10 20 30 40 50 -200 -100 0 100 200 (i) Mode 2 0 100 200 300 400 -200 -100 0 100 200 (j) Mode 2 (k) Mode 3 0 5 10 15 20 Local Time -50 0 50 Latitude -0.01 -0.005 0 0.005 0.01 50 100 150 200 250 F 10.7 -40 -20 0 20 (l) Mode 3 0 10 20 30 40 50 A p -40 -20 0 20 (m) Mode 3 0 100 200 300 400 DOY -40 -20 0 20 (n) Mode 3 Figure: Mean and first 3 dominant modes for He. Measurement Intercalibration Typically, reliable data assimilation requires the observations to be intercalibrated. The CHAMP and GRACE observa- tions are first intercalibrated by multiplying the GRACE densities with a yearly scale factor to match the mean and variance of the observation-to-model ratio. Figure: Observations/MSIS; CH = CHAMP, GR = GRACE, GR-S = GRACE Scaled, [mean,variance]. The GUVI number density and intercalibrated CHAMP/GRACE mass density observations are then calibrated daily to the reference GUVI observation-to-model value (based on mass density computed with O , N 2 , and O 2 ) at 200 km, where the uncertainties are minimum. Model or Measurement Calibration? Intercalibration (IC) of observations accounts for biases with respect to a given model; however, it keeps the calibration from the true state by modifying the observations. The real goal is to calibrate the model to the observations, even if it means relaxing certain model assumptions. We first validate the data assimilation process with intercalibrated observa- tions for representative days (2002270 and 2007034 for high and low solar activity, respectively) using 3, 5, and 10 modes. We find that using 5 modes provides optimal results while avoiding overfitting. We then perform assimilation w/o IC of the observations using 5 modes. All results presented are derived using 5 modes. Table: RMS values. CH: CHAMP, GR: GRACE, GV: GUVI Assimilate CH GR CH+GR GV CH+GV GR+GV CH+GR Validate (%) (%) (%) (%) (%) (%) +GV (%) 2002270 CH w/ IC 6.9 10.8 9.7 14.3 8.7 11.7 10.5 GR w/ IC 16.3 10.0 10.1 14.1 15.2 10.8 10.7 CH w/o IC 6.2 12.0 9.1 14.8 9.5 13.5 12.4 GR w/o IC 24.1 9.1 9.3 14.8 17.1 10.5 10.5 2007034 CH w/ IC 7.5 16.8 10.7 27.6 8.8 16.1 10.7 GR w/ IC 18.1 12.5 13.2 34.5 20.4 12.2 12.5 CH w/o IC 7.0 17.4 9.2 16.8 8.8 15.1 11.3 GR w/o IC 29.1 11.2 11.7 18.4 22.7 11.5 12.1 Oxygen-to-Helium Transition We use the methodology to infer He dynamics and O -to-He transition. Assimilation shows that the O -to-He transition occurs at significantly lower altitudes, as inferred by Thayer et. al., [4] using CHAMP and GRACE observations. (a) He/O MSIS -50 0 50 Latitude 100 200 300 400 500 600 Altitude 2 4 6 8 10 12 14 (b) He/O: Assimilated with IC -50 0 50 Latitude 100 200 300 400 500 600 5 10 15 20 25 (c) He/O: Assimilated without IC -50 0 50 Latitude 100 200 300 400 500 600 5 10 15 20 25 30 Figure: Helium-to-Oxygen ratio on 2007034. The amount of O and He at higher altitudes differ signifi- cantly between the two different cases (w/ and w/o IC). This difference is caused by the IC of observations with the case w/o IC providing the true state of the thermosphere. For both cases, MSIS underpredicts the amount of He at higher altitudes in the winter polar region. (a) He: Assimilated/MSIS w/ IC -50 0 50 100 200 300 400 500 600 Altitude 1 1.2 1.4 1.6 (b) He: Assimilated/MSIS w/o IC -50 0 50 100 200 300 400 500 600 0.85 0.9 0.95 1 1.05 1.1 1.15 (c) O: Assimilated/MSIS w/ IC -50 0 50 Latitude 100 200 300 400 500 600 Altitude 0.6 0.8 1 1.2 1.4 (d) O: Assimilated/MSIS w/o IC -50 0 50 Latitude 100 200 300 400 500 600 0.4 0.6 0.8 1 1.2 1.4 Figure: He and O Assimilated/MSIS ratio on 2007034. The spatially and temporally averaged daily vertical pro- files of He and O are used to estimate the contribution of lower boundary composition and temperature effects under the diffusive equilibrium assumption. Assimilating observa- tions with IC suggests over and underprediction by MSIS close to GRACE altitudes for O and He, respectively. Assim- ilating without IC suggests that MSIS models He accurately, however, significantly overpredicts O at GRACE altitudes. 10 12 10 13 10 14 10 15 100 200 300 400 500 600 Altitude (a) He with IC MSIS Assimilated 10 12 10 13 10 14 10 15 100 200 300 400 500 600 (a) He without IC MSIS Assimilated 10 10 10 12 10 14 10 16 10 18 Number Density, kg/m 3 100 200 300 400 500 600 Altitude (a) O with IC MSIS Assimilated 10 10 10 12 10 14 10 16 10 18 Number Density, kg/m 3 100 200 300 400 500 600 (a) O without IC MSIS Assimilated Figure: He and O vertical profile on 2007034. Table: Contribution of composition and temperature variations 125 km 500 km (m -3 ) (m -3 ) (m -3 ) (m -3 ) Total % from from MSIS Assimilated MSIS Assimilated Overprediction Comp Temp w/ IC Oxygen 1.27e17 1.49e17 3.87e12 3.18e12 21.7 -21.1 42.8 Helium 4.47e13 4.61e13 1.88e12 2.46e12 -23.6 -2.4 -21.2 w/o IC Oxygen 1.27e17 1.48e17 3.87e12 1.91e12 102.6 -33.5 136.1 Helium 4.47e13 4.45e13 1.88e12 1.89e12 -0.5 0.5 -1.0 Storm-time Calibration We also perform storm-time calibration to show that the methodology works effectively even during periods of high variability; we perform assimilation on a 3-hourly time-scale. Table: RMS values with and without IC (Intercalibration) w/ IC w/o IC MSIS Assimilated MSIS Assimilated AGU Storm, Days 348-350, 2006 CHAMP 49.1% 16.7% 60.5% 16.9% GRACE 81.8% 15.2% 105.1% 14.5% 348 348.5 349 349.5 350 350.5 351 0 0.5 1 1.5 Mass Density, kg/m 3 10 -11 (a) CHAMP with IC MSIS Observations Assimilated 348 348.5 349 349.5 350 350.5 351 0 0.5 1 1.5 2 10 -12 (b) GRACE with IC MSIS Observations Assimilated 348 348.5 349 349.5 350 350.5 351 Day of the Year 0 0.2 0.4 0.6 0.8 1 Mass Density, kg/m 3 10 -11 (c) CHAMP without IC MSIS Observations Assimilated 348 348.5 349 349.5 350 350.5 351 Day of the Year 0 0.5 1 1.5 10 -12 (d) GRACE without IC MSIS Observations Assimilated Figure: Calibration during the AGU storm, days 348-350, 2006 Conclusion The developed method can be used for investigation and in- ference of thermosphere dynamics and variations and cali- bration of empirical models. References [1] R. R. Meier and J. M. Picone, et. al. Remote sensing of earth’s limb by timed/guvi: Retrieval of thermospheric composition and temperature. Earth and Space Science, 2(1):1–37, 2015. 2014EA000035. [2] Piyush M. Mehta, Andrew C. Walker, Eric K. Sutton, and Humberto C. Godinez. New density estimates derived using accelerometers on board the champ and grace satellites. Space Weather, 15(4):558–576, 2017. 2016SW001562. [3] Piyush M. Mehta and Richard Linares. A methodology for reduced order modeling and calibration of the upper atmosphere. Space Weather, 15(10):1270–1287, 2017. 2017SW001642. [4] J. P. Thayer, X. Liu, J. Lei, M. Pilinski, and A. G. Burns. The impact of helium on thermosphere mass density response to geomagnetic activity during the recent solar minimum. Journal of Geophysical Research: Space Physics, 117(A7):n/a–n/a, 2012. A07315. Contact Information Email: [email protected] Phone: +1 (612) 481 7542 View publication stats View publication stats

Data-Driven Inference and Investigation of …rlinares/papers/2017_09.pdfData-Driven Inference and Investigation of Thermosphere Dynamics and Variations PiyushM.Mehta1,RichardLinares1,andEricK.Sutton2

Embed Size (px)

Citation preview

Page 1: Data-Driven Inference and Investigation of …rlinares/papers/2017_09.pdfData-Driven Inference and Investigation of Thermosphere Dynamics and Variations PiyushM.Mehta1,RichardLinares1,andEricK.Sutton2

Data-Driven Inference and Investigation of Thermosphere Dynamics andVariations

Piyush M. Mehta1, Richard Linares1, and Eric K. Sutton2

1Department of Aerospace Engineering and Mechanics, University of Minnesota, 2 Air Force Research Laboratory

Major Contributions

XNew methodology for data-driven inference andinvestigation of thermosphere dynamics and variations.

XReduced order modeling and self-consistent calibrationusing mass and number density observationssimultaneously.

Introduction

Modal decomposition or variance reduction methods offer anopportunity for data-driven investigation of thermospheredynamics and variations and for self-consistent calibrationof the thermosphere models. We develop the methodologyusing the MSIS model and infer oxygen-to-helium transi-tion as a validation by simultaneously assimilating discreteTIMED/GUVI and CHAMP/GRACE observations [1,2,3].

Methodology

We generate hourly model output (snapshots), xi, for eachinput sample generated using a latin-hypercube (F10.7 ∈[60, 250], Ap ∈ [0, 50], DOY ∈ [1, 365]) to cover the fullrange of inputs. We use a total of 365 + 8 (corner samples ofthe latin-hypercube) = 373 samples. A SVD decompositionis performed on the snapshot matrix, X = [x1, x2, . . . , xm], toderive the optimal set of basis vectors, U (X = USVT ), forO, O2, N2, and He. We do not tune N and H under the as-sumption that the CHAMP and GRACE observations do notcontain any signal about the minor species and that the par-tial pressure of H is negligible. The spatial basis vectors ormodes, U, can then be combined with time-dependent coef-ficients, c, such that x(s, t) =

∑ri=1 ci(t)Ui(s), where r is the

order or rank of truncation. The first (r = 3) modes for eachspecies captures more than 98% of the total variance. Thecoefficients, c, are derived by projecting the data, x, onto thespatial modes, U. We model their daily temporal variationsusing a sum of three cosine terms c(t) =

∑3i=1 ai cos(ωit+ζi)

and fit a, ω, ζ for each mode and species using Gaussian Pro-cess Regression for prediction at any new set of inputs.

(a) Mean

0 5 10 15 20

Local Time

-50

0

50

La

titu

de

3

4

5

61012

1 2 3 4 5 6 7 8 9 10

Mode

10-2

100

102

%

(b)96.24

2.16

0.38 0.32 0.30 0.25

0.10 0.10 0.08 0.07

(c) Mode 1

0 5 10 15 20

-50

0

50

La

titu

de

-0.0112

-0.0111

-0.011

-0.0109

50 100 150 200 250-2700

-2650

-2600

-2550(d) Mode 1

0 10 20 30 40 50-2700

-2650

-2600

-2550(e) Mode 1

0 100 200 300 400-2700

-2650

-2600

-2550(f) Mode 1

(g) Mode 2

0 5 10 15 20

-50

0

50

La

titu

de

-0.01

0

0.01

50 100 150 200 250-200

-100

0

100

200(h) Mode 2

0 10 20 30 40 50-200

-100

0

100

200(i) Mode 2

0 100 200 300 400-200

-100

0

100

200(j) Mode 2

(k) Mode 3

0 5 10 15 20

Local Time

-50

0

50

La

titu

de

-0.01

-0.005

0

0.005

0.01

50 100 150 200 250

F10.7

-40

-20

0

20(l) Mode 3

0 10 20 30 40 50

Ap

-40

-20

0

20(m) Mode 3

0 100 200 300 400

DOY

-40

-20

0

20(n) Mode 3

Figure: Mean and first 3 dominant modes for He.

Measurement Intercalibration

Typically, reliable data assimilation requires the observationsto be intercalibrated. The CHAMP and GRACE observa-tions are first intercalibrated by multiplying the GRACEdensities with a yearly scale factor to match the mean andvariance of the observation-to-model ratio.

Figure: Observations/MSIS; CH = CHAMP, GR = GRACE, GR-S =GRACE Scaled, [mean,variance].

The GUVI number density and intercalibratedCHAMP/GRACE mass density observations are thencalibrated daily to the reference GUVI observation-to-modelvalue (based on mass density computed with O, N2, andO2) at ∼200 km, where the uncertainties are minimum.

Model or Measurement Calibration?

Intercalibration (IC) of observations accounts for biases withrespect to a given model; however, it keeps the calibrationfrom the true state by modifying the observations. The realgoal is to calibrate the model to the observations, even if itmeans relaxing certain model assumptions. We first validatethe data assimilation process with intercalibrated observa-tions for representative days (2002270 and 2007034 for highand low solar activity, respectively) using 3, 5, and 10 modes.We find that using 5 modes provides optimal results whileavoiding overfitting. We then perform assimilation w/o ICof the observations using 5 modes. All results presented arederived using 5 modes.

Table: RMS values. CH: CHAMP, GR: GRACE, GV: GUVI

Assimilate → CH GR CH+GR GV CH+GV GR+GV CH+GRValidate ↓ (%) (%) (%) (%) (%) (%) +GV (%)

2002270CH w/ IC 6.9 10.8 9.7 14.3 8.7 11.7 10.5GR w/ IC 16.3 10.0 10.1 14.1 15.2 10.8 10.7

CH w/o IC 6.2 12.0 9.1 14.8 9.5 13.5 12.4GR w/o IC 24.1 9.1 9.3 14.8 17.1 10.5 10.5

2007034CH w/ IC 7.5 16.8 10.7 27.6 8.8 16.1 10.7GR w/ IC 18.1 12.5 13.2 34.5 20.4 12.2 12.5

CH w/o IC 7.0 17.4 9.2 16.8 8.8 15.1 11.3GR w/o IC 29.1 11.2 11.7 18.4 22.7 11.5 12.1

Oxygen-to-Helium Transition

We use the methodology to infer He dynamics and O-to-Hetransition. Assimilation shows that the O-to-He transitionoccurs at significantly lower altitudes, as inferred by Thayeret. al., [4] using CHAMP and GRACE observations.

(a) He/O MSIS

-50 0 50

Latitude

100

200

300

400

500

600

Alt

itu

de

2

4

6

8

10

12

14

(b) He/O: Assimilated with IC

-50 0 50

Latitude

100

200

300

400

500

600

5

10

15

20

25

(c) He/O: Assimilated without IC

-50 0 50

Latitude

100

200

300

400

500

600

5

10

15

20

25

30

Figure: Helium-to-Oxygen ratio on 2007034.The amount of O and He at higher altitudes differ signifi-cantly between the two different cases (w/ and w/o IC). Thisdifference is caused by the IC of observations with the casew/o IC providing the true state of the thermosphere. Forboth cases, MSIS underpredicts the amount of He at higheraltitudes in the winter polar region.

(a) He: Assimilated/MSIS w/ IC

-50 0 50100

200

300

400

500

600

Alt

itu

de

1

1.2

1.4

1.6

(b) He: Assimilated/MSIS w/o IC

-50 0 50100

200

300

400

500

600

0.85

0.9

0.95

1

1.05

1.1

1.15

(c) O: Assimilated/MSIS w/ IC

-50 0 50

Latitude

100

200

300

400

500

600

Alt

itu

de

0.6

0.8

1

1.2

1.4

(d) O: Assimilated/MSIS w/o IC

-50 0 50

Latitude

100

200

300

400

500

600

0.4

0.6

0.8

1

1.2

1.4

Figure: He and O Assimilated/MSIS ratio on 2007034.The spatially and temporally averaged daily vertical pro-files of He and O are used to estimate the contribution oflower boundary composition and temperature effects underthe diffusive equilibrium assumption. Assimilating observa-tions with IC suggests over and underprediction by MSISclose to GRACE altitudes forO andHe, respectively. Assim-ilating without IC suggests that MSIS modelsHe accurately,however, significantly overpredicts O at GRACE altitudes.

1012

1013

1014

1015

100

200

300

400

500

600

Alt

itu

de

(a) He with IC

MSIS

Assimilated

1012

1013

1014

1015

100

200

300

400

500

600(a) He without IC

MSIS

Assimilated

1010

1012

1014

1016

1018

Number Density, kg/m3

100

200

300

400

500

600

Alt

itu

de

(a) O with IC

MSIS

Assimilated

1010

1012

1014

1016

1018

Number Density, kg/m3

100

200

300

400

500

600(a) O without IC

MSIS

Assimilated

Figure: He and O vertical profile on 2007034.

Table: Contribution of composition and temperature variations125 km 500 km

(m−3) (m−3) (m−3) (m−3) Total % from fromMSIS Assimilated MSIS Assimilated Overprediction Comp Temp

w/ ICOxygen 1.27e17 1.49e17 3.87e12 3.18e12 21.7 -21.1 42.8Helium 4.47e13 4.61e13 1.88e12 2.46e12 -23.6 -2.4 -21.2

w/o ICOxygen 1.27e17 1.48e17 3.87e12 1.91e12 102.6 -33.5 136.1Helium 4.47e13 4.45e13 1.88e12 1.89e12 -0.5 0.5 -1.0

Storm-time Calibration

We also perform storm-time calibration to show that themethodology works effectively even during periods of highvariability; we perform assimilation on a 3-hourly time-scale.

Table: RMS values with and without IC (Intercalibration)w/ IC w/o IC

MSIS Assimilated MSIS AssimilatedAGU Storm, Days 348-350, 2006

CHAMP 49.1% 16.7% 60.5% 16.9%GRACE 81.8% 15.2% 105.1% 14.5%

348 348.5 349 349.5 350 350.5 3510

0.5

1

1.5

Ma

ss D

en

sit

y,

kg

/m3

10-11 (a) CHAMP with IC

MSIS

Observations

Assimilated

348 348.5 349 349.5 350 350.5 3510

0.5

1

1.5

210

-12 (b) GRACE with IC

MSIS

Observations

Assimilated

348 348.5 349 349.5 350 350.5 351

Day of the Year

0

0.2

0.4

0.6

0.8

1

Mas

s D

en

sit

y,

kg

/m3

10-11 (c) CHAMP without IC

MSIS

Observations

Assimilated

348 348.5 349 349.5 350 350.5 351

Day of the Year

0

0.5

1

1.510

-12 (d) GRACE without IC

MSIS

Observations

Assimilated

Figure: Calibration during the AGU storm, days 348-350, 2006

Conclusion

The developed method can be used for investigation and in-ference of thermosphere dynamics and variations and cali-bration of empirical models.

References[1] R. R. Meier and J. M. Picone, et. al.

Remote sensing of earth’s limb by timed/guvi: Retrieval of thermospheric composition and temperature.Earth and Space Science, 2(1):1–37, 2015.2014EA000035.

[2] Piyush M. Mehta, Andrew C. Walker, Eric K. Sutton, and Humberto C. Godinez.New density estimates derived using accelerometers on board the champ and grace satellites.Space Weather, 15(4):558–576, 2017.2016SW001562.

[3] Piyush M. Mehta and Richard Linares.A methodology for reduced order modeling and calibration of the upper atmosphere.Space Weather, 15(10):1270–1287, 2017.2017SW001642.

[4] J. P. Thayer, X. Liu, J. Lei, M. Pilinski, and A. G. Burns.The impact of helium on thermosphere mass density response to geomagnetic activity during the recent solar minimum.Journal of Geophysical Research: Space Physics, 117(A7):n/a–n/a, 2012.A07315.

Contact Information

•Email: [email protected]•Phone: +1 (612) 481 7542

View publication statsView publication stats