38
Error analysis T. A. Herring M. A. Floyd Massachuse(s Ins,tute of Technology GAMIT/GLOBK/TRACK Short Course for GPS Data Analysis Korea InsDtute of Geoscience and Mineral Resources (KIGAM) Daejeon, Republic of Korea 23–27 May 2016 Material from T. A. Herring, R. W. King, M. A. Floyd (MIT) and S. C. McClusky (now ANU)

Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

Erroranalysis

T.A.HerringM.A.FloydMassachuse(sIns,tuteofTechnology

GAMIT/GLOBK/TRACKShortCourseforGPSDataAnalysisKoreaInsDtuteofGeoscienceandMineralResources(KIGAM)

Daejeon,RepublicofKorea23–27May2016

MaterialfromT.A.Herring,R.W.King,M.A.Floyd(MIT)andS.C.McClusky(nowANU)

Page 2: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

IssuesinGPSErrorAnalysis

•  Whatarethesourcesoftheerrors?

•  Howmuchoftheerrorcanweremovebybe[ermodeling?

•  DowehaveenoughinformaDontoinfertheuncertainDesfromthedata?

•  WhatmathemaDcaltoolscanweusetorepresenttheerrorsanduncertainDes?

2016/05/25 Basicerroranalysis 2

Page 3: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

DeterminingtheUncertainDesofGPSParameterEsDmates

•  RigorousesDmateofuncertainDesrequiresfullknowledgeoftheerrorspectrum—bothtemporalandspaDalcorrelaDons(neverpossible)

•  SufficientapproximaDonsareoaenavailablebyexaminingDmeseries(phaseand/orposiDon)andreweighDngdata

•  Whatevertheassumederrormodelandtoolsusedtoimplementit,externalvalidaDonisimportant

2016/05/25 Basicerroranalysis 3

Page 4: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

ToolsforErrorAnalysisinGAMIT/GLOBK

•  GAMIT:AUTCLNreweight=Y(default)usesphasermsfromposeitedittoreweightdatawithconstant+elevaDon-dependentterms

•  GLOBK–  rename(eq_file)_XPSor_XCLtoremoveoutliers–  sig_neuaddswhitenoisebystaDonandspan;bestwayto“rescale”therandomnoise

component;alargevaluecanalsosubsDtutefor_XPS/_XCLrenamesforremovingoutliers

–  mar_neuaddsrandom-walknoise:principalmethodforcontrollingvelocityuncertainDes–  Inthegdlfiles,canrescalevariancesofanenDreh-file:usefulwhencombiningsoluDons

fromwithdifferentsamplingratesorfromdifferentprograms(Bernese,GIPSY)•  UDliDes

–  tsviewandtsfitcangenerate_XPScommandsgraphicallyorautomaDcally–  grwandvrwcangeneratesig_neucommandswithafewkeystrokes–  FOGMEx(“realisDcsigma”)algorithmimplementedintsview(MATLAB)andtsfit/ensum;

sh_gen_statsgeneratesmar_neucommandsforglobkbasedonthenoiseesDmates–  sh_plotvel(GMT)allowsseongofconfidenceleveloferrorellipses–  sh_tshistandsh_velhist(GMT)canbeusedtogeneratehistogramsofDmeseriesand

velociDes.

2016/05/25 Basicerroranalysis 4

Page 5: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

SourcesofError

•  SignalpropagaDoneffects–  Receivernoise–  Ionosphericeffects–  Signalsca[ering(antennaphasecenter/mulDpath)–  Atmosphericdelay(mainlywatervapor)

•  UnmodeledmoDonsofthestaDon– Monumentinstability–  Loadingofthecrustbyatmosphere,oceans,andsurfacewater

•  UnmodeledmoDonsofthesatellites

2016/05/25 Basicerroranalysis 5

Page 6: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

Epochs

12345Hours

20

0mm

-20

ElevaDonangleandphaseresidualsforsinglesatellite

CharacterizingPhaseNoise

2016/05/25 Basicerroranalysis 6

Page 7: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

Fixedantennas

Walls

Poles

Reinforcedconcretepillars

Deep-bracing

h[p://pbo.unavco.org/instruments/gps/monumentaDon

2016/05/25 Basicerroranalysis 7

Page 8: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

TimeseriescharacterisDcs

Page 9: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

TimeseriescomponentsobservedposiDon

(linear)velocityterm

iniDalposiDon

2016/05/25 Basicerroranalysis 9

Page 10: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

observedposiDon

(linear)velocityterm

annualperiodsinusoid

iniDalposiDon

Timeseriescomponents

2016/05/25 Basicerroranalysis 10

Page 11: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

observedposiDon

(linear)velocityterm

annualperiodsinusoid

semi-annualperiodsinusoid

iniDalposiDon

seasonalterm

Timeseriescomponents

2016/05/25 Basicerroranalysis 11

Page 12: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

observedposiDon

(linear)velocityterm

annualperiodsinusoid

semi-annualperiodsinusoid

iniDalposiDon

seasonaltermε=3mmwhitenoise

Timeseriescomponents

2016/05/25 Basicerroranalysis 12

Page 13: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

“White”noise•  Time-independent(uncorrelated)•  MagnitudehasconDnuousprobabilityfuncDon,e.g.Gaussian

distribuDon•  DirecDonisuniformlyrandom

“True”displacementperDmestepIndependent(“white”)noiseerrorObserveddisplacementaaerDmestept(v=d/t)

2016/05/25 Basicerroranalysis 13

Page 14: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

“Colored”noise•  Time-dependent(correlated):power-law,first-orderGauss-

Markov,etc•  Convergenceto“true”velocityisslowerthanwithwhite

noise,i.e.velocityuncertaintyislarger

“True”displacementperDmestepCorrelated(“colored”)noiseerror*ObserveddisplacementaaerDmestept(v=d/t)*exampleis“randomwalk”(Dme-integratedwhitenoise)

•  Mustbetakenintoaccounttoproducemore“realisDc”velociDesThisisstaDsDcalandsDlldoesnotaccountforallother(unmodeled)errorselsewhereintheGPSsystem

2016/05/25 Basicerroranalysis 14

Page 15: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

Annualsignalsfromatmosphericandhydrologicalloading,monumenttransla,onand,lt,andantennatemperaturesensi,vityarecommoninGPS,meseries

VelocityErrorsduetoSeasonalSignalsinConDnuousTimeSeries

TheoreDcalanalysisofaconDnuousDmeseriesbyBlewi(andLavallee[2002,2003]

Top:Biasinvelocityfroma1mmsinusoidal

signalin-phaseandwitha90-degreelagwithrespecttothestartofthedataspan

Bo(om:Maximumandrmsvelocitybiasover

allphaseangles–  TheminimumbiasisNOTobtainedwith

conDnuousdataspanninganevennumberofyears

–  Thebiasbecomessmallaaer3.5yearsofobservaDon

2016/05/25 Basicerroranalysis 15

Page 16: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

CharacterizingtheNoiseinDailyPosiDonEsDmates

NotetemporalcorrelaDonsof30-100daysandseasonalterms

2016/05/25 Basicerroranalysis 16

Page 17: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

Figure5fromWilliamsetal[2004]:Powerspectrumforcommon-modeerrorintheSOPACregionalSCIGNanalysis.Linesarebest-fitWN+FNmodels(solid=meanampl;dashed=MLE)Notelackoftaperandmisfitforperiods>1yr

SpectralAnalysisoftheTimeSeriestoEsDmateanErrorModel

2016/05/25 Basicerroranalysis 17

Page 18: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

SummaryofSpectralAnalysisApproach

•  Powerlaw:slopeoflinefittospectrum–  0=whitenoise–  -1=flickernoise–  -2=randomwalk

•  Non-integerspectralindex(e.g.“fracDonwhitenoise”à1>k>-1)

•  GooddiscussioninWilliams[2003]

•  Problems:–  ComputaDonallyintensive–  Nomodelcapturesreliablythelowest-frequencypartofthespectrum

2016/05/25 Basicerroranalysis 18

Page 19: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

CATS(Williams,2008)

•  CreateandAnalyzeTimeSeries•  MaximumlikelihoodesDmatorforchosenmodel–  IniDalposiDonandvelocity– Seasonalcycles(sumofperiodicterms)[opDonal]– Exponentofpowerlawnoisemodel

•  Requiressomelinearalgebralibraries(BLASandLAPACK)tobeinstalledoncomputer(commonnowadays,butcheck!)

2016/05/25 Basicerroranalysis 19

Page 20: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

Hector(Bosetal.,2013)•  MuchthesameasCATSbutfasteralgorithm•  MaximumlikelihoodesDmatorforchosenmodel–  IniDalposiDonandvelocity–  Seasonalcycles(sumofperiodicterms)[opDonal]–  Exponentofpowerlawnoisemodel– Also

•  RequiresATLASlinearalgebralibrariestobeinstalledoncomputer

•  LinuxpackageavailablebuttrickytoinstallfromsourceduetoATLASrequirement

2016/05/25 Basicerroranalysis 20

Page 21: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

sh_cats/sh_hector

•  ScriptstoaidbatchprocessingofDmeserieswithCATSorHector

•  RequiresCATSand/orHectortobepre-installed

•  Outputs– VelociDesin“.vel”-fileformat– Equivalentrandomwalkmagnitudesin“mar_neu”commandsforsourcinginglobkcommandfile

•  CantakealongDme!

2016/05/25 Basicerroranalysis 21

Page 22: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

WhitenoisevsflickernoisefromMaoetal.[1999]spectralanalysisof23globalstaDons

Short-cut(Maoetal,1998):UsewhitenoisestaDsDcs(wrms)topredicttheflickernoise

2016/05/25 Basicerroranalysis 22

Page 23: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

“RealisDcSigma”AlgorithmforVelocityUncertainDes

•  MoDvaDon:computaDonalefficiency,handleDmeserieswithvaryinglengthsanddatagaps;obtainamodelthatcanbeusedinglobk

•  Concept:Thedeparturefromawhite-noise(sqrtn)reducDoninnoisewithaveragingprovidesameasureofcorrelatednoise.

•  ImplementaDon:–  Fitthevaluesofchi2vsaveragingDmetotheexponenDalfuncDon

expectedforafirst-orderGauss-Markov(FOGM)process(amplitude,correlaDonDme)

–  Usethechi2valueforinfiniteaveragingDmepredictedfromthismodeltoscalethewhite-noisesigmaesDmatesfromtheoriginalfit

–  and/or–  FitthevaluestoaFOGMwithinfiniteaveragingDme(i.e.,random

walk)andusetheseesDmatesasinputtoglobk(mar_neucommand)

2016/05/25 Basicerroranalysis 23

Page 24: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

Extrapolatedvariance(FOGMEx)•  Forindependentnoise,variance∝1/√Ndata

•  Fortemporallycorrelatednoise,variance(or𝜒2/d.o.f.)ofdataincreaseswithincreasingwindowsize

•  ExtrapolaDonto“infiniteDme”canbeachievedbyfionganasymptoDcfuncDontoRMSasafuncDonofDmewindow–  𝜒2/d.o.f.∝e−𝜎𝜏

•  AsymptoDcvalueisgoodesDmateoflong-termvariancefactor

•  Use“real_sigma”opDonintsfit

2016/05/25 Basicerroranalysis 24

Page 25: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

Yellow:Daily(raw)Blue:7-dayaverages

UnderstandingtheFOGMExalgorithm:EffectofaveragingonDme-seriesnoise

NotethedominanceofcorrelatederrorsandunrealisDcrateuncertainDeswithawhitenoiseassumpDon:.01mm/yrN,E.04mm/yrU

2016/05/25 Basicerroranalysis 25

Page 26: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

Samesite,Eastcomponent(dailywrms0.9mmnrms0.5)

64-davgwrms0.7mmnrms2.0

100-davgwrms0.6mmnrms3.4

400-davgwrms0.3mmnrms3.1

2016/05/25 Basicerroranalysis 26

Page 27: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

Redlinesshowthe68%probabilityboundsofthevelocitybasedontheresultsofapplyingthealgorithm.

UsingTSVIEWtocomputeanddisplaythe“realisDc-sigma”results

NoterateuncertainDeswiththe“realisDc-sigma”algorithm:0.09mm/yrN0.13mm/yrE0.13mm/yrU

2016/05/25 Basicerroranalysis 27

Page 28: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

ComparisonofesDmatedvelocityuncertainDesusingspectralanalysis(CATS)andGauss-Markovfiongofaverages(FOGMEx)

PlotcourtesyE.Calais

2016/05/25 Basicerroranalysis 28

Page 29: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

SummaryofPracDcalApproaches

•  Whitenoise+flickernoise(+randomwalk)tomodelthespectrum[Williamsetal.,2004]

•  Whitenoiseasaproxyforflickernoise[Maoetal.,1999]•  RandomwalktomodeltomodelanexponenDalspectrum[Herring“FOGMEx”

algorithmforvelociDes]•  “Eyeball”whitenoise+randomwalkfornon-conDnuousdata______________________________________•  OnlythelasttwocanbeappliedinGLOBKforvelocityesDmaDon•  AllapproachesrequirecommonsenseandverificaDon

2016/05/25 Basicerroranalysis 29

Page 30: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

ExternalvalidaDonofvelocityuncertainDesbycomparingwithamodel-Simplecase:assumenostrainwithinageologicallyrigidblock

GMTplotat70%confidence

17sitesincentralMacedonia:4-5velociDespierceerrorellipses

2016/05/25 Basicerroranalysis 30

Page 31: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

..samesoluDonplo[edwith95%confidenceellipses

1-2of17velociDespierceerrorellipses

2016/05/25 Basicerroranalysis 31

Page 32: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

McCaffreyetal.2007

ExternalvalidaDonofvelocityuncertainDesbycomparingwithamodel-amorecomplexcaseofalargenetworkintheCascadiasubducDonzone

ColorsshowslippingandlockedporDonsofthesubducDngslabwherethesurfacevelociDesarehighlysensiDvetothemodel;areatotheeastisslowlydeformingandinsensiDvetothedetailsofthemodel

2016/05/25 Basicerroranalysis 32

Page 33: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

VelociDesand70%errorellipsesfor300sitesobservedbyconDnuousandsurvey-modeGPS1991-2004Testarea(nextslide)iseastof238E

2016/05/25 Basicerroranalysis 33

Page 34: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

ResidualstoelasDcblockmodelfor73sitesinslowlydeformingregionErrorellipsesarefor70%confidence:13-17velociDespiercetheirellipse

2016/05/25 Basicerroranalysis 34

Page 35: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

CumulaDvehistogramofnormalizedvelocityresidualsforEasternOregon&Washington(70sites)NoiseaddedtoposiDonforeachsurvey:0.5mmrandom1.0mm/sqrt(yr))randomwalkSolidlineistheoreDcalforachidistribuDon

PercentWithinRaDo

RaDo(velocitymagnitude/uncertainty)

StaDsDcsofVelocityResiduals

2016/05/25 Basicerroranalysis 35

Page 36: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

RaDo(velocitymagnitude/uncertainty)

PercentWithinRaDo

Sameaslastslidebutwithasmallerrandom-walknoiseadded:0.5mmrandom0.5mm/yrrandomwalk(vs1.0mm/sqrt(yr))RWfor‘best’noisemodel)Notegreaternumberofresidualsinrangeof1.5-2.0sigma

StaDsDcsofVelocityResiduals

2016/05/25 Basicerroranalysis 36

Page 37: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

PercentWithinRaDo

Sameaslastslidebutwithlargerrandomandrandom-walknoiseadded:2.0mmwhitenoise1.5mm/sqrt(yr))randomwalk(vs0.5mmWNand1.0mm/sqrt(yr))RWfor‘best’noisemodel)Notesmallernumberofresidualsinallrangesabove0.1-sigma

RaDo(velocitymagnitude/uncertainty)

StaDsDcsofVelocityResiduals

2016/05/25 Basicerroranalysis 37

Page 38: Error analysis - Massachusetts Institute of Technology › ... › Korea16 › pdf › 34-Error_analysis.pdf · Tools for Error Analysis in GAMIT/GLOBK • GAMIT: AUTCLN reweight

Summary

•  AllalgorithmsforcompuDngesDmatesofstandarddeviaDonshavevariousproblems:Fundamentally,ratestandarddeviaDonsaredependentonlowfrequencypartofnoisespectrumwhichispoorlydetermined.

•  AssumpDonsofstaDonarityareoaennotvalid

•  FOGMEx(“realisDcsigma”)algorithmisaconvenientandreliableapproachtogeongvelocityuncertainDesinglobk

•  Velocityresidualsfromaphysicalmodel,togetherwiththeiruncertainDes,canbeusedtovalidatetheerrormodel

2016/05/25 Basicerroranalysis 38