8/15/2019 ERD_DS1

1/31

An Overview of SWFSC’sEnvironmental Research Division’s

(ERD)Data Services and Tools

 The ERD (formerly FE! and FE") facility# $%%& ' $*

ERD’s data +ro,-.

Roy /endelssohn# "ynn DeWitt# 0o1 Simons# Dale Ro1inson 2Dave Foley3

3deceased Decem1er 4# $5

8/15/2019 ERD_DS1

2/31

"ast ,-dated. A,+,st $*

8/15/2019 ERD_DS1

3/31

Satellite Data Browsers

West Coast of the U.S. & Mexico:

http://coastwatch.pfel.noaa.gov/coastwatch/CWBrowser.jspGlobal, longitude ! to "#!:http://coastwatch.pfel.noaa.gov/coastwatch/CWBrowserWW360.jsp

Global, longitude $%! to %!:http://coastwatch.pfel.noaa.gov/coastwatch/CWBrowserWW180.jsp

'(DD)*

http://coastwatch.pfeg.noaa.gov/erddaphttp://coastwatch.pfeg.noaa.gov/erddap/griddap

+he 'DC for )rcGS, Matlab, ( or 'xcel

http://www.pfeg.noaa.gov/products/EC/ or

http://www.asascience.co"/software/downloads/

-tract$o$atic routines for Matlab & (

http://coastwatch.pfel.noaa.gov/#tracto/

'(D +/('DDS ser0er 

http://oceanwatch.pfeg.noaa.gov/thredds/catalog.ht"l

12)) Satellite Course

http://www.pfel.noaa.gov/events/$%&&'atCourses

3uestions or Coents4

e("ail cara.wilson)noaa.gov

8/15/2019 ERD_DS1

4/31

Table of Contents

S,mmary of ERD’s tools666666666666666666666666666666666666666666666666*Overview of ERD Datasets66666666666666666666666666666666666666666666&

Satellite Data 0rowsers66666666666666666666666666666666666666666666666667ERDDA66666666666666666666666666666666666666666666666666666666666666666666666$$Environmental Data Connector (EDC)6666666666666666666666666$789tractomatic scri-ts for /atla1 2 R666666666666666666666666666S-eciali:ed We1 -a+es666666666666666666666666666666666666666666666666;OAA Ocean Satellite Co,rses6666666666666666666666666666666666665

*

8/15/2019 ERD_DS1

5/31

Summary of ERD’s tools

+ool Usage *rogras *ros5Cons

'atelliteataBrowsers

*ood tool for viewingsatellite datasets

$ot reco""ended fordownloading data. $otall satellite datasets onall the +rowser, "ostnota+le -' and

 &uarius salinitdatasets are not on it.

E&2 & data server that gives ouor a "achine4 a si"ple,

consistent wa to downloadsu+sets of scientificdatasets in co""on filefor"ats and "a5e graphsand "aps. E&2 wasdeveloped at E + Bo+'i"ons, +ut other centersnow have their ownE&2 servers.

ata can +evisualied or

downloaded in avariet of dataand i"agefor"ats oraccesseddirectl fro"within tools suchas 7atla+, ,*r&' and"ore

E#tensive dataholdings, not just

satellite data i.e., &*% floats, $BC+uo data, CalC%data and "odel outputare also on E&24.

 &llows for viewingdatasets, +ut switching+etween datasets iseasier in the 'atelliteata Browser.

EC *eographical and

te"porall su+set data andi"port directl into clientsoftware.

 &rc*', 7atla+,

, E#cel 9stand(alone

Wor5s not just with

Es data servers,+ut can connect to an%2e$&2,;(;trac5, fro" a user(defined+ounding +o# or fro" a

user(defined polgon

7atla+ 9 %nl wor5s with asu+set of the datasetson Es E&2

&

8/15/2019 ERD_DS1

6/31

Overview of ERD Datasets

 The data servers at the So,thwest Fisheries Science Center’s

Environmental Research Division (ERD) serve over 7 T0 of data6 TheWest Coast node of ;OAA’s CoastWatch -ro+ram (coastwatch6noaa6+ov)is -art of ERD# and the Coastwatch satellite 1rowsers -rovide access tooceano+ra-hic satellite data as -art of this -ro+ram6 The CoastWatch1rowsers -rovide data over a limited time ran+e# while ERD data services-rovide data over as lon+ a time -eriod as -ossi1le6 ERD data servicesalso -rovide a variety of other environmental data in addition to satellitedata6 A 1rief# and incom-lete# listin+ of some the dataset holdin+s is+iven 1elow6 For a com-lete listin+ of all the datasets served 1y ERD +oto the ERDDA server. htt-.ector Winds. ASCAT and ,iBScat datasetsAltimetry. A>=SO SS? datasetsSalinity. A,ari,s dataset

For more information a1o,t these satellite datasets# see the SatelliteData rimer# also -rod,ced 1y ERD6 A version can 1e fo,nd athtt-.

8/15/2019 ERD_DS1

7/31

H

8/15/2019 ERD_DS1

8/31

Satellite Data Browsers

West Coast of the U.S. & Mexico:http://coastwatch.pfel.noaa.gov/coastwatch/CWBrowser.jsp

Global, 6longitude ! to "#!7:http://coastwatch.pfel.noaa.gov/coastwatch/CWBrowserWW360.jsp

Global, 6longitude $%! to %!7:http://coastwatch.pfel.noaa.gov/coastwatch/CWBrowserWW180.jsp

or google 8CoastWatch "#9 or 8CoastWatch %9

 The West Coast node of ;OAA’s CoastWatch -ro+ram (which has 1eenho,sed at the ERD since 5) has develo-ed three -rimary satellitedata 1rowsers6 The @rst 1rowser develo-ed covers the west coast of theGS# while the other two 1rowsers are +lo1al# and were develo-ed when itwas a--arent that ,sers of west coast CoastWatch node needed datasetsat +lo1al resol,tion6 Datasets in the WW57 1rowser have lon+it,de inI to 57I# and datasets in the WW$4 1rowser have lon+it,de in9$4I to $4I6 The WW57 and WW$4 1rowsers have all of the datasetsthat the west coast 1rowser has# -l,s a few additional datasets forre+ions other than the west coast of the G6S6 DiJerent datasets havediJerent s-atial resol,tions and diJerent tem-oral com-osite o-tions6

;ote the aci@c Ocean datasets# which have a hi+her s-atial resol,tionthan the !lo1al datasets# act,ally incl,de an area that covers m,ch ofthe northwestern Atlantic Ocean6

C,rrently new datasets are not ro,tinely 1ein+ added to the 1rowsers6Conse,ently there are a n,m1er of si+ni@cant satellite datasets that arenot on the 1rowsers# for eKam-le >==RS chloro-hyll data# A,ari,s salinitydata# and the hi+h resol,tion ($ Bm) !?RSST datasets6 These datasetsare availa1le via T?REDDS and ERDDA (see -a+e 4)6 The 1rowsers are a+ood tool for tasBs s,ch as.

? 1rowse thro,+h the diJerent datasets to see the amo,nt of covera+e inone’s area of interest? easily com-are diJerent tem-oral com-ostin+ o-tions? +et a ,icB timeseries for a -oint? com-are satellite data to 1,oy data? overlay vector wind @elds? maBe a ,icB animation

4

8/15/2019 ERD_DS1

9/31

0elow we descri1e how to do these tasBs6 While the data associatedwith any ima+e can 1e downloaded from the 1rowser in a variety of dataformats (6asc# 6Bml# 6hdf# 6mat#6nc etc)# o,r other tools (ERDDA# -a+e $ or the EDC# -a+e $) are1etter o-timi:ed for downloadin+ ch,nBs of data6

Comare di!erent datasets in a arti"ular re#ion

%

Fi+,re $6 /a- -a+e of the CoastWatch 0rowsers6

8/15/2019 ERD_DS1

10/31

 To choose an area# clicB the The /a- 1,tton on the Edit @eld (the +reenrow) at the to- of the -a+e (Fi+,re $)6 Lo, can select one of the-rede@ned re+ions# or select yo,r own latit,de and lon+it,de limits6 =f yo, want the ma- to s-an the dateline# maBe s,re yo, are ,sin+ theWW57 1rowser6 Similarly# if yo, want the ma- to s-an the -rime

meridian# maBe s,re yo, are ,sin+ the WW$4 1rowser6 After yo, havethe ma- dis-layin+ yo,r re+ion of interest# clicB the !rid Data 1,ttonon the Edit @eld (the +reen row) at the to- of the !rid Data -a+e6

Select a dataset from the dro-9down men, in the @rst oran+e row at theto- of the -a+e (Fi+,re )6 Datasets are arran+ed al-ha1etically6 =f thereis not m,ch color variation on the ma- yo, will want to chan+e the-alette (oran+e row M&) minim,m and maKim,m val,es6 0y defa,lt#chloro-hyll is ma--ed to a lo+ scale# it can 1e chan+ed to a linear scale if that is -referred6 0y defa,lt# the most recent data availa1le is dis-layed6 To select a diJerent time# choose one in Select a centered time (oran+e

row M5)6 As an eKercise looB at a daily com-osite of the followin+ SST(sea9s,rface tem-erat,re) -rod,cts for yo,r re+ion.

? A/SR9E# a microwave meas,rement that can see thro,+h clo,ds? /OD=S# an =R meas,rement that can not see thro,+h clo,ds? !OES# an =R meas,rement from a +eostationary -latform# taBen every $&

min,tes

$

Fi+,re 6 !rid Data -a+e of the CoastWatch 0rowsers# showin+ a timeseries 

8/15/2019 ERD_DS1

11/31

Also looB at each of these -rod,cts in the vario,s tem-oral com-ositin+o-tions that are availa1le6 This is done 1y selectin+ a time -eriod in row (yellow row)6 The tem-oral com-osites are the avera+e data for a +iventime9-eriod# 1ased on a center time# meanin+ a &9day com-osite for A,+ will incl,de data from A,+ 9*6

;ear9Real9Time (;RT) data vs6 Science ,ality data 9 ;RT data is 1etweena few min,tes and a few months old6 The +oal is to maBe the dataavaila1le as soon as -ossi1le6 Science ,ality data are at least twomonths old6 The eKtra time is ,sed for additional ,ality control andvalidation of the data6 Sometimes diJerent -rocessin+ methods are ,sedfor science ,ality and near9real9time data sets6 The 1rowsers have 1oth;RT and science ,ality data sets6 ;RT datasets may or may not 1ela1eled as s,ch6 Science ,ality data sets are always la1eled NScience,alityN6

$iewin# a timeseries/aBe s,re yo, are on the !rid data -a+e (Fi+,re ) and then clicB onany -oint on the ma- to create a timeseries of the data at that -oint6 Thetimeseries -lot will show ,- on the ri+ht side of the -a+e6 The end timeof the -lot corres-onds to the time of the ima+e dis-layed on the left6 The defa,lt is to dis-lay a month of data6 To increase the len+th of thetimeseries dis-layed# chan+e the 1e+innin+ data in Select a 1e+in time(yellow row M4)6 To see a timeseries at a diJerent s-ot sim-ly clicB onthat s-ot on the ma- or enter the eKact coordinates in O-tional (oran+erow MH)6 Only one timeseries can 1e viewed at a time6 To remove thetimeseries clicB any s-ot on the timeseries -lot6

Comarin# satellite data to buoy data

Select any SST -rod,ct from the !rid Data -a+e and maBe s,re thecolor -alette is f,lly ,tili:ed (i6e6# the ma- isn’t entirely 1l,e or red)# 1ychan+in+ the -alette minim,m and maKim,m val,es if necessary6 Selectthe Station Data $ 1,tton on the Edit @eld (the +reen line) at the to- of the -a+e6 Select SST (;D0C 0,oy) from the dro- down men,6 The1rowser will a,tomatically sync the times of the two diJerent datasets (if yo, don’t want them synched# +o the The /a- -a+e and ,nchecBSynchroni:e times# see Fi+,re $)6 =f yo, have chan+ed the min and

8/15/2019 ERD_DS1

12/31

Select the >ector Data 1,tton on the Edit @eld (the +reen row) at theto- of the -a+e6 Select one of the wind -rod,cts from the dro-9down list6 The wind vectors will show ,- over whatever @eld is dis-layed on thema-6 The 1rowser will a,tomatically sync the times of the two diJerentdatasets (if yo, don’t want them synched# +o the The /a- -a+e and

,nchecB Synchroni:e times# see Fi+,re $)6 To have the ma- show thewind s-eed as the colored ma--ed varia1le# +o to the !rid Data -a+eand select the mod,l,s -arameter of the wind -rod,ct whose vectors aredis-layed6

&dd "ontour lines

$

8/15/2019 ERD_DS1

13/31

Select the Conto,r Data 1,tton on the Edit @eld (the +reen row) at theto- of the -a+e6 Select a varia1le to conto,r6 =t does not have to 1e thesame varia1le ma--ed o,t6 The conto,rs will show ,- over whatever@eld is dis-layed on the ma-6 The 1rowser will a,tomatically sync thetimes of the two diJerent datasets (if yo, don’t want them synched# +o

the The /a- -a+e and ,nchecB Synchroni:e times)6 The defa,ltcolor of the conto,rs is red# it can 1e chan+ed in Select a color (yellow

row M)6 The n,m1er of conto,r lines can 1e ad,sted in Draw lines at(oran+e row M5)6 S-ecifyin+ one n,m1er will set ,- a constant intervals-acin+6 Enterin+ a list of val,es will set the conto,rs lines at thoses-eci@c val,es6

Ma'e a (ui"' animation

Select the The /a- 1,tton on the Edit @eld (the +reen row) at the to-of the -a+e6 Select the n,m1er of ima+es to animate (oran+e row M&)and clicB on >iew itP6 This sho,ld not 1e done for a lar+e n,m1er of timeste-sP

)or more *el

See the ?el- linB at the to- of each CW0rowsers# e6+6#

$5

Fi+,re 56 Station Data -a+e of the CoastWatch 1rowsers# showin+ as-atial and tem-oral com-arison 1etween satellite SST data and SST data

 

8/15/2019 ERD_DS1

14/31

8/15/2019 ERD_DS1

15/31

ERDD&+

http://coastwatch.pfeg.noaa.gov/erddap orhttp://upwell.pfeg.noaa.gov/erddap/griddap

or google 8'(DD)* '(D9 or 8'(DD)* U)9

ERDDA stands for the Environmental Research Division’s Data Accessro+ram6 ERDDA is a we1 a--lication (for h,mans with 1rowsers) and awe1 service (with services for com-,ter -ro+rams)6 =t was written 1y 0o1Simons to -rovide a easier access to datasets for 1oth -eo-le andmachines6 ERDDA.

? OJers a consistent way to +et data from a variety of diJerent dataso,rces6 =n addition to satellite datasets# ERD’s ERDDA serves otherdatasets s,ch as AR!O oats# ;D0C 1,oys# CalCOF= data and modelo,t-,t6

? "ets yo, download data in yo,r -referred data @le format (netcdf# csv#ESR=csv# QSO;# OD>teKt# mat# teKt and more)

? "ets yo, create ima+es in yo,r -referred ima+e @le format (-n+#trans-arent -n+# -df# Bml)

? S,--orts tem-oral and s-atial s,1settin+? =s RESTf,l# meanin+ the GR" com-letely de@nes the data yo, want# in

the format yo, want6 This is descri1ed in more detail on -a+e $56

$&

8/15/2019 ERD_DS1

16/31

ERD hosts two diJerent ERDDA servers6 The oceanwatch ERDDA isthe -rimary data server for the datasets of interest to ERD6 The otherERDDA is -art of ;OAA’s GAF (Gni@ed Access FrameworB)# an eJort to

develo- a ,ni@ed access to ;OAA’s distri1,ted data# with the initial eJortfoc,sed on +ridded datasets in ;OAA6 =n Se-tem1er $5 there were H&$datasets on the oceanwatch ERDDA server and #7$ on the GAF server6(All of the data on the oceanwatch ERDDA are also on the GAF ERDDA)6

To use ERDD&+:

$6 Search for a dataset of interest with one of the o-tions on the ri+ht sideof the ERDDA home -a+e6 For eKam-le# enter SST in the SearchteKt1oK or clicB on >iew a list of666 to see all the availa1le datasets(Fi+,re *)

6 ClicB on the dataset’s +ra-h linB (Fi+,re &) to +et a form that hel-s yo,create +ra-hs and ma-s of the data6

56 ClicB on the dataset’s data linB (Fi+,re *)to +et a form that hel-s yo,download a s,1set of the dataset in the data @le format that want6

$7

Fi+,re *6 Sna-shot of main ERDDA -a+e6 To select a dataset ,se thesearch 1oK# or clicB on >iew a list of all to see all the availa1le

https://geo-ide.noaa.gov/wiki/index.php?title=Overview_and_benefits_of_the_GEO-IDE_UAF_Grid_Projecthttps://geo-ide.noaa.gov/wiki/index.php?title=Overview_and_benefits_of_the_GEO-IDE_UAF_Grid_Project

8/15/2019 ERD_DS1

17/31

$H

Fi+,re &6 Sna-shot of the to- of the listin+ of all datasets on the ERD OceanwatchERDDA server6 ClicBin+ +ra-h to the left of a dataset will 1rin+ ,- a -a+e toselect a -ortion of that dataset to vis,ali:e6 ClicBin+ data to the left of adataset will 1rin+ ,- a -a+e to select a -ortion of that dataset to download6

8/15/2019 ERD_DS1

18/31

ERDD&+’s RESTful ,RsERDDA is RESTf,l# meanin+ theGR" com-letely de@nes the data yo,want# in the format yo, want6 Theforms on the +ra-h and data

we1 -a+es hel- yo, create a GR"that s-eci@es yo,r entire re,est6For eKam-le# the ma- on the ri+htwas -rod,ced 1y this GR".

htt-.

8/15/2019 ERD_DS1

19/31

X For more data and ima+e o,t-,t o-tions seehtt-.

8/15/2019 ERD_DS1

20/31

6csv @le# the read6csv command will access the data directly# foreKam-le.

seaTem-\9read6csv(Yhtt-.

8/15/2019 ERD_DS1

21/31

Environmental Data Conne"tor 5EDC7

http://www.pfeg.noaa.gov/products/EC/ orhttp://www.asascience.co"/software/downloads/

or google 'DC '(D

 The EDC is a Qava91ased !ra-hical Gser =nterface (!G=) that allows foreasy access to distri1,ted data from directly within Arc!=S# /atla1# R andEKcel (Windows only)6 Gsin+ we1 services the EDC can access dataserved 1y Oe;DA# T?REDDS# ERDDA# =OOS SOS and also local @les6 The EDC allows the ,ser to search and +ra-hically select the tem-oraland s-atial s,1set of the data desired# and then the selected s,1set ofthe data is a,tomatically 1ro,+ht into the software a--lication6 The EDCwas develo-ed 1y A--lied Science Associates (ASA) ,nder contractf,ndin+ from ERD6 The @rst version came o,t in 46 Since then therehave 1een a n,m1er of revisions made to the EDC6 The most recentversion (released Q,ly $5) can 1e ,sed from within Arc!=S (,-dated toworB with version $6)# as well as from within /atla1# R# EKcel (Windowsonly) and as a standalone Qava a--lication6 There is a sin+le install @lethat installs all versions of the EDC (Qava is re,ired to r,n the installer)6=nstallation instr,ctions as well as an EDC Gser’s /an,al come as -art ofthe installation @les6

EDC-,I

 The EDC !G= -rovides a common interface across versions6 There aretwo windows that will come ,- with the EDC6 The @rst window (Fi+,re 7)-rovides a dialo+,e to -rovide the so,rce of the data# as well as to selectthe desired dataset6 The data so,rce is chosen in the to- -ortion of thewindow6 >alid data so,rces incl,de GR"s of T?REDDS data catalo+s#GR"s of non9T?REDDS Oe;DA servers (or local netCDF @les)# GR"s ofSOS servers# or GR"s of ERDDA servers6 The dro-9down men,s list somecommon so,rces for oceano+ra-hic and atmos-heric data6 Lo, mayselect one of the catalo+s or datasets in the dro-9down men,s or

man,ally ty-e in a diJerent GR"6 The _Catalo+ GR"’ connects to T?REDDSdataset catalo+s# while the _Direct Access GR"’ connects to Oe;DAservers6 Once yo, have selected a catalo+# dataset# or service# clicB the_Connect’ 1,tton to connect to that server6 Once the EDC is connected tothe server# the datasets availa1le on that server will 1e dis-layed on theleft# and can 1e 1rowsed similarly to the dialo+ in a normal O-encommand (that is clicBin+ on a folder will o-en ,- the neKt level in the@le hierarchy# clicBin+ on a dataset will select it)6 When connected to an

$

8/15/2019 ERD_DS1

22/31

ERDDA server#datasets aresearcha1le over avariety of criteriain order to narrow

down the choice of datasets6 When a-artic,lar datasethas 1een selected#the metadataa1o,t that datasetwill 1e dis-layed inthe ri+ht9handwindow# incl,din+s-atial andtem-oral 1o,nds if 

availa1le from the service6 After a dataset has 1een selected clicB on theS,1set 2 rocess 1,tton6 Another window will 1e la,nched (Fi+,re H)6

!ra1 the +lo1e with the mo,se to move it aro,nd to yo,r re+ion ofinterest6 Lo, can select an area 1y drawin+ on the ma- with the mo,se1y clicBin+ the Select 1y 00O86 Lo, can also enter the eKactcoordinates of yo,r 1oK6 Lo, also m,st select the varia1le in the ,--erri+ht9hand corner6 ClicB on the rocess 1,tton to eKtract the desireds,1set of data6 After the data has 1een eKtracted# the EDC window willclose and yo, willrevert 1acB to thesoftware -latform yo,started from6

 The c,rrent release of the EDC cannotdownload data whichs-an either the -rimemeridian (I lon+it,de)or the internationaldateline ($4Ilon+it,de)# de-endin+on the 1o,nds of the

ori+inal dataset6 =norder to +et the entirere+ion of the data# yo,sho,ld download thedata in two -ieces withone west of the1o,ndin+ lon+it,de and

Fi+,re 76 The EDC window to select the so,rce of data andthe -artic,lar dataset6 A list of datasets at the chosen sitewill show ,- on the left6 =nformation a1o,t a chosen dataset

Fi+,re H6 The s-atial and tem-oral s,1settin+ window of the

8/15/2019 ERD_DS1

23/31

the other east of the 1o,ndin+ lon+it,de6 Then mer+e the data in yo,rsoftware a--lication6

EDC-&r"IS

 To la,nch the EDC from Ac!=Sr (after it has 1een installed) clicB on theEDC icon on the to- of the Arc!=S men, 1ar6 Follow the directions,nder the EDC9!G= (-a+e $)6 Once the download is com-lete# the EDCwill close6 The downloaded netCDF @le is then converted to two ty-es of@les# an Arc!=S raster for each time ste- and a raster catalo+ of all thedata ,sin+ Arc!=S’s conversion tools6 0e -atient while Arc!=S convertsthe @le6 At this -oint# taBe a note of the date ran+e and time ste-s yo,have selected as it can 1e di`c,lt to @nd this information after it isdownloaded6 This can often 1e a len+thy ste- and there is no -ro+ress1ar to show that Arc/a- is still worBin+ on the conversion6 The res,ltin+Arc!=S layer consists of a raster catalo+ alon+ with the @rst raster of the

data set which dis-lays a le+end for the f,ll dataset6 The data dimension,sed as the 1and dimension is s-eci@ed in the _O,t-,t O-tions’ windowof the EDC6 This 1and dimension is ,s,ally time# 1,t can 1e anotherdimension (s,ch as de-th or hei+ht)# if that dimension is availa1le6 Rastercatalo+ @les cannot 1e mani-,lated ,sin+ the s-atial analyst tool 1oK(e6+6 raster calc,lator and ma- al+e1ra)# and instead yo, sho,ld add allof the desired raster @les from the EDC download directory (1y defa,ltthis is c.EDC)6 =f the dataset contains more than 5 dimensions# then yo,m,st select the val,e of the *th dimension in the _Select "evel’ men,6 ForeKam-le# if the dataset has dimensions of _latit,de’# _lon+it,de’#_altit,de’# and _time’# and yo, select _time’ as the 1and dimension# then

yo, wo,ld have to -icB the altit,de level of the data6 Some datasetsmi+ht have a *th dimension containin+ only one val,e (e6+6 ' meteraltit,de for sea level data)6

EDC-Matlab

 To la,nch the EDC from /atla1 (after it has 1een installed) ty-e.

^ satdataVedc]matla1

at the command line6 The call is case sensitive6  Gse of the !G= is thesame as descri1ed -revio,sly (-a+e $)6 Once the data has 1een

downloaded locally 1y the EDC# /atla1 o-ens it ,- and -,ts it into a/atla1 str,ct,re ty-e called satdata (or whatever varia1le name was,sed in the command line call a1ove) with @elds for each varia1le6

EDC-R

5

8/15/2019 ERD_DS1

24/31

After installin+ the EDC on yo,r machine# and checBin+ to install theversion with R# yo, will still need to install two li1raries 1efore ,sin+ theEDC# ncd* and EDCR# 1y ty-in+ at the R -rom-t.

^ li1rary(ncdf*)

^ li1rary(EDCR)

 Then to la,nch the EDC from R ty-e.

^ satdata \9EDC6+et($)

at the command line6 The call is case sensitive6  Gse of the !G= is thesame as descri1ed -revio,sly (-a+e $)6 After the data has 1eeneKtracted oJ the server# it will eKist in R in a varia1le called satdata# orwhatever varia1le name was ,sed in the command line call a1ove6 Tosee the str,ct,re of the download# iss,e the command.

^ str(satdata)

EDC-E;"el

*

8/15/2019 ERD_DS1

25/31

 The EDC for EKcel only worBs with Windows versions of EKcel6 =t can notim-ort +ridded data (i6e6 satellite data) that T?REDDS or !R=DDA(ERDDA) ret,rns# 1,t it can im-ort ta1,lar data from a SOS (SensorO1servation Service) or from TA0"EDA (ERDDA)6 To la,nch the EDCfrom EKcel (after it has 1een installed) clicB on the ASA ta1 at the far

ri+ht of the EKcel /en, 1ar (Fi+,re 4)6 An icon will show ,- on the to-left9hand -art of the window that says "a,nch EDC6 ClicBin+ on that

will la,nch the EDC !G= descri1ed -revio,sly6 As already mentioned# itwill only im-ort data from SOS or ERDDA servers6 After selectin+ thedata yo, want# the EDC will -rocess the eKtraction and download the

data# then a window will a--ear sayin+ /icrosoft EKcel is waitin+ foranother a--lication to com-lete an O"E o-eration# clicB Ob and yo,rdata will a--ear in yo,r EKcel s-readsheet# with the @elds la1eled in theto- row6

&

Fi+,re 46 Screenshot of an EKcel Window set9,- to la,nch the EDC6

8/15/2019 ERD_DS1

26/31

8/15/2019 ERD_DS1

27/31

eKtractVKtracto(5# *# daten,m(Y79$9$&Y)# _*$Y# 6 6&)

;tra"to>8D The Ktracto]5D scri-t is a f,nction that eKtracts a 59dimensional s,1setof the data6 The @rst three in-,t varia1les# K-os# y-os# and t-os# are two

dimensional arrays which contain the minim,m and maKim,m val,e oflon+it,de# latit,de and time6 The fo,rth varia1le# dty-e# s-eci@es thedesired satellite dataset# ,sin+ the same =D system as for /atla1# andwhich is listed within the scri-t6

For eKam-le# the followin+ R code.

K-os\9c(9$5#9$)y-os\9c(57#55)t-os\9c(Y$59H9$&Y#Y$59H9$&Y)eKtract\9Ktracto]5D(K-osVK-os#y-osVy-os#t-osVt-os#dty-eVYerd>?chlamdayY

)

will eKtract >==RS chloro-hyll data from lon+it,des ($5I9$IW)#latit,des (57I955I;)# at $59H9$&6 The e,ivalent /atla1 code is.

K-osV9$5 9$U[y-osV57 55U[t-osVdaten,m(Y$59H9$&Y) daten,m(Y$59H9$&Y) U[eKtractVKtracto]5D(K-os#y-os#t-os# Yerd>?chlamdayY)[

 The n,m1ers are s-eci@ed hi+h to low 1eca,se this dataset (>==RS) stores

latit,de val,es hi+h to low6 That is ,n,s,al# most datasets store latit,deval,es low to hi+h6

A se-arate call is ,sed for each desired eKtract6 These scri-ts onlyaccess data from ERD’s data servers6 The recommended -ractice is thatthese f,nctions are called witho,t modi@cation within a ,ser de@nedscri-t (for eKam-le +et]data6m or +et]data6R) that s-ecify the re,iredin-,ts to the f,nction# and that any ,ser modi@cations to the scri-ts 1edone on a co-y of the ori+inal @le6

 There are scri-ts for /atla1 (with an 6m eKtension) and scri-ts for R(with an 6r eKtension)6 Don’t +et yo,r m’s and r’s miKed ,-P

C*an#es from t*e revious versions of ;tra"tomati"Gsers of the ori+inal 1da- Ktractomatic scri-ts sho,ld 1e aware thatthere are some diJerences 1etween the ERDDA scri-ts and the earlier1da- scri-ts6 First# donYt ass,me that the n,m1er of the dataset is thesame in the new scri-t6 /ostly they are# 1,t do do,1le9checB 1y looBin+at the code6

H

8/15/2019 ERD_DS1

28/31

;ot all datasets on the ERDDA server are on a (# 57) lon+it,de +rid#and not all of the datasets are on a (9%#%) latit,de +rid6 >==RS data forinstance are on a (%#9%) +rid6 The -ro+ram will taBe care of a re,estin the ar+,ment that r,ns from 5.& in latit,de# 1,t will ret,rn the dataas it is on the server# that is from & to 56 The coordinate information is

ret,rned with the data# so always ,se this for the coordinates of theo,t-,t of yo,r re,est# not the re,est itself6

 The information ret,rned from the f,nctions has chan+ed some# thecomments at the to- of the f,nctions -rovide the ,-dated information6

=n the R scri-ts# there is now an o-tional ar+,ment N,ietN# with defa,ltval,e N,ietVTRGEN6 =f yo, -ass N,ietVFA"SEN yo, can see the details of the ERDDA GR" calls# which can 1e hel-f,l for de1,++in+ -,r-oses ifyo, @nd a -ro1lem6

4

8/15/2019 ERD_DS1

29/31

Se"iali?ed @eb a#es

ERD hosts a n,m1er of s-eciali:ed we1-a+es for vario,s -roects and

or+ani:ations6 These all involve tailorin+ the dis-lay and mani-,lation ofdata from ERDDA servers# and hi+hli+ht the -ower and ,tility of thewe191ased dataservices that ERD has develo-ed6 These -a+es have all1een written and maintained 1y "ynn DeWitt.

SES&ME 5Salmon E"osystem Simulation and Mana#ementEvaluation7

htt-.

htt-.

8/15/2019 ERD_DS1

30/31

AO&& O"ean Satellite Courses

Since 7 ERD has 1een cond,ctin+ ann,al 59day short co,rses in

oceano+ra-hic satellite data6 These co,rses are +eared towards ;ational/arine Fisheries Service and ;ational Ocean Service scientists# 1,t arealso o-en to non9;OAA -artici-ants if s-ace -ermits6 Thro,+h the $5co,rse# over $H -eo-le have taBen this co,rse# with -artici-ants fromeach of the 7 @sheries science centers# $ of the $* marine sanct,aries#as well as -artici-ants from other +overnment a+encies s,ch as the GSCoast !,ard# GS !eolo+ical S,rvey and the GS Fish and Wildlife Service6

 The co,rse consists of 1oth lect,res and la1s6 The lect,res cover 1asicinformation a1o,t the vario,s environmental satellite datasets availa1le 'ocean color# sea s,rface tem-erat,re# sea s,rface hei+ht# ocean s,rfacevector winds and salinity6 The la1oratories# the remainder of the co,rse#

are s-ent in a com-,ter class room (each -artici-ant has their owncom-,ter) so -artici-ants can learn where and how to access relevantsatellite data from the =nternet# foc,sin+ on the tools -resented in thisdoc,ment6 The o1ective is to show -artici-ants how to im-ort satellitedata into the -latform that is most e`cient and a--ro-riate for theirneeds6 Therefore we disc,ss a variety of diJerent software d,rin+ theco,rse6 We +enerally foc,s on Arc!=S# /atla1 and R 1eca,se those arethe software -acBa+es that have 1een ,sed the most 1y -artici-ants ino,r -revio,s co,rses6

artici-ants are eK-ected to come to the co,rse with a s-eci@c -roect to

worB on d,rin+ the la1 com-onent6 For eKam-le# if their -roect is tomer+e ta++ed animal tracBs with satellite data# they sho,ld 1rin+ thetracB data with them6 This eK-ectation em-hasi:es that this is very m,cha hands on worBsho-6 Additionally# we @nd that -artici-ants +et moreo,t of the worBsho- if they have s-eci@c ,estions or -roects to worB ond,rin+ it6 We are however# eKi1le a1o,t this eK-ectation# and we+enerally won’t t,rn away ea+er -artici-ants witho,t a s-eci@c -roect6

 There is no fee associated with the co,rse# 1,t -artici-ants are ,s,allyres-onsi1le for all their travel costs# altho,+h we did have f,ndin+ in7 and in $5 to cover -artici-ants’ travel costs6 We ,s,ally hold theclasses at Ore+on State Gniversity (OSG) in Corvallis# OR where there is a

com-,ter classroom e,i--ed with all the software that we need6 Theco,rse is ,s,ally held the last weeB in /arch# when OSG is on s-rin+1reaB6

 To 1e noti@ed a1o,t f,t,re co,rses# send an email tocara6wilsonnoaa6+ov# or si+n9,- via the online linB athtt-.

8/15/2019 ERD_DS1

31/31

resentations from the $5 co,rse can 1e fo,nd at.htt-.