Upload
others
View
2
Download
0
Embed Size (px)
Citation preview
Introducing NOAA's Climate Data Record Best Practices into NCEI's Center for Weather and Climate (CWC) ProductsDaniel Wunder,GaryEllingson,CandaceHutchins,andBrianNewport,GlobalScience&Technology,Inc.•JeffPrivette,NOAA/NCEI•TerryMcPherson,LMI
Poster:877
January,2017
Introduction• NOAA’sClimateDataRecord(CDR)ProgramwasestablishedattheNationalCentersfor
EnvironmentalInformation(NCEI)(formerlytheNationalClimaticDataCenter)inordertodevelopandimplementarobust,sustainable,transparent,andscientificallydefensibleapproachtoproducingandpreservingauthoritativeclimaterecordsfromsatellitedata
• Sinceitsinceptionin2009,theCDRProgramhastransitioned37CDRsdevelopedbyvariousresearchgroupstoaninitialoperatingstateatNCEI
• Fortransparencyandscientificdefensibility,theCDRdataset,documentation,andsourcecodearepreservedinNCEI’sarchiveandmadeaccessibletothepublic
ConfigurationControlisNecessaryforScientificIntegrity
TailoredProcesstoBaselineanOperationalProduct
• Tailorexistingprocessesasnecessarytoencompassamuchbroadersuiteofproducts• Rankproductsbasedonuserneeds,economicimpact,andcompliancewithdirectives• Initiateportfoliomanagementacrosssimilarproductsandservices• Maintainthecorevaluesoftransparencyandscientificintegrity
ImplementingacrossCWC
• Routineextensionsoftheoperationalproductaremadewhileallowingforsystematicdevelopmentanddeploymentofalgorithmimprovements
• Achangerequest(CR)issubmittedagainstthebaselineversionwhensignificantimprovementsareachieved• Theconfigurationcontrolboard(CCB)approves/disapprovestheCRafterevaluatingthelevelof
improvementvs.costofimplementingandsustaininganewversion
CDRWebsite:https://www.ncdc.noaa.gov/cdr
50CDRs
Tailoredprocesses150CWCProducts
HundredsofNCEIProducts
ApplyLessonsLearned
NationalOceanicandAtmosphericAdministration| NationalCentersforEnvironmentalInformation
ResearchtoOperationsSteps
1)Assessment
SubmissionAgreement
Data
Documents
SourceCode
KDP*
AlgorithmDevelopers
DocumentHeader
Information
2)Submission
SampleDataTransfer
3)Transfer
SourceCodeTransfer
EnterCodeintoVersionControlSoftware
DocumentsTransfer
MainDataTransfer
4)Validation
ValidateCodePackage
Validate‘ReadMe’
ValidateDataFlowDiagram
ValidateMaturityMatrix
ValidateMetadata
ValidateData
CodePackageArchived
Documen-tation
Archived
ProductDataArchived
AncillaryDataArchived
5)Archival 6)Access
CodeMadeAvailableto
Public
DataMadeAvailableto
Public
CDRAssessment
*ORR=OperationalReadinessReview
*KDP=KeyDecisionPoint
Documen-tation MadeAvailableto
Public
Step1:AssessmentDetermineifacandidateresearchproductissufficientlymaturefortransitiontooperations.
Step2:SubmissionIdentifythecompletepackage(code,documents,anddata)inaformalSubmissionAgreement,suchthatNCEIcanplanforarchiveandaccessofthematerials.
Step3:TransferTransferthecompletedataset,sourcecode,anddocumentationmaterialstoNCEIforValidation.
Step4:ValidationIntegratedProductTeam(IPT)ensuresthesourcecode,documentation,anddataareconsistentwiththecurrentcodingandmetadatastandards.
Step6:AccessConductanORR*,thenprovideafullytransparentandscientificallydefensibleproducttothepublic.Availableat:www.ncdc.noaa.gov/cdr/operationalcdrs.html
Step5:ArchivalProductisputunderversioncontrolandsubmittedtoNCEIarchive.Thisinitiatesstewardshipforaminimumof20yrs.
ClimateDataRecord:A timeseriesofmeasurementsofsufficientlength,consistency,andcontinuitytodetermineclimatevariabilityandchange (NationalResearchCouncil,2004)
ORR*