Quality Assurance Procedures for Quality Assurance Procedures for CCAQS DataCCAQS Data

• Part 1 - QA of Field Measurement Data

• Part 2 - QA of Emissions Data

Part 1 - Part 1 - QA of Field Measurement DataQA of Field Measurement Data

• QA performed by:

– Field Data Sources (contracted & routine)

– QA/QC and Data Analysis Contractors

– Users (e.g. Stakeholder Data Analysis and Modeling of Episodes)

CCAQS DatabaseCCAQS Database

• Standards for input formats, variables, and files structures, etc.

• Maintains all reported observations. Each observation is assigned...

– One of five data levels that describes the QA/QC procedures that the observation has been subjected to.

– A validity flag indicating the validity of the observation following the QA/QC procedure (e.g. V=valid, I=invalid, & S=suspect).

• Standards for Data and Validity Flag Re-Submittal

QA/QC Data LevelsQA/QC Data Levels

Data Level Description of Procedures Conducted0 Raw Data Collection (Data Source)1a Field/Lab Validation (Data Source)1b ‘Consistency’ with Project Conventions (e.g. formats,

variables, site codes, units, etc.) and ‘Resonability’via Automated Checks (e.g. Max/Min Range Checks)

2 Data Analysis Level 1 – testing measurementassumptions and parameter relationships; comparingco-located instruments; etc.

3 Data Analysis Level 2 – comparisons of modeling anddata analysis approaches

Data SourcesData Sources• CCOS Contractors

– CCAQS format, variables, and QA flags– Received as Level 1a– Database processes to Level 1b after automated

consistency and reasonability checks (format, units, variable names, range checks, duplicate checks, etc.)

• Supplemental (Non-CCOS) Sources – Their format, variables, and QA flags– Assumed to be Level 1a– CCAQS standardization conducted in-house and under

contract with T & B systems– Submitted to database for automated Level 1b checks

QA/QC StatusQA/QC Status

• CCOS - – Validation of CCOS Data (Contractor

performance problems)– Resubmittals: Episodic analyses by ARB – Final Validation of CCOS Field Data Project in

place with Sonoma Technology

• CRPAQS - – Data Analysis and QA/QC in Progress

Final CCOS Data QA ContractFinal CCOS Data QA Contract(in place)(in place)

– Comprehensive, independent check of database and the process to manage and QA the data

– Audit/inventory of database contents versus field study contracts

– Summary of all QA/QC conducted – ID, flag, and re-submit any gross outliers– Perform focused, in-depth analyses with input from

TC– Summarize any problems encountered and provide

recommendations

Part 2 - QA of Emissions DataPart 2 - QA of Emissions Data• QA performed via:

– District-ARB Interaction: • Emission Inventory Tech. Adv. Committee (EITAC)

– QA/QC of ARB’s ‘official’ inventory database, CEIDARS

– QA/QC of ARB’s growth/control forecast system, CEFS

• Gridded Inventory Coordination Group (GICG)– QA/QC of Modeling inputs

– User Feedback• Modeling & Data Analysis

• SIP Planning