Embed Size (px)
Citation preview
The Development of a Quality Management System to Support National Ambient Air Quality
Monitoring Network
Session 8.2 13th Annual Air Quality Governance Lekgotla
Mitta Seperepere Convention Centre, Kimberly, Northern Cape
P. Gwaze
Presentation Outline
• Background to Ambient Monitoring in South Africa
• What QMSs exists?
• What are the challenges with these systems?
• What are the objectives of NAAQMN QMS?
• What is the scope of the NAAQMN QMS?– NAAQMN Continuous Monitoring
– Low costs Monitoring
• How are we going to roll-out the NAAQMN QMS?
• What is the way forward?
Abbreviations
• NAAQMN – National Ambient Air Quality Monitoring Network
• SAAQIS – South African Air Quality Information System
• QMS(s) – Quality Management System (s)
• NAAQS – National Ambient Air Quality Standards
Continuous Ambient Monitoring
NAAQMN consists of over 120 monitoring stations
About 65stations are reporting to SAAQIS
SAAQIS Website: Public Access to Information
SAAQIS APP
• Available on Android and on IOS
• LIVE INDEX, POLLUTANTS, METEOROLOGY
– Ability to plot historical data
– Generate reports
– Set APP for personal use with specific stations of interest, settings
National Ambient Monitoring ToolsNEMAQA,
NAAQS, Norm & Standards
NAAQMN
SAAQISNMISA
SANASQuality
Management System
Current QMS in NAAQMN
• QMS for accreditation
– SAWS network – priority area stations – informed by the current SANAS Technical requirements
• Networks managed by authorities – locally developed systems
• Some QMS are held by service providers when they operate government stations
Challenges with current NAAQMN QMSs
• Systems are limited in completeness or they don’t exist at all – limited capacity in government
• QMSs are developed independently by network owners – cost to government
• Where QMSs exist, there is no guidance and consistency in the way the systems have been developed or implemented
• In most stations, the QMSs are in hard copies, and there are risks in the storage and archiving of documentation
• QMSs are held by service providers, and as soon as the contract lapse, the systems are lost and a new service provider has to develop systems afresh
• Stranded stations lose the QMS and new initiates have to be put in place during resuscitation of stations
• Hence DEA-SAWS intervention to develop a national QMS to support NAAQMN
What is the scope of the NAAQMN QMS?
Project Objective
• To develop a NAAQMN QMS with detailed procedures and protocols for the effective management of government owned ambient air quality monitoring stations in line with ISO 17025:2017 test/calibration requirements and ISO 9001 quality requirements
• NAAQMN QMS will be built as part of the SAAQIS system in order to enable all stations reporting to SAAQIS to implement sound quality systems and demonstrate that network operators are technically competent and able to produce valid and reliable ambient monitoring and calibration protocols
• Service provider appointed by SAWS
NAAQMN Quality System Objectives
QMS will support Continuous Ambient Monitoring as well as Low Cost Monitoring in order to:
• Provide national consistency in the way ambient air quality monitoring is conducted and reported across the NAAQMN
• Reduce overall government costs in developing parallel quality systems per network/district or provincial level.
• Provide a framework to assist network owners to implement information technologies and incorporates the use of computer systems, electronic records supported by the new SAAQIS NAAQMN modules
National Ambient Monitoring ToolsNEMAQA,
NAAQS, Norm & Standards
NAAQMN
SAAQISNMISA
SANASQuality
Management System
QMS Project Plan (Continuous Monitoring)
Review NAAQMN Systems in
SAAQIS
Identify QMS gaps in the SAAQIS
modules
Fill in the gaps and present a
complete QMS
Pilot QMS with 3 networks
Assess piloting of QMS
Update the QMS with inputs from
piloting phase
Develop national roll-out program
of QMS
Description Verifiable
Indicator
Means of Verification
Output A: Review NAAQMN and
the new SAAQIS components to
align with ISO 9001 and ISO 17025:
2017 and draft National Norms and
Standard for Ambient Air Quality
Monitoring.
Assessment of the NAAQMN
components;
NAAQMN Asset Maintain
NAAQMN Data Manager
NAAQMN Station Manager
A detailed Assessment Report with
recommendations on the gaps between the
NAAQMN components and Norms and
Standards, against ISO 9001 and ISO
17025:2017 requirements. The report should
identify gaps in procedures, protocols,
templates, forms, checklists etc.
Output B1: Development of
procedures, protocols, templates,
forms and checklists identified in
Output A.
Development of procedures,
protocols, templates, forms to
ensure that three NAAQMN
components are aligned to standard
requirements.
Procedures, protocols, templates, forms
identified in Output A developed and
presented to DEA/SAWS for implementation
into SAAQIS/NAAQMN computer systems.
Scope of the QMS
Scope of the QMS: Output B1
Technical Requirements• Maintain laboratory environmental condition • Handling, transport, storage, use and planned
maintenance of equipment • Intermediate checks • Measurement traceability and calibration • Evaluation of measurement uncertainty and
statistical techniques for analysis of data • Assuring and monitoring of validity of result • Transportation, receipt, handling, protection,
storage, retention, and disposal or return of test items
• Control of data • Document and data control • Control of records• Method validation
Management Requirements
• Personnel and training
• Management review
• Corrective action
• Internal audit
• Procurement of externally provided products and services
• Review of requests, tenders and contracts
• Receiving, evaluating and making decisions on complaints
• Control of non–conforming work
• Risk assessment
Outcomes from Output B1
Technical Manual Outcomes• Procedures for the handling of
transportation, storage, usage and maintenance of measuring equipment
• Procedures for the performance of intermediate check on the equipment
• Justifiable calibration programs
• Equipment instructions that is readily available
• Records for the laboratory equipment including historical performance so that trends can be identified
• Measurement traceability of equipment calibration
Management Manual Outcomes
• Ensure consistency of practices, activities, processes and systems;
• Clear transmission of information resulting from a minimal loss of information;
• Permanent, written and dependable information results in improved understanding, by:
• Providing basic control;
• Eliminating uncertainty and confusion;
• Providing direction;
• Improved control and the management of changes prevents ‘shortcuts’; and
Description Verifiable Indicator Means of Verification
Output C1: NAAQMN QMS
Awareness/Capacity Development
Programme.
Undertake an awareness program
to capacitate DEA/SAWS and the
two pilot municipalities’ personnel
on the NAAQMN QMS.
NAAQMN Quality System
awareness/capacity program
rollout.
Output C2: Rolling out and piloting
NAAQMN QMS at three national
priority area stations, one City of
Johannesburg and one Western Cape
station.
Oversee a program to roll-out the
NAAQMN QMS at the selected
stations.
Monthly NAAQMN QMS Rollout
and Assessment Report.
Output C3: Checklists and protocols
to assess implementation of the QMS
at the selected stations.
Develop a checklist and protocols
to be implemented in assessing the
roll-out of the quality management
system in the NAAQMN.
NAAQMN QMS Assessment
Protocols and Checklist.
Scope of the QMS conti..
Description Verifiable Indicator Means of Verification
Output D: Review and
revise the pilot NAAQMN
QMS.
Review NAAQMN QMS as
implemented by SAWS other
selected networks over a period of
6 months, revise where necessary
and make recommendations to
SAWS/DEA and other station
owners.
NAAQMN QMS pilot
reviewed and revised where
required.
Output E: NAAQMN QMS
Awareness Programme.
National awareness program to
NAAQMN Quality System to all
government owned stations
NAAQMN Quality System
awareness program
developed.
Scope of the QMS conti..
What is the scope of the NAAQMN QMS?Low Cost Sensors
Monitoring Requirements Categories M
UST • Level 1 - Core
monitoring of ALL pollutants using reference methods
MA
Y • Level 2 Requirements to install continuous monitoring MUST be informed by screening
• Monitoring MUST include PM and SO2 and O3
• Other specific pollutants can be considered
• No requirement to monitor all pollutants
NO
T A
DV
ISA
BLE • Level 3 – Regularly
conducting screeningmonitoring in order to assess AQ status
• In case of deteriorating AQ levels, Level 2 monitoring MUSTbe considered
NAQI Stations – providing the National AQ Indicator across all levels
Low Cost Monitoring Techniques
• Electrochemical samplers /Air Sensors/ Micro sensors
• Compact analysers
• Low volume samplers (only for particulate matter)
• Passive sampling
• Remote Sensing
• Photochemical/dispersion/ predictive modelling
Low Cost Sensors Techniques
MiniVol – PM sampling Passive sampling
Images from UMN
Low Cost Sensors Techniques
Commercial samplers Personal/Portable samplers
Comparisons with Reference Methods
Comparison with reference: Instrument brochure
Comparisons with reference methods: Scientific study
Model Terms of Reference for Low Cost Sensors
• DEA to develop model TORs to support authorities on the procurement of low cost sensors
• The TORs will include:– Operating details – Information on the general design of the device, data output
rate, and data units generated
– Detection approach – How the sensor measures a particular pollutant, its precision, accuracy, detection limit, deterioration of sensor with time, sensors lifetime
– Maintenance – How the instrument will be managed after commissioning including replacement of sensors when they have deteriorated below required level
– Data transfer – How data will be transferred directly to SAAQIS
• Low Cost Sensors are not ALWAYS low costs
US EPA Guidance: Use
and Performance Criteria
Support System for Citizens
Establishing Low Cost Sensor Guidance
• Testing of sensors - Invite suppliers of low costs sensors to undertake a SOUTH AFRICAN testing exercise
– Undertake sensors comparison experiment (6 months -1 year)
– Bring in sensors to run in a neutral laboratory
– Establish how well sensors perform in comparison to reference monitoring technologies
– Publish results so that all authorities are guided in the procurement of low cost sensors
– Ensure that can have local confidence in the sensors purchased
How are we going to roll-out the NAAQMN QMS?
NAAQMN QMS Development TimeframesItem Output Duration Expected Delivery Date
1. Output A: Review NAAQMN and the new SAAQIS components to
align with ISO 9001 and ISO 17025: 2017 and draft National
Norms and Standard for Ambient Air Quality Monitoring.
1 month 1 month after contract
signing
2. Output B1: Development of procedures, protocols, templates,
forms and checklists identified in Output A.
2 months 3 months after contract
signing
3. Output C1: NAAQMN QMS Awareness/Capacity Development
Programme.
1 months 4 months after contract
signing
4. Output C2: Rolling out and piloting NAAQMN QMS at three
national priority area stations, one City of Johannesburg and one
Western Cape station.
4 month 5 months after contract
signing
5. Output C3: Checklists and protocols to assess implementation of
the QMS at the selected stations.
1 month 5 months after contract
signing
6. Output D: Review and revise the pilot NAAQMN QMS. 1 month 6 months after contract
signing
7 Output E: NAAQMN QMS Awareness Programme. 1 month 7 months after contract
signing
NAAQMN QMS Roll-Out
• Engage with authorities identified in the pilot phase
• Output F provides a national roll-out program for NAAQMN QMS to be developed
– Program will be aligned to SAAQIS training for authorities
– Prioritising stations – NAQI, priority areas stations and operational stations
• For low cost sensors DEA:
– Establish the model Terms of Reference for Low Costs Sensors
– Identify a neutral laboratory and initiate the voluntary process of sensor tests comparisons – provide
