20
Standards Certification Education & Training Publishing Conferences & Exhibits SCADA Documentation and Disaster Recovery 2016 ISA Water / Wastewater and Automatic Controls Symposium August 2-4, 2016 Orlando, Florida, USA Speakers: Mike Stoup, PE, McKim & Creed Mike Skrzypek, Pinellas County Utilities

SCADA Documentation and Disaster Recovery

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: SCADA Documentation and Disaster Recovery

Standards

Certification

Education & Training

Publishing

Conferences & Exhibits

SCADA Documentation

and Disaster Recovery

2016 ISA Water / Wastewater and Automatic Controls Symposium

August 2-4, 2016 – Orlando, Florida, USA

Speakers:

Mike Stoup, PE, McKim & Creed

Mike Skrzypek, Pinellas County Utilities

Page 2: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA 2

Presenter

• Mike Stoup, PE, I&C Group Manager

– Oversees 10 controls and SCADA engineers,

designers, programmers & technical specialists

– 22 years experience in design, implementation &

management of I&C/SCADA projects

– B.S., Electrical Engineering, University of South Florida

• Mike Skrzypek, SCADA & Security Systems Manager

– Oversees operation and maintenance of county’s SCADA

system

– 45 years experience, including regional service manager for

manufacturers

– Graduate of Northeastern University of Illinois, Computer

Science and Economics

Page 3: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA 3

Presentation Outline

• Overview of the situation

• Existing conditions

• Project justification

• Project execution strategy

• Project execution

• Deliverables

• Potential project roadblocks

• Benefits of the project

• Questions

Page 4: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA 4

Overview of the Situation

• Sixth most populated county in Florida

• Most densely populated county in Florida

• Using Wonderware Archestra and InTouch

• Communicate with a combination of radio,

cellular, fiber and microwave

• Homeland Security Audit in late 2015

• Deficient documentation of SCADA system

• No SCADA disaster recovery plan

• Must address items in audit

• Desired completion date 12/31/15

2 Water Plants

3 Wastewater Plants

1 Solid Waste Facility

6 Pumps Stations

330 Remote Sites

Pinellas County, FL

Page 5: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA

Existing Conditions

• Past practice of awarding to lowest bidder:

• Project specific documentation that wasn’t incorporated into the

overall SCADA system set

• Various levels of quality, format and thoroughness of SCADA

documentation

• Departure of most staff familiar with SCADA system

• Preparing for a major overhaul over the next 3 years.

5

Page 6: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA

Project Justification

• Extended downtime that could cause:

• Environmental spills

• Interruption of service

• Contaminated water distribution

• High costs to rewrite software due to insufficient backups

• Meet regulatory and Homeland Security Audit

requirements

6

Page 7: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA

Project Execution Strategy

• Assemble team

• Define scope and boundaries of research

• HMI system (not including the PLC)

• Ethernet networking

• Explain sensitivity

• Identify goals and schedule

7

Page 8: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA

Project Execution

• Assemble the team

• County Utility Managers

• Plant Managers

• SCADA Technical Resources

• Consultant

• Interview plant technical, managerial and operations staff.

• Perform field research to trace wires, interrogate devices on

networks.

• Review existing documentation.

8

Page 9: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA

Project Execution

• Work with Wonderware, the

HMI vendor, for backup and

restore procedures.

• Develop draft documents for

county review.

• Finalize deliverables after

review and deliver to Pinellas

County.

9

Page 10: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA

Deliverables

• All deliverables in native format

• Network drawings

• Operational block diagram

• System-specific backup and restore procedure

• System-specific server file location and names for backups

10

Page 11: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA

Network Drawings

11

Page 12: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA

Network Drawings

12

Page 13: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA

Network Drawings

13

Page 14: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA

Network Drawings

14

Page 15: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA

Operational Block Diagram

15

Page 16: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA

System-Specific Backup and

Restore Plan

16

Page 17: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA

System-Specific Server

File Locations and Names

17

Page 18: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA

Potential Project Roadblocks

• Technical staff refuses to share information

• Operations won’t give access to equipment

• Extensive inaccurate or missing documentation

18

Page 19: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA

Benefits of the Project

• Accurate documentation of the SCADA system

• Launching point for a larger planning effort

• Better defined scopes for future projects

• System-specific backup and restore procedure

• Documents in native format

19

Page 20: SCADA Documentation and Disaster Recovery

2016 ISA WWAC Symposium

Aug 2-4, 2016 – Orlando, Florida, USA

Thank You

Questions?

• Mike Stoup, PE

[email protected]

• 813.624.2506

20