AT&T Mobility Cell Site Civil Quality Training - …dagger12.com/attqtmods/ATT Cell Site Quality Training Module 22... · at&t Mobility training provided to Ericsson a o Ericsson

at&t Mobility training provided to Ericsson at&

t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

AT&T Mobility Cell Site Civil Quality Training Ralph Natale & Mike Scott

Part 22 – Standards and Audits

© 2014 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property. Proprietary and Confidential. Do not distribute outside of AT&T


t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

2

Mobility Cell Site Quality Introduction

Intentionally left blank



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

3

Mobility Cell Site Quality Introduction

Standards & Requirements



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

• Purpose - Consistent Site Quality

4

Mobility Cell Site Quality Working Together

National Standards Team

Third Party Audit (TPA)

Team

Cell Site Operations (CSO)

Team

One team working for a

common purpose

Interactions

• Audit • Extend • Feedback • Interpret • Measure & Report • Train


• Develop • Deliver • Extend • Interpret • Train



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

• Role - Develop and Deliver Standards

5


One team working for a

common purpose


Team


Team

• Develop • Deliver • Extend • Interpret • Train

Mobility Cell Site Quality National Standards Team



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

6

Mobility Cell Site Quality National Standards Team

AT&T C&E Mobility Program Office (CEMPO)

Hardware Standards Team

1. Jeff Townend (21) Area Manager – C&E Mobility Program Office

2. Kurt Beecher (23) Vendor Management, Remote Site Management

3. Scott Whitney (17) RAN Hardware Standards

4. Tom Land (20) RAN Hardware Standards

5. Rick Badgero (20) Power and Thermal Standards

6. Matt Karcher (19) Shelter and HVAC Standards

7. James Martin (24) Generator and Site Control Standards

8. Glen Sparks (24) Installation, Grounding and Cable Standards

9. Bijo Abraham (12) Cabinet and Equipment Enclosure Standards



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

7

Mobility Cell Site Quality National Standards

Q: What are the AT&T Mobility site National Standards? Mandatory minimal standards designed for service, safety, and long term

strategic planning

Q: What do these standards apply to? All Mobility cell sites

All locations

Q: Where do the standards documents come from? From the equipment design and the team’s technical experience and

feedback from markets/vendors

Q: Where can copies of the standards be obtained? Posted in APEX (AT&T internal) Posted on the Vendor Management Tool (VMT) for TVs & TPA auditors



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

Q: Can an OEM or supplier standards be used?

Yes, if accepted by the National Standards Team Some requirements in an OEM or supplier standard may not meet

AT&T minimum standards – review required

Q: Can Markets use their own local requirements?

Yes, if they do not contradict the National Standards Yes, if a National Standard does not exit Yes, if local regulatory requirements demand something different NO, if they do not meet he minimum National Standards

Q: Who decides if a local requirement contradicts the

National Standard?

National Standards Team SME

8




t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

Q: Who signs off on a local requirement where a National

Standard does not exist?

National Standards Team SME

Q: How does a Market get approval for a local requirement or exception?

Work though the exception process Submit to National Standards Team for review Submit directly or through TPA Team Market is responsible for any added cost

9




t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

10


CEMPO Team and TURF Vendor Monthly Forum

Scheduled each month to work through the submitted questions and concerns from the Turf Vendors

Focused to improve quality and reduce ambiguity

Used as a feedback loop to determine if modifications or clarifications are needed in the standards documents

Relationship to TPA and Ops audits

TPA enforces National Standards at Construction Complete (MS125/126) Ops Audit enforces National Standards at Integration Complete (MS143)



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

Third Party Audits & AuditMaster

11

Mobility Cell Site Quality Third Party Audit Overview



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

• Role - Turf Vendor Construction Quality

12

Mobility Cell Site Quality Third Party Audit Team


Interactions

One team working for

common purpose


Team


Team




t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

• Purpose for the TPA – Verify Turf Vendor’s civil construction quality

• Justification for the TPA – Defined in the AT&T/Turf Vendor contract

• Site project types audited – NSB – LTE 1C – UMTS 1C – Future programs

• Timing – CASPR Construction Complete Milestone – MS125/126

• Audit volume – 30% minimum per market, per Turf Vendor, and per project

• Audit Scope:

– Ground (indoor & outdoor) and tower work

13




t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

• Audit Checklist:

TPA - Civil Construction Acceptance Checklist: ATT-002-290-502

• Independent (third party) auditors are utilized to perform the audits

• The auditors are contracted through AT&T Supply Chain Management

• Auditors reference the National Standards as inspection criteria

• Audits are funded by the AT&T Markets

• Each step of the audit process has a defined duration assigned

• One of three site audits…

• Third Party Audit (TPA) • Cell Site Operations Audit (CSO) • Site Condition, Access, Security, & Safety Bi-Annual Inspection (CASS)

14




t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

• There are six primary steps in the TPA process…and reporting

• Each step has an owner

1. Site / Auditor Selection – AT&T 2. Perform Site Audit – Auditor 3. Submit Site Audit Report – Auditor 4. Initial Review – AT&T and Turf Vendor 5. Corrective Action – Turf Vendor 6. Post Repair Review – AT&T

• Performance Measurement and Reporting

15




t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

Site & Auditor Selection – completed within 60 days of

Construction Complete milestone (MS125/126)

1. Selects the sites to audit 2. Selects the auditor 3. Initiates the Purchase Order procurement

What happens if…

– Missed 60-day site selection window: Missed opportunity to audit a

site

– P.O. procurement delay: Delay of audits, impacts auditor’s window of opportunity (schedule compression)

16

Mobility Cell Site Quality Step 1 - AT&T Roles & Responsibilities



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

Site Audit – completed within 120 days of Construction Complete milestone (MS125/126)

1. Communicate with AT&T market and mobilize to conduct site audit 2. Conduct site audit IAW the TPA checklist (ATT-002-290-502)

Audit Report Submission – within 3 days of audit completion

1. Submit completed audit report/photos to AuditMaster 2. Audit result are distributed to:

• Market audit originator • Turf Vendor • National TPA management

What happens if…

– Auditing process delays: Delay of downstream processes (schedule compression)

17

Mobility Cell Site Quality Step 2 & 3 - Auditor Roles & Responsibilities



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

Initial Review (IR) – completed within 14 days receipt of the audit report

– To review each audit finding with the turf vendor to verify accountability and ownership

– The OOM is available on the AuditMaster Initial Review page as a reference during the review

– Key Reminder: If a finding has been repaired prior to the Initial Review meeting, the repair does not remove the finding from the audit

What happens if… – IR process conducted without TV: The site will be placed back in the IR

module and the process will be repeated with the Turf Vendor present

– 14-day window is missed: Creates a delay in performance report publication and causes a downstream schedule compression

– Failing to “Save/Send” IR changes: The site will continue to appear on the Initial Review Aging report

18

Mobility Cell Site Quality Step 4 - AT&T plus Turf Vendor Roles & Responsibilities



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

Corrective Action – resolution submitted within 10 days post Initial

Review

– Address/repair each finding assigned

– Document resolution action

– Submit camera-dated photos of resolutions

What happens if…

– Corrective Action is not completed: Risk of site operational failure due to defects plus potential findings in subsequent audits (CSO, CASS)

– Failing to “Save and Submit” inputs: AuditMaster will not be updated and the site will continue to appear on the Corrective Action Aging report

19

Mobility Cell Site Quality Step 5 - Turf Vendor Roles & Responsibilities



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

Post Repair Review – completed within 10 days after the Corrective

Action is submitted

– AT&T Market Manger reviews and approves the Turf Vendor’s repairs

– Turf Vendor is notified that audit is closed

What happens if…

– Repairs are rejected: – unapproved repairs are sent back to the Corrective Action module for action

– The review is not conducted: The Turf Vendor is not notified that the repairs are approved/rejected. The site will continue to appear on the Post Repair Aging report

20

Mobility Cell Site Quality Step 6 - AT&T Roles & Responsibilities



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

21

Mobility Cell Site Quality Third Party Audit Team – Performance Reporting

• Reports Communicate and Tell the Story A number of reports are generated from the Third Party Audit data

• Monthly and Semi-Annual Performance Reports Provides the overall audit results of recent performance – Distributed to Market, Region, and National Management

• Weekly Aging Reports – “Something needs to be done!” Each of the steps has a time limit – Audit Aging: Sites pending an audit report – Initial Review Aging: Sites pending an Initial Review – Corrective Action Aging: Sites pending TV action – Post Repair Review Aging: Sites pending Market review

Focused on Quality and Process Improvement


22

27% 26%

15%

7% 5% 4%

2% 2% 2% 2%

42%

22%

6% 7% 5% 5%

1%

0%

10%

20%

30%

40%

50%

2012

2013

• 4,055 failed SA items on 1,879 sites • Avg. = 2 findings per site

Mobility Cell Site Quality 2013 Service Affecting Audit Findings


23

10%

9% 9%

7% 7%

6%

5%

4% 4%

0%

8%

9% 9%

7%

6%

7%

4% 4% 4%

3%

0%

2%

4%

6%

8%

10%

12%

2012

2013

Mobility Cell Site Quality 2013 Non-Service Affecting Audit Findings

• 23,691 failed NSA items on 6320 sites • Avg. = 4 findings per site



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

24

Mobility Cell Site Quality Third Party Audit Team Interactions

Key interfaces • National Standards Team

– Receive standards, interpretations, clarifications – Receive advance notification of upcoming changes – Receive interpretations and clarifications – Provide recommendations for additions and changes – Provide suggestions to resolve issues and requests for guidance – Goal: remain current with National Standards requirements

• Cell Site Operations Team – Align requirements between teams – Assist CSO Team with standards requirements – Act as a resource to CSO Team – Interpret and clarify requirements – Answer questions – Assist with resolving issues – Participate in CSO Team discussions – Goal: maintain consistency between TPA and CSO site audits



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

25


Other interfaces

• Vendors (Turfs, OEMs)

• AT&T Implementation Teams

– Communicate standards requirements & interpretations

– Goal: assist AT&T construction teams with requirements knowledge



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

26


• Interactions with National Standards Team

• Help “bridge the interface” between standards delivery and implementation – Assist with identifying standards (what standards apply

and where they can be found) – Apply prior knowledge to current situations – Interpret and clarify requirements – Extend (recommend precedents for new applications) – Offer suggestions – Engage SMEs for direction and support – Assist with communicating solutions and updates



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

27


• Interactions With Cell Site Operations Team

What happens if…

• TPA audits and CSO audits do not use same standards: TPA audit may pass an item that is later failed as a defect by the CSO audit …

• “Local” quality preferences are used: TPA audits and CSO audits may be in conflict with “local” way of doing things …

Confusion and possible return visit by Turf Vendor to make late repairs



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

Cell Site Operations – Quality Checklist

28

Mobility Cell Site Quality Cell Site Operations Site Acceptance



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

• Role – Site Ready for Operations

29


One team working for

common purpose

Interactions

Cell Site Operations Team


Team

Mobility Cell Site Quality Cell Site Operations Team




t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

• The Cell Site Operation team (CSO) audits:

• Apply to all cell sites (100%) • Apply to all locations • Conform to National Standards

• They:

• Are mandatory! • Apply to AT&T equipment and civil installation • Allow for approved Market and OEM requirements…under

certain conditions

30

Mobility Cell Site Quality Overview



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

31

TPA – Third Party Audit • 30% of NSB/1C/LTE-1C

• Includes tower climbs

• Triggered by “Construction Complete” (MS125/126)

• Documented in SwiftTrac – Audit Master

• Overseen by National Team

• Operationalized by Market

CSO – Ops Site Acceptance • 100% of all build programs

• Does not include tower climb

• Triggered by “Integration Complete” (MS143)

• Documented in SwiftTrac - Quality Punchlist

• Operationalized by Ops Market Manager

Mobility Cell Site Quality AT&T Mobility - Quality Program Comparison



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

32

28%

17% 13%

0%

5%

10%

15%

20%

25%

30%

A B C

2013 Pass Percent

Mobility Cell Site Quality Site Acceptance Vendor Performance



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

Thank You

Q & A

33 © 2014 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property. Proprietary and Confidential. Do not distribute outside of AT&T



t Mo

bility train

ing p

rovid

ed to

Ericsson

at&

t M

ob

ility

tra

inin

g p

rovi

ded

to

Eri

csso

n

Revision History

• 18 June 2014 – General revision

• 05 August 2014 – minor change on slide 21

34



Documents

AT&T Mobility Cell Site Civil Quality Training - …dagger12.com/attqtmods/ATT Cell Site Quality Training Module 22... · at&t Mobility training provided to Ericsson a o Ericsson