INDUSTRY DAY

Testing

7 June 2016

DCC Public

AGENDA

Impact of Contingency Request on ‘Industry

Testing’ activities.

Interface Testing R1.2

End to End Testing R1.2

DCC Public 1

CONTINGENCY REQUEST IMPACT

DCC Public

PROPOSED DATE CHANGES

Proposed Testing Dates:

R1.2 User Entry Process Testing (UEPT): 4 July

R1.2 End-to-End Testing: 25 July

Other Dates:

DCCKI Live Certificates: 6 July

Remote Test Lab Service: TBC*

Prototype/Test CH (PTCH): TBC*

*Before R1.2 End to End Testing commences

DCC Public 3

IMPACT ON TESTING PARTICIPANTS

UEPT Readiness Assessment will be based against 4 July start

date for Large Supplier Parties and other Parties that wish to

test at this point:

Data required from Systems Integrator (SI)*

Access to Test Issue management tool provided by SI

Entry Gate Meeting conducted by DCC

End to End Testing Service can be used as soon as it is

available and the Testing Participant has completed UEPT in

respect of a defined User Role:

Entry criteria must be met

Entry Gate Meeting conducted by DCC

* Test Data Plan provided to DCC for review on 6 June

DCC Public 4

ADDRESSING CONCERNS

Please contact your Industry Testing Analyst to discuss impact of the

contingency request on a bilateral basis if you have any concerns.

Escalation contacts:

Industry Test Manager: Rupal Patel rupal.patel@smartdcc.co.uk

Project Director, Testing: Jane Eccles jane.eccles@smartdcc.co.uk

DCC Public 5

INTERFACE TESTING

DCC Public

INTERFACE TESTING SCOPE User Entry Process Testing (UEPT)

Change Of Supplier Test:

SI will co-ordinate the test between Large Supplier Parties conducting

UEPT in Interface Testing Stage

Devices used for UEPT will be transferred to another Large Supplier

and then back again

No overall loss of Devices

Will be conducted in parallel with/after UEPT

Details being finalised and will be discussed with TAG

Volume Test

SI will ask Parties conducting UEPT to send messages at same time to

DCC

Value of test will be reviewed with TDEG/TAG

DCC Public 7

EARLY UIT CONNECTIVITY TESTING Parties can connect to DCC User Integration Testing (UIT)

environment:

UIT environment used for Pre-UEPT, UEPT and End to End Testing

Pre-requisites:

User Gateway Connection

SMKI Test Certificates

DCCKI Test Certificates (Parties need to complete DCCKI RAPP to

extent required to obtain Test Certificates)

Scope of Test: transmission of a message and receipt of a

response.

Successful response in Pre-UEPT guide

DCC Public 8

PRE-UEPT Intended to de-risk UEPT

Service to enable Testing Participants to send 4 Service Requests

to DCC and receive valid (but standard) payload due 6 May 2016

Provision of service has been delayed due to multiple defects

Assurance activities on-going

No firm date for delivering Pre-UEPT yet available: pending

resolution of defects.

DCC Public 9

RE-CAP OF UEPT

User Entry Process Testing:

Undertaken in each User Role that a Party wishes to operate within.

Reliance can be placed on Adaptor Provider Testing and on testing

undertaken in different Licensee roles

‘Adaptor Providers’ are able to test in all User Roles

Scope set out in Common Test Scenarios Document (CTSD)

DCC will provide Devices:

Aim – to conduct UEPT on actual meters used in SIT

Smart Energy Code enables UEPT to be undertaken on meter emulators

– if SEC Panel agrees that they are fit for purpose

Possible the UEPT undertaken against a mix of emulators and meters

Emulators being assured against ‘meter test harness’

DCC Public 10

UEPT: PRE-TESTING ACTIVITIES

DCC Public 11

Activity TP DCC CSP SI DSP

Notification X

Initiation meeting X X

Manage slot booking X

Provision of meters X

Provision of Debug Capable PTCH

(DCPTCH)

X

Submit readiness reports X

Submit testing artefacts X

Review testing artefacts X

Provision of testing data X

Provision of Issue resolution tool X

Physical device set install X

Attend entry quality gate X

Approval to proceed certificate X

UEPT: TESTING

DCC Public 12

Activity TP DCC CSP SI DSP

Conducting testing X

Commissioning of Device (Non-

supplier)

X X

Commissioning of Device (supplier) X

Manage Issue Resolution X

Triage of issues X X X X X

Remove faulty Devices and replace X

Provide storage for Devices X

Asset tracking for installed and stored

Devices

X

Maintenance of Debug Capable PTCH X

Maintenance of meters X

Environment/release management X X X X

UEPT: POST TESTING ACTIVITIES

DCC Public 13

Activity TP DCC CSP SI DSP

Physical Device set removal X

Prepare Device for next Testing

Participant (TP)

X X

Submission of test evidence X

Review of test evidence X

Attend exit quality gate X

Issue test completion certificate X

Notify SEC Panel X

UEPT PROCEDURAL STEPS

DCC Public

2. Conduct UEPT Initiation

Meeting and confirm DCC

Test Lab Booking

3. TP Completes

Connection forms, RAPP

Forms and produces TRR

4. DCC reviews TRR

and provides feedback

5. TP produces Test Artefacts

and DCC progresses Gateway

Connection and RAPP forms

7. UEPT Execution 8. UEPT Completion 10. UEPT Test

Completion Certificate 6. UEPT Entry Quality

Gate

9. UEPT Exit Quality

Gate

1. TP Completes

Notification form including

DCC Test Lab request

14

END TO END TESTING

DCC Public

Parties can use the End to End Testing Service in a specific User

Role when:

They have completed UEPT in that User Role; AND

The End to End Testing Stage has started

End to End Testing can be conducted in a DCC Test Lab or

Remote Test Lab

Parties are able to test meters of their own choice and their Back

Office Systems against the DCC UIT environment subject to

meeting the pre-requisites in the Testing Approach Document

inc:

Devices are developed against SMETS2 specification

Devices are ZigBee Sep 1.2 a) compliant

Parties need to comply with procedures for raising Testing Issues

Relevant training course undertaken to use the CSP Test Labs

END TO END TESTING

DCC Public 16

DCC will provide meters that have been used successfully in SIT

for Parties to use during End to End Testing

Debug capable CH will be provided to support triage activities,

but will only be available in the DCC Test Labs

DCC will support triage and Testing Issue management activities

Change request has been raised to provide instrumented test CH

END TO END TESTING

DCC Public 17

NON-SUPPLIER?

DCC Public 18

Can test using DCC Test Lab

Upon request:

Device sets will be provided by DCC

Installation of device sets will be completed by CSP

Commissioning of device sets will be completed by the Systems

Integrator and CSP

Testing Issue resolution and triage process identical to Supplier

Party testing process.

END TO END TESTING: PRE TESTING

DCC Public 19

Activity TP DCC CSP SI DSP

Notification X

Initiation meeting X X

Manage slot booking X

Provision of meters X X

Ordering of Remote Test Lab (RTL) X

Ordering of PTCH for RTL X

Delivery of PTCH and RTL service X

Provision of PTCH for DCC Lab X X

Submit readiness reports X

Provision of testing data (non-supplier) X X

Provision of testing data (supplier) X X

Provision of Issue resolution tool X

Lab Induction meeting X X

Physical device set install for RTL X

Physical device set install for DCC Lab - Supplier X

Physical device set install for DCC Lab – non Supplier X

Attend entry quality gate X X

Approval to proceed certificate X

END TO END TESTING: TESTING

DCC Public 20

Activity TP DCC CSP SI DSP

Conducting testing X

Commissioning of Device (Non-supplier) X X

Commissioning of Device (supplier) X

Manage issue resolution X

Triage of issues X X X X X

Remove faulty devices and replace –

DCC devices X

Remove faulty devices and replace – TP devices X

Provide storage for Devices – DCC Labs X

Asset tracking DCC Devices for installed and stored

devices – DCC Labs X

Maintenance of DCPTCH - DCC Labs X

Environment / release management X X X X

END TO END TESTING: POST TESTING

DCC Public 21

Activity TP DCC CSP SI DSP

Physical device set removal - Supplier X

Physical device set removal - non Supplier X

Prepare lab and data for next TP X X

END TO END TESTING PROCEDURAL STEPS

DCC Public

2. Conduct E2E Initiation

Meeting and confirm DCC

Test Lab Booking*

3. TP Completes

Connection forms*, RAPP

Forms* and produces TRR

4. DCC reviews TRR

5*. DCC progresses Gateway

Connection and RAPP forms

7. E2E Execution 8. E2E testing

Completion

6. E2E Entry Quality

Gate

1. TP Completes

Notification form including

DCC Test Lab request*

*if required; TP’s may already have completed

these as part of UEPT or EUCT/Pre-UIT

22

CSP SUPPORT

1.0 DCC Public

USE OF DCC TEST LABS

DCC Public 24

Pre-requisite Description Additional Information

Induction • All TPs attending the DCC Labs must

have attended an induction session in

advance

• Induction is mandatory

• Only those attending induction may

attend the Test Labs

• Induction will cover topics including: • Health, Safety and Environment

Induction

• Overview of Site and Facilities

• Test Lab and Office Tour

• Non-Disclosure Requirements

• Routine on arrival

• Contact information

• Administration

• Other relevant information

• DCC to capture attendee

details including: • Name

• Organisation

• Contact Details

• Vehicle Registration

• Event date

• Duration : 2 Hours (max)

• Dates to be published by DCC

in due course

Testing Slot • TP must have a confirmed “Test Slot”

booking with the DCC

• Booking information will be

passed to CSPs by DCC

Onsite Induction • On-site induction on the day of arrival • Site specific and Security

matters to be covered

CSP SUPPORT Locations & Facilities

DCC Public 25

:

CSP Test Lab Location Facilities:

North & Scotland

(ARQIVA)

Arqiva

Crawley Court

Winchester

SO21 2QA

Lab opening Hours:

08:00 – 18:00 Mon-Fri

Facilities offered at the test labs include:

• Parking

• Coach transfer from local train

station**

• Desk allocation (not for 100%

utilisation)

• Wi-Fi Services

• Meeting Room booking facilities

• Canteen/Kitchenette

• Coffee areas

• Break out areas

• Separate Male/Female toilets

Note: may vary a little across sites or may be subject to some limitations

Central & South

(TELEFONICA)

Telefonica*

5 Reynoldston Close

(Brackmills Industrial Estate)

Northampton

NN4 7BX

Lab Opening Hours:

08:00 – 18:00 Mon-Fri

• * Second test lab will be provided at Runcorn if overflow required

• ** Arqiva only

TEST LAB SERVICES1

DCC Public 26

1 subject to some volumetric limitations 4 Redacted CH logs to be provided due to security limitations 2 subject to size limitations 5 where technically possible 3 not in Telefonica test labs 6 TBC 7 At CSP discretion

Support Service Will Do Optional services7

Administration • Assistance with facilities and meeting

room bookings

• Contact support for induction and testing

slots

• Arranging Wi-Fi access

• Open to considering requests

Device Services • Physical installation of CH6 & Meters for

UEPT and non suppliers for E2E

• Physical swap out of faulty Devices

• Storage of spare devices

• Asset Tracking for PTCH & Meters

• Security of Devices

• Assistance (hands on)

• Meter upgrades & Changes (firmware &

certificates)5

Testing

Services

• Storage lockers for TP test equipment2

• Knowledge Sharing

• Assistance with service testing (within the

DCC Lab)

Remote

Cameras

• Web based camera service3

Triage Support • Assistance with diagnostics within CSP

solution4

• Zigbee HAN traffic capture

• Meter Stubs

• De-bug capable Prototype Testing CH

• Triage assistance for meters (with

assistance from meter manufacturers)

REMOTE TEST LAB SERVICES1

DCC Public 27

1 subject to some volumetric limitations 2 At CSP discretion

Support Service Will Do Optional services2

Installation of

equipment at

remote site

• Carry out site survey

• Agree on suitable location for

remote test service equipment

ARQ: access node equipment

(Base Station)

TEF: Boost box

• Identify enabling work (to be

completed by the customer) before

CSP equipment can be installed

• ARQ: Supply & Install a test configuration

Base Station

• TEF: Supply necessary ‘plug and play’

Boost box(es) with installation guidance

• Supply of certified, registered

communications Hubs with on-going

• Configuration management

• Hardware and Firmware upgrades

(where required)

• Test Communication Hubs outside of the

warranty period

• Provide replacement PTCH

Testing

Services

• Practical knowledge sharing

Triage Support • Provide remote assistance to diagnose

faults with the supplied RTS equipment

• Support issue resolution/triage for test

execution in line with agreed processes

for E2E

• Confirm traffic generation of RTL lab

GENERAL SUPPORT TO INDUSTRY

TESTING PARTICIPANTS

DCC Public

Systems Integrator to manage Issue Resolution during office

hours

Testing Issues will be recorded in HP ALM or using spreadsheet

which will be held on DCC SharePoint in individual Party folder

Response times in line with guidelines agreed in Joint Test

Strategy (available on DCC website)

Regular teleconferences will be convened with Testing

Participants to discuss open Testing Issues.

Industry Test Support Analyst appointed to each Testing

Participant

INDUSTRY TESTING SUPPORT

DCC Public 29