Key Performance Indicators Market consultation information meeting September 10 th, 2012

Key Performance Indicators

Market consultation information meeting

September 10th, 2012

Het Fairway consortium bestaat uit KPMG Advisory burg. CVBA , Eubelius burg. CVBA en Collis BV 2

KPI determination in an all-roads GNSS environment

• Purpose

• Determine performance of the system and SSP to be able to determine compensation and penalties for Service providers

• Challenge

• All roads

• No enforcement equipment on all roads

• Fraudulent intents

• Malfunctioning equipment

• Solution

• Data mining



• KPIs

• Performance of kilometer registration

• Performance of enforcement equipment

• Performance of (in a timely manner) reporting non-regulatory vehicles

• Incorrect reporting of non-regulatory vehicles

• Performance requirements

• Customer care

• Availability service points

• Availability stock of OBUs

• Reliability

• Etc.

Based on the performance level,penalties may be imposed



Correctly functioning

OBUs

All vehicles liable to the charge

Registered vehicles Non-registered vehicles

2%98%

Malfunctioning OBUs

Fraudulent Users

Registered kilometres

Non-registered kilometres

98% 1%1%

99% 1%


Kilometre registration KPIs

1. Accuracy*

2. Overcharging*

3. Undercharging*

The total number of registered kilometres on routes, to be decided later, of vehicles with a correctly functioning OBU, shall deviate by no more than 2% of the actual number of kilometres driven

The number of vehicles with a correctly functioning OBU whose registered kilometres deviate by more than +1% compared to the actual number of kilometres driven shall be less than 0.1%

The number of vehicles with a correctly functioning OBU whose registered kilometres deviate by more than -2% compared to the actual number of kilometres driven shall be less than 2%

* Values are working assumptions subject to evaluation


Enforcement equipment KPIs

1. Detections

2. Classification

3. ANPR

4. DSRC link

Of the vehicles detected by DSRC using enforcement equipment, at least 99% shall have been detected by the equipment's other functions

Of the vehicles detected by DSRC using enforcement equipment, at least 80% shall be correctly classified as a vehicle liable for the kilometre charge

Of the vehicles detected by DSRC using enforcement equipment, at least 95-98% shall be correctly identified by ANPR

Of the vehicles identified by ANPR using enforcement equipment, the journey of which is recorded in the BO (through direct communication from the OBU), at least 99.99% shall be correctly identified through the DRSC link


Reporting non-regulatory vehicles KPIs

1. No registration

2. Non-functioning

3. Fraudulent intent

Of all the vehicles liable for the kilometre charge that are detected as they pass the enforcement equipment and were not registered with the SSP, at least 99% shall be reported to the enforcement centre within 1 hour

Of all the detected vehicles registered with the SSP that pass the enforcement equipment and are no longer entitled to drive due to lack of payment methods or defective OBU, at least 99% shall be reported to the enforcement centre within 1 hour

Of all the detected and defrauding vehicles (OBU removed / blocked / disrupted) that pass the enforcement equipment, at least 99% shall be reported to the enforcement centre within 1 hour


Incorrect reporting of non-regulatory vehicles KPIs

1. No registration

2. Non-functioning

3. Fraudulent intent

Of all the vehicles reported as ‘liable for the kilometre charge and not registered', this report shall be incorrect in no more than 1% of the cases

Of the vehicles reported as 'non-functioning OBUs', this report shall be incorrect in no more than 1% of the cases

Of all the vehicles reported as 'defrauding', this report shall be incorrect in no more than 10% of cases


SSP reporting on KPIs

The SSP reports to the interregional entity, monthly and commutatively annually, in digital form and according to a predefined format and channels (through table, graphs and notes) about the agreed KPIs and performance requirements.

The KPIs are reported to the interregional entity every month within 20 working days of the end of the month

Should it appear that a tolerance defined for a KPI is going to be exceeded, the SSP shall provide an interim report of this within 24 hours


Key performance indicators

RealMeasured (average)

> +1%< –2% 0%-0.7%

A-E

• Vehicles detected on OBU id or license plate

• Results render performance of:

• Recorded kilometre registration

• Performance enforcement equipment

A

B

CD

E

F


Enforcement stations to be used for KPI measurement

20

17

3


Data mining

Data mining

License platesOBU data

User dataRegistration dataUsage data


Kilometer registration accuracy

kilometer afwijking

KPI 1: inaccuracy wrt average deviation)

KPI 3: onder-registratie(max 2%)

KPI 2: over-registratie(max 1%)

> +1%< -2% 0 %werkelijk

- 0,8 %registratie


Enforcement equipment performance

ANPR

DSRC

ANPR

DSRC

A CB

ANPR

DSRC1-ABC-123 ?-???-??? 1-ABC-123


Completeness indicator

• Completeness =

• SSP field of influence is limited to:

• Accurate and reliable kilometre registration

• Detection of offenders (collection of evidence)

• Reporting of offenders

all kilometers driven by vehicles liable to the charge

all kilometers collected by vehicles liable to the charge


Completeness indicator

Correctly functioning

OBUs

All vehicles liable to the charge

Registered vehicles Non-registered vehicles

2%98%

Malfunctioning OBUs

Fraudulent Users

Registered kilometres

Non-registered kilometres

98% 1%1%

99% 1%


Summary

Kilometre registration Enforcement performance Reporting of non-regulatory vehicles

Documents

Key Performance Indicators Market consultation information meeting September 10 th, 2012