Cooperative driving: moving from design to testing 16 July 2014 Francois Fischer Senior Project Manager ERTICO
project start date: 01.01.2011 | end date: 31.07.2014
Objectives
16.07.2014|| Final event - from design to testing 2
Transform the methodology into FOT
Integrated European wide testing
Test sites preparation
set the stage
Piloting
use the feedback for FOT
FOT
manage the data and subjects
project start date: 01.01.2011 | end date: 31.07.2014
From cooperative system design to testing
16.07.2014|| Final event - from design to testing 3
DRIVE C2X system design Validation on the system test site
Test site preparation Piloting Field Tests
project start date: 01.01.2011 | end date: 31.07.2014
DRIVE C2X system design Towards test site adaptation
16.07.2014|| Final event - from design to testing 4
• The main challenge was to ensure successful deployment of cooperative driving functions on all test sites • The DRIVE C2X software toolkit enabled seamless deployment on
existing test site equipment • OSGI open SW platform eased setup and maintenance during the
FOT
vehicle station
CU AU
Roadside station
CU AU
project start date: 01.01.2011 | end date: 31.07.2014
DRIVE C2X system design Reference functions for FOT
16.07.2014|| Final event - from design to testing 5
AEVW - Approaching Emergency Vehicle Warning
TJAW – Traffic Jam Ahead Warning
IVS – In Vehicle Signage
RWW – Road Work Warning
OW - Obstacle Warning
GLOSA – Green Light Optimal Speed Advisory
CBW – Car Breakdown Warning
WW - Weather Warning
project start date: 01.01.2011 | end date: 31.07.2014
Validation Ensure interoperability
16.07.2014|| Final event - from design to testing
• Interoperability is a critical challenge for cooperative systems
• Public interoperability events supported by DRIVE C2X provided interoperability and conformance test sessions allowing to: • Check compliance of vendor implementations with standards • Verify interoperability between different vendor systems
6
project start date: 01.01.2011 | end date: 31.07.2014
Validation Ensure system performances
16.07.2014|| Final event - from design to testing
• Functional testing is important to ensure that the whole system is working
• 6 test sessions of 1 week were carried out at the system test site in Helmond (NL)
• Real drive tests with vehicle platoons to validate: • Vehicle and roadside ITS stations • Cooperative functions at the HMI level • FOT control tool • Data collected by the logging units
7
project start date: 01.01.2011 | end date: 31.07.2014
Validation Drive test session - impression
16.07.2014|| Final event - from design to testing 8
Prepare scenario Briefing Line-up and start
MAI Test on the road Debriefing Collect logs
project start date: 01.01.2011 | end date: 31.07.2014
Test site preparation Vehicle adaptation at TS Italy
16.07.2014|| Final event - from design to testing 9
project start date: 01.01.2011 | end date: 31.07.2014
Test site preparation Application adaptation at TS Italy
16.07.2014|| Final event - from design to testing
Databases - interfaces
Legacy, no adaptation
DRIVE C2X Test Management Centre
Use Case Unit Adapted for DRIVE C2X
SERVICE CENTRE
10
ROAD
AU1 RIS 1 CCU
AU2 RIS 2 CCU
AU3 RIS 3 CCU
AU4 RIS 4 CCU
AU5 RIS 5 CCU
Road sensors and VMS
project start date: 01.01.2011 | end date: 31.07.2014
Test site preparation Roadside deployment at TS Italy
16.07.2014|| Final event - from design to testing
Images and map source: Google
11
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
165
164
167
166
136 Toll station / stazione “Trento Centro”
Toll station / stazione “Rovereto Nord”
Toll station / stazione “Rovereto Sud”
Rest area / AdS “Nogaredo Ovest”
RSU
N
TCC
VMS
RSU
Gantry
Roadside Unit
137
138
139
140
141
142
143
802 . 11 p transmitter
TVCC
Traffic sensor
S
168
RSU
RSU
Fiber - optics network
RSU
RSU
RSU
RSU
RSU
RSU
RSU
project start date: 01.01.2011 | end date: 31.07.2014
Test site preparation Functions at TS Italy
16.07.2014|| Final event - from design to testing 12
• 18 km A22 Highway equipped with: • DRIVE C2X functions
• Traffic Jam Ahead Warning • In Vehicle Signage • Slow Vehicle Warning • Car Breakdown Warning • Approaching Emergency Vehicle • Road Works Warning • Motorcycle approaching indication
• Regional function • Wrong Way Driving in Gas Stations
project start date: 01.01.2011 | end date: 31.07.2014
Test site preparation Harmonised test methodology
16.07.2014|| Final event - from design to testing 13
• Harmonisation of test process is needed at the level of: • Functions (HMI) • Test scenarios • Event definition • User management • Data management
Test site Data collection
Central Data storage
TS logs Validation tools
project start date: 01.01.2011 | end date: 31.07.2014
Test preparation Variable weather conditions
16.07.2014|| Final event - from design to testing 14
0 – distance (m) 5000 10000 15000 20000 25000 m, 47 min
project start date: 01.01.2011 | end date: 31.07.2014
Piloting Last check before FOT start
16.07.2014|| Final event - from design to testing 15
• Stepwise approach for checking that all systems perform according to the test methodology
• Led to fine tuning of the study design • Use of observers on the back seat to take note and guide the
driver through the test route
Systems Test control Log Data
project start date: 01.01.2011 | end date: 31.07.2014
Piloting Recommendations for the HMI
16.07.2014|| Final event - from design to testing 16
• Piloting tests provided recommendations to improve the HMI: • Increase the size of warning and informing pictograms • Increase the size of speed limit in severe warning. • Remove the speedometer and distance bar • Improve warning sounds
project start date: 01.01.2011 | end date: 31.07.2014
Field tests Data Processing
16.07.2014|| Final event - from design to testing 17
LogPro
LogPro Events & indicators
Repository Test Site
TE function TE function TE function Function valid
Test valid
Request Data processing
/LogMover log data
Quality check
DITCM LogMover Data Analysis
Log files Test_i
Upload test data
Impact evaluation
sheets
project start date: 01.01.2011 | end date: 31.07.2014
Field tests Controlled test process - TS Finland
16.07.2014|| Final event - from design to testing 18
RWW event detail
project start date: 01.01.2011 | end date: 31.07.2014
Field tests Planning controlled tests
16.07.2014|| Final event - from design to testing 19
project start date: 01.01.2011 | end date: 31.07.2014
Field Tests Naturalistic test process – TS Sweden
16.07.2014|| Final event - from design to testing 20
CW 2013 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 WW Icy road Wind warning IVS GLOSA OW/CBW GLOSA
Baseline Treatment
RWW roadside unit GLOSA locations
project start date: 01.01.2011 | end date: 31.07.2014
Field tests Naturalistic test ITS corridor
16.07.2014|| Final event - from design to testing 21
• During naturalistic tests, drivers are not guided to pass by equipped vehicle or roadside units
• Corridors, which many users are likely to cross, shall be equipped.
• Example: ITS corridor used for commuting by Volvo workers
project start date: 01.01.2011 | end date: 31.07.2014
Field tests User experience in winter conditions
16.07.2014|| Final event - from design to testing 22
• User acceptance is critical for cooperative functions like Weather Warning and Slippery road Warning
• Winter is a challenging season for driving with harsh weather conditions • Test site Finland organised a winter test session to assess cooperative
driving concerning: • Technical performances, impact and user experience
project start date: 01.01.2011 | end date: 31.07.2014
758 drivers participated in the FOT with 262 vehicles over 1,8 million Km driven during 30990 trips enabling
the collection of more than 400 Gbytes of data containing 367 500 events
Results
16.07.2014|| Final event - from design to testing 23
The FOT delivered data to evaluate system performances, assess the impact and user acceptance
of cooperative driving