Transportation leadership you can trust.
Operations and ITS Data Tools – Turning Data into InformationTRANSPO
October 2012
Anita Vandervalk, P.E.
Cambridge Systematics, Inc.
2
AgendaWhy is this important?
Which data?
What decisions?
Challenges
Solutions and tools
Future outlook
3
Why is this Important?Performance Management in an era of declining budgets
Information industry - Rapid changes in technology and infrastructure for data sharing» Breadth of technologies for data management and
dissemination continues to increase» Complexity and cost of deploying these tools
continues to fall» Rapid growth in open source software solutions
and low-priced, third-party hosting services
Access to data necessary» Analyzing and evaluating management and
operations strategies» Making the case for greater levels of investment
in operations
4
MAP 21 – Focus on Performance Measurement
National Goal Areas: 1.) Safety; 2.) Infrastructure condition; 3.) Congestion reductions; and 4.) System reliability
ITS is needed to measure and improve safety, congestion, system reliability, and freight movement
Contains strong language supporting Transportation Systems Management and Operations (TSM&O)
Potential for a large ITS planning effort out of RITA/JPO
Section 513 requires a comprehensive plan be developed to assess ITS deployment activities across all modes
Continues funding for the Connected Vehicle Program
Includes research statements on several Ops and ITS areas
5
Transportation Agency ChallengesFaced with» Big Data, lots of (new) data» Technology/Innovation advances» Aging Infrastructure » Outdated IT strategies» Evolving customer expectations» Information Management challenges
Need» INFORMATION – Organized and Fused for
Decision Making» A well designed strategy for data, analytical
tools and information technology to support and institutional new processes around economics, freight, project selection, PMs
6
Data Management Services Framework
DecisionsInformationData
OperationsPlanningFundingProjectsPolicy
Programming
Collection Analysis Integration Visualization
BUSINESS REQUIREMENTS
ToolsForecasting/
Modeling Communication
7
Which Data?Traveler Information Systems» Current traffic conditions (e.g., travel time, speed,
level of congestion)» Traffic incidents, work zone, and/ or lane closures
Traffic Control Systems» Time and location of traffic control actions (e.g.,
ramp metering, traffic signal control, lane control signals, message board content)
Incident and Emergency Management Systems» Location, cause, extent, and time history of
roadway incident/ emergency detection and clearance, incident timeline.
Roadway Infrastructure Data» Roadway characteristics, intersection data, traffic
control data
8
Which Data?Vehicle Probe Data: Recent “real-time” speed and travel time» Historical speed and travel time; data quality
measures – completeness, accuracy, latency; and validation
State/Local Generated Detector Data» Recent “real-time” volume, occupancy, speed,
travel times, vehicle type; and historical volume, occupancy, speed, travel times
State/Local Work Zone » Location, agency, lanes closed, date/ time,
duration
Weather Data» State/ local RWIS data, NWS (or equivalent) data –
date/ time, road ways affected, type, intensity
9
Which Data?Advanced Public Transit Systems» Transit vehicle passenger boardings by time
and location, vehicle trajectories, passenger origins, and destinations
Network Typology» Link capacity, free flow speed, number of
lanes
Origin/Destination Data» Surveys, travel diaries, or direct monitoring
Traffic Monitoring and Detection Systems» Vehicle volume, speed, classification, weight,
turning movements, and position trajectories
10
NEW DATA SOURCES FROM PRIVATE SECTOR
Toll tag readers» Toll tag readers deployed at various points on a
roadway network– Electronic tags, antennas, readers, and a central
computing and communication facility
Bluetooth device matching» Computers, car radios, navigation devices, PDAs,
cell phones, headsets, and other personal devices are Bluetooth enabled
» Unique Median Access Control (MAC) addresses to Bluetooth equipped devices
» Travel time measurement involves identifying and matching the MAC address of Bluetooth-enabled devices carried by motorists as they pass a detector location
11
NEW DATA SOURCES FROM PRIVATE SECTOR
Wireless location technology» Using signaling information from cell phones
(such as cell tower handoffs) to anonymously track wireless devices as they traverse a roadway network
» Major vendors of the technology include Cellint (TrafficSense system), AirSage, and Delcan
Crowd-sourcing» Obtaining real-time traffic congestion information
from drivers’ GPS-enabled mobile phones» Relies on a large number of users and is primarily
to support personal navigation systems and mobile applications
12
NEW DATA SOURCES FROM PRIVATE SECTOR
Private data providers» Combine information from multiple probe
technologies such as cell phones, toll tags, crowd-sourcing, and fleet-based GPS probe vehicles, as well as data from existing fixed-sensor networks such as loop- or radar-based detection
» Data is then fused to provide real-time travel time estimates and incident information
» Private data sources include INRIX, Navteq Traffic, TomTom, Clear Channel’s Total Traffic Network and American Transportation Research Institute (ATRI)
13
Which Programs? (TSM&O) Traveler Information Systems
Active Traffic Management
Traffic Incident Management
Maintenance Activity Planning
Work Zone Management
Event Management
Traffic Control Device Synchronization
Road Weather Information Systems
Regional Traffic Management Centers
14
Which Programs?Freight Management and Commercial Vehicle Operations;
Electronic Toll and Fare Collection
Congestion Management Process
Performance Measures
ITS Strategic Planning
Managed Lanes
15
Which Decisions?
Planning for Operations» Investment » Project priorities» Types of strategies
Real Time Management» Traveler Information» Work Zones» Weather
16
ChallengesTechnical» Development and maintenance of hardware
and software» Specifications for data collection, analysis,
archiving, and reporting.
Institutional » Centralized policy-making, and decentralized
execution of policies» Limited appreciation by decision-makers of
the role of data systems in supporting business operations
» Lack of formal policies and standards
17
Challenges with Data IntegrationData Integration
Data Resolution
Data Quality» Maintaining extensive electronic field equipment
(sensors and communication)
Active Versus Passive Archiving
Rigid Data Format Standards versus Flexible Formats with Metadata
Data Integration (Fusion) Issues» Location Matching» Version Control
18
Transportation Data Formats!TranXML, TMDD, Data.gov, geospatial reference frameworks (e.g., TMC codes), Apache Software Foundation Object-Oriented Data Technology, NTCIP, and TCIP. Others will be included such as the National Information Exchange Model (FHWA Office of Policy is currently examining this model as a possible standard), UN-recommended UN/EDIFACT (which is the only international standard and is predominant outside of North America and as well predominant in life science and pharmaceutical industry), U.S. standard ANSI ASC X12 (X12)(predominant in North America), TRADACOMS standard developed by the ANA (Article Numbering Association) (predominant in the UK retail industry), ODETTE standard used within the European automotive industry, ebXML, used by many Asian community systems, WCO standards, such as WCO data model and ASYCUDA.
SOLUTIONS AND TOOLSTECHNICAL AND INSTITUTIONAL
Data Business PlanningWhat is a Data Business Plan?» A plan for efficient
utilization of people, processes, and technology, to support management of data and information within an organization
» The data business plan framework links business objectives, programs, and processes to data systems, services and products
20
Data Management and GovernanceData Management» Development, execution and oversight of
architectures, policies, practices, and procedures to manage the information life-cycle needs of an enterprise in an effective manner as it pertains to data collection, storage, security, data inventory, analy sis, quality control, reporting, and visualization
Data Governance » Execution and enforcement of authority over the
management of data assets and the performance of data functions. The implementation of data governance includes participants from many areas of the organization
21
22
FHWA Office of Operations – Data Business Plan
GOAL 1. Improve the coordination and communication mechanism across U.S. DOT and FHWA offices involved with roadway travel mobility data to avoid investing resources in the same or similar types of data related programs.
» Objective 1.1. Identify gaps and redundancies in roadway travel mobility data programs.
» Objective 1.2. Devise “rules of engagement” regarding collaboration of the data functions for roadway travel mobility data.
23
FHWA Office of Operations – Data Business Plan
GOAL 2. Improve the coordination of the connected vehicle data capture program with other related data programs within U.S. DOT and FHWA.
» Objective 2.1. Identify how current and planned data from the connected vehicle initiative can support existing data programs.
» Objective 2.2. Identify how data from other mobility related programs within U.S. DOT and FHWA can support the connected vehicle initiative.
» Objective 2.3. Identify existing/future data inventory and data structures/ policies/governance practices that could be applicable to the Research Data Exchange.
24
D. Data Products (Raw Data & Reports)Infrastructure (Inventory)
- State Roadway Inventory ProgramsTravel (Speed and Volume)
- Archived Data User Service- Transportation Technology Innovation & Demonstration (TTID)- Urban Congestion Report (UCR) Program- State Traffic Monitoring Stations- Traffic Volume Trend (TVT) Reports
Climate (Weather)- Road Weather Information Systems
Modal- FHWA Freight Performance Measures Initiative
Other Data Products- Integrated Corridor Management (ICM) Program
Real-Time Data Capture and Management Program- TFHRC Data Resources Testbed- DCM Program Test Data Sets- Dynamic Mobility Application Datasets (Future)
C. Core Data Systems & RepositoriesHighway Performance Monitoring System (HPMS)National Speed Data Collection & Reporting Program
(Future)Travel Monitoring and Analysis System (TMAS)Vehicle Travel Information System (VTRIS)ClarusNorth American Transborder FreightCross-Town Improvement Project (C-TIP) (Future)Freight Analysis Framework (FAF)International Freight Data System (IFDS) (Future)Data.govDCM Program Research Data Exchange
Manage & Consume
A. Operations ObjectivesSupport activities to mitigate non-recurring congestion
through aggressive management of temporary disruptions as well as consideration of public safety and security by preparing for emergency response (Transportation Operations)
Promote efficient, seamless, and secure freight flows on the U.S. highway system, intermodal connectors, and across our borders (Freight Management & Operations)
Support activities to improve day-to-day operation of the transportation system and to reduce recurring congestion through the development and implementation of new technologies and procedures (Transportation Management)
Enable
SupportB. Business ObjectivesNational LeadershipProgram DeliverySystem PerformanceCorporate Capacity
Achieve
UseE. Communities of Interest:Mobility Data COI (Internal/External)
Connected Vehicle Data COI (Internal/External)
F. Data ServicesData Acquisition and UpdatingData Quality Data StandardsBusiness Analysis ToolsData Privacy and SecurityData Storage and AccessInternal CoordinationTraceabilityPerformance MeasuresRisk AssessmentValue of Data ProgramsKnowledge Management System
Provide
Mobility Data Business Owners
Implements
Designates
FHWA Enterprise
Data Architect (IT office??)
FHWA Data Custodian (IT
Office)
MobilityData Stewards
Designates
Structures
Administers
Use
GovernanceFramework
Office of Operations Data
Governance Team
G. Other Data Governance InitiativesFHWA Data StandardsFHWA Data Governance Advisory Council Structure
Coordinates with
FHWA Data Governance Board (1 Rep
from OPS)
Participates
Connected Vehicle Data
Business Owners
Connected Vehicle
Data Stewards
Operations Program OfficesFHWA Office of Transportation Management
FHWA Office of Transportation OperationsFHWA Office of Freight Management & Operations
25
State Roadway Inventory Programs
Travel Monitoring & Analysis System
(TMAS)
State Traffic Monitoring Programs
State Database (Future)
State Database (Future)
State Database (Future)
NOTE: Orange symbols represent future data systems/programs. Orange dashed lines represent future connections.
Researchers
Federal, State & Local
Transportation Agencies
Private Data Providers
Public
Vehicle Weight Data
National Park Volume/Asset Data
(Future)
Bicycle/Pedestrian Volume/Asset Data
(Future)
Long Term Pavement
Performance Data (Future)
Roadway/Asset Inventory Data
Traffic Volume Data
Vehicle Classification Data
Vehicle Speed Data (Future)
U.S. Congress
FAST On-Line Dashboard http://bugatti.nvfast.org/PMMS/
27
PeMs
28
RITIS
29
INRIX Analytics Tool
Cloud-based service that combines Traffic Archive with real-time and historical analytics tools
Real-time Dashboard highlighting bottleneck locations, 99status and history
Historical analysis tools to enable configurable graphing, 99plotting, and mapping traffic performance measures
Configurable Massive Data Downloader to extract 99detailed Traffic Archive data by time, road segment, etc.
Options to add agency data (sensors, incidents, work 99zones, etc.) to increase utility of analysis
30
31
The CloudNational Association of State Chief Information Officers (NASCIO) has published an exhaustive set of resources
U.S. government is » mandating agency IT resources migrate to the
cloud (“cloud-first” strategy) » highly concerned with data security» larger in scale than any State or individual State
agency/DOT» an information and policy resource
32
State DOT Cloud use SurveyAll 50 states contacted
16 states responded
Lots of variation of cloud users, agencies considering the cloud, and agencies not using or considering the cloud
Storage and availability of GIS is a very common application for the cloud
SaaS (remote access to an application) is more common than IaaS (remote storage of agency data)
33
Survey Responses
Agency Agency currently Stores data "in the cloud"
Agency plans to Store data "in the cloud"
Neither
Colorado DOT •
Hawaii DOT •Iowa DOT •
Illinois DOT •
Missouri DOT •
Montana DOT •
Nevada DOT •
New Hampshire DOT •
New York State DOT •
North Dakota DOT •
Ohio DOT •Pennsylvania DOT •Utah DOT •
WHAT THE FUTURE HOLDS
35
What the future holdsIncreasing public involvement in managing transportation
Evolving role of ITS and Operations
Increasing private sector data sources – Issues» Common definitions for performance measures
(how to calculate from low-level data)» Integration with agency data: volumes, incidents,
work zones, weather, highway location» Distinguish O/D travel times
Technology and Innovation
????
36
FHWA/Saxton Labs Data Sharing Framework/Virtual Data Warehouse - Goals
Bring together many types of transportation data (probe data, traffic counters, incident locations, weather events) to give planners and operators a multi-faceted view of transportation performance overtime and by select locationBased on Concept of Operations, User Needs and Requirements, addressing:» Technical issues - data integration issues» Institutional issues - business rules
Partner agency involvement Software addresses access/feed, connection to applications
Virtual Data Integration
38
Virtual Data Integration
39
Framework Strategic Outcomes Framework is widely adopted by states and regions across the U.S.
Demonstration regarding how data sharing can support modeling, operations and planning
Planners and operations managers have complete and accurate information on the operational performance of the regional transportation system
Planning and investment decisions reflect all available and relevant data
MPOs and State DOTs are better able to meet new performance measurement requirements of MAP-21
“Start using operations data – eliminate barriers”
40
Thanks! ([email protected])