An Interactive Visual Analytics System for Bridge Management

( - ) X ia o y u H s ia o YuW a n g

C h a r lo t t e V is u a liz a t io n C e n t e r. . U S D e p a r t m e n t o f T r a n s p o r t a t io n

Wenwen Dou, Shen-En Chen, Remco Chang, William Ribarsky

Problem Statement• Bridge is crucial for transportation

safety

• Bridge deteriorates over usage and time

• Bridge inspection requires analysis of multiple factor

•Structural analysis

•Actual traffic usage analysis

OverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

Reports from American Society of Civil Engineers

OverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

In 2009, more than 26 percent of the U.S.’s 599,766 bridges are either structurally deficient or functionally obsolete.

Current Practice• Inspections and managements are carried out

by states and cities

• Using hierarchical reporting structure

• Report information stored in heterogeneous formats

• Decisions rely on bridge managers experiences

• Limited Budget and limited manpower

OverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

Current Practice con'd

OverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

PONTIS Bridge Management System BridgeStation

Situation Assessment• Collaborative Survey with AASHTO

• 35 states responded with 71 answered questionnaires

• 29 state bridge unites use PONTIS exclusively

• 6 state bridge unites have some modifications or in-house system

OverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

Survey Results

• BMSs have not provided effective support for bridge managers’ decision-making processes.

• BMSs are rigid in structure and cannot be easily adapted to support individual bridge manager’s task routines

• BMSs have not provided abilities to incorporate local inspection technologies.

OverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

Computer Scientists + Civil Engineers

• Small Format Aerial Photography (SFAP)

• Pavement Analysis

• LiDAR Scanning (Structural Analysis)

• Motion Analysis

OverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

Integrated TechnologiesOverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

Research Question

What’s the proper abstraction to help bridge managers to make accurate maintenance decisions?

OverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

System OverviewOverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

Support Decision Making Proc. System Customization

•Dynamic Geospatial View

•High Dimensional Structure Analysis

•Scalable Temporal View

•Flexible work environment.

•Integrated Local Inspection Technologies

•Interactive Exploration of Large Scale Bridge data

•Incorporation of multiple heterogeneous data sets

•Customizable based on bridge managers needs

System OverviewOverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

Geospatial Analysis

Temporal Analysis

Structural Analysis

OverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

Customization of the System

View Manager

PCP View

Scatter Plot View

Treemap View

D a t a M a n a g e r

Dimension A

Dimension B

Dimension C

S t a t is t ic sT r a n s f o r m e r

M a p p in gM a n a g e r

D a t aP a r s e r

OverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

Dynamic Geospatial View:•Select Multiple Regions

• Zoom into local details

• Representing additional bridge information e.g. Present Condition etc.

OverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

Structural Analysis• Depict bridge internal structures side by side

•Understand correlations among different groups of bridges e.g. sort by type or surface structure.

OverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

Structural Analysis•Interactively select bridge components

•Integration of multiple data sources,

•Present temporal and relational information

OverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

Temporal Analysis• Suggesting the deterioration trends of groups of bridges, e.g. the surface type or the type of work

• Automatically alert bridge managers about significant changes

•Help to examine the historical information and to plan for the future maintenance

Evaluation

OverviewOverview Current Imp.Current Imp. Future WorkFuture WorkEvaluationEvaluation

• - (1 2 )O n s it e E x p e r t E v a lu a t io n E x p e r t s

• (3 0 -4 0 )S y s t e m T r a in in g S e s s io n m in s

• - (4 5 -6 0 E x p e r t s H a n d s o n S e s s io n)m in s

• - F e e d b a c k a n d K n o w le d g e g a inE v a lu a t io n

• (2 )L o n g T e r m E v a lu a t io n b r id g e u n it s

• D e p lo y e d t o N o r t h C a r o lin a D O T a n d C h a r lo t t e D O T

• G a in F e e d b a c k t h r o u g h o u t t h ep r o c e s s

• - -F e a t u r e A d d o n s a n d B u g F ix

Evaluations Results

OverviewOverview Current Imp.Current Imp. Future WorkFuture WorkEvaluationEvaluation

• In t e r a c t iv e V is u a l F a c il it a t io n o f- D e c is io n m a k in g p r o c e s s

• Id e n t if y m a in t e n a n c e c a n d id a t e s

• G a t h e r a n d R e p o r t E v id e n c e

• F le x ib il it y t o a s s is t in d iv id u a l w o r k f lo w

• C u s t o m iz a b le s y s t e m v ie w s

• T h o r o u g h e x a m in a t io n o f b r id g e

• - E a s y t o g e t h a n d s o n e x p e r ie n c e

• M o r e p r o d u c t iv e

• M o r e w ill in g t o u s e a s a n A n a ly t ic a lt o o l

Achievements

• Outreached to 6 States and several bridge units in Canada

• Deployed system to local and North Carolina Department of Transportation

• Collaborated with commercial groups to provide additional system features

• Proposed and Received funding (1.3Million) for next 2 years

OverviewOverview Current Imp.Current Imp. Future WorkFuture WorkEvaluationEvaluation

- C o lla b o r a t iv e W e b b a s e d D e c is io n M a k in g S y s t e m

OverviewOverview EvaluationEvaluationOverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

- C o lla b o r a t io n a n d W e b b a s e d ( D e c is io n M a k in g S y s t e m C lo s e

-2 .0 )L o o k W e b

OverviewOverview EvaluationEvaluationOverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

OverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

3D LIDAR Point Structure Surface Defect Analysis

OverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation

Image Analysis on Small Format Aerial Photography

Thanks

• My awesome team members and my advisor

• Xiaoyu (Hsiao-yu) Wang: xwang25@uncc.edu

• http://www.ncrst.uncc.edu

OverviewOverview Future DirectionFuture DirectionCurrent Imp.Current Imp. EvaluationEvaluation