20
Optimizing Rail Data for Google Earth TM Mashup Lawrence Chong Technical Data Support Transport Canada April 24, 2012

Optimizing Rail Data for Google Earth Mashup

Embed Size (px)

DESCRIPTION

Presented by Lawrence Chong of Transport CanadaAbstract:Displaying a huge data set for Google Earth can be a challenge. The data must be properly processed for efficient display. Using FME, the KML output is structured using grouping, networklink, tiling and region for optimization.

Citation preview

Page 1: Optimizing Rail Data for Google Earth Mashup

Optimizing Rail Data for Google EarthTM MashupLawrence ChongTechnical Data SupportTransport Canada

April 24, 2012

Page 2: Optimizing Rail Data for Google Earth Mashup

Optimizing Rail Data forGoogle EarthTM Mashup

OVERVIEW Preparing huge dataset for display in Google Earth can be a challenge. The

data must be properly structured for efficient display. Recent release of FME 2012 includes several transformer enhancements

specifically for KML translation. This presentation is to demonstrate how to achieve KML optimization using

Grouping, Tiling, NetworkLink, Folder, Region and Styling with FME.

Page 3: Optimizing Rail Data for Google Earth Mashup

Optimizing Rail Data forGoogle EarthTM Mashup

BACKGROUND Transport Canada (TC) is responsible for transportation policies and

programs. TC regulations, standards and programs work to ensure that air, marine,

road and rail transportation are safe, secure, efficient and environmentally responsible.

With 48,000 kilometres of tracks and over 25,000 road crossings, Canada has one of the largest rail networks in the world.

OBJECTIVE Implement a cost effective, efficient and portable system for viewing Rail

Data. Provide Rail Inspectors the visualization tool to access rail

information using Google EarthTM and Google Street ViewTM for planning, review and analysis, anywhere, anytime.

Google EarthTM and Google Street ViewTM are trademarks of Google Inc.

Page 4: Optimizing Rail Data for Google Earth Mashup

Optimizing Rail Data forGoogle EarthTM Mashup

Rail Data Mashup Layers Road Crossings Main Tracks Yards Spurs Crossing Collisions

Source: Google EarthTM and Google StreetTM View

Page 5: Optimizing Rail Data for Google Earth Mashup

Optimizing Rail Data forGoogle EarthTM Mashup

Basic FME Workflow

MS Access DatabaseExcel Spreadsheet

ESRI SHP FilesMapInfo TAB Files

RailData

Terminate

Fail

PassData

Integrity

• Date formatting

• Label formatting

• Attribute cleanup

DisplayError

KMLOptimization

• Grouping • Tiling

• NetworkLink• Folder

• Regioning

Styling

Symbolization

KML Output

Output to 5 folders grouped by TC

Regions

Verification

ValidationLevel 1

(Low LOD)

Multi-steps parallel processing to create data for various LOD utilizing thinning and

cluster sampling technique

Level 2

Level 3(High LOD)

KMLOptimization

KMLOptimization

Page 6: Optimizing Rail Data for Google Earth Mashup

FME Workbench for Road Crossings

CascadingNetworkLink(Level 3)

Level 1 (Low LOD)

Level 2

Level 3 (High LOD)

Casc

ad

ing

Fold

ers

(Levels

1 &

2)

Grouping

Tiling

ClusterSampling

LOD 1

LOD 2

LOD 3

Styling Regioning

Optimizing Rail Data forGoogle EarthTM Mashup

Style DefinitionKML OptimizationData Integrity Loading Output

Page 7: Optimizing Rail Data for Google Earth Mashup

Optimizing Rail Data forGoogle EarthTM Mashup

FME Workbench for Road CrossingsData Integrity

Original: yyyymmdd00000000000Formatted: yyyy-mm-dd

Page 8: Optimizing Rail Data for Google Earth Mashup

Optimizing Rail Data forGoogle EarthTM Mashup

FME Workbench for Road CrossingsKML Optimization – Cluster Sampling & Tiling

LOD 1Loading

Page 9: Optimizing Rail Data for Google Earth Mashup

Optimizing Rail Data forGoogle EarthTM Mashup

FME Workbench for Road CrossingsKML Optimization – Cluster Sampling & Tiling

LOD 2

Page 10: Optimizing Rail Data for Google Earth Mashup

Optimizing Rail Data forGoogle EarthTM Mashup

FME Workbench for Road CrossingsKML Optimization – Tiling

LOD 3

Page 11: Optimizing Rail Data for Google Earth Mashup

Optimizing Rail Data forGoogle EarthTM Mashup

FME Workbench for Road CrossingsKML Optimization – Step 1

CascadingFolder

Casca

din

g

Netw

orkLink

Cascading Folder• kml_document=Destination KML

document• kml_id=kml_name=Folder Label

Cascading NetworlLink• kml_link_href=Output KML file• kml_id=kml_name=NetworkLink label

Page 12: Optimizing Rail Data for Google Earth Mashup

Optimizing Rail Data forGoogle EarthTM Mashup

FME Workbench for Road Crossings

KML Optimization – Step 2

CascadingFolder

CascadingNetworkLink

Cascading Folder• kml_document=Destination KML

document• kml_parent=Previous Grouping (fanout)• kml_id=kml_name=Current Grouping

Cascading NetworlLink• kml_document=Previous Grouping

(fanout)• kml_link_href=Output KML file• kml_id=kml_name=NetworkLink label

Page 13: Optimizing Rail Data for Google Earth Mashup

Optimizing Rail Data forGoogle EarthTM Mashup

FME Workbench for Road Crossings

KML Optimization – Cascading Folder

Ste

p 2

Step 1

Page 14: Optimizing Rail Data for Google Earth Mashup

Optimizing Rail Data forGoogle EarthTM Mashup

FME Workbench for Road Crossings

KML Optimization – Cascading NetworkLink

Step

2

Ste

p 1

Page 15: Optimizing Rail Data for Google Earth Mashup

Styling Regioning

FME Workbench for Road Crossings

LOD 3(Street Level)Multiple files-NetworkLink structure

LOD 1(High Altitude)Single file-Folder structure

LOD 2Single file-Folder structure

Cascading Folder• kml_document=Destination KML

document• kml_parent=Previous Grouping (fanout)• kml_name=Placemark Label

Cascading NetworlLink• kml_document=Previous Grouping

(fanout)• kml_name=Placemark label

Optimizing Rail Data forGoogle EarthTM Mashup

KML OutputKML Optimization – Step 3

Page 16: Optimizing Rail Data for Google Earth Mashup

Optimizing Rail Data forGoogle EarthTM Mashup

FME Workbench for Road CrossingsStyle Definition

Page 17: Optimizing Rail Data for Google Earth Mashup

FME Workbench for Crossing Collisions

Styling

CascadingNetworkLink

RegioningGrouping

Tiling

Optimizing Rail Data forGoogle EarthTM Mashup

>

Style DefinitionKML OptimizationData Integrity Loading Output

Page 18: Optimizing Rail Data for Google Earth Mashup

FME Workbench for Rail Network

Grouping

Tiling

Casc

ad

ing

Netw

ork

Link

Regioning

Level 1 (Low LOD)Main Tracks

Level 2 (High LOD)Main Tracks

Level 3 (Street Level)Yards & Spurs

Styling

Optimizing Rail Data forGoogle EarthTM Mashup

Main Tracks

SpursYards

Style DefinitionKML OptimizationPre-processing Output

Page 19: Optimizing Rail Data for Google Earth Mashup

Optimizing Rail Data forGoogle EarthTM Mashup

Output

Page 20: Optimizing Rail Data for Google Earth Mashup

Thank You!

Questions?

For more information: Lawrence Chong

[email protected] Canada