May 2012 Oracle Spatial User Conference...changed features per day ... accuracy and content •...

May 2012 Oracle Spatial User Conference

May 23, 2012 Ronald Reagan Building and International Trade Center

Washington, DC USA

Andrew Howles & Jo Shannon IS Principal Architect General Manager, Operations

Automated Data Quality Processes in Ordnance Survey’s GDMS

OVERVIEW •  Centrally managed, authoritative database •  Incorporates 5 corporate national datasets •  Supports national data capture and maintenance •  Contains in excess of 500 million features

CHALLENGES / OPPORTUNITIES •  Need to integrate disparate data sets •  Need to extract 32 million features and submit 313,000

changed features per day •  Need to support multiple users in the same geographic area •  Automated data validation to achieve product ready

database ORACLE SOLUTIONS •  Oracle Spatial Database, Partitioning, RAC, Dataguard •  Oracle Workspace Manager •  Oracle Application Server & Weblogic •  Oracle BPEL & Worklist Application •  Oracle Enterprise Service Bus •  Oracle Identity Management

RESULTS •  Consolidation of raster, vector, network data in 5.3TB

sized central repository •  Single source database for product derivation •  Seamless working – removal of tile based restrictions •  Resilient production environment achieving 99.5%

availability

Ordnance Survey Geospatial Data Management System

Insert application screenshot here

Agenda

•  Introductions • Ordnance Survey and GDMS business context • Oracle technology in GDMS • Radius Studio technology in GDMS • Challenges • Next steps • Conclusions • Q&A

Introductions

•  To the Presenters: – Andrew Howles, Ordnance Survey –  Jo Shannon, 1Spatial

•  To the Geospatial Data Management System (GDMS): – Enterprise geospatial data factory – end-to-end planning, collection,

management, validation, and publication to product stores – Multi-vendor service-oriented architecture built on the Oracle

technology stack – Went live in July 2011

Ordnance Survey business context

•  Self-funding government agency; remit covers Great Britain (England, Scotland and Wales) – 243,241 sq km / 93,956 sq miles

•  Datasets maintained on a national basis – common specifications to ensure consistency in terms of precision, accuracy and content

•  Close collaboration with Land Registry of England and Wales, and Registers of Scotland

•  Integrated data capture for field surveyors, HQ-based editors, and external suppliers

Ordnance Survey business context

•  Digital geospatial data products over 90% of Ordnance Survey’s business

•  Over 450 million unique feature identifiers (TOIDs) introduced by OS MasterMap® in 2001 – hooks to which information can be linked: –  emphasis on geographic information –  integration of addresses, boundaries, road

centre-lines and network topology with topographic base

GDMS programme context

•  Seamless data maintenance solution •  Intelligent and integrated maintenance

data model •  Separation of product data •  Automated data validation •  650+ production users in Ordnance

Survey and other organisations •  Platform for new product development

• Main unit is the feature •  Features are composed of components including:

–  identity –  lifecycle –  location –  classification –  relationships –  history

• Model prescribes around 150 specification rules

GDMS real-world object model – Geobase-04

•  500 million features and growing (+ history) •  4,000 data maintenance jobs per day •  32 million feature extractions per day •  313,000 features updates per day •  650+ users inside and outside Ordnance Survey •  99.5% availability

Non-functional characteristics

•  Mainstream architecture patterns: –  n-tier solution –  service-oriented approach (business logic) –  workflow layer (orchestration logic)

•  Heterogeneous software environment – best of breed COTS components from diverse vendors:

–  1Spatial, BAE Systems, ESRI, Intergraph, Microsoft, Oracle, Safe Software, Snowflake Software

•  Long transaction management, disconnected editing •  Scalable infrastructure on commodity hardware, selective virtualisation

Architectural principles

GDMS programme context Logical architecture

• Member of the Intergraph Consortium along with Snowflake Software

Role of 1Spatial within the Intergraph Consortium

Role Of Oracle in GDMS

Real Application Clusters

Workspace Manager in GDMS Key to Transaction Integrity

Workspace Manager in GDMS Acetate Overlay Model

Workspace Manager in GDMS Data Conflict

Workspace Manager in GDMS Logical Inconsistency

Role of Radius Studio

•  Spatial data integration platform •  Knowledge Store • Rules based spatial analysis • Web application & web services • GRID processing •  Extensible – built-ins, datastores

What is

Role of Radius Studio Rules based processing paradigm

Action Pattern Fact

Data Rule

Report

Reconcile

Role of Radius Studio Examples of Rules

PATTERN Railway points must be within 0.8 metres of at least 1 rail object

ACTION

Challenges

•  Schema design choices can cause physical data conflict to arise in instances where there is no logical conflict

1. Physical realisation of the logical model

Challenges 1. Physical realisation of the logical model

Challenges

•  Schema design choices can cause physical data conflict to arise in instances where there is no logical conflict

• Our advice: When optimising your schema, don’t just think about performance but consider conflict avoidance as well

1. Physical realisation of the logical model

Challenges

• Complex data requirements mean simple A versus B type decisions are not suitable for conflict resolution: –  logical semantics of spatial data – e.g. topological structuring –  version metadata

2. Conflict resolution

Challenges 2. Conflict resolution

Challenges

• Complex data requirements mean simple A versus B type decisions are not suitable for conflict resolution: –  logical semantics of spatial data – e.g. topological structuring –  version metadata

• Our advice: Understand the implications of your data model and schema for the process of conflict resolution

2. Conflict resolution

Challenges

•  Planning work to avoid conflict, where possible, is better than being in a conflict resolution situation

3. Work planning

Challenges 3. Work planning

Challenges

•  Planning work to avoid conflict, where possible, is better than being in a conflict resolution situation

• Our advice: Investigate and understand the implications of work planning processes with respect to susceptibility to conflict, and agree an appropriate approach with users of the system

3. Work planning

Challenges

•  Building innovative systems with cutting edge technologies and designs, means you will be charting new territory and encountering unexpected challenges.

• Our advice: Develop a trusted relationship with suppliers to ensure a collaborative approach to resolving issues as they arise.

4. Charting new territory

GDMS next steps

• Data quality improvement for existing products •  Strategic data enhancements to support new products:

–  additional intelligence (lifecycle, attribution, cross-referencing) –  increasing 3D capabilities –  additional networks

• Operational improvements: – Oracle Database upgrade to 11.2.0.3 – Mid-tier upgrade to WebLogic

Conclusions

• Cutting edge development requires a strong architectural vision and well managed requirements

• Core technologies must support the non-functional requirements out of the box

• Getting the business processes right is as important as building the right systems

• Understanding the logical data model’s physical implications is critical

• Collaborative supplier relationships are key to success

“If successful the Ordnance Survey's new geospatial database and data management system will define a best practice for the collection, distribution and use of geospatial data.”

International Data Corporation, 2007

• GDMS operational since July 2011 •  1.2 million Ordnance Survey units of change committed to date • Data, system and process enhancements now in progress for

delivery of new products

May 2012 Oracle Spatial User Conference...changed features per day ... accuracy and content •...

Documents

MASSACHUSETTS REGISTERS AND ASSISTANT REGISTERS …€¦ · For the Commonwealth of Massachusetts ... 5-2 TRUSTEE'S CERTIFICATE (c ... the Massachusetts Registers and Assistant Registers

Registers of Scotland 10-Year - ros.gov.uk · Although the total market value for Scotland decreased by 12.3% over the 10 years, the value in 2014-15 was up by 41.7% when compared

Registers of Scotland House Price Data: Collecting the Data Charles Keegan, Head of Business Development Ailsa Robertson, Business Development Manager

Section A - INCIDENCE Scottish Renal Registry Report 2009 Published by the Information Services Division (ISD Scotland), Common Services Agency for NHSScotland,

OASIS/ebXML Registry Information Model v2.02 Bug … · Registry Registry to Registry

The Representation of the People (Electoral Registers ......Sep 03, 2020 · The Representation of the People (Electoral Registers Publication Date) (Coronavirus) (Scotland) Regulations

Certificate Implementation Package - eHealth Ontario · Certificate Implementation Package/ version 1.1 Sensitivity - Low 2 System Registry Form : This form registers and enrolls

Registers and counters - howard huanghowardhuang.us/teaching/cs231/14-Registers-and-counters.pdfJuly 16, 2003 Registers and counters 2 Registers Flip-flops are limited because they

POWER9 Processor Registers Specification · Specification POWER9 Registers Advance Representation of Enumerated Registers To succinctly describe registers that are identical except

10 2017 03 14 Netherlands - United Nations 19... · 2017. 10. 11. · Land Registry Land consolidation Cables and Pipelines Key Registers Information node ... §Land grabbing §Aid

The December 2015 electoral registers in Great Britain · The December 2015 electoral registers in Scotland ... This is the final report in the Commission’s planned programme of

HM Land Registry: From tradition to revolution · Overview of HM Land Registry • Government department since 1862 • Registers ownership of land, mortgages and encumbrances in

Section G – Special Projects Scottish Renal Registry Report 2008 Published by the Information Services Division (ISD Scotland), Common Services Agency

Institutional Framework - Improving Customer Service in Registers of Scotland Marcus Mackenzie Customer Service Centre Manager marcus.mackenzie@ros.gov.uk

The Land Registry in Spain · LAND REGISTERS ORGANIZATION LAND REGISTERS ORGANIZATION Land Registry in Spain is organically linked to the Ministry of Justice Directorate General of

ECP2036 Microprocessor and Interfacing Registers Control & Status Registers Program Counter User-Visible Registers Instruction Register... General-Purpose

Registers of Scotland · Web viewThe Registers of Scotland (Fees) Order 2014 proposes no change to the current fees for registration. The Keeper is committed to reviewing fees every

Common Repair, Common Sense€¦ · apply only when ‘maintenance’ is being carried out. Maintenance is: repairs and replacement; cleaning; Registers of Scotland for registering

Crofting Commission annual audit report 2016/17 · crofting census and processing croft registration applications on behalf of the Registers of Scotland. ... Within the Commission’s

1. Summary of average values (plot weighted)...Source: Land Registry or Registers of Scotland and Zoopla Property Group. *Zoopla market share varies continuously in both absolute and