20
<Insert Picture Here> Open Data API delivery “Open-XDX” David Webber, Information Architect, Oracle Public Sector Open Data Exchange

Introducing Open XDX Technology for Open Data API development

Embed Size (px)

DESCRIPTION

Introduction to the concepts of Open-XDX for building Open Data APIs using the CAMeditor toolkit. See also http://www.verifyXML.org for working online demonstration site. For online demonstration site please see: http://www.verifyxml.org

Citation preview

Page 1: Introducing Open XDX Technology for Open Data API development

<Insert Picture Here>

Open Data API delivery “Open-XDX”

David Webber, Information Architect, Oracle Public Sector

Open

Data

Exchange

Page 2: Introducing Open XDX Technology for Open Data API development

The following is intended to outline Oracle general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.

The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Disclaimer Notice

Slide 2

Page 3: Introducing Open XDX Technology for Open Data API development

Background

"Open Data is the new default…

anywhere, anytime on any device,

and everything should be APIs"

Steven VanRoekel

Federal CIO – Whitehouse Digital Strategy Architect

Page 4: Introducing Open XDX Technology for Open Data API development

© 2012 Oracle Corporation – Proprietary and Confidential 4

Decoding the Digital Strategy

•What exactly are Open Data APIs?

•How can Oracle solutions support them?

•What does a solution architecture look like?

Page 5: Introducing Open XDX Technology for Open Data API development

© 2012 Oracle Corporation – Proprietary and Confidential 5

Open Data APIs explained

•A way, via the internet, to securely deliver

information between entities and systems

•API – Application Programming Interface

•Security is supported along with roles and

permissions for requestors, e.g.

– Public information – such as road works, health services, voting

– Private information – patient data, student data, company data

Page 6: Introducing Open XDX Technology for Open Data API development

© 2012 Oracle Corporation – Proprietary and Confidential 6

Oracle Solutions for Open Data

•Introducing Open-XDX

•How Oracle Solutions work with Open-XDX

•Open Data APIs – unleashed data

•Cross-platform and device delivery

Page 7: Introducing Open XDX Technology for Open Data API development

© 2012 Oracle Corporation – Proprietary and Confidential 7

Oracle Open Data Solution – Open-XDX

•Open-XDX is an all new component designed

to deliver rapid Open Data APIs

•Integrates into Oracle Fusion Middleware

foundation and Database products

•Uses XML configuration templates and code-

less methods and open source NIEM tools

•Allows plug-and-play delivery for Oracle

customers and applications

Page 8: Introducing Open XDX Technology for Open Data API development

Integration Conceptual ViewOpen XDX deployment

• Visual Editor

• SQL Browser

• Dictionaries

• Drag and Drop

• Generate Data

• Validate Data

• Send Data

• Open XDX

• Web Services

• FMW / BPM

Design Test Deploy

DB

Web

Open XDX

CAMV

CAM Editor

Open XDX

• Device

• Browser

• Server

Data Delivery

SQL

XML

XML

SQL

FMW

Page 9: Introducing Open XDX Technology for Open Data API development

Data Exchange

Open XDX - Conceptual Overview

Existing Information Databases

SQL

Open Data XML

Open-XDX

Send

SQL

Rapid

Deploy

JDBC connection

Control template contains information of the exchange structure design and DB mapping rules of data tables and columns

Template

Structure

Rules

DB Mappings

Parameters

Configuration

Page 10: Introducing Open XDX Technology for Open Data API development

Data Exchange Mapping

Option #1 – Visual Mapping Mode

Control template contains information of the exchange structure design and DB mapping rules of data tables and columns

Template

Structure

Rules

DB Mappings

Parameters

Store Configuration

• Individual column assignments made as DB mapping rules to existing XML structure layout;

• Original XML layout imported from industry schema (such as NIEM PMIX shown here)

Drag and Drop Mappings

Database schema viewer

XML structure viewer

Existing application SQL tables; e.g.

Oracle Healthcare, E-Business Suite,

custom system, etc.

Data store connection wizard

Page 11: Introducing Open XDX Technology for Open Data API development

Data Exchange Design

Option #2 – Visual Designer Mode

• Start with new empty XML structure;

• Toggle database viewer to designer mode.

Drag and Drop Designer

Database schema viewer

XML structure viewer

EMPTY (Patient Report)

Page 12: Introducing Open XDX Technology for Open Data API development

Data Exchange Design

Visual Designer Mode

Control template contains information of the exchange structure design and DB mapping rules of data tables and columns

Template

Structure

Rules

DB Mappings

Parameters

Store Configuration

• Drag and Drop table into XML structure

• Complete XML structure components automatically inserted (with DBMappings);

• All component names / definitions conform to NIEM NDR (smart rename wizard converts SQL to XML)

Drag and Drop Designer

Database schema viewer

XML structure viewer

Drag and Drop of Table

Page 13: Introducing Open XDX Technology for Open Data API development

Data Exchange

Demonstration – Open-XDX Data Generation

Existing Information

Open Data XML

Open-XDX

Send

SQL

Live Data Demo

Oracle Tools

MySQL Workbench

XML Designer

Generate

Application Data Tables

1

2

3

Page 14: Introducing Open XDX Technology for Open Data API development

© 2012 Oracle Corporation – Proprietary and Confidential 14

SQL DB Mapping Quick Guide

•Tables and Views mappable– Direct access only, use of synonyms not supported– Foreign keys for relationships between tables

•Primary keys and Foreign keys automatically mapped– Indexes not mapped automatically – must be referenced – Views – no index definitions – so must be referenced

•Data - by default all records are retrieved from all tables referenced– Filtering – parameters must be used on all tables to produce

subset of matching records as needed – e.g. date range, customerID

– Master & Parent / Child table hierarchy automatically deduced from DBMapping rules and XPath to XML structure

•Access control via normal account admin and user rights•Tested with Oracle DB and MySQL

Page 15: Introducing Open XDX Technology for Open Data API development

© 2012 Oracle Corporation – Proprietary and Confidential 15

XML Structure Usage

•Repeatable parent element for matching SQL table– Rows of data inserted as child elements of parent

•Table joins provided by parameter select statements– Select statements reference key fields (primary or foreign keys)

•Optional and Choice elements– If not used for extracted data, then exclude or use default value– Ensure components needed for data are not part of choice or

optional

•Map to existing elements or add new elements– Attributes also supported

•Data hinting value mechanism can be used in tandem with SQL data inputs for fixed values (company name, company address, exchange version #, etc)

Page 16: Introducing Open XDX Technology for Open Data API development

© 2012 Oracle Corporation – Proprietary and Confidential 16

Tools Check List

•SQL Database– Oracle SQL database– MySQL database– JDBC connector for target SQL database

•SQL Development tool– MySQL Workbench– SQL Developer

•Open-XDX solution– CAM Editor XML visual developer– Open-XDX JAR for XML generation batch component

•Secure message delivery– Oracle Weblogic / SOA Suite– Open-XDX integration (JAX-WS)

Page 17: Introducing Open XDX Technology for Open Data API development

© 2012 Oracle Corporation – Proprietary and Confidential 17

Deployment Usage Scenarios

• Rapid prototyping of information exchange packages

• Developing NIEM conformant exchange structures / dictionaries

• Query / Response interfaces with filter parameters

• Publish / Subscribe Daily or Hourly reporting

• XML information structures conform to SQL database model

• Limited number of SQL tables involved

• SQL data model well behaved with primary indexes and foreign keys

• Out of Scope

– Highly complex reporting and data manipulation

– Huge data volumes / massively high query rates per minute

– Multiple sets of tables and relationships

Page 18: Introducing Open XDX Technology for Open Data API development

© 2012 Oracle Corporation – Proprietary and Confidential 18

Key Technology Capabilities

• Delivering on the Open Data Digital Strategy Vision for government

• Open Standards and Open Source based

• Plug and play with code-free templates and rapid development

• Supports NIEM and Open XML exchanges

• Leverages deployed technology today

• Workflow integration

• Secure messaging delivery and partner management

• Delivered across-platform and device

• End-to-end security & governance

Page 19: Introducing Open XDX Technology for Open Data API development

CAMeditor.ORG Project Statistics

‹#›

SNAPSHOT OF PROJECT

ACTIVITIES

50,000+ CAMeditor.org page

visits in one year

130+ countries have downloaded tools; 30% of visitors are

from U.S.;400+ downloads

weekly

5 to 10 students use online video training

resource weekly

6 languages now available

www.cameditor.org

Page 20: Introducing Open XDX Technology for Open Data API development

©2012 Oracle Corporation 20