NIEM, CAM and Open-XDX tools

<Insert Picture Here>

David Webber, NIEM Team, Oracle Public Sector

NIEMTest Model Data

Deploy Requirements

Build Exchange

GenerateDictionary

Exchange Development

NIEM, CAM, and Open-XDX

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

The following is not intended to outline Oracle general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.

The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Disclaimer Notice

Slide 2


Agenda

hy NIEM? Quick Overview• National Information Exchange Model (NIEM)• Who, What, Why, How?• Technology thoughts

IEM information exchange anatomy• Exchange structures and schema• NIEM domain schema• NIEM IEPD• NIEM enterprise dictionaries (aka EIEM)

aking It Real – CAM tools and Open-XDX for NIEM• Rapid XML exchange development• Not just transactions – web services • Open-XDX – the future for Open Data APIs

ummary • Project Overview • Resources

Slide 3

N

M

S

W


NIEM Turned 7 years old in April –Where have we COME with NIEM

• NIEM Chartered on April 19, 2005

• First Major Version: 1.0, published in 2006

• Next Major Version: 2.0, published in 2007

• Current Minor Version: 2.1 minor release, published in 2009

• 2012 - NIEM 3.0 work in progress + NIEM UML profile

4

W


5

FEDERAL AGENCY COMMITMENTS

AGENCY USE OF NIEMDepartment of Agriculture Committed to UseDepartment of Defense Committed to UseDepartment of Education Committed to UseDepartment of Energy Committed to UseDepartment of Health and Human Services Committed to UseDepartment of Homeland Security Committed to UseDepartment of Housing and Urban Development Committed to UseDepartment of Justice Committed to UseDepartment of Labor Committed to UseDepartment of State Committed to UseDepartment of the Interior Committed to UseDepartment of the Treasury Committed to UseDepartment of Transportation Committed to UseDepartment of Veterans Affairs Committed to UseEnvironmental Protection Agency Further Evaluation RequiredGeneral Services Administration Committed to UseNational Aeronautics and Space Administration Further Evaluation RequiredNational Archives and Records Administration Committed to UseNational Science Foundation Committed to UseNuclear Regulatory Commission Will Not UseOffice of the Director of National Intelligence Committed to UseSocial Security Administration Further Evaluation RequiredGeospatial Line of Business Will Not UseGrants Management Line of Business Further Evaluation RequiredFinancial Management Line of Business Committed to UseHuman Resources Line of Business Committed to Use

W


NIEM’s Newest Domains

NEWEST DOMAINS

NIEM Government Resource

Management Domain

NIEM Health Domain

NIEM Human Services Domain

DOMAINS IN PLANNING

NIEM Agriculture

NIEM Education

NIEM Transportation

W


National Information Exchange Model (NIEM)WCentralize - Joint DOJ / DHS / HHS program

1 Created a centralized organization to promote standardization of information exchange for cross jurisdictional information sharing.

NIEM’s governing structure is comprised of Federal, State, Local, Tribal and private organizations. NIEM is managed at an executive level by the Department of Homeland Security (DHS), Department of Justice (DOJ), and Department of Health and Human Services (HHS)


NIEM is still improving…

• Collections of complex XML Schema• Verbose components• Embedded context in names• Currently facing significant scaling challenges

• Inconsistencies; too much manual management; slow lifecycles• Dictionary technology incubating• Enhanced code lists mechanism incubating• UML profile is evolving initiative with OMG

• Attempt to marry modelling techniques and XSD Schema syntax• Policy and Security mechanisms incubating• Need to embrace enabling tools for rapid expansion of domains

and community collaboration

W


National Information Exchange Model (NIEM)WTools for enabling interoperability 3

Provides the tools for enabling interoperability at the data layer within and across systems supporting information sharing, while preserving investments in current technology and optimizing new technology development.

COMPLEXITYmultiple

disconnected components + closed coded


INFORMATION EXCHANGE ANATOMY

• Exchange structures and schema• NIEM domain schema• NIEM IEPD• NIEM enterprise dictionaries (aka EIEM)

N


National Information Exchange Model (NIEM)NRepeatable, Reusable Methodology(Exchange Specification Lifecycle)

2

• Design• Develop• Deploy• Document• Dictionaries• Discovery• Differentiate• Diagnose

IEPD - Information Exchange Package Documentation


NIEM IEPD Reports

DictionariesDiscovery

NIEM IEPD / Exchange Delivery Lifecycle

Diagnose

Differentiate

Design

Develop

Validated

Templates /

Schema

XSD Schema

XML Samples

XMI / UML Models

Production

Results

Requirements

Updates

Documentation

Drag and Drop Visual

Designer

DocumentDeploy

Exchange

Templates 1

2

3

4

5

Required IEPD artifacts

N


MAKING IT REAL

• Rapid XML exchange development• Not just transactions – web services • Open-XDX – the future for Open Data APIs• Real reuse – Collaborative Component Dictionaries

M


CAM Toolkit

• Minimal learning curve for practitioners• Provide technology neutral methods, tools and techniques• Leverage visual metaphors – WYSIWYG• Business Rule Validation• Conformance Test Suites• SQL data mapping / XML generation (code-free methods)

• Creates technical artifacts needed for a NIEM IEPD• Deliver the NIEM domain and core component sets in format that

can be quickly adapted and reused

Slide 14

M

SIMPLICITYintegrated

components + visual metaphors +

open source


15

IEPD Delivery Tasks / Tools Matrix

CAM CAMVOpen-XDX

(OPX)Exchange Schema Development X

Canonical Model Development / Generation X

Exchange Schema Generation X

NIEM Compliance Checking / Reporting X

WSDL / JAXB Binding Generation X

Operation Message Test Case Generation X

Production Services Message Generation X

SQL Schema Mapping X X

NIEM IEPD Artifact Generation X

- Cross-reference spreadsheet X

- UML model X

- Business Rules Report X

- XSD schema package X

Conformance Test Suite X

Run time XML instance validation X

In order to be NIEM-conformant, the IEPD must adhere to:

1. NIEM Conformance Document

2. NIEM Naming and Design Rules (NDR) v1.3

3. NIEM Model Package Description (MPD) Specification v1.0

M


CAM Runtime Validation Framework

CAMVXML instance

Template (compiled)

Database Lookup

(optional)

Results XML

Java Handler Errors and Warnings

Structure

Rules

Code Lists

SQL Query

M- Data Exchanges

Information Exchange


CAM Open-XDX Deployment

Open-XDXSQL

Template (compiled)

Database Lookup

Diagnostics and Metrics

XML Instance

Structure

Rules

Code Lists

SQL Query

M

SQL Mapping

System

- Data Exchanges

http://www.youtube.com/watch?v=oVXtJIZVvRA

http://www.youtube.com/watch?v=oVXtJIZVvRA


Integration Deployment ViewOpen XDX / CAMV architecture

• Visual Editor

• SQL Browser

• Dictionaries

• Drag and Drop

• Generate Data

• Validate Data

• Send Data

• Open XDX

• Web Services

• FMW / BPM

Design Test Deploy

DB

Web

Open XDX

CAMV

CAM Editor

Open XDX

• Device

• Browser

• Server

Data Delivery

SQL

XML

XML

SQL

FMW

M

CAMV


SUMMARY

• Project Overview • Resources

S


CAMeditor.ORG Project Statistics

‹#›

SNAPSHOT OF PROJECT

ACTIVITIES

50,000 CAMeditor.org page

visits in one year

140 countries have downloaded tools; 27% of visitors are

from U.S.;600+ downloads

weekly

1000+ video training minutes viewed

monthly

6 languages now available

S


Links and References

DOWNLOADS - http://cameditor.org

NIEM MATERIALS -Oracle NIEM website

http://www.oracle.com/goto/niem Oracle XMLOrb blog site

http://blogs.oracle.com/xmlorb Online NIEM tutorials

http://www.niemtrainingvideos.org

Slide 21

S

http://www.oracle.com/goto/niem

http://blogs.oracle.com/xmlorb

http://www.youtube.com/user/TheCAMeditor


Formal NIEM IEPD Packaging Details

IEPD Artefact Description

Exchange Files

Subset Schema (SSGT) Subset of the full NIEM schema—a compressed directory of schemas to distinguish from other schema sets.

Wantlist User requirements -distinguishes user-required data components from components they depend on for conformance. Generated by and up-loaded to the Schema Subset Generation Tool (SSGT). This is an open specification and the SSGT is not required to create a wantlist, though it is easier.

Exchange Schema Base document schema that defines the XML root element and is generally named after the IEPD itself. Also known as the document schema, reference schema, or root schema.

Constraint Schema Constraints for separate constraint validation path—a compressed directory of schemas to distinguish from other schema sets.

Extension Schema Specification for extended components—separate local name-spaces of components not contained in NIEM.

Sample XML Instance Example instance(s) – may reference optional stylesheet.

Stylesheet (generic) Example stylesheet for display of instance(s).

Documentation

Master Documentation The Master Document is the main document for which all of the context and details around the exchange are explained. This document includes, the overview, as well as details surrounding the exchange, business drivers and requirements

Exchange model XMI Exchange model in standard open format (xmi, vsd, zargo) and standard open graphic (jpg, pdf, etc.) preferably a Unified Modeling Language (UML) model.

Business Rules Business rules in one of the following formats: (1) plain or structured English, (2) written into master documentation, (3) Schematron or other formal business rule language, or (4) generated by a development tool.

Mapping to NIEM Mapping of domain components, tagged with constraints (i.e., cardinality, etc.) to NIEM components ; preferably the Component Mapping Tool (CMT).

Extended Components Components created because they were not in NIEM—may be part of mapping spreadsheet and include structure and definitions of new components. Prefer CMT.

Change log Record of cumulative changes from previous IEPD versions. The initial IEPD simple records its creation date.

Catalog

Catalog XML file A machine-readable list of artifacts in the IEPD in an open, portable and browser-displayable format (simple manual edit).

Metadata XML file All metadata of owner and domain to be registered with the IEPD (simple manual edit).

Generated using CAM

Never Used

Word Document

Manual Entry

S


CAM Toolkit CapabilitiesS