NCOIC Geospatial Interoperability Task Team Presentation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

NCOIC Geospatial Interoperability Task Team Presentation Dr. Brand Niemann Director and Senior Enterprise Architect Data Scientist Semantic Community http://semanticommunity.info/ AOL Government Blogger http://gov.aol.com/bloggers/brand-niemann/ January 20, 2012 1

Recent History December 15, 2011: Kickoff Meeting (Slides, Minutes-in process) January 6 th, 2012: Discussion of First Steps and Architecture Required for Cycle 1 of the Demonstration (Slides and Minutes) January 13 th, 2012: OV-1 and Central node Architecture Development (Discussion, Minutes) January 20 th, 2012: GITT Meeting 2

Kickoff Meeting NGA Expectations from Todd Myers, NGA Technical Advisor, NSG Expeditionary Architecture, Cloud Elements for the Global Enterprise See NEA-Cloud-for AWS-Cloud-Summit-Todd-Myers.pdf NGA is open to ideas regarding the final tactical mile and operator platforms (think iPad or Android) NATOs interest and role (see next slides) New NCOIC business model: Members working together to develop a voice-of-industry position NCOIC has established a staff member as the program manager to ensure neutrality 3

NATO Crisis Support Elements Establish the cloud quickly upon notification of need for crisis support. Establish account access and password instructions for NATO to pass to geospatial coordinating/participating nations (those who will be providing information to NATO, and possibly data and products in support of the crisis response). Distribute instructions to the participants for access, identification validation, upload of data, catalog search, retrieval, download, accounting, replacement of outdated data (version control is key). Demonstrate flexibility in cataloging, as the geo data is almost never entirely available at the beginning of an op, but will be added to and updated throughout. Data from the nations often needs to be incorporated into a standard data set, in specific formats, to enable its use by C2 systems. Consideration should be given to simple users (who need to download completed products for use) and super users who need to manipulate large data sets to make them ready for use. Assumptions: Cloud manager can react to the start of a crisis and be up and running with NATO- designated data (if available) in a matter of a few days. My Note: In a matter of minutes with Amazon AWS Cloud Services! 4

NATO Crisis Support Elements (continued) Notifications from the cloud. Consider how the users will be informed that there is new data available, and what it is. (Is there a capability to push the data, or is it entirely pull?) To get buy-in from NATO nations, which want to ensure their data will be protected, the cloud should demonstrate security of the data, available only to a validated list of users (visible to the contributing nations and NATO command structure). In a multinational scenario, make sure the data source is identified, with POC information, so that NATO and/or the nations can seek additional release from the source provider, if necessary. An understanding of security and accreditation protocols would be helpful. NATO systems by and large are not accredited for ftp or installation of web client services that enable access to some Google Earth visualization tools, for example. 5

NATO Crisis Support Elements (continued) Test design should take into consideration not just OGC standards, but NATO STANAGs (unclassified and available from NGA/OCIO-CE) that apply to geospatial information. (Although the DLA Geospatial Catalog is what NGA provides to NATO to show our national production, OCIO-CE should have the final word on standards used for cataloging. Theyre working on a NATO Geospatial Information Framework (NGIF) standard that mirrors (95%) the US geo standard. It would be a good idea for E to also seek support from SLM, which works technical standards for MGCP and has experience with data exchange via a central server.) Bandwidth restriction testing. A challenge for many nations, and the primary reason we still rely on the US postal service to deliver data bricks to NGA reps stationed in the NATO footprint. My Note: Need Amazon AWS Provisioning of Thin Client Apps 6

Response Scenario Timeline Day 1: NATO HQ notifies SHAPE of impending crisis support Day 2: SHAPE evaluates its geospatial holdings, and requests support from the nations to identify geospatial data available over the crisis area and provide to the lead coordinating nation for consolidation and development of availability catalog for NATO use. Day 3 (and throughout): Nations begin to upload information on geospatial data availability. The nations producing the data will determine to whom the data may be released, and will inform the lead nation. Day 4-7: Lead nation will provide a list of recommended data and products to NATO to designate for use in support of the crisis. List to be published to cloud. Day 5 (and throughout): Nations will upload data and products to cloud, and access data/products for their use. Geospatial Support Group (usually a nation) will manipulate data to ensure proper formats are available for C2. 7

Additional Items The use of a Complex Humanitarian Disaster (CHD) scenario like the Haiti earthquake that requires Network Enabled Emergency Response (NEER) capabilities* Specific datasets/data types needed Ability to share data across platforms Examples of why this is important from the Haiti experience NGA data sets from SOUTHCOM Vanessa Jones, SOUTHCOM NGA TX My Note: Trying to contact her http://www.nga.gov/gemini/credits2.htm http://www.nga.gov/gemini/credits2.htm 8 * See My Concepts for a Pilot Slide

Schedule Three Cycles Roughly as described in the proposal: Cycle 1: Central node and associated capabilities with at least one end node to demonstrate capabilities of the central node* 6-7 months Approximately 1/3 of the effort and funding Cycle 2: End nodes with demonstrated geospatial capabilities to support the Use Case 7-8 months Overlaps with Cycle 1 Start date dependent on full funding and results of Cycle 1 planning Approximately 1/3 to 1/2 the effort and funding depending on member proposals Cycle 3: End nodes demonstrating stretch capabilities Start date dependent on the preliminary results from Cycles 1 & 2 TBD depending on remaining funding 9 * See My Concepts for a Pilot Slide

Key Points from the Kickoff Change in emphasis to Infrastructure Independent Platform-as-a- Service (PaaS)* Shift away from management of the infrastructure Move to developing capabilities on multiple nodes and making them available to the cloud Support for challenged nodes NGA is focused on:* Geospatial capabilities on the platform Content management Exposing APIs/Services for discovery and use by cloud participants Using linked data to provide interoperability at the semantic layer Starting small and working toward the bigger items Need cloud security for the demonstration but it is not the focus 10 * See My Concepts for a Pilot Slide

Summary of Project Tasks Three basic tasks: Develop a representation of the NEA Cloud Framework (NCF)* Identify and determine how to use appropriate data sets* Build online geospatial services* Need to determine whether we use a single standardized platform across all nodes or allow multiple platforms across multiple nodes. (the NCF/Central Node should allow both!)* Prioritized capabilities To the glass via a design pattern that allows multiple players to contribute* Framework to make this happen* Access via a web browser* 11 * See My Concepts for a Pilot Slide

Open Actions Check on availability of Haiti data for the use cases (NGA/NJVC)* Fully define the data sets that will be used (GITT)* Fully define the use cases (GITT)* Look at the NIST format for use cases to capture ours Include data location and availability as part of this Look into getting a non-COI statement from NGA to put into the member agreements with NCOIC (NCOIC) Define the image file size (notional representative values) (GITT)* Define notional meta-data for the demo (GITT)* Update the requirements for each cycle of the demonstration (GITT) Provide member agreement document to participants (NCOIC) 12 * See My Concepts for a Pilot Slide

My Concepts for a Pilot Basic Principles: Provision instead of Procure Use Amazon Cloud for MindTouch (Worlds Most Respected Social Knowledgebase) and Spotfire (Fastest to Actionable Insight, Visability into the Unknown, Self Service Discovery, and Universal Adaptability) Linked Data on Mobile Devices for the First Responders Use Linked Open Data Dynamic Case Management for Business Agility Model and Portal in Be Informed 4 (enables organizations to realize knowledge intensive administrative processes where complex decisions have to be made on a regular basis) Identify Community Efforts for Best Content: Wikipedia Page for 2010 Haiti Earthquake Harvard GIS Data Portal for 2010 Haiti Earthquake Etc. 13

My Concepts for a Pilot We Ask and Answer the Right Questions to Develop the Use Cases: A Disaster Occurs Somewhere in the World: Do we already have information provisioned for it? (e.g. CIA World Fact Book) Do we already have a pattern that we can use for responding to it? (e.g. Wikipedia on 2010 Haiti Earthquake) How can we get data for it and provision it quickly? (e.g. Harvard Haiti Earthquake Data Portal) Etc. 14

Pilot for Today CIA World Fact Book as Linked Open Data My Earlier Pilot on the Quint Business Process Pattern Metamodel From Wikipedia on 2010 Haiti Earthquake New to Get Ready to Use Be Informed 4 Inventory and Use of Harvard Haiti Earthquake Data Portal New to Demo Use of Spotfire for Delivering a Collaborative App To the Glass on a Mobile Device Etc. 15

CIA World Fact Book 16 https://www.cia.gov/library/publications/the-world-factbook/index.html

Best Content to a Knowledgebase (MindTouch) 17 http://semanticommunity.info/CIA_World_Factbook The Entire Fact Book as Linked Open Data: About (4) References (6) Appendices (7) FAQs (1) Country Profiles (277) Well-defined URLs to subparts of the document and figure and tables.

Knowledgebase to Spreadsheet (Excel) 18 http://semanticommunity.info/@api/deki/files/15989/=Quint.xlsx Regional Maps Country Profiles Below

Excel to Dashboard (Spotfire) 19 Web Player See the Data Sort/Facet Search the Data Download the Data Share the Data (iPad) Chat About the Data (Tibbr) Three Tabs for CIA

Spotfire Data Federation 20 http://semanticommunity.info/Build_DoD_in_the_Cloud/Enterprise_Information_Web_ for_Semantic_Interoperability_at_DoD/Spotfire_Data_Federation http://ondemand.spotfire.com/public/library.aspx?folder=Users/FAMIEVL-91915/public Search Analytic Apps in the Cloud: About 150

Spotfire Inverts your Bathtub, automates and dramatically reduces time to action Data in motion Zero Install Web Player In-Memory Processing Professional Administration & Integration Spotfire Server Software Relational Databases SAP BI SAP BW HR Siebel Oracle eBusiness *.* *.mdb etc *.csv *.txt etc *.xml, custom sources Web Services PowerPoint Excel Word PDF HTML Images (eg. gif, jpg, png, bmp) Professional Enterprise CollectionAnalysisActionable Activity levels without Spotfire Activity levels with Spotfire FLOW Time to complete task Activity Levels FL0W

Spotfire The source of the previous diagram is Jim Hawley, Director of Government Programs Spotfire, TIBCO Software, Inc. NGA has collected excellent databases in various database packages but needs an easy to use analytical tool like Spotfire to work with them. Spotfire offers dimension-free data exploration, data mashups, predictive and event driven, contextual collaboration and enterprise class technology. Todd Myers mentioned in the Kickoff meeting that Spotfire was a good tool for this project. 22

TIBCO Software Cloud Platforms Business Events: Complex Event Processing Enterprise Service Bus Business Activity Monitoring iProcess Suite (Dynamic) http://media.tibco.com/flash/bpm-plus/index.html http://media.tibco.com/flash/bpm-plus/index.html Silver Spotfire (I am using this for the pilot) Interactive information visualization and analytic solutions https://silverspotfire.tibco.com/us/home Collaboration Tibbr http://www.tibbr.com/ 23 Business Events: http://media.tibco.com/flash/cep/business-events/index.htmlhttp://media.tibco.com/flash/cep/business-events/index.html

Wikipedia on 2010 Haiti Earthquake 24 http://en.wikipedia.org/wiki/2010_Haiti_earthquake

Best Content to a Knowledgebase (MindTouch) 25 http://semanticommunity.info/A_Quint-Cross_Information_Sharing_and_Integration/2010_Haiti_Earthquake_Metamodel

Knowledgebase to Spreadsheet (Excel) 26 http://semanticommunity.info/@api/deki/files/16940/=Haiti.xlsx

Be Informed 4 Training 27 http://semanticommunity.info/AOL_Government/Be_Informed_4_-_They_really_got_it

Be Informed 4 Be Informed 4: Has Four Metamodels and it usually takes all four for a complete application as follows: Case Management To performing activities towards a goal that usually have pre and post conditions, etc. Products and Decisions: To show the logic of making a decision with conditions that reference data and calculations and logic operations Interaction: To define contents of a role-based portal, or legacy system interfaces Registration: To show data objects and relationships Be Informed 4: Has Profiling to configure interfaces to knowledge services, systems, infrastructure and devices 28

Be Informed 4 Training 29 http://semanticommunity.info/AOL_Government/Be_Informed_4_-_They_really_got_it#Fig._1._Summary_of_the_Meta_Model_for_capturing_Business_Processes

Be Informed 4 Training 30 PC Desktop Studio

Be Informed 4 Training 31 http://semanticommunity.info/Be_Informed_4

Be Informed 4 Community Services Mills Davis, Managing Director of Project 10x and US Representative for Be Informed (Netherlands): Be Informed 4 is a major achievement in agile development for business and technology people that does not require conventional software development Be Informed 4 provides the Model = Design + Application + Documentation, and all of the them are Semantic Services. Be Informed 4 is a advanced software platform for both business and technology people to build dynamic case management applications that provides extensive training and services (specifically for this work): A $50K pilot with training workshop for Cycle 1 with hosted cloud portal. A $100K for Cycles 2 and 3 with hosted cloud portal. 32

Harvard Haiti Earthquake Data Portal 33 http://cegrp.cga.harvard.edu/haiti/

Best Content to a Knowledgebase (MindTouch) 34 http://semanticommunity.info/A_Quint-Cross_Information_Sharing_and_Integration/2010_Haiti_Earthquake_Metamodel/Harvard_Haiti_Earthquake_Data_Portal

Knowledgebase to Spreadsheet (Excel) 35 http://semanticommunity.info/@api/deki/files/16940/=Haiti.xlsx

Excel to Dashboard (Spotfire) 36 PC Desktop Spotfire

Shapefile to Dashboard (Spotfire) 37 Web Player

Raster to Dashboard (Spotfire) 38 Web Player Note: This can be annotated with data points as a Background Map Image in Spotfire.

Image to Dashboard (Spotfire) 39 Note: This can be annotated with data points as a Background Map Image in Spotfire. Web Player

Some Next Steps Get Feedback from the GITT Team and NGA on this Pilot for Cycle 1 Decide if want to do Be Informed Metamodel Pilot and Community Support Decide if want to use MindTouch and Spotfire for Cycle 1 Pilot Decide on additional Haiti Earthquake content and data for the Cycle 1 Use Case Develop a Broader Context for Disasters See Next Slides for Work in Process 40

Disasters Knowledgebase 41 http://semanticommunity.info/AOL_Government/2011_Natural_Disasters_Costliest_on_Record

World Map 42

Percentage Distribution 43

Percentage Distribution Ordered by Content 44

Number of Events With Trend for 1980-2011 45

Overall and Insured Losses with Trend for 1980-2011 46

World Map (without events labeled) 47

2009 48

2009 49

2008 50

2002 51

2002 52

2001 53

2000 54

Documents

NCOIC Geospatial Interoperability Task Team Presentation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community