GWG Metadata Focus Group (GWG MFG) Norman C. Andersen Chair, MFG NGA/NCGIS Inaugural Meeting 3-4 August 05 Chantilly, VA 2 Agenda Welcome NSG & IC GWG and GWG Focus Groups GWG Metadata Focus Group Purpose / Scope / Goals Metadata Harmonization Activities Development Process / Drivers / Crosswalks / Data Dictionaries / Metadata Sets Producers and Contributors Descriptions / Functions Review and Approve MFG Charter Topics for Discussion Actions / Key Dates Summary / Way Forward NSG & IC 4 National System for Geospatial Intelligence (NSG) The NSG is the integration of technology, policies, capabilities, and doctrine necessary to conduct geospatial intelligence in a multi-intelligence environment The NSG includes the DoD and non-DoD components of the Intelligence Community (IC), including, where appropriate, coalition and Federal civil agency partners 5 National System for Geospatial Intelligence (NSG) NSG Doctrine, Policies, Standards, and Guidance 6 Intelligence Community (IC) The Intelligence Community (IC) is comprised of DoD and non-DoD intelligence elements in the U.S. The IC Metadata Working Group (IC MWG) is the U.S. IC's sanctioned forum for developing metadata policies for use within the entire IC XML, DTD's, schemas, and related metadata efforts are central to the IC MWGs focus within the IC Metadata-relevant IC standards: IC Metadata for Core Metadata (IC Core) IC Metadata Standard for Information Security Markings (IC ISM) IC Metadata Standard for Publications (IC MSP) 7 Intelligence Community (IC) GEOINT Standards Working Group (GWG) 9 The GWG Inaugurated Jan 05 Mission Populating the DoD IT Standards Registry (DISR) with GEOINT Standards Community forum for evolving GEOINT standards and vetting issues Goals Advance GEOINT interoperability across the NSG by mandating relevant standards using the DISR Advocate other standards relevant to the NSG 10 DISR Replaces the Joint Technical Architecture (JTA) New process that program managers are directed to use to build Technical Views (TVs) Mandates minimum set of IT standards and guidelines for the acquisition of all DoD systems that produce, use or exchange information Defense Information Systems Agency (DISA) is the executive agent for the DISR 11 GWG Core Members NGA CIA NRO NSA Army Navy Air Force Marine Corps ODNI OSD (NII or AT&L) SOCOM Joint Staff (J2) DHS DISA DIA DLA DARPA DTRA FGDC 12 GWG Associate Members American National Standards Institute (ANSI) International Organization for Standardization (ISO) / Chair, TC 211 Open Geospatial Consortium (OGC) US Geospatial Intelligence Foundation (USGIF) Digital Geographic Information Working Group (DGIWG) NATO Air Group IV ABCA (United Kingdom, Canada, Australia) 13 GWG Benefits Eliminate duplicative standards investments that deliver the same or similar capabilities Bring subject matter experts together within the DoD and IC to fully address GEOINT standards matters Enhance our ability to manage and share GEOINT data among disparate groups 14 GWG Focus Groups & Chairs 1.National Imagery Transmission Format Standard (NITFS) Technical Board (NTB), Chair Steve Kerr 2.Motion Imagery Standards Board (MISB), Chair John Zabitchuck 3.Community Sensor Model Working Group, Coordinator Neil Sunderland 4.GEOINT Reporting, Chair Dave Irvin 5.Geographic Portrayal, Chair Dan Gleason 6.Application Schemas for Feature Encoding, Chair Cliff Daniels 7.Metadata, Chair Norm Andersen 8.Information Transfer and Service Architecture, Co-Chairs Dr. Charles Roswell and Glenn Guempel GWG Focus Groups NITFS Transmission Board (NTB) 17 NITFS Technical Board The technical focal point for still imagery, and imagery- related standardization activities within the GEOINT community Initially established in the early 1990s by the Imagery Standards Management Committee (ISMC) Now serving as a technical board within the GWGs Imagery Focus Group 18 Description The mission of the NTB is to facilitate the: Development, Selection, Adoption, Profiling, Application, Implementation, and Testing of standards essential to establishing interoperability and quality for still imagery, associated metadata, and other related aspects within the National System for Geospatial-Intelligence (NSG) 19 Participants Participation in the NTB is open to: The Department of Defense (DOD) and Other Intelligence Community (IC) Organizations, Federal Agencies, Civil Agencies, Coalition Partners, and Commercial Organizations that standardize, produce or use geospatial intelligence imagery data 20 Standardization Topics Still imagery and gridded data Imagery and gridded data formats Imagery and gridded data compression Graphical, textual, and other means to annotate imagery and imagery products Imagery-related support data and metadata Imagery-derived data and metadata, to include foundation data Image Quality Other topics as designated by the GWG 21 Standards Organizations American National Standards Institute (ANSI) International Committee for Information Technology Standards (INCITS) H3 Computer Graphics and Image Processing L1 Geographic Information Systems (GIS) L3 Coding of Audio, Picture, Multimedia, and Hypermedia Information Federal Geographic Data Committee (FGDC) Digital Geographic Information Working Group (DIGEST) NATO Air Force Armaments Group Air Group IV (AGIV) Reconnaissance and Surveillance ISR STANAG Custodial / Technical Support Teams International Organization for Standardization (ISO) ISO/IEC JTC 1/SC 24, Computer Graphics and Image Processing ISO/IEC JTC 1/SC 29, Coding of Audio, Picture, Multimedia, and Hypermedia Information ISO TC211, Geographic Information / Geomatics Open Geospatial Consortium (OGC) American Society of Photogrammetry and Remote Sensing (ASPRS) 22 Examples of Standards Mil-Std-2500C NITF Version 2.1 Mil-Std-2301A Computer Graphics Metafile Mil-Std JPEG Image Compression Mil-Std A JPEG Image Compression Mil-Std Vector Quantization Decompression STDI-0001 National Support Data Extensions (SDEs) STDI-0002Compendium of TREs STDI-0004FDDRD STDI-0005Implementation Practices of the NITFS (IPON) STDI-0006NITF 2.1 Commercial Dataset Requirements Document (NCDRD) N0105/98NITFS Test Program Plan N0106/98BWC Standards & Guidelines NSG-STD NGA NITF 2.0 Dataset Definition Document (NNDDD) NSG-STD NGA Commercial Data Definition Document (NCDDD) 23 Examples of Standards (cont) STANAG 4545NATO Secondary Imagery Format (NSIF) STANAG 4559NATO Secondary Imagery Library Interface (NSILI) STANAG 4607Ground Moving Target Interface (GMTI) STANAG 7023Primary Image Format STANAG 7194Image Quality Rating Scale STANAG 7074Digital Geographic Information Exchange Standard (DIGEST) DGIWG ProfileISO/TC 211-based Standards Profile ISO/IEC Basic Image Interchange Format (BIIF) ISO/IEC JPEG (DCT lossy & DPCM lossless) ISO/IEC JPEG 2000 Part 1 NSIF01.00NSIF Profile of BIIF BPJ2K01.00BIIF Profile for JPEG 2000 BPCGM01.00BIIF Profile for CGM 24 Program of Work Format Working Group (FWG) Replacement Sensor Model (RSM) The TRE Dilemma Naming conventions Beyond NITF What Next Bandwidth Compression WG (BWCWG) JPEG 2000 Interactive navigation of imagery & metadata over networks Metadata Profile WG (MPWG) Universal Phase History Data (UPHD) Tools Metadata for common products 25 How to Participate Contact the NTB Chairman:Self-register for the NTBreflector list. Instructions at: Participate in NTB working meetings (typically three per year) plus electronic media interchange Met July 2005 in Colorado Next meeting, first week of Dec05, location TBD Motion Imagery Standatrds Board (MISB) 27 Description The MISB provides a technical forum for establishing motion imagery interoperability standards across the DoD and IC under the auspices of the NCGIS. The MISB also provides technical input to the ICSIS, IC/NSG and DoD Joint Technical Architecture (JTA) (now the DISR), and leadership in motion imagery standards for NATO Air Group IV. The main deliverable of the MISB is the Motion Imagery Standards Profile (MISP), which is typically updated every quarter MISB Web Site: 28 Description The MISB provides not just standards for motion imagery, but advanced testing and implementation assistance, via standard practices and engineering documents, Managing the glass to glass sensor to shooter aspects of motion imagery MISB Interoperability Lab Advanced Motion Imagery Testing Facility Open to government and vendor community Capability for advanced quantitative and limited qualitative testing Advanced Authoring Format (AAF) Testbed Surrogate Community Motion Imagery Library (CMIL) Holding Gold standard clips of motion imagery Accessible via Internet VPN access 29 Participation and Meetings 300+ members Typically ~ 50 meeting participants (main session & working groups) Five Working Groups Advanced Motion Imagery Working Group Advanced Compression Working Group Interoperability Working Group Metadata Working Group Infrared Working Group Meet 2 4 times per year Ad Hoc Working Groups meet as required 30 Types of Standards Video Compression Encoding/Decoding MPEG-2 H.264 Other, i.e., JPEG2000 File Format MPEG-2 Transport Stream AAF/MXF Advanced File Format Prototyping Metadata KLV Metadata Tagging/Registration MISB acts as community conduit for KLV element data dictionary registration to the Society for Motion Picture and Television Engineering (SMPTE) Infrared Standards Cutting edge, leading government and industry Significant changes already being made to SMPTE standards Community Sensor Model Working Group (CSMWG) 32 Community Sensor Model Working Group BACKGROUND: Working Group currently exists as an NGA and Services collaborative forum Currently maintains Technical Requirements Document and API under configuration control Outgrowth of Air Force and NGA requirement to develop plug-and-play sensor models Identified need for a community standard 33 Community Sensor Model Working Group FUNCTION Working Group to function as : Subject Matter Experts and advisory group to the NCGIS GWG Standing Focus Group 34 Sensor Models are a critical prerequisite for the entire range of current And future geopositioning products, services and applications required By the DoD. Community Sensor Model Working Group PURPOSE Collaborative environment to support a community approach for the development, verification, validation, maintenance and configuration management of sensor models 35 Community Sensor Model Working Group MISSION Ensure all sensor models identified and designated to support DoD and IC geopositioning services, production, and applications are based upon and compliant with open, consensus-based community standards/specifications Specifications maintained within Technical Requirements Document and will be posted in the DISR 36 Community Sensor Model Working Group Roles and Responsibilities Roles and responsibilities of members set forth within a Memorandum of Agreement (MOA) between NGA and member organizations and WG Charter Maintenance of CSMS documents TRD, API, Test Procedures Validation of CSMS plug-in sensor models Subject Matter Experts Oversight of Change Control Board 37 Community Sensor Model Working Group The Standard Community Sensor Model Standard (CSMS) is an emerging Standard DoD IT Standards Registry (DISR) Air Force has nominated CSMS for insertion into DISR Vote for insertion scheduled for Oct 05 Open Geospatial Consortium (OGC) Geospatial Intelligence Standards Working Group (GWG) is coordinating with the OGC to commercialize CSMS CSMS is being used today by: Precision Targeting Workstation (PTW), Joint Targeting Workstation (JTW), and RainStorm NGA Libraries GRIDLOCK 38 Community Sensor Model Working Group Activities CSM Memorandum of Agreement (MOA) Army and Navy concur, AF expected to do the same, awaiting USMC and SOCOM response WG and CCB meeting WPAFB, OH Aug 05 Backwards compatibility for CSM 2.0 Working solutions and recommendations GEOINT Reporting Focus Group (RFG) 40 GEOINT Reporting Focus Group Advise GWG on standardization issues, candidate DISR standards for reporting, and required implementation profiles Serve as a community forum for issues relating to reporting based on exploitation of GEOINT Serve as the GEOINT community of interest for: The USMTF CCB Other messaging bodies as appropriate 41 Reporting Focus Group Description The mission of the RFG is to serve as a geospatial intelligence (GEOINT) community forum to identify requirements for intelligence reporting based on GEOINT, identify and resolve standardization and interoperability issues relating said reporting, and as a conduit for information and coordination relating to GEOINT reporting activities within the community 42 Potential Members Core and associate GWG members NGA Analysis and Production Combatant Commands Services DoD Agencies Joint Staff Other Intelligence Community members 43 GEOINT Reporting Potential Standards MIL-STD-6040, U.S. Message Text Formatting Program (USMTF): Imagery Interpretation Report (IIR) (C100) Graphical Report - Overlay Message (GRAPHREP) (C203) Reconnaissance Exploitation Report (RECCEXREP) (C101) Sensor Tactical Contact Report (SENSOREP) (C133) (TBD) Tactical Measurement And Signature Intelligence Report (TACMASINTREP) (C140) (TBD) XML-MTF (TBD) Other potential standards: MIL-STD-6016C, Tactical Data Link Variable Message Format (VMF) NGA and CMO developed standards for web presentation 44 Issues Types of issues this Focus Group might address: Harmonization of EARS with USMTF and other community standards Integration of Advanced Geospatial Intelligence (AGI) reporting Migration of text-based reporting to XML: XML-MTF RSS Standards for web presentation of GEOINT And Reporting for the 21 st century: How do we do business today? How do we want to do business in the future? 45 Next Steps and Logistics Whats next Reporting Focus Group August in this room Develop charter Administering membership Identify all stakeholder contacts Build distribution list to communicate Meetings Hold in conjunction with GWG initially Work virtually as much as possible 46 How to Join GWG RFG open to interested organizations Attend RFG 4 August here Send me anat (unclassified) or at Information Transfer and Service Architecture Focus Group (ITSAFG) 48 ITSAFG ITSA is the GWG advisor on matters related to GEOINT data services that provide for Tasking, Posting, Discovery, Access, and Analysis of GEOINT data stores/information in a distributed, real-time environment Additional services required for positioning, cataloguing, change detection, and so on Special interests are emerging service architecture components and technologies 49 ITSA Activities Activities DISR Change Requests- Standards/Specifications recommended for inclusion in the DISR: Approved for current DISR cycle ISO (Approved by GWG 4/05 ) Preparing for next DISR cycle OGC Web Map Service OGC Web Feature Server OGC Filter Encoding Geography Markup Language (GML) OGC Web Coverage Service OGC Catalog Service 50 ITSA Activities Activities - Next steps Identify requirements/standards for Service: Metadata Registers Access Identify shortfalls in existing standards Eliminate Shortfalls 51 ITSA Schedule Meetings held last Thursday of month Next meeting August 30 POCs Dr. Charles Roswell Glenn Guempel Application Schemas for Feature Encoding Focus Group (ASFE FG) 53 ASFE FG GEOINT standardization relating to: data structure data exchange data storage This includes data format, feature & attribution coding schemes, exchange media, geographic feature geometry and feature attribution 54 ASFE FG GEOINT Community forum to: Adjudicate standards, dictionaries, catalogues and issues that pertain to data structure, exchange, storage required by one or more applications 55 ASFE FG Activities Met 19 July 05, jointly with Portrayal Focus Group to: Develop a DoD/IC facilities information data exchange plan for portrayal and production of MIMs Determine standards, catalogues, dictionaries being used Develop a plan to adopt a common standard, catalogue, dictionary Review standards being considered for possible DISR inclusion Schedule Next meeting: 19 Oct 2005 Portrayal Focus Group (PFG) 57 PFG Portrayal Focus Group Composed of NCGIS, representatives from Services and coalition partners Approach Develop a GEOINT portrayal registry Symbols for portrayal of GEOINT and rules for symbol assignment Based on ISO Geographic Information - Portrayal Governance process needs to be developed Based on ISO Procedures for Registration of Items of Geographic Information Integrate requirements from multiple communities such as DOD, IC, DGIWG, FGDC, International Hydrographic Organization, etc. 58 Organization Activities Activities DGWG Application Schema for Portrayal Registry under development by NCGIS GeoSym Second Edition will fix topographic symbols for US Army and other issues serve as input content to GEOINT portrayal register Metadata-specific Activities OGC developing metadata about symbols in OWS-3 Feature Portrayal Service Schedule Next meeting 19 October 2005, in conjunction with GWG DGIWG registry prototype Nov 05 GeoSym Second Edition review Oct 05, publish Sept 06 Metadata Focus Group (MFG) 60 Metadata Focus Group Advise GWG on standardization issues and candidate DISR standards for metadata Serve as a community forum for issues relating to the metadata of GEOINT data Serve as the GEOINT community of interest for metadata activity stakeholders 61 Description The mission of the MFG is to serve as a geospatial intelligence (GEOINT) community forum to identify requirements for the development of harmonized GEOINT metadata, identify and resolve standardization and interoperability issues relating to the development of geospatial intelligence information, and as a conduit for information and coordination relating to GEOINT metadata activities within the community. 62 Metadata Timetable Develop NSG roadmap for GEOINT metadata Harmonize with metadata roadmaps, already under development Ensure continuity of all roadmaps and existing charters, etc. Metadata Harmonization Activities Activity at All Levels 65 Levels of Metadata Activities International NATO Coalition Partners and Co-Producers Intelligence Community National Agency/Organizations DoD Metadata Harmonization Participants Hugh to redo next 4 slides 68 - DoD Metadata Working Group (DoD MWG) - Intelligence Community Metadata Working Group (IC MWG) - International Organization for Standardization Technical Committee 211 (Geospatial) (ISO/TC211) - ISO/International Electrotechnical Commission Joint Technical Committee 1 Sub-Committee 24 (ISO/IEC JTC1 SC24) - ISO/IEC JTC1 SC29 - Advanced Geospatial Intelligence MP Working Group (AGI MPWG) - Air Force Distributed Common Ground System Multi-Service Execution Team Metadata Working Group (DCGS MET MWG) - American National Standards Institute/International Committee for Information Technology Standards (ANSI/INCITS) - Dept Homeland Security Community of Interest Metadata Working Group (DHS COI MWG) - Digital Geospatial Information Metadata Working Group (DGIWG MWG) - MASINT IPT - Motion Imagery Standards Board Metadata Working Group (MISB MWG) - Multinational Geospatial Co-Production Group Technical Group (MGCP TG) - National Imagery Transmission Format Standard Technical Board (NTB) - NATO Air Group IV Metadata Harmonization Technical Support Team (AGIV MH TST) - NGA Engineering Architecture (EA) (GeoScout) - NGA Image Product Libraries Access Standardization Working Group (IPL ASWG) Geospatial Metadata Harmonization Activities - Central Intelligence Agency (CIA) - Defense Information Systems Agency (DISA) - Federal Geographic Data Committee (FGDC) - Geospatial Intelligence Standards Working Group (GWG) - Joint Interoperability Test Center (JITC) - National Reconnaissance Agency (NRO) - National Security Agency (NSA) - NGA Engineering Data Working Group Metadata Focus Group (EDWG MFG) - NGA Enterprise Engineering (EE) - Open Geospatial Consortium (OGC) Topic 11 (mandatory reqts) 69 - DoD Metadata Working Group (DoD MWG) - Intelligence Community Metadata Working Group (IC MWG) - International Organization for Standardization Technical Committee 211 (Geospatial) (ISO/TC211) - ISO/International Electrotechnical Commission Joint Technical Committee 1 Sub-Committee 24 (ISO/IEC JTC1 SC24) - ISO/IEC JTC1 SC Advanced Geospatial Intelligence MP Working Group (AGI MPWG) - Air Force Distributed Common Ground System Multi-Service Execution Team Metadata Working Group (DCGS MET MWG) - American National Standards Institute/International Committee for Information Technology Standards (ANSI/INCITS) - Dept Homeland Security Community of Interest Metadata Working Group (DHS COI MWG) - Digital Geospatial Information Metadata Working Group (DGIWG MWG) - MASINT IPT - Motion Imagery Standards Board Metadata Working Group (MISB MWG) - Multinational Geospatial Co-Production Group Technical Group (MGCP TG) - National Imagery Transmission Format Standard Technical Board (NTB) - NATO Air Group IV Metadata Harmonization Technical Support Team (AGIV MH TST) - NGA Engineering Architecture (EA) (GeoScout) - NGA Image Product Libraries Access Standardization Working Group (IPL ASWG) Central Intelligence Agency (CIA) - Defense Information Systems Agency (DISA) - Federal Geographic Data Committee (FGDC) - Geospatial Intelligence Standards Working Group (GWG) - Joint Interoperability Test Center (JITC) - National Reconnaissance Agency (NRO) - National Security Agency (NSA) - NGA Engineering Data Working Group Metadata Focus Group (EDWG MFG) - NGA Enterprise Engineering (EE) - Open Geospatial Consortium (OGC) Topic 11 Geospatial Metadata Harmonization Activities (mandatory reqts) Development Process 71 Producers AF DCGS MET MWG AGI MPWG AGIV MH TST ANSI/INCITS DGIWG MWG DHS COI MWG MASINT IPT MGCP TG MISB MWG NGA EA / IPL ASWG NTB Producers AF DCGS MET MWG AGI MPWG AGIV MH TST ANSI/INCITS DGIWG MWG DHS COI MWG MASINT IPT MGCP TG MISB MWG NGA EA / IPL ASWG NTB Deliverables MD Catalogs Core/Recommended MD Sets Crosswalks Data Dictionaries IC Organizational Extensions Product Specs Quality MD Standards/Profiles Schemas Deliverables MD Catalogs Core/Recommended MD Sets Crosswalks Data Dictionaries IC Organizational Extensions Product Specs Quality MD Standards/Profiles Schemas Contributors CIA DISA FGDC GWG JITC NGA/EDWG NRO NSA OGC Contributors CIA DISA FGDC GWG JITC NGA/EDWG NRO NSA OGC Drivers DoD MWG IC MWG ISO Drivers DoD MWG IC MWG ISO Geospatial Metadata Standards Development Process Sponsors develop reviewed by / shared among directed by coordinate with contribute to exert compliance upon provide input to Drivers 73 DoD MWG - Defense Discovery Metadata Specification (DDMS) Focus Group IC MWG - IC Metadata for Core Metadata (IC Core) - IC Metadata Standard for Information Security Markings (IC ISM) - IC Metadata Standard for Publications (IC MSP) ISO/TC211 - ISO Reference Model for Imagery - ISO Geospatial Metadata - ISO XML Schema Implementation of ISO ISO Extensions for Imagery and Gridded Data - ISO Sensor and Data Models for Imagery and Gridded Data ISO/IEC JTC1 SC24 - ISO/IEC Basic Image Interchange Format (BIIF) - ISO/IEC , SEDRIS-based standards ISO/IEC JTC1 SC29 - ISO/IEC 15444JPEG 2000 Geospatial Metadata Drivers Producer Activities 75 AF DCGS MET MWG - AF DCGS Block 10.2 Metadata Catalog DGIWG MWG - Metadata Standard for use within the Military Community - DGIWG Metadata Register Elements MISB MWG - Advanced Authoring Format (AAF) Profile for Aerial Surveillance and Photogrammetry Applications (ASPA) MGCP - Specification of the MGCP Cell and Sub-Region Metadata NATO AGIV MH TST - STANAG 7023 Primary Imagery - STANAG 4545 Secondary Imagery - STANAG 4607 Ground Moving Target Indicator - STANAG 4609 Digital Motion Imagery - STANAG 4633 NATO Common Emitter Reporting Format - STANAG 4559 NATO Standard Imagery Library Interface (NSILI) - Crosswalks of STANAG Metadata NGA Engineering Architecture (GeoScout) - Metadata Catalogs NGA Enterprise Engineering (Standards Group) - Metadata Crosswalks - Core/Recommended Community Metadata Element Sets NGA IPLs - Core Command SPIA Metadata Tags Geospatial Metadata Deliverables/Activities 76 Geospatial Metadata Producer Deliverables/Activities ProducerDriverFunctionActivity/Deliverable AGI MPWGSensors AF DCGS MET MWGISO 19115, Imagery, SensorsMetadata Catalog; CrosswalksANSI/INCITSISO Vector, Imagery, Sensors Standards, Profiles DHS COI MWG Vector, Imagery Core metadata sets; data dictionaries; taxonomies DGIWG MD WGISO VectorProfile; Metadata Registers MASINT IPTImagery, Sensors MISB MWGISO 19115, 19130ImageryProfilesMGCP TGISO 19115, 19139VectorProfile; Specification NTBISO 19115, Imagery Standard NATO AGIV MH TST ISO 19115, , Imagery, Sensors Crosswalks; Profiles; STANAGs NGA EA ISO 19115, , 19130, 19139; IC MD Stnd; DDMS Vector, Imagery, Sensors Crosswalks; Profile NGA EE ISO 19115, , 19130, 19139; IC MD Stnd; DDMS Vector, Imagery, Sensors Crosswalks; Core/Recommended Community Metadata Sets NGA IPL ASWGISO 19115Imagery, Sensors Crosswalks; Core Community Metadata Set Crosswalks ISO Crosswalks; Products Spec FGDC ISO , 19130 Crosswalks 78 Geospatial Metadata Crosswalks in Development ISOSTANAGMIL-STDANSINASFGDC ISO STANAG 7023 STANAG 4545 STANAG 4607 STANAG 4609 STANAG 4633 Product Spec Command ISOICDDMSGMAPDCGS (Blk 10.2) NSG Core DCGS Blk 10.2MGCPETC Master STANAGs Profile / Spec IPLs NGA/EA-DCGS NSG Core Data Dictionaries 80 All Geospatial Metadata Data Dictionaries in Development Row#Row# NameDefinitionCondition ality Source 1 resource titlename by which the cited resource is known MandatoryISO ; Dublin Core IC Core ; DDMS GMAP 2 resource reference datereference date for the cited resource MandatoryISO ; Dublin Core IC Core ; DDMS GMAP 3 resource abstractbrief narrative summary of the content of the resource(s) MandatoryISO ; Dublin Core IC Core ; DDMS GMAP 4 metadata point of contact party responsible for the metadata information MandatoryISO ; GMAP 5 metadata date stampdate that the metadata was created MandatoryISO ; GMAP 6 dataset languagelanguage(s) used within the dataset MandatoryISO ; Dublin Core IC Core ; DDMS GMAP Core Metadata Sets 82 Mandatory/Recommended Metadata Sets for the Geospatial Community Geospatial Recommended Core (RC) V (MC) I (MC) V (RC) Mandatory Core (MC) Recommended Core (RC) Geospatial Mandatory Core (MC) I (RC) S (RC) All Datasets (IC Metadata, DDMS, Dublin Core) All Geospatial Datasets (All Datasets (above) & ISO 19115) Specific Geospatial Datasets (in development) Organizational Extensions (in development) S (MC) Producers & Contributors Air Force Distributed Common Ground System Multi-Service Execution Team Metadata Working Group (AF DCGS MET MWG) 85 Topics Background What is DCGS? DCGS Objectives align with DoD netcentric goals Metadata Harmonization Efforts Lessons Learned Summary 86 U-2 Commercial National UAV F-16 System of Systems to Process, Exploit And Disseminate Multi-Intelligence information to the warfighter What is AF DCGS? Daily operations for 25 years Reachback ops for the last 10 years 400 crew positions and over 1,300 crew members worldwide Supporting the Joint Forces 24 / 7 Fixed site ground stations or deployable mobile ground stations 87 DCGS MET MWG Objectives Align with DoD Data Strategy Goals Usability Ensuring that the DCGS metadata and metadata catalog support the operational needs of the DCGS user community Information Visibility and Awareness Information Accessibility Data Quality Understandability (future Vocabulary, Taxonomy, Thesaurus, and Ontology efforts) Harmonization Ensuring that DCGS, as required, is interoperable with Service Command and Control (C2) elements Other DoD Intelligence Surveillance & Reconnaissance (ISR) enterprises Intelligence Community Coalition C2 and ISR systems Interoperability Jointness Quality Accessibility Understandability Visibility and Awareness * * * * Current Focus of the DoD data strategy efforts DoD Data Strategy Goals Source: Applying the Net-Centric Data Strategy brief at the 20 April 2005 meeting of the DoD Core Enterprise Services MD WG (CES MWG). 88 Digital Geographic Information Working Group (DGIWG) Multinational Geospatial Co-Production Group (MGCP) Intelligence Community Metadata Working Group (IC MWG) Federal Geographic Data Committee (FGDC) Open Geospatial Consortium (OGC) DoD Discovery Metadata Standard (DDMS) NATO Air Group IV (AGIV) - STANAG 7023 Primary Imagery - STANAG 4545 Secondary Imagery - STANAG 4607 Ground Moving Target Indicator - STANAG 4609 Digital Motion Imagery - STANAG 4559 NATO Standard Imagery Library Interface (NSILI) International Organization for Standardization (ISO) - ISO 19115:2003 Geospatial Metadata - ISO Extensions for Imagery and Gridded Data - ISO XML Schema Implementation of ISO 19115: ISO Sensor and Data Models for Imagery and Gridded Data EE/GeoScout Harmonization Efforts Accomplished NGA DCGS Metadata Catalog harmonization accomplished for mandatory core catalog elements NATO Discovery Metadata Specification (NDMS) draft added to the metadata harmonization crosswalk 89 Crosswalk with Standards to ensure Harmonization (M) mandatory (O) Optional [n] nesting level in ISO standard 90 References used for Metadata Crosswalk DCGS 10.2 Development materials DoD Discovery Metadata Specification (DDMS) Version 1.1, 1 July 04 Intelligence Community (IC) Standard for Core Metadata DED Version 1.0, 5 July 02NGADublin Core ISO Element Hierarchy DCGS 10.2 ElementDDMS ElementIC ElementGMAP Element [6] title (M)multiIntMetadata.titleC5.T1.Title (M)Title (M)resource titleTitle [6] date [7] CI_Date [8] date (M) Metadata catalog database entry has an effective date and an expiration date. Also, see detailed list of DCGS elements C5.T6.Date (O) / C6.T3.TemporalCover age (M) Date (M) / Coverage (M) resource reference dateDate [8] dateType - CI_DateType [6] identifier [7] MD_Identifier [8] code C5.T2.Identifier (M)Identifier (M) Identifier Geospatial Metadata Mapping Crosswalk for NGA-DCGS 91 Metadata Catalog Harmonization Updates The following entries are being proposed as updates to the metadata catalog core to prepare for catalog harmonization between DCGS, DDMS, and NGA ElementDescriptionSource reference DescriptionDDMS and IC Standard have the same element description: An account of the content of the resource. ISO element: abstract DDMS and IC Standard element: Description SubjectDDMS and IC Standard have the same element description: Subject keyword(s) that characterize the subject matter of a resource. IC Standard usage: Typically, a Subject will be expressed as keywords, key phrases or classification codes that describe a topic of the resource. Recommended best practice is to select a value from a controlled vocabulary or formal classification scheme. ISO element: keyword DDMS and IC Standard element: Subject TypeDDMS and IC have the same element description: The nature, genre, or discipline, of the content of the resource. It further recommends selection of a value from a controlled vocabulary. DDMS element: Type IC element: Type ISO element: TopicCategoryCode defined as Main themes of the dataset. LanguageISO element description: Data set language, information needed to identify the dataset. DDMS and IC Standard element description: The primary language of the intellectual content of the resource. It further recommends selection of a value from a controlled vocabulary. IC Standard usage: Language is specified using ISO or ISO language codes. DDMS element: Language IC element: Language ISO element: language 92 Metadata Harmonization Plans Harmonization efforts underway with Army and Navy: Identify data assets in the data stores that need to be shared using the metadata catalog Identify the standard that defines the format of the metadata for the data assets (ie, DoD XML Metadata Registry, etc.) Identify the discovery metadata for the data assets that should be in the metadata catalog Map the appropriate discovery metadata elements to the metadata catalog core elements Identify the appropriate discovery metadata elements for the metadata catalog content extensions Identify the classification levels of the metadata schema and the data content Develop an XML schema for the metadata catalog content extensions Identify any updates needed for the metadata catalog core Complete a metadata catalog change request form 93 Coalition Metadata Harmonization DCGS MET MWG Participation in metadata related Coalition activities ISR Data Discovery and Exchange Capabilities meetings NATO Standard Imagery Library Interface (NSILI) web services and metadata meetings NATO Consultation, Command and Control Agency (NC3A) (NC3A) metadata plans for a core for ISR metadata that is not covered by the current NSILI data structures Ensuring interoperability with crosswalks of the proposed ISR core elements to the DCGS metadata catalog core elements and DCGS content extensions in the DCGS metadata catalog. NATO Air Group IV ISR Integration Working Group (ISRI WG) Metadata Harmonization Technical Support Team (MH TST) Multi-Sensor Aerospace-ground Joint ISR Interoperability Coalition (MAJIIC) provides the venue for DCGS to achieve Coalition interoperability requirements (i.e., NATO STANAGs) 94 Lessons Learned Summary Re-purposing existing XML schemas into discovery schemas is possible but can create very complex and heavy catalog structures Recommendation: Reuse guidance is needed for the XML registry Recommendation: Develop & register a discovery catalog schema Ensuring the usability of the metadata catalog requires time and expertise Programs (eg DCGS) must bear the burden of harmonization with the standards bodies (e.g. ISO), specifications (e.g. IC, DDMS, NDMS), and other systems (e.g. NGA Geoscout) The MWG needs to be actively involved with other groups in order to make interoperability a reality! 95 Geospatial Metadata Mapping Crosswalk for NGA-DCGS Standards Mapped DCGS Enterprise Architecture (GeoScout) DDMS IC Core GMAP Dublin Core ISO TC 211 Approach ISO TC 211s standards (19115:2003, , 19130) used to map all of the above to each other Shows what the standards have in common, and where harmonization is necessary 96 Topics Background What is DCGS? DCGS Objectives align with DoD netcentric goals Metadata Harmonization Efforts Lessons Learned Summary American National Standards Institute / International Committee for Information Technology Standards (ANSI/INCITS) 98 North American Geospatial Metadata Profile ANSI-INCITS has adopted INCIT/ISO Geographic Information Metadata; ISODTS Geographic Information Metadata XML Schema implementation is a draft technical specification soon to be completed by ISO; these documents are universal in design to address global requirement Typically nations, regions, or information communities develop profiles to tailor these specifications to their needs; INCITS-L1 proposes to develop a profile based on these two standards tailored for the US market It is planned to coordinate our development with separate but like efforts in Canada and Mexico to establish a North American Profile 99 North American Metadata Profile Who is involved Representatives from INCITS/L1 (US) Representatives from SCC (Canada) Approach Objective is to profile 19115:2003 Profile will include additional codelists (in place of free text fields), constrained relationships and possible national extensions (such as security) Target Date of Initial Public Review: March 15, 2006 Digital Geospatial Information Working Group Metadata Working Group (DGIWG MWG) 101 DGIWG Digital Geospatial Information Working Group Coalition of nations developing geospatial standards for the military community Approach Profile existing geospatial standards to meet the requirements of the military community Leverage ISO TC211standards and OGC implementation specifications Standards are developed and adopted through consensus of the members 102 DGIWG Activities Activities Data Structures Technical Panel Data model and encoding standards Services Interface Technical Panel Web services for cataloguing and dynamic retrieval of features and maps Data Access Technical Panel Product specifications and compliance testing Metadata Specific Activities Schedule Meetings, deliverables, major suspense Multinational Geospatial Co- Production Group Technical Group (MGCP TG) 104 MGCP Multinational Geospatial Co-Production Program Coalition of (~23) nations producing 1x1 degree vector geospatial datasets at a scale of 1:50,000 with 25m accuracy or better Datasets are stored in the International Geospatial Warehouse (IGW) for download by contributing nations Approach Reuse existing standards to maximum extent practicable ISO TC211 ESRI Shapefiles MGCP and DGIWG have been working closely in profiling the standards needed to meet MGCP requirements 105 MGCP Activities Technical Group Activities (in conjunction with DGIWG) Metadata profile Feature catalogue definition Extraction guidance Metadata-specific Activities Vector dataset metadata specification Based on ISO 19115:2003 Metadata standard Provides minimum cataloguing elements for storage and retrieval of datasets in the IGW Feature metadata elements Schedule Metadata Specification August 2005 TG meeting, October 2005 NATO Air Group IV Metadata Harmonization Technical Support Team (AGIV MH TST) 107 NATO AGIV NATO Air Group IV Coalition of NATO nations developing tools and technical interface standards (STANAGs) to achieve interoperability among intelligence, surveillance, and reconnaissance (ISR) systems (both manned and unmanned) assigned to support NATO coalition forces Approach STANAGs in use represent four different imagery/ISR data formats each structured to support that specific type of data Maintain Custodial Support Teams (CST) and Technical Support Teams to update STANAGs with new requirements Maintain a Metadata Harmonization Technical Support Team (MH TST) to develop common ISR metadata definitions across the STANAGs 108 NATO AGIV Activities STANAGs being harmonized by the MH TST: STANAG 7023 Primary Imagery Format STANAG 4545 Secondary Imagery Format STANAG 4607 Ground Moving Target Indicator Format STANAG 4609 Digital Motion Imagery Format STANAG 4633 NATO Common Emitter Reporting Format STANAG 4559 Standard Imagery Library Interface (NSILI) Most metadata elements in each STANAG are unique, however some represent the same information but are often encoded differently MH TST currently developing series of crosswalks to identify inconsistencies in metadata element names, definitions, and value domain; to be then used to develop the common definitions and domains 109 NATO AGIV Activities Current imagery/ISR formats will not be changed in the near term to use the new definitions, however this work is aimed at new developments which will be able to incorporate the common metadata definitions without impact to legacy systems Harmonization effort will also lead to eventual update of STANAGs to contain the new metadata defintions Schedule Next MH TST meeting Nov 05 in Prague co-located with DGIWG meeting Deliverables Metadata crosswalks by Nov 05 AEDP document capturing new metadata definitions and proper usage 110 Geospatial Metadata Crosswalk for AGIV STANAGs NGA Image Product Libaries Access Standardization Working Group (IPL ASWG) 112 Producers and Authorities of Imagery Products/Services NGA/PR (IPL Management) Commands CENTCOM PACOM JFCOM SOUTHCOM EUCOM Commercial partners 113 IPL Status Imagery Product Libraries (IPLs) Multiple Imagery product libraries maintained by multiple organizations for access by users/customers to gain access to imagery and intelligence items stored in a centrally located database Issue - Multiple IPLs maintained by an organization does not allow for common access query parameters based on a common set of metadata fields Primary IPL maintained by NGA populates IPL metadata fields differently than those IPLs established by the military-support Commands (i.e., CENTCOM, PACOM, JFCOM, etc) Standard and non-standard production systems contain different sets of metadata information in multiple formats that require standardization techniques 114 IPL Status NGA and Commands Concerns: - Population methodology differences - Terminology differences - Legacy data - Production Software enhancements - Cost and resource allocations - Valuable ???? 115 Topics For Discussion Fields listed 14 fields of primary interest Unique.Access.id - *** Target ID GeoLocation or TargetGeo Keyword repetitions Producer Code Target category Code Product Short Name Security Classification Releasability Instructions - *** Target Country Code - *** Target name Product Title Sensor Name - *** Product Creation Time 116 Topics for discussion GOALS: To establish - Core set of data fields for ALL standard NGA products as well as non-standard products for inclusion into the IPLs where ever they may exist !!! Consistency between organizations Communications if/when issues arise Reporting mechanism for discussions and issue resolution 117 IPL Common Access Requirement NGA and Commands need to populate Core set of metadata fields in a standardized method for Common Access to multiple IPLs maintained at multiple locations Follow-on Actions: Several open actions for NGA, Commands, production partners, product suppliers, imagery producers, etc NOT impossible to resolve - Coordination is required Conclusion: Establish a core set of fields required for Enterprise-wide data production, storage, query, access, and dissemination. These IPL fields should be a part of that set !! 118 IPL Geospatial Metadata Joint Interoperability Test Center (JITC) XML Multi-Function Lab 120 JITC XML Multi-Function Lab Joint Interoperability Test Command (JITC) XML Multi-Function Lab Provides development and testing services for Government and commercial organizations that develop and/or use XML-based dissemination systems within the DoD and IC; intended to enhance Warfighter readiness. Provides validation and conformance testing resources available to XML- system sponsors and developers from the beginning of systems procurement / development through the systems lifecycle. Approach Provide XML validation against multiple sources Provide technical review/feedback for development teams Host repository for XML Standards Participate in harmonization efforts Perform various levels of testing: Developmental Testing (DT) Standards Conformance Testing (SCT) Operational Test and Evaluation (OT&E) Interoperability Assurance (IA) 121 XML Multi-Function Lab Capabilities Capabilities Knowledge Management (KM) XML Standards Conformance and Interoperability Testing Web Services Design using the Service Oriented Architecture (SOA) Stack (XML/SOAP/WSDL/UDDI) Distributed SCT of SOA / Net-Centric Enterprise Services (NCES) systems Apply the most advanced IT capabilities, i.e., DoD architectural frameworks, modeling, simulation, ontology development Base test development and conduct methodology on provable formal concepts, including System Entity Structure (SES) / Discrete Event ontology structuring and Automated Test Case Generation (ATC Gen) Broadcast Intelligence (BI) Data Engineering (DE) XML Standards Development Distributed Test Node JWICS / SIPRNET connectivity UHF SATCOM capability Multiple BI Tactical Data Processors (TDPs) 122 XML Multi-Function Lab Activities Participates with various Standards Groups Technical Services: DGIWG - Chair for SCT ISO TC211 - Developing 19xxx Standards W3C - Real Time XML Parser Standards Development Stood Up XML Test Capability for DoD National Imagery Transmission Format (NITF) Technical Board JPEG 2000 Standardization Simulation Interoperability Standards Organization (SISO) - Emulation Development NATO Air Group 4 Cooperative Imagery and Geospatial Standards Development NGA Standards Development and Interoperability Experiment Testing Support NATO Motion Imagery Standards (MIS) T&E Program Custodian (STANAG 4609) 123 XML Multi-Function Lab Activities Currently involved with the following groups/projects (not a comprehensive list): XML Standards Conformance testing for DoD/IC/Industry Key Interface Profile (KIP): Framework of KIPS, Family of KIPS, Appendices/KIPS Motion Imagery (MI) systems SCT with Command, Control, Communications, Computers, and Intelligence (C4I) and Intelligence, Surveillance, and Reconnaissance (ISR) systems NGA Metadata conversion to XML E-Chart analysis Geographic Information System (GIS) Metadata Engineering and conversion Request For Information (RFI) System Analysis Real time parser standards development and certification Defense Information Systems Agency (DISA) Test and Evaluation (T&E) and NCES testing development Open Geospatial Consortium (OGC) Standards Development and Interoperability Experiment Test Support NATO Standards / DGIWG ISO Standards Group collaborative work Federal Geographic Data Committee (FGDC) Insert Sharon Shin brief Review MFG Charter 127 Review MFG Charter Review GWG MFG Charter Comments to discuss Approve GWG MFG Charter Topics for Discussion 129 Topics for Discussion Common / Recommended Core Taxonomy / semantics / ontology Security marking Organization extensions Schema publication Registries Quality Feature metadata Implementation Legacy Records metadata (NGA) Compliancy Tear line metadata Country codes Domain name space handling Imagery-related activities Levels of metadata Topics for Discussion: Country codes 131 Producers and Authorities for Country Codes DGIWG OGC ISO TC211 Air Group IV NATO NGA/NCGIS FAA/ICAO DIA/CIA/CAPCO Host of others !!!! 132 Country Code Issue Multiple Authorities DoD, intelligence agencies, civilian authorities, international organizations Issue - FIPS Pub 10-4 (2-letter country codes) ISO 3166 (3-letter country codes) Activities U.S. DoD and partner agencies have FIPS-PUB 10-4 listed as mandatory for their use and implementation ICAO, ISO, OGC, etc, have ISO 3166 as an implementation requirement May require a crosswalk between the two authoritative standards Major issue Legacy DMA/NIMA/NGA data is not expandable in some cases ISO 3166 is not on the implementation schedule for U.S. (Not listed as emerging) 133 Country Code Issues/Concerns Country Code Field Identification for Common access Establishment of Core set of metadata fields Legacy data decision Crosswalk s/w package Groupings of countries (FIPS 10-4) Future design and development 134 Country Codes Common Access Requirement NGA, Commands, international organizations, intelligence agencies, NSG participants, civilian authorities, and etc need to establish a standard methodology for coding the various countries names Impacts GeoNames, Name Space, IPL, CIL, NIL, Aeronautical, Maritime, Standard and non-standard product identification, dissemination, releasability Follow-on Actions: Open actions for NGA, Commands, NSG Community Design future systems to allow for growth Topics for Discussion: Domain Name Space Handling 136 Domain Name Space Handling Requirement Communities need to share geospatial-enabled information Description Domains (communities) have different: Data Models Encodings (schema) Data Presentations Solution needed to support interoperability Requirement cuts across organizational lines 137 Solution Domain Name Space Handling Possible Solutions Single data model used by all communities (one-size fits all) Common encoding for data exchange (common language) Transformation services to allow communities to deal with data using their native encodings (heterogeneous solution) Recommended Way Forward Form a Working Party under the GWG MFG to develop a strategy for exchange of metadata within the GEOINT community Topics for Discussion: Imagery Activities and Relationships 139 Producers and Authorities for Imagery-related Activities Imagery-related Organizations - NGA/NCGIS DGIWG OGC ISO TC211 Air Group IV NATO 140 Imagery-Related Activities Imagery-related Activities: Multiple Imagery-related activities are being worked simultaneously with each other. The hope is that none are being done in a vacuum but are being communicated throughout the working groups. Imagery Work items - NTB - NITFS Technical Board NSILI NATO Secondary Imagery Library Interface (STANAG 4559) NSIF NATO Secondary Imagery Format (STANAG 4545) ISO Part 2 Geographic Information Imagery Metadata ISO Part 2 Geographic Information Imagery Reference Model ISO thru -13 JPEG 2000 Imagery Compression SC 24/TC 211 and SC 29 (Imagery Compression) subcommittees 141 Imagery-Related Activities OGC Open Geospatial Consortium Imagery- related NetCentric Discussion papers and implementation specifications GWG GEOINT Standards Working Group Imagery Focus Group (NTB, MISB, SMFG) Metadata Focus Group IPL Imagery Product Library Multiple libraries of imagery-related products and intelligence items (Core set of metadata fields) TC 211 Technical Committee Work Items 142 Imagery Topics for Discussion Inter-relationships need to be established and communicated Minutes and decision points need to be shared and understood. Do NOT develop imagery standards in a vacuum !! No one organization can be expected to know everything about every activity that is being worked related to Imagery Forum needed to share information 143 Imagery WG Relationships Requirement: Consistency !! GWG-related Imagery Focus Group Centralized location for information sharing and dissemination of related activities Follow-on Actions: Continuous Imagery Focus Group agenda item Additional Participation (Commands/services) WEB site for imagery-related activities Topics for Discussion: Other Items 145 Other Items for Discussion Common/Recommended Core: specification of the common elements (mandatory and optional) used throughout the community Taxonomy / semantics / ontology: establishing a common meaning and context for the metadata elements used within the GEOINT community Security marking: classification and caveat (codeword, releaseability, etc.) marking of data and metadata Organization extensions: preparing unique geospatial extensions for organization profiles Schema publication: publication of extensions and other community-specific schemas Registries: publication mechanism for code lists, organizational extensions, data dictionaries, and other supporting elements Quality: data quality reporting Feature metadata: defining metadata elements (common and recommended core) at the feature level Implementation: recommended best practices for using existing and emerging technologies (i.e. web services) and encodings (XML, GML, Transducer ML, Sensor ML, etc.) Legacy: handling of legacy formats element mappings, transformation mechanisms Records metadata (NGA) Compliancy: establishing policy for ensuring compliance with common and recommended core metadata elements and best practices for establishing and implementing organizational extensions Tear line metadata: map existing tear line metadata to ensure appropriate elements are captured to support the requirements of the GEOINT community Actions 147 Actions Name Action DUE DD MMM YY Key Dates 149 Key Dates DoD MWG Quarterly IC MWG 1 st Wednesday monthly GWG October 2005 GWG MFG December 2005 April 2006 August 2006 NTB December 2005 ISO September 2005 (TC 211) May 2006 (TC 211) (SC 24) (SC29) ANSI/INCITS L1 8 September 2005 12 October 2005 6 December 2005 AF DCGS MET WMG Fall 2005 AGIV MH TST 14-15 November 2005 DHS COI MWG 1 st Tuesday monthly DGIWG MWG 14-18 November 2005 MISB MWG 22 September 2005 Quarterly MGCP TG September 2005 Summary 151 Summary GWG Metadata Focus Group Purpose / Scope / Goals Metadata Harmonization Activities Development Process / Drivers / Crosswalks / Data Dictionaries / Metadata Sets Producers and Contributors Descriptions / Functions Review and Approve MFG Charter Topics for Discussion Actions / Key Dates Summary / Way Forward GWG MFG Points of Contact 153 GWG MFG POCs Norman Andersen National Geospatial-Intelligence Agency (NGA)/National Center for Geospatial Intelligence Standards (NCGIS) Bob Kuffel ( ), NGA Enterprise Engineering (EE) Hugh Bryant ( NGA Enterprise Engineering (EE) Shawn Silkensen ( ), NGA Enterprise Engineering (EE) Gerald Johnston ( ), NGA Enterprise Engineering (EE)