21
1 The Geospatial Platform Offering: Defining the Requirements 2011 Esri Federal Users Conference Thursday, January 20, 2011 Room 204B (10:45AM – 12:00PM)

The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

1

The Geospatial Platform Offering:  Defining the Requirements 

2011 Esri Federal Users ConferenceThursday, January 20, 2011

Room 204B (10:45AM –

12:00PM) 

Page 2: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

2

Overview of the Offering: 

Introduction (Karen Siderelis)

Shared Infrastructure

GeoCloud Sandbox Initiative (Doug Nebert)

Data, Services, and Applications

Technical Deployment Task Team (Steven Jackson)

Identifying Federal and non‐Federal stakeholder  needs and capabilities (Jerry Johnston) 

Page 3: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

3

Shared Infrastructure Federal Geographic Data Committee (FGDC) and GSA 

GeoCloud Sandbox Initiative

Initiated as an Architecture and Technology Working Group activity in 

December 2009 with a call to federal agencies to nominate geospatial 

applications for testing in the Cloud environment for a one‐year 

prototyping process coordinated by FGDC and GSA

Eleven projects have been nominated by federal agencies as existing 

projects with existing software suites to be deployed in commercial‐

or 

government‐hosted Cloud environments

Two deployment environments (platforms) were abstracted from the

nominated projects: Open source service stack on Linux64 and a 

Commercial service stack on Windows 2008 Server

Page 4: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

4

Deploying Federal Geospatial Services  in the Cloud 

One‐year+ project to test and monitor externally‐hosted Cloud data and service 

solutions for the geospatial domain, to support the Geospatial Platform activity

Acquire, compose, document, and deploy

reference platform cloud that support Geospatial

Platform standards

Monitor costs, loads, issues and options in support of OMB IT project document

guidance

Certify Geospatial Solution Packages to facilitate re-use

Document Best Practices and guides to agencies on

adoption of geospatial Cloud infrastructure

Activities, Outcomes

Page 5: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

5

Notional Cloud Computing Stack

GSA apps.gov is now offering 

Infrastructure as a service 

(IaaS) solutions for acquisition

This is roughly equivalent to 

"shared‐hosting" of raw 

computers with an operating 

system in the Cloud domain

Platform as a Service (PaaS) 

provides configurable 

software components and 

services

http://en.wikipedia.org/wiki/Cloud_computing

Page 6: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

6

Platform as a Service (PaaS)“A cloud platform

(PaaS) delivers a 

computing platform and/or solution 

stack as a service, generally consuming 

cloud infrastructure

and supporting cloud 

applications. It facilitates deployment of 

applications without the cost and 

complexity of buying and managing the 

underlying hardware and software 

layers.”*

The GeoCloud is piloting the deployment 

of candidate services via solution 

architectures (suites of software) by 

composing reference platforms on top of 

the GSA IaaS to provide common 

geospatial capabilities. 

Page 7: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

7

GeoCloud Community 

Platform 

Value Proposition

GeoCloudCommunityPlatform

Pool of geospatial projects identified for

cloud migration

Federal Platform Reference Implementations

AppsNeed

Platforms

PlatformsAmplify

IaaSSavings

Platf orm Reve nue Stre am

Page 8: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

8

Platform asa Service (PaaS)

Applications10 identified GeoSpatial Applications + more agency apps…

Infrastructure(IaaS)

Virtual Machines / CPU

Storage

Application Servers: Provide the deployment environment for actual business applications with access to enablers, frameworks and runtimes, including interfaces and payload standards endorsed by the FGDC.

Frameworks provide bundled access to common behaviors and services, which applications can rely upon.

Libraries are reusable code modules which can be called directly from an application.

Frameworks and Libraries save time and expense freeing developers from having to build common code and behaviors.

Platform Enablers: Platform enablers provide core supporting capabilities for developing , testing and deploying code, including DBMS, Directory, Queue, Service Bus, etc. A relational database is the most common enabler example but is not present in all platforms

Runtimes: provide the execution support for developing and running the code. Examples include Java, Python, Microsoft Common Language Runtime, etc.

PlatformApplication Servers

App Frameworks / Libraries

Runtime Systems

Platform Enablers (DB’s, etc)

Operating System

Platform as a Service Architectural Framework Distinguishing Application, Platform and Infrastructure

Page 9: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

9

Cloud Community Platform Service Activities Primary Activity Cycle

Page 10: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

10

Basic Image

GSA Windows 2008 Server Image

.NET, IIS

Linux (CentOS)

Cloud Community Platform Service Activities  Preliminary Platform Architecture

Base Platforms

Open Source Additions

Java, PHP, PostGRES Tomcat, FLEX, Apache

Open Source CoreApache,

PostGreS/MySQL, Java, Ruby on Rails,

Tomcat, Perl, Python)

Specialized Platforms

ArcGIS ServerGeospatialPlatform

Semantic DrupalGlassFish 3, Axis,

SunMQ

OpenGeo: GeoServer, GeoNetwork

Geospatial, H

HS and Sem

antic Apps

Geospatial, H

HS and Sem

antic Apps

Windows Platform

Open Source Platform

Tiers (e.g. database, app server) can be split or combined as needed

THREDDS

Note: Software requirements for the candidate platforms were dictated by the eleven projects nominated by federal agencies. Standards are dictated by the FGDC endorsed standards list, Commonalities were identified in defining the stack. Additional software suites could be defined in the future using the same design process.

Custom

UIs and Standard A

PIs

Harden, Build Base Platforms Specialize for Target Apps

Page 11: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

11

Standards and the Geospatial Platform

FGDC recently endorsed 64 external voluntary consensus 

geospatial standards from ISO, OGC, and other standards 

bodies

Standards include Web service interfaces, data formats 

and encoding, and related protocols that, when adopted, 

will facilitate systematic discovery and exchange of 

geospatial information

Page 12: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

12

Standards of immediate concern

Web service standards

OGC Web Map Service

OGC Web Feature Service

OGC Web Coverage Service

OGC Catalog Service (CSW) and OpenSearch‐geo 

OGC Web Processing Service

OGC Web Map Tiling Service

Data formats and encoding

OGC Geography Markup Language (GML)

OGC KML

GeoTIFF, PNG, JPEG

Related non‐geospatial standards

Atom1.0 with geospatial extensions (GeoRSS)

Page 13: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

13

GoogleBing

Yahoo

GoogleBing

Yahoo

Service architecture for Geospatial  Platform

PublisherPublisher

UserUser

Catalog – Search EngineCatalog – Search Engine

DataData

Metadataas XML (push, form, harvest)

Data.govData.gov

Metadata as XHTML

Metadataas XML

Uploads /Serves

Search InterfaceSearch Interface Search API

Search API

OpenSearch / CSW

WMS

KML

WFS

WCS

VisualizationInterface

VisualizationInterface

CSW, OS

Context

SLD

Tiles

GoogleMapsGoogleMaps

GazGeoCloud

Page 14: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

14

Deployment Options within GeoCloudCost evaluation for each of the initial projects was performed 

using online ‘calculator’

based on data transfer, storage, CPU, and 

demand requirements

Most projects could be feasibly hosted in AWS (~$350‐500/month)

Some projects were cost‐prohibitive in the Cloud due to large data storage or transfer  

costs 

Amazon Web Services (EC2) was selected as the primary ‘public’

cloud computing environment for various sizes and numbers of 

virtual machines (AWS via Apptis is a GSA apps.gov IaaS offering

on BPA)Dell/VMWare vCloud environment was selected for government‐

hosted cloud infrastructure – at USGS EROS Data Center

Page 15: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

15

Project SynopsisNWI Wetlands Mapper AWS, Windows 2008, ArcGIS Server

US Census TIGER/Line Downloads AWS, Linux64 (CentOS)

Integrated Ocean Observing System Catalog and 

Viewer (NOAA)

AWS, Linux64 (CentOS), GeoNetwork

NOAA ERDDAP AWS, Linux64 (CentOS), THREDDS

EPA Lakes and Ponds AWS, Windows 2008, ArcGIS Server

USGS National Elevation Dataset (NED) service and 

data

VMWare vCloud on Dell HW, Windows 2008, 

ArcGIS Server

USGS National Map Map Tile Cache VMWare vCloud on Dell HW, Windows 2008 or 

Linux64

Particles in the Cloud (NOAA) particle tracking 

computational service for air or water dispersion/ 

diffusion

AWS, Linux64 (CentOS)

GEOSS Clearinghouse Catalog AWS, Linux64 (CentOS)

USDA FSA or NRCS data service application AWS, Windows 2008, ArcGIS Server

Page 16: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

16

GeoCloud Status and PlansProvided login credentials (encrypted key pairs) for AWS and its

management interface to individuals using AWS

Initiating image builds of OS plus base software dependencies for 

CentOS (RedHat) and scripting the geospatial module activation

Scripting Windows 2008 Server using hardening guidelines used 

by GSA and other agencies with ESRI ArcGIS Server as image 

baseline

Installation and monitoring of the deployment environment with 

agency‐facing Web services (January‐March)

Initial public‐facing Web Services (January)

Page 17: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

17

Questions and AnswersContact Information:

Doug Nebert ([email protected])

Robert Patt‐Corner, eGlobalTech/GSA (robert.patt‐

[email protected])

Page 18: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

18

Technical Deployment Task TeamOrigin:

Assembled December 2010, as a functional team comprised of 

representatives nominated by FGDC partner agencies and the 

Geospatial Platform Core Team

Purpose: 

Recommend a path forward for implementation of Geospatial 

Platform common services and shared infrastructure 

Lead efforts to deploy "mature" capabilities identified in the 

Modernization Roadmap for the Geospatial Platform that 

provide a useful service, can be built upon, and can be 

undertaken quickly

Page 19: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

19

Technical Deployment Task TeamApproach: 

Develop a set of requirements by evaluating existing Federal 

geospatial capabilities to determine their potential to meet 

the needs of the Geospatial Platform

Outcome:

Generate a Technical Deployment recommendation for the 

Geospatial Platform Core Team and FGDC Executive 

Committee which will include: 

Notional technical architecture  

Candidate solutions architecture(s)

Page 20: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

20

Technical Deployment Task TeamNext Steps:

Develop recommended list of candidate 

services/applications

Draft Use Cases for existing capabilities to develop a 

notional architecture

Deploy services/applications on GeoPlatform.gov 

Develop a "how‐to" guide for deploying applications and/or 

services on GeoPlatform.gov

Page 21: The Geospatial Platform Offering: Defining the Requirements · 1/18/2011  · Platform standards. Monitor costs, loads, issues and options in support of OMB IT project document guidance

21

Technical Deployment Task TeamTeam Members:

Chair: Steven Jackson, NGA 

Myra Bambacus, NASA 

Jeff Booth, DHS 

Paul Fukuhara, USDA

Doug Nebert, FGDC

Kari Sheets, NOAA

Michele Torreano, EPA