1

Leveraging Leveraging PostgreSQLPostgreSQL withwithESRI'sESRI's ArcGIS system ArcGIS system

Derek LawDerek LawProduct Management GroupProduct Management Group

FOSS4G Lab 14 FOSS4G Lab 14 –– September 26, 2007September 26, 2007

Copyright © 2007 ESRIAll rights reserved.

The information contained in this document is the exclusive property of ESRI and is subject to change without notice.

Other companies and products mentioned herein are trademarks or registered trademarks of their respective trademark owners.

2

AgendaAgenda

•• ESRI ESRI –– BackgroundBackground•• Open Source & ESRIOpen Source & ESRI•• Overview of Enterprise GISOverview of Enterprise GIS•• Introduction of ArcGIS Server EnterpriseIntroduction of ArcGIS Server Enterprise

–– ArcSDE TechnologyArcSDE Technology–– Enterprise geodatabaseEnterprise geodatabase–– Implementation on PostgreSQLImplementation on PostgreSQL

•• SummarySummary•• ExerciseExercise

3

ESRI ESRI –– company backgroundcompany background

•• Founded in 1969; located in Redlands, CAFounded in 1969; located in Redlands, CA•• A research & development company focused on A research & development company focused on

GIS technology & its communityGIS technology & its community–– Software developmentSoftware development–– Consulting & application solutionsConsulting & application solutions–– Educate & promote GIS science/technologyEducate & promote GIS science/technology

•• U.S. & International officesU.S. & International offices

4

Open source & ESRIOpen source & ESRI

•• ESRI uses a variety of open source technology in ESRI uses a variety of open source technology in software developmentsoftware development

•• Encourage developers to employ open source technology Encourage developers to employ open source technology & interoperability for their application solutions& interoperability for their application solutions

5

•• Continue work with the open source communityContinue work with the open source communityto further GIS research & developmentto further GIS research & development

•• Active participant in open source & interoperability Active participant in open source & interoperability standards communitiesstandards communities

Open source & ESRIOpen source & ESRI

6

GIS is evolving towardsGIS is evolving towardsEnterprise Information SystemsEnterprise Information Systems

Desktop ToolsDesktop Tools& Data& Data

PersonalPersonalProfessionalProfessionalProductivityProductivity

Client / Server Client / Server SystemsSystems

WorkgroupWorkgroupInformationInformation

ManagementManagement

EnterpriseEnterpriseGIS ServicesGIS Services

Web Services Web Services NetworksNetworks

7

What is an Enterprise GIS system?What is an Enterprise GIS system?

•• Provides broad access to geospatialProvides broad access to geospatialdata & servicesdata & services–– Common infrastructure to build & deploy GISCommon infrastructure to build & deploy GIS

•• Generally multiGenerally multi--departmentdepartment& integrated with other enterprise systems& integrated with other enterprise systems–– e.g., Land records managemente.g., Land records management

•• Helps to achieve business objectivesHelps to achieve business objectives•• Scaleable, reliable, & secureScaleable, reliable, & secure•• Supports interoperability & IT standardsSupports interoperability & IT standards

Bottom line: An enterprise GIS should meet an organization’sneeds both collectively & individually

A

8

Enterprise GIS system challengesEnterprise GIS system challenges

•• Sharing services & information across Sharing services & information across departmentsdepartments

•• Good design/implementation vs. quick resultsGood design/implementation vs. quick results•• Consensus on a common set of standardsConsensus on a common set of standards

& governance processes& governance processes•• Not losing sight of the business strategy behind Not losing sight of the business strategy behind

the projectthe project•• Budget constraints ($$$$)Budget constraints ($$$$)

•• After establishing: Maintaining performanceAfter establishing: Maintaining performance

A

9

Small enterprise GIS configurationSmall enterprise GIS configuration

Network

Clients Web Server &GIS Application

Server

Data Server

DBMS

10

Large enterprise GIS configurationLarge enterprise GIS configurationService Oriented ArchitectureService Oriented Architecture

Network

Clients GIS ApplicationServer

Data ServerGIS WebServer

DBMS

11

Performance modelPerformance model

•• Response time for end userResponse time for end user•• Total response time:Total response time:

–– Based on load, # of users, & # of operationsBased on load, # of users, & # of operations

User interaction

Client

Clientprocessing

TCP/IP

DBMSserver

SQL

SQLDBMS

processingTCP/IP

Serverprocessing

Client

Results presented

Totalresponse

time

Clientprocessing

Database

12

ArcGIS: a complete GISArcGIS: a complete GIS

Client

Server

Storage

OpenAPIs

ArcGISMobile

WebMapping

Application

ArcGISExplorer

ArcGISDesktop

ArcGISServer

13

ArcGIS Server EnterpriseArcGIS Server Enterprise

•• Consists of 4 components:Consists of 4 components:–– Server Object Manager, Server Object Container, Server Object Manager, Server Object Container,

ArcSDE Technology, & Web App Dev FrameworkArcSDE Technology, & Web App Dev Framework

•• ArcSDE TechnologyArcSDE Technology–– The gateway between GIS clients & DBMSThe gateway between GIS clients & DBMS–– Enables users to easily store, access, & manage spatial Enables users to easily store, access, & manage spatial

data on the leading DBMS platformsdata on the leading DBMS platforms–– Essential component to setEssential component to set--up & maintain anup & maintain an

enterprise geodatabaseenterprise geodatabase–– Supports:Supports:

•• MultiMulti--user editing environmentuser editing environment•• Complex GIS workflowsComplex GIS workflows•• Geospatial data integration with IT systemsGeospatial data integration with IT systems

14

Introducing the Enterprise GeodatabaseIntroducing the Enterprise Geodatabase

•• A container for spatial & attribute dataA container for spatial & attribute data–– GIS data stored in a DBMS using ArcSDE TechnologyGIS data stored in a DBMS using ArcSDE Technology–– Leverages existing DBMS functionality withLeverages existing DBMS functionality with

ArcObjects functionalityArcObjects functionality–– Capable of modeling complex spatial relationshipsCapable of modeling complex spatial relationships–– Supports data integrity with business rulesSupports data integrity with business rules–– ScaleableScaleable

•• ArcGIS has suite of tools toArcGIS has suite of tools tomigrate existing GIS datamigrate existing GIS data

DBMS

ArcSDE

ArcObjects

15

Geodatabase elementsGeodatabase elements

Feature dataset

Terrain

Topology

Network dataset

Geometric network

Feature class

LinePolygon

PointDimensionAnnotation

Route

Relationship class

Table Raster dataset

Raster catalog

Toolbox

Tool Model Script

Schematic dataset

BehaviorRelationship rulesConnectivity rulesTopology rules

Attribute domainsAttribute defaultsSplit/merge policy

Survey dataset

Cadastral Fabric

16

ArcSDEArcSDE Technology for Technology for PostgreSQLPostgreSQL

•• Next ArcGIS release in 2008Next ArcGIS release in 2008•• Standard Enterprise Standard Enterprise ArcSDEArcSDE installinstall

–– Will include Will include PostgreSQLPostgreSQL databasedatabase•• Supported platforms:Supported platforms:

–– Windows, Linux (Red Hat & Windows, Linux (Red Hat & SuSeSuSe), & Sun Solaris), & Sun Solaris•• Geometry storage managed through spatial typesGeometry storage managed through spatial types

1.1. ESRI spatial typeESRI spatial type ((ST_GeometryST_Geometry))–– Conformance with the ISO/OGC simple feature specificationsConformance with the ISO/OGC simple feature specifications

2.2. PostGISPostGIS –– Open source spatial type (Open source spatial type (GeometryGeometry))•• Complete geodatabase data model enabledComplete geodatabase data model enabled

A

Note: ALL CONTENT NOT FINALIZED

17

Geometry storage in Geometry storage in PostgreSQLPostgreSQL

•• Geometry stored as a custom DBMS data typeGeometry stored as a custom DBMS data type•• SQL spatial functions are defined for all SQL spatial functions are defined for all

operations on the geometry objectoperations on the geometry object•• OGC compliant operators supportedOGC compliant operators supported

18

Geometry storage in Geometry storage in PostgreSQLPostgreSQL

•• Contents of spatial type attribute fieldContents of spatial type attribute field

19

Advantages of spatial typesAdvantages of spatial types

•• Ability to integrate spatial types throughout the Ability to integrate spatial types throughout the enterprise GISenterprise GIS–– Share data between ArcGIS & other applicationsShare data between ArcGIS & other applications–– SQL access to spatial data implies that you do not SQL access to spatial data implies that you do not

need ArcGIS to view geometryneed ArcGIS to view geometry–– Perform spatial operations at the SQL level using Perform spatial operations at the SQL level using

spatial operatorsspatial operators

SQL

Non-ArcGIS client

20

Available SQL functionsAvailable SQL functions

•• Spatial functions defined on the spatial typeSpatial functions defined on the spatial type–– Constructor functionsConstructor functions

•• Build a geometry objectBuild a geometry object–– AccessorAccessor functionsfunctions

•• Access properties of a geometry objectAccess properties of a geometry object–– Transformation functionsTransformation functions

•• Construct new geometry objects from existing geometry Construct new geometry objects from existing geometry objectsobjects

–– Relationship functionsRelationship functions•• Test the spatial relationship between 2 geometry objectsTest the spatial relationship between 2 geometry objects

21

Installation of Installation of ArcSDEArcSDE for for PostgreSQLPostgreSQL

•• Install Install PostgreSQLPostgreSQL softwaresoftware–– Included with ArcGIS Server EnterpriseIncluded with ArcGIS Server Enterprise

•• Install Install ArcSDEArcSDE Technology softwareTechnology software–– Create Create SDEHOMESDEHOME directorydirectory–– PostPost--install wizard (4 steps)install wizard (4 steps)

1.1. Create database & Create database & ‘‘sdesde’’ useruser2.2. Create repository tablesCreate repository tables3.3. Authorize softwareAuthorize software4.4. Create Create ArcSDEArcSDE serviceservice

(Windows only)(Windows only)

22

SummarySummary

•• ESRI ESRI –– brief company profilebrief company profile–– Its relationship with open source communityIts relationship with open source community

•• Enterprise GISEnterprise GIS•• ArcGIS Server EnterpriseArcGIS Server Enterprise

–– ArcSDEArcSDE TechnologyTechnology–– Enterprise geodatabaseEnterprise geodatabase–– Implementation on Implementation on PostgreSQLPostgreSQL

•• Looking for Looking for ArcSDEArcSDE on on PostgreSQLPostgreSQL beta beta program participantsprogram participants