Preserving State and Local Government Digital Geospatial Data Steve Morris Head of Digital Library Initiatives North Carolina State University Libraries

  • Published on
    03-Jan-2016

  • View
    213

  • Download
    1

Embed Size (px)

Transcript

  • Preserving State and Local Government Digital Geospatial Data Steve MorrisHead of Digital Library InitiativesNorth Carolina State University LibrariesALA NDIIPP SymposiumJune 25, 2007

  • NC Geospatial Data Archiving ProjectPartnership between university library (NCSU) and state agency (NC Center for Geographic Information & Analysis)Focus on state and local geospatial content in North Carolina (state demonstration)Tied to NC OneMap initiative, which provides for seamless access to data, metadata, and inventoriesObjective: engage existing state/federal geospatial data infrastructures in preservation

    Serve as catalyst for discussion within industry

  • NCGDAP: Targeted ContentResource TypesGIS vector (point/line/polygon) dataDigital orthophotography Digital mapsTabular data (e.g. assessment data)Content ProducersMostly state, local, regional agenciesSome university, not-for-profit, commercialSelected local federal projects

  • Targeted data: Vector dataCadastral (tax parcels) Street centerlinesZoningTopographic contoursSchool, sheriff, fireVoting precinctsMore 98 of 100 NC counties have GIS More detailed, accurate, current Subject to frequent update

  • Targeted data: Digital orthophotography 90+ NC counties with orthophotos 1-5 flights per county 30-300 gb per flight

  • GIS SoftwareSoftware project file (.mxd, .apr, )Data layer file (.avl, .lyr, )PDF map exportsWeb Services-based representations

    Targeted data: Cartographic

  • Not yet targeted data: Place-based dataMobile, LBS, and, social networking applications

    Long-term cultural heritage value in non-overhead imagery: more descriptive of place and function

    Oblique ImageryDOT VideologsTax Dept. PhotosStreet View Images

  • Risks to Digital Geospatial Data.shp.mif.gml.e00.dwg.dgn.bsb.bil.sid

  • Risks to State/Local Geospatial DataProducer focus on current dataData overwrite as common practiceFuture support of data formats in questionNo open, supported format for vector dataShift to web services-based accessData becoming more ephemeralInadequate or nonexistent metadataImpedes discovery and useIncreasing use of spatial databases for data managementThe whole is greater than the sum of the parts

  • Local Applications Where GIS Is UsedSource: NC OneMap Data Inventory 2004

  • Temporal Data Supports Decision-MakingLand use change analysisReal estate trend analysisSite selection (past uses?)Forecasting

    Parcel Boundary Changes 2001-2004North Raleigh, NC

  • Temporal Data Supports Decision-MakingSuburban Development 1993/2002

    Near Mecklenburg-Cabarrus County border

  • Wake County, NC

    Interstate 540 / US Highway 70 Interchange

    Near Raleigh/DurhamInternational Airport2005 Wake County Ortho

  • Todays geospatial data as tomorrows cultural heritageFuture uses of data are difficult to anticipate (as with Sanborn Maps).

  • Challenge: Vector Data FormatsNo widely-supported, open vector formats for geospatial dataSpatial Data Transfer Standard (SDTS) not widely supportedGeography Markup Language (GML) diversity of application schemas and profiles threatens permanent accessSpatial DatabasesThe whole is more than the sum of the parts, and the whole is very difficult to preserveCan export individual data layers for curationSome thinking of using the spatial database as the primary archival platform

  • Challenge: Cartographic RepresentationCounterpart to the map is not just the dataset but also models, symbolization, classification, annotation, etc.

  • Challenge: Geospatial Web Services How to capture records from decision- making processes? Possible: Atlas collections from automated image capture Web 2.0 impact: Emerging tiling and caching schemes (archive target?)

  • Challenge: Preservation MetadataResults from a 2006 survey of all 100 NC counties and 25 largest NC municipalities

    Chart15

    0.2553191489

    0.085106383

    0.0638297872

    0.5957446809

    % of Respondents

    Metadata Archived?

    Sheet1

    ParcelsStreet CenterlinesZoning

    Annually42.6%28.3%34.8%

    Every 6 Months8.5%6.5%6.5%

    Quarterly8.5%8.7%4.3%

    Monthly14.9%10.9%8.7%

    Weekly or Daily12.8%6.5%2.2%

    Not Saved12.8%39.1%43.5%

    Jurisdictional Boundaries

    After changes39.4%

    Annually30.3%

    Every 6 Months9.1%

    Quarterly3.0%

    Monthly15.2%

    Weekly or Daily3.0%

    County Boundaries40.4%

    Municipal Boundaries53.2%

    Extraterritorial Jurisdictions34.0%

    None40.4%

    ParcelsStreet CenterlinesJurisdictional BoundariesZoning

    Shapefile76.2%77.4%72.7%66.7%

    Geodatabase35.7%25.8%30.3%26.7%

    Arc Coverage28.6%25.8%21.2%20.0%

    Arc Interchange (e00)7.1%9.7%6.1%6.7%

    Other9.5%9.7%15.2%16.7%

    ParcelsStreet CenterlinesJurisdictional BoundariesZoning

    Yes52.3%34.3%34.4%35.5%

    No47.7%65.7%65.6%64.5%

    ParcelsStreet CenterlinesZoning

    Yes as attached attributes61.4%82.9%78.1%

    Yes in a separate table22.7%5.7%6.3%

    No15.9%11.4%15.6%

    FGDC format25.5%

    Locally defined metadata8.5%

    NC OneMap metadata starter block6.4%

    None59.6%

    Tape21.3%

    CD42.6%

    DVD17.0%

    External Hard Drive8.5%

    Server or Online Storage57.4%

    Other0.0%

    Onsite55.3%

    Offsite6.4%

    Both Onsite and Offsite38.3%

    Yes all of the files30.4%

    Yes some of the files13.0%

    None56.5%

    IT policy19.6%

    Records retention policy17.4%

    Tax admin rules23.9%

    Land use change analysis10.9%

    Resolution of legal issues19.6%

    Historic mapping56.5%

    Other28.3%

    Tape5.7%

    CD42.9%

    DVD32.9%

    External Hard Drive18.6%

    Server or Online Storage65.7%

    Other14.3%

    Not Stored7.1%

    Historic hardcopy maps scanned only15.5%

    Historic hardcopy maps scanned and georeferenced9.9%

    Aerial photos scanned only8.5%

    Aerial photos scanned and georeferenced26.8%

    None54.9%

    Sheet1

    Parcels

    Street Centerlines

    Zoning

    Frequency

    % of Respondents

    Capture Frequency

    Sheet2

    Jurisdictional Boundaries

    % of Respondents

    Frequency

    Capture Frequency: Jurisdictional Boundaries

    Sheet3

    Parcels

    Street Centerlines

    Jurisdictional Boundaries

    Zoning

    Formats

    % of Respondents

    Format of Snapshot

    Yes

    No

    Dataset

    % of Respondents

    Format Conversion Involved?

    Parcels

    Street Centerlines

    Zoning

    % of Respondents

    Attributes Saved with Geometry?

    % of Respondents

    Which Jurisdictional Boundaries?

    % of Respondents

    Metadata Archived?

    % of Respondents

    Storage Environment

    % of Respondents

    Storage Location

    0.3043478261

    0.1304347826

    0.5652173913

    % of Respondents

    Public Access to Snapshots?

    0.1956521739

    0.1739130435

    0.2391304348

    0.1086956522

    0.1956521739

    0.5652173913

    0.2826086957

    % of Respondents

    Driving Factors

    0.1549295775

    0.0985915493

    0.0845070423

    0.2676056338

    0.5492957746

    % of Respondents

    Digitizing Efforts

    0.0571428571

    0.4285714286

    0.3285714286

    0.1857142857

    0.6571428571

    0.1428571429

    0.0714285714

    % of Respondents

    Disposition of Orthophotos

  • NCGDAP Project DirectionsWorking with state spatial data infrastructure on content exchange mechanismsInfrastructure being created for other business reasonsBenefit to archive in terms of lower acquisition costs, better metadata, established provennanceCo-established the Data Preservation Working Group in the Open Geospatial ConsortiumInsert temporal use cases into specification processesCollaboration with State ArchivesWork towards infusing local records outreach and records retention with geospatial components

  • Questions?Steve MorrisHead, Digital Library InitiativesNCSU Librariesph: (919) 515-1361Steven_Morris@ncsu.edu

    http://www.lib.ncsu.edu/ncgdap

    In the largest urban areas in the state, counties and federal agencies tend to fly aerial imagery every three to five years the basis for temporal analysis if the earlier images are readily accessible. In the Charlotte area, some municipalities were incorporated after 1994 (e.g., all red Fairview and all orange Unionville on lower right side of the map).

Recommended

View more >