A Prototype Digital Library for 3D Collections:

Tools to Capture, Model, Analyze and Query Complex 3D Data

Dr. Jeremy RoweHead, Media Development, Information Technology

Partnership for Research in Spatial Modeling

Arizona State University

NAWeb 2003 October 19, 2003

Partnership for Research In Spatial Modeling (PRISM)

Established in Spring 1996 at Arizona State University to promote interdisciplinary research in 3D Data Acquisition, Visualization & Modeling, and Form Realization.

PRISM includes researchers with a shared interest in visualizing 3D and higher dimensional data.

Discipline partners include: Anthropology Archaeology Biology Computer Science Educational Technology Fine Arts Industrial Engineering Mechanical Engineering

3D Imaging - Moving Beyond Viewable Images

Extending research capabilities beyond Image-Only 3D display such as QuickTime VR, Rhino, & Maya.

Funding: VP Research at ASU National Science Foundation - Digital Library/Knowledge and Distributed Intelligence DARPA, NIH, IGERT

Goals: Work with Domain Researchers to Develop Processes to:

-Create Quantifiable, Measurable Models-Automatically Identify and Extract Data -Create Catalog Information-Automatically Populate Database-Support Analysis and Interaction-Help Answer Research Questions and Generate New Knowledge

Conceptual Model of a 3D Digital Library

Acquire

Represent

Analyze

Access and Interaction

Archive

Data Acquisition

Cyberware Laser Scanner

Also:-Portable Laser Scanners-Confocal Microscope-CAT Scanner-Satellite Imagery-Other Method of 3D Point Cloud Capture

Laser Scanning to Create Point Cloud

Single Scan Multiple Scans Combine to Create Point Cloud Representing the Original Object

Point Cloud Triangular Mesh Surface

Surface Generation from Point CloudAssemble Point Cloud from Multiple Scans (Cyberware Geomagic) Generate Triangular Mesh

Surface Modeling

Fitting a Modeled, Measurable IsoSurface

(using Cyberware Geomagic and PRISM Software)

Spatial Measures of Similarity

Graphically -illustrate symmetry -depict changes in curvature-permit comparisons among objects

Goal - To provide objective measures of objects and component features

Profile Curves

Also: Area Volume Local Curvature Inflection Points Proximity Orientation Etc.

Example 3D Scan/Image of Trapezium

Example Watershed Based Identification of Regions Using Curvature

Combining/Editing Using Region Editor

Analysis of Relationships Among Surfaces

Spatial analysis of curved surfaces using plane generatedby least squares to represent curvature with a replicable measurement providing a baseline for cross-specimen comparison.

Spatial Analysis

Range of ProjectsDNA in Fertilized Mouse Egg

Through the Cell Biology Pilot project, we applied computer algorithms that enabled us to obtain more information from confocal microscope images.

Range of ProjectsNative American Ceramic Vessels

Digital collections to analyze shape, morphology, manufacturing techniques, improve measurement accuracy, permit objective comparison of objects, document before repatriation.

Bone Surfaces and Forensics Digital collections to analyze

shape, structure, morphology, improve measurement accuracy, permit objective comparison of objects, and to identify unique individuals.

Range of Projects

Curvature Distribution

Wire Frame Model

PRISM Feature Segmentation

3D Facial Recognition Uses curvature distribution, segmentation, and 3D feature extraction to provide greater accuracy and reliability than 2D pixel-based techniques. Recognizes and compares curvature in unique biometric areas that define each human face and unlike image-based techniques, is not sensitive to added make-up or facial hair.

Edge Detect

HSB +

Observations and Modeling of Orographic Cumulus Development

Edge Detection

Volume Modeling

Research Interface

3D Handwriting AnalysisApplies transfer functions and algorithms to extract chain code and parametrized curves creating 3D volume models of ink and stroke representations from 2D characters. (other applications include forensics, and image analysis problems)

Extractions from handwriting and banknote

Range of Projects

Region Identification

Morphology/SymmetryObject Identification

Feature Extraction/Comparison

-Development of Shared Vocabulary-Development of XML Schema and DTDs-Capture/Digitization of Spatial Data-Modeling and Data Extraction

-Volume modeling research -Develop modeling software-Data extraction

-Data Storage-Text and Tabular Data-Binary Geometric/Spatial DataPoint cloud dataPolygonal meshSurface/volume models

-Query (Contextual and Spatial) and Interaction-Design and Implementation

-Evaluation (Process and Product)

Current Project Process Summary

Vocabulary

3D Class Inheritance

Class:Object

::Vessel

::JarPlus...Axis

Base Plane

Diameter

Circumference

Generic Attributes…

Object Type

Contextual Data Links

Spatial Data Link

::Surface model

Plus...Spatial Descriptors:

Surface Area

Volume

Symmetry

Plus...Shoulder Height

Aperture Diameter

Shape

Each subclass definition inherits generic attributes from its parent class and qualifies them or adds new, more specific attributes

Class Based XML Schema Contextual and Spatial Data

*

Contextual

Spatial

Class Based XML SchemaRaw and Modeled Spatial Data

*

Class Based XML SchemaModeled Data

*

Class Based XML SchemaSurface Data

Addition of 3D Data to Relational Databases

Conventional RelationalDatabase Tables

Tables added to accommodate3D Metadata

RDBMS(Oracle, SQL Server, etc)

AttributeTables

3D Indexes

Existing Data Access Protocols

(ODBC, JDBC,XML)

3D QueryProcessor

Custom 3DData objects

(Surfaces, Volumes)

Database organizationUser Interface applications(Java, Visual Basic, C++)

Text search Spatial Search

Data Components-Raw Data

Textual/Metric2D Image/Surface3D Spatial N-Dimensional (i.e. Composition, Time, Sensor Data, etc.)

-Modeled Data-Derived Data-Technical Data

File FormatsApplications (i.e. viewers, tools, etc.)

-Administrative (i.e. access control, permissions, archiving) -“Book mark” Information to Document Searches/Interaction-Researcher Annotations (to permit “process” reconstruction, and add interpretation and analysis to the object record)

Link to Demo

Query and InteractionCreating a Digital Library

Example of Query Input by Manipulating Volume Model

3DK Project TeamPartnership for Research in Spatial Modeling

Arizona State University

Priti Aggarwal Myungsoo BaeMichael Bailey D. Page BaluchDavid Capco Daniel CollinsGerald Farin Patricia GreenMark Henderson Jiu Xiang HuAdam Huang Graham JonesRaghu Krovvidi Anand LakshamananDezhi Liu Mary MarzskePeter McCartney Pornchai Mongkolnam Greg Nielson S. PanchanathanSandeep Pulla B. RamakrishnaAnshuman Razdan Jeremy RoweUtsav Schurmans Arleyn SimonMatt Tocheri David Van Alfen May Zsu

Contact Information

Partnership for Research in Spatial Modeling (PRISM)

Arizona State Universityhttp://3dk.asu.edu

Dr. Jeremy Rowejeremy.rowe@asu.edu

END