Research Cyberinfrastructure: Research Cyberinfrastructure: Virtual Organizations, Data and Virtual Organizations, Data and

VisualizationVisualization

Chaitan BaruChaitan BaruSan Diego Supercomputer CenterSan Diego Supercomputer Center

UC San DiegoUC San Diego

OutlineOutline

Virtual Organizations and Data SharingVirtual Organizations and Data Sharing

PortalsPortals

Visualization and CyberdashboardsVisualization and Cyberdashboards

Collaboration, and the Socio-technical Collaboration, and the Socio-technical InfrastructureInfrastructure

Some VO ProjectsSome VO Projects

BIRN, BIRN, www.nbirn.net (NIH) www.nbirn.net (NIH) – Biomedical Informatics Research Network– VO for sharing neuroscience imaging data

NEES, www.nees.org, NEES, www.nees.org, it.nees.org (NSF)it.nees.org (NSF)– Network for Earthquake Engineering Simulations– VO for sharing earthquake engineering experiment and simulation data

GEON, www.geongrid.org (NSF) GEON, www.geongrid.org (NSF) – Geosciences Network– VO to facilitate integration of earth sciences data

TEAM, www.teamnetwork.org, (Moore/Conservation TEAM, www.teamnetwork.org, (Moore/Conservation International) International) – Tropical Ecology, Assessment and Monitoring– VO for sharing field ecology data from wildland sites in the tropics

More VO Projects…More VO Projects…

GLEON, www.gleon.org (Moore, NSF)GLEON, www.gleon.org (Moore, NSF)– Global Lake Ecology Observation Network– VO for sharing lake ecological data

TDAR, www.tdar.org (NSF) TDAR, www.tdar.org (NSF) – The Digital Archaeological Record– Sharing of data from different digs

MOCA, moca.anthropogeny.org (Mathers, UCSD)MOCA, moca.anthropogeny.org (Mathers, UCSD)– Museum of Comparative Anthropogeny– Creation of a phenomic information resource for investigating the origin of humans

Many others…in high energy physics, astronomy, Many others…in high energy physics, astronomy, climate/atmospheric research, hydrology, ecology, climate/atmospheric research, hydrology, ecology, biomedicine, emergency response, …biomedicine, emergency response, …

Cyberinfrastructure at the speed of Cyberinfrastructure at the speed of researchresearch

In some cases, “do what it takes” to keep upIn some cases, “do what it takes” to keep up– Take shortcuts– Leverage infrastructure from other CI projects and off-the-shelf

products– Difficult because

• Can be stressful on software developers who take pride in creating their own

• Software engineers may think PI is changing course too many times

In other cases, “don’t get too far ahead” of the usersIn other cases, “don’t get too far ahead” of the users– User community may see no apparent benefit to the

infrastructure being developed• And, therefore, become frustrated and may stop using the system

entirely

““Community data” and the nature Community data” and the nature of data sharingof data sharing

Physics:Physics:– Petabytes of data from the same detector, shared by a global research

community. Common physics model.

Astronomy:Astronomy:– Petabytes of digital data from the same telescopes, shared by a global research

community. Common astrophysics model.

Biomedicine:Biomedicine:– 100’s terabyte to several petabytes of digital imaging data about the same

human organ (e.g. brain) from different individuals. Common organ model.

Earth Science (e.g. geophysics):Earth Science (e.g. geophysics):– 10’s-100’s Terabytes of seismic sensor data and tomographic image data,

shared by a global research and hazards response and policy community. Common Earth model.

““Community data” and the nature Community data” and the nature of data sharingof data sharing

Ecology:Ecology:– 10’s of terabytes of sensor and field ecology data. There may be

common models at local and regional scale. What is the common model at continental and global scale?

ArchaeologyArchaeology– Megabytes to terabytes of data from archaeological digs. What is the

common model? The data may be the model.

Social SciencesSocial Sciences– Sharing data from surveys of small populations

– Share data or share models? What is the metadata for models? Is there a way to “normalize” the data, e.g. basic steps such as creating grids from non-gridded data

Portal-based Science EnvironmentsPortal-based Science Environments Support for resource sharing and collaborationsSupport for resource sharing and collaborations

GEON PortalGEON Portal

GEON Portal and Cyberinfrastructure provide:GEON Portal and Cyberinfrastructure provide:– Authenticated access to data and Web services– Registration of data sets, tools, and services with metadata– Search for data, tools, and services, using ontologies– Scientific workflow environment and access to HPC– Data and map integration capability– Scientific data visualization and GIS mapping

GEON LiDAR Workflow (GLW) GEON LiDAR Workflow (GLW) PortletPortlet

Data: opentopography portalData: opentopography portal

EarthScope Data PortalEarthScope Data Portal

- SDSC San Diego

- IRIS Seattle

- UNAVCO Boulder

- ICDP Potsdam

Cyberdashboard for a Tropical Cyberdashboard for a Tropical Ecology NetworkEcology Network

Cyberdashboard for Emergency Cyberdashboard for Emergency ResponseResponse

2007 San Diego Wildfires2007 San Diego Wildfires– 911 calls

• Data mining of spatiotemporal data

• Analysis of calls during San Diego wildfires, Oct 2007

– Wildfire Evacuations• Visualization of data from Red Cross

disastersafe database

California Fire PlanCalifornia Fire Plan• UCSD/SDSC will assist in the new Fire

Plan for State of California

Campus-scale informationCampus-scale information

Cyberinfrastructure for Data VisualizationCyberinfrastructure for Data Visualization

On-demand access to dataOn-demand access to data– Short lead times from request to readiness to rendering

and display

On-demand access to computingOn-demand access to computing– Online modeling, analysis, and visualization tools

““On-line” Collaboration environmentsOn-line” Collaboration environments– Software architecture– Facility architecture

Software: E.g. OpenEarth Framework Software: E.g. OpenEarth Framework Interactive Visualization of 3D/4D earth science data Interactive Visualization of 3D/4D earth science data

–Derived 3D volumetric model–Multiple isosurfaces, with different transparencies–Slices through the volume–Variable gridding: data typically has lower resolution at greater depths

–2D surface data: Satellite imagery, street maps, geologic maps, terrain surface, fault lines, and other derived features etc.

–Bore hole or well data

“For a given region (i.e. lat/long extent, plus depth), return a 3D structural model with accompanying physical parameters of density, seismic velocities, geochemistry, and geologic ages, using a cell size of 10km”

OpenEarth Framework (OEF)OpenEarth Framework (OEF)

Facility: E.g. SDSC / Calit2 Facility: E.g. SDSC / Calit2 Synthesis CenterSynthesis Center

Conceived as a collaboration space “to do” scienceConceived as a collaboration space “to do” science– Bring together …

• High-performance computing

• Large-scale data storage

• In-person collaboration

• Technical professionals to move projects forward

Face-to-face collaborationsFace-to-face collaborations– Are important, even in a “flat world” where distance is

disappearing…

Synthesis Center FacilitySynthesis Center Facility

Large meeting spaceLarge meeting space

Multiple display Multiple display devicesdevices

Private conference Private conference room with high room with high resolution projection resolution projection systemsystem

A variety of usesA variety of uses

Viz-oriented workshopsViz-oriented workshops– GEON Visualization workshop– Workshop on Visualization of Large

Biomolecular Complexes– Tsunami Recon Data Workshop– GEON Workshop on Constructing, Editing,

and Visualizing Integrated models of Earth Structure

– GEON Digital Acquisition Workshop: From hand-held computers to ground-based LIDAR

Classes / Hands-onClasses / Hands-on– UCSD Digital Photo Class– GEON Summer Institute– NBCR Summer Institute– GEON Portal Usability Workshop– NEES IT Managers’ Retreat

MeetingsMeetings– SEEK All-Hands Meeting– NEON CI Planning Workshop– The NEURON Simulation Environment– Metagenomics 2006– BIRN All-Hands Meeting– Information Theory and Applications

Workshop– ORION Coastal/Global RFP meeting– Geoinformatics 2007– Governor’s Broadband Taskforce Meeting– Moore Foundation Annual Marine

Microbiology Investigator Symposium

Site VisitsSite Visits– NEESit NSF Site Visit– LOOKING NSF Review Meeting– Calit2 UCOP Review– NEON NSF Conceptual Design Review

Staffing and FundingStaffing and Funding

StaffingStaffing– Technical Support Staff– Research Staff: Visualization, Data Integration,

Analysis, Data Mining– Coordination

FundingFunding– “Project-based” funding: Staff funded by research

projects– “Recharge”: Facility usage fee

Calit2 Stereo Wall (C-Wall)Calit2 Stereo Wall (C-Wall)

Dual HD resolution (1920 Dual HD resolution (1920 x 2048 pixels) with JVC x 2048 pixels) with JVC HD2k projectorsHD2k projectors

2 Linux PCs w/Nvidia 2 Linux PCs w/Nvidia Quadro 5600Quadro 5600

Passive stereoPassive stereo

Ascension Flock of Birds Ascension Flock of Birds tracking system tracking system w/Wandaw/Wanda

Calit2 Stereo Wall (C-Wall)Calit2 Stereo Wall (C-Wall)

Philip Weber exploring a multi-spectral DaVinci painting

Calit2 Digital Cinema TheaterCalit2 Digital Cinema Theater

200 Seats, 8.2 Sound, Sony SRX-R110, SGI Prism w/21TB, 10GE to Computers/Data

The StarCAVEThe StarCAVE

Computers: 15 Dell XPS PCs with Quad Computers: 15 Dell XPS PCs with Quad Core Intel CPUs Core Intel CPUs

OS: CentOS LinuxOS: CentOS Linux

Graphics cards:Graphics cards:2 Nvidia Quadro 5600 per node2 Nvidia Quadro 5600 per node

Projectors: 30 JVC HD2k (1920x1080 Projectors: 30 JVC HD2k (1920x1080 pixels), ~30 megapixels per eyepixels), ~30 megapixels per eye

Stereo: passive with circular polarization Stereo: passive with circular polarization filtersfilters

15 screens, ~8 x 4 feet each15 screens, ~8 x 4 feet each

Optical tracking system by ARTOptical tracking system by ART

Visualization software:Visualization software:COVISE, OpenSceneGraphCOVISE, OpenSceneGraph

Programming Language: C++Programming Language: C++

Calit2’s 225 Megapixel HiPerSpaceTiled DisplayCalit2’s 225 Megapixel HiPerSpaceTiled Display

Personal Varrier: 3D Personal Varrier: 3D TeleconferencingTeleconferencing

The Varrier WallThe Varrier Wall

12 x 5 array of 12 x 5 array of autostereoscopic autostereoscopic displays from EVLdisplays from EVL

15 Linux PCs with 15 Linux PCs with Nvidia GeForce 7900 Nvidia GeForce 7900 graphics cardsgraphics cards

1600 x 1200 pixels on 1600 x 1200 pixels on each displayeach display

Optical trackingOptical tracking

SIO Visualization CenterSIO Visualization Center