23
The Telescience Project - ATOMIC (A pplications t o M iddleware I nteraction C omponents) https://telescience.ucsd.edu Transparent Grid Access for Scientific Communities Jason Novotny [email protected] Abel W. Lin [email protected] National Center for Microscopy and Imaging Research University of California San Diego

The Telescience Project - ATOMIC ( A pplications t o M iddleware I nteraction C omponents)

Embed Size (px)

DESCRIPTION

The Telescience Project - ATOMIC ( A pplications t o M iddleware I nteraction C omponents) https://telescience.ucsd.edu Transparent Grid Access for Scientific Communities Jason Novotny [email protected] Abel W. Lin [email protected] - PowerPoint PPT Presentation

Citation preview

Page 1: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

The Telescience Project - ATOMIC (Applications to Middleware Interaction Components)

https://telescience.ucsd.edu

Transparent Grid Access for Scientific Communities

Jason [email protected]

Abel W. [email protected]

National Center for Microscopy and Imaging Research

University of California San Diego

Page 2: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

Scales of NS data from Maryann MartoneScales of NS data from Maryann Martone

Mission:

Develop and implement technologies to determine and

reveal supramolecular details in their cellular and tissue contexts.

NCMIR forges innovations in CI and IT to enable solutions

for grand challenges in biomedical imaging research

Page 3: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

NCMIR is an Accessible Resource Center for

Advanced Biomedical Research Fielding High-throughput Imaging Instruments, Computational

Analysis Tools and Databases

Page 4: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

The Telescience Core Methodology

Partnership

RemoteInstrumentation

Databases &Digital Libraries

Computation

VisualizationNetwork

Connectivity

Training and Dissemination

Integrate resources, technologies and applications using standardized Grid middleware technologies and advanced

networking to provide an end-to-end solution for challenges like multi-scale biomedical imaging.

Page 5: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

Interacting with the Grid

Portal and Applications

NMI

Compute Resources

Interaction with Middleware appears to be unified ...

MyProxy

Portals and Applications

CoG GridPort

Globus

GridFTP GRAM MDSSRB NWS

Physical Resources

CAS

Grid Security Infrastructure

CACL

Pegasus

LDAP

DataCutter

Condor(-G)

but is actually very fragmented

For example, some or all, of these components are necessary for end-to-end computation

Page 6: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

Portal and Applications

Physical Resources: Data Storage, Compute Resources, etc.

Telescience ATOMIC bridges the Gap betweenmiddleware and applications

Local (Services): GSI, Globus, Condor, RLS, SRB, NWS, etc.

Collective Services : MyProxy, Pegasus, DataCutter, GridFTP, etc.

ATOMIC

Page 7: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

Telescience Portal and Applications

ATOMIC provides tools for users and developers

Provides an intuitive GUI for end-users to launch jobs and manage data

ATOMIC: TeleAuth/GAMA, TeleWrap, TeleRun, etc.

Provides a programming interface and other tools for developers (Telescience Portal and others) to access to

Telescience Grid (compatible with other Scientific Grids).

Page 8: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

Telescience is reducing the threshold to the use of Grid technologies

Gridsphere Portals framework serves as a rich GUI for end-users (bench scientists)

ATOMIC services scientific applications developers (mathematicians, physicists, etc…)

ATOMIC supports legacy applications and native grid applications with equal intensity.  

Motivation for ATOMIC: The Grid should be brought to bear for scientific processes...scientific processes should not necessarily have to conform to the Grid

Page 9: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

Telescience spurs development, integration, and interoperability along all levels of CI

Page 10: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

Telescience is realized in the context of microscopy but extendsdirectly to analogous applications that are data and compute intensive

and require parity between computers and instruments

This model is for all data generator devices: microscopes (EM/LM), shaker tables, particle accelerators, oceanic observers, ecological

sensor networks

Telescience Infrastructure

Richly integrated user environment

ATOMIC: applications (portal) enabler

NMI

Data Devices: generate, compute, store

Page 11: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

ATOMIC Bundles Available

GAMA/TeleAuth: End-to-End GSI Security

TeleWrap: Transparent Data Grid I/O for applications

TeleRun: Information Gathering for Globus/MPI based applications

Page 12: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

GAMA/TeleAuth

GAMA is complete GSI credential management and integration solution tailored for use in emerging cyberinfrastructure through web portals or web

service-based clients.

GAMA makes grid security as easy to use as any commercial web site while maintaining the security and delegation capabilities of GSI.

Page 13: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

Interactive Applications: TeleWrap

Page 14: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

ATOMIC also motivated by Data Generation and Computation Resources and Requirements

Heterogeneity places increase burden on application developers

Telescience CA recently

accepted by TeraGrid (1st

non-CS organization)

Utrecht Univ./ SARAOsaka Univ.KBSI/KISTI

NCHC

Page 15: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

Portals

“The portal ecosystem and portal fabric will become the dominant models of application delivery by 2005."

- Gartner Research Group

Telescience Portal is built on the JSR168 GridSphere Project:

• extends the suite of richly integrated, grid enabled tools for the end user

• provides a new level of flexibility, customization, and seamless (administration free) harnessing of the power of global grids

• accomplishes this while also reducing the complexity of its own creation and management.

• amplifies the extensibility of its underpinnings to other scientific domains with analogous needs.

Page 16: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

Portals: Single Sign-On

Page 17: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

Portals: Launching Heterogeneous GridApplications

No CS information, onlybiologically relevant parameters

Page 18: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

Portals: Data Grid Acces

Page 19: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

ATOMIC is built out of Applied Experience, not only leading CS concepts…

ATOMIC is more than just a packaging of technologies, it is the bundling of nearly a decade of interdisciplinary experience in bringing these

technologies to bear for scientific applications.

Especially critical at this juncture, given the growing sophistication of GUI interface components

Page 20: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

Future activities

• ATOMIC Web/Grid Services

• Extension of GTS (Generalized Telemicroscopy System) as ATOMIC-based services

• Telescience ATOMIC "Rocks Rolls"

For more information:https://telescience.ucsd.eduhttp://ncmir.ucsd.edu

Page 21: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

Acknowledgments

Page 22: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)
Page 23: The Telescience Project - ATOMIC  ( A pplications  t o  M iddleware  I nteraction  C omponents)

Expressing and Executing Workflows

Laboratory Process

Application Pipelines

Recruit Subject Scan Visit Subject Analysis Group Analysis

Pre-Processing

Analysis

Post-Processing

Localizer

Structural

Functional