33
Investment for the Future of PRAGMA Progress Since PRAGMA 10: PRAGMA 11 Osaka University 15 – 17 October 2006

Investment for the Future of PRAGMA Progress Since PRAGMA 10: PRAGMA 11 Osaka University 15 – 17 October 2006

Embed Size (px)

Citation preview

Investment for the Future of PRAGMAProgress Since PRAGMA 10:

PRAGMA 11

Osaka University

15 – 17 October 2006

PRAGMA ExcitementCyclone Larry

Tropical cyclone Larry is seen striking the coast of Australia in this

satellite image.

Magnitude 5.8 - OFF THE EAST COAST OF HONSHU, JAPAN

2006 October 10 23:58:07 UTC

NSF Renews PRAGMA for Five Year

Thanks to the work of all of us

And what is expected of PRAGMA?

Validate the investments in cyberinfrastructure

One (not to be lost in) translation:

Have scientist use the grid to do science!

Savannah Burn:How tightly linked are burning, vegetation, and

rainfall? • PRAGMA Testbed ran CSIRO

climate model called CCAM in combination with Nimrod/G tool set.

• Executed on a maximum of 90 processors (out of a maximum 159) across 7 PRAGMA grid resources located in Australia, Japan, Korea, Taiwan, Thailand and the U.S.

• David Abramson, Amanda Lynch

Validation of Cyberinfrastructure Investmentsby the Savannah Burn experiment

• Science Resulted: The hypothesis that burning the Savanna can affect the strength and timing of the monsoon was confirmed.

• Testbed Exercised: The testbed operated for 170 days, and delivered over 1.25 million processor hours! Importantly, we were able to do a live upgrade of a number of the cyberinfrastructure components during the period.

• Middleware Improved: Improved Nimrod's ability to schedule computations by incorporating both data location and transport delays.

– Allowing it to make a better choice of resources, improving the performance of the system as well as its fault tolerance.

– We also enhanced Nimrod's ability to handle faults in the Grid testbed.

• Policy Impacted: The experiment shipped some 1.6TB of data across national and international networks. This exposed some interesting features of Australia’s network charging policy, and will lead to lasting improvements.

PRAGMA Overview and ApproachProcess to Promote Routine Use Team Science

Application-Driven CollaborationsApplications Middleware

Routine Use Lab/TestbedTesting Applications

Building Grid and GOC

Multiway DisseminationKey Middleware

Workshops and Organization

Information Exchange

Planning and Review

New Collaborations

New Members

Expand Users

Expand Impact

Outcomes

Improved middlewareBroader Use

New CollaborationsTransfer Tech.

StandardsPublications

New KnowledgeData AccessEducation

PRAGMA Continues to Experiment• Expand our impact to new application areas

– GEO and Geosciences*; Metagenomics*

• Increase emphasis on data in our routine use laboratory – Establish data grid testbed* (AIST, SDSC, Tsukuba, NCHC)– GEO and Geosciences and others

• Harness the potential of lambda grids– Telescience and Tile Display Walls* with demo at SC06

• Work with productions grids to achieve interoperations– Grid Interoperations Now (GIN)*

• Broaden involvement of middleware developments from outside the Pacific Rim– U Amsterdam; UK National e-science Center, U Zurich

• Build the community– Develop federated approach to training and to establishing research

directions*– Understand organizational aspects of how virtual organizations work*

* We’ll already be seeing results of some of these activities

PRAGMA Grid TestbedPRAGMA Grid Testbed

AISTOSAKAUTITECHJapan

CNICGUCASChina

KISTIKorea

ASCCNCHCTaiwanUoHyd

India

MUAustralia

BIIIHPCNGO

Singapore

KUNECTECThailand

NCSAUSA

SDSCUSA

CICESEMexico

UNAMMexico

UChileChile

QUTAustralia

UZurichSwitzerland

JLUChina

MIMOSUSM

Malaysia

IOIT-HCMVietnam

BUUSA

UMCUSA

30 Clusters from 27 institutions in 14 countries

Source Cindy Zheng

Applications http://goc.pragma-grid.net

• Achieved long run and scientific results– Savannah/Nimrod, MU, Australia– FMO/Ninf-G, AIST, Japan

• Successful run– MM5/Mpich-Gx, CICESE/KISTI,

Mexico/KISTI

• 11 applications continue run in testbed– Savannah: climate model, MU, Australia– MM5: climate model, CICESE, Mexico– QM-MD, FMO: quantum-mechanics, AIST,

Japan– iGAP: genomics, UCSD, USA– HPM: genomics, IOIT-HCM, Vietnam– mpiBlast: genomics, ASCC, Taiwan– Gamess-APBS: organic chemistry,

UZurich, Switzerland– Siesta: molecular simulation, UZurich,

Switzerland– Amber: molecular simulation, USM,

Malaysia

Source Cindy Zheng

• Coupling of applications with middleware

Grid Security

• APGrid PMA Meeting (yesterday)– See Yoshio Tanaka

• IGTF (OGF) http://www.gridpma.org/– APGrid PMA, http://www.apgridpma.org/

• 5 site-CAs are IGTF accredited– AIST, ASGC, CNIC, NCSA, NECTEC

• PRAGMA CA– Naregi-CA, https://www.naregi.org/ca/

• APGrid, UChile, …– Experimental CA in use for users/hosts– Working on production CA under APGRID PMA

• GAMA and Naregi-CA integration– GAMA, http://grid-devel.sdsc.edu/gridsphere/gridsphere?cid=gama– User private key issue

Grid Interoperation Now (GIN)http://forge.gridforum.org/sf/wiki/do/viewPage/projects.gin/wiki/GinOps

• GIN testbed (started Feb. 2006)– PRAGMA, TeraGrid, EGEE, OSG, NorduGrid

• Applications– TDDFT/Ninf-G

• Lead: Yoshio Tanaka, Yusuke Tanimura (AIST, Japan)

• Deployed and run– PRAGMA - AIST, NCSA, SDSC– TeraGrid – ANL– OSG – UCSD– NordiGrid

• Working on deployment to EGEE

– Savanah Study (data intensive)• Lead: Colin Enticott (MU, Australia)

• In preparation

• Presentation at SC06

Grid Interoperation Now (GIN) [2]http://forge.gridforum.org/sf/wiki/do/viewPage/projects.gin/wiki/GinOps

• Somsak Sriprayoonsakul, Sugree Phatanapherom, (KU, ThaiGrid)• Infrastructure testing matrix

– Test 7 clusters from 5 grids http://goc.pragma-grid.net/cgi-bin/scmsweb/probe.cgi

– New version to handle various grid service configurations/tests• GIN map

– implemented a XML-> LDIF translator for GIN maphttp://maps.google.com/maps?q=http://lfield.home.cern.ch/lfield/gin.kml

• Cross-grid monitoring– Common schema

http://wiki.pragma-grid.net/index.php?title=GIN_%28Grid_Inter-operation_Now%29_Monitoring

Telescience

Osaka has deployed software and tested with UCSD and NCHCTransferred dv and hdv bidirectionally using pixer movie

Hope to have Osaka University President Miyahara tomorrow from Thailand!

Developed by PRIUS Students

SO

FT

WA

RE

Global Engagement Examples and Programs

GR

IDE

DU

CA

TIO

NS

CIE

NC

E

• GLEON– Global Ecological Observatory Network– Grassroots effort to understand lake dynamics

• PRIME – Pacific Rim Undergraduate Experiences– Prepares globally-enabled workforce

• PRIUS– Pacific Rim International UniverSity at Osaka University– Prepares global workforce in context of curriculum

• PRAGMA– Pacific Rim Application and Grid Middleware Assembly– Catalyzes collaborations

• OptIPuter: – Optical networking, Internet Protocol, computer storage,

processing and visualization technologies – Develops technologies for data intensive computing and

collaborations

Source: Philip Papadopoulos – Talk to NSF about Global Engagement

3rd GLEON and CREON Joint Workshop3-4 October 2006 Hsinchu

• Science: – Qualitative explanation of

diel oxygen– Understanding biological

and physical influences on metabolism by modeling

– Publications

• Data Infrastructure: – Metadata about lakes;

controlled vocabulary

• Students:– Find funding

• Next Meeting: GLEON– Finland, March 2-5 2007

PRIME: A Pilot Project for Global Engagement

• Built on top of PRAGMA people network and activities for Undergraduate Research:– Summer Internship in a host country laboratory– Mentors in US and Abroad– Pre-/Post experience research opportunities – Cultural pre-/during-/post-activity awareness

component (use www.pacific.edu/culture)– Professional development seminars

PR

IME

Class

2006

PRIME 2006 and Beyond

• Sustainability• Enhancement of research, cultural

component, extended sites• Transfer, assess, and disseminate

Challenges for our renewal

With President Miyahara Osaka UWith President Miyahara Osaka U

NCHC’s New Facility TaichungNCHC’s New Facility Taichung

Monash U in MelbourneMonash U in Melbourne

Melissa DiCiero-Monash

Lao She Tea HouseLao She Tea House

PRIUS Students 2006

Queensland University of Technology:Raj Chhabra, Yohei Sawai, Junya SeoBioscience Portal

Nanyang Technological University (NTU), Singapore: Francis Lee, Shingo Takeda,

Junwei Zhang Grid Security

National Center for High-performanceComputing: Seiki Kuwabara, Fang-Pang Lin, Sun-In Lin, Yi-Haur Shiau, Jer-Huang Shiau and Shi-Wei Lo Tile Display Walls

Working Groups: Organize PRAGMA Efforts

• Resources and Data– Mason Katz, SDSC– Yoshio Tanaka, AIST– Cindy Zheng, SDSC (testbed)

• Biological Sciences– Karpjoo Jeong, Konkuk

U/KISTI– Habibah Wahab, USM– Raj Chhabra, QUT– Wilfred Li, UCSD

• Telescience– Shinji Shimojo, Osaka– Fang-Pang Lin, NCHC

• GeoGrid, GEON (tentative)– Ryosuke Nakamura, AIST

Some Members and Participants

http://pragma-goc.rocksclusters.org/pragma-doc/org.html; Resource Group Album: Total 85 Pictures – and another album

Warning: Be wary of people with cameras

Annual Reports

•Prepare for SCxy•Highlight Accomplishments•Promote PRIME and PRIUS•Describe Working Group Progress•Summarize Individual Institution Contributions•Give Additional Information, e.g. Publications, Sponsors

Highlights of 2006 - 2007

• Simulating the Australian Monsoon and the Effect of Wildfires

• PRAGMA Biosciences Portal• PRAGMA Leads Grid Interoperation

Experiments in GIN Testbed• PRAGMA Establishes Certificate Authority (CA)

Using Naregi-CA Software• Expanding the Collaboration Grid• Building Communities, Catalyzing Collaborations• PRIME and PRIUS• More accomplishments in the Working Group

sections

Steering Committee Agenda• Business Issues

– New Membership Applications: Thai National Grid Center

– Workshop Applications: Proposal to host PRAGMA 15 (Fall 2008) in Penang Malaysia, by Universiti Sains Malaysia

– PRAGMA Annual Report: Review and Approve– SC’06 Schedule: Coordinate and Promote Activities

• Governance– Steering Committee Composition

• Other– PRAGMA Training / Research Institute – HPDC and PRAGMA collaboration (Satoshi

Matsuoka, Carl Kesselman)

Investing in the Future of PRAGMA Challenges and Opportunities

• Build the community – Grow shared resources; Set research directions; Engage new

applications; Create new generation of researchers and developers;

• Grow future leadership– What leadership opportunities or challenges can we create?

• Focus on science we can enable– Make routine use of testbed a reality

• Specific Challenges and Opportunities– Working Groups

• What other activities should be highlighted in the Annual Report?• What science accomplishment will you enable?• What type of “PRAGMA Institute” would benefit your members?

– HPDC – an opportunity to focus on a topic and engage others – similar to CCGrid activities

– How do we engage more students and postdocs?

Potential New Participantsto help address these challenges

• Chinese University Hong Kong, Sammy Tang• Academic State University Research Center, Costa Rica, Jose Castro• University of Auckland, New Zealand, Paul Bonnington• BeSTGRID New Zealand, Neil Gemmell• National Institute of Information and Communications Technology, Asako

Toyoda, Akiyoshi Nishiura, Masayuki Shimada, Yamaguchi Megumi• Kyoto University, Yasuo Okabe• Senri International Information Institute, Ryuichi Shimizu, Keishi Kimura• Kyushu University, Koji Okamura• Hyogo College of Medicine, Seiichi Kato• High Energy Accelerator Research Organization (KEK), Go Iwai• National Applied Research Laboratory, Taiwan, Joe Juang, Guey-Shin

Chang, Cheyenne Chen• Disaster Prevention & Research Center, National Cheng-Kung

University,Taiwan, Min-Lang Huang• National Chung Hsing University, Ye-Nu Wan• Institute of High-Energy Physics - Beijing, Huaxiang Fan• University of Utah, representing Vietnam’s Grid Effort, Thanh Truong• Florida International University, Julio Ibarra and Kuldeep Kumar

The Enablers of the Workshop

• NEC Corporation• SGI Japan Ltd.• Sun Microsystems • Nippon Telegraph and Telephone West

Corporation• KDDI Corporation• KDDI R&D Laboratories• Foundry Networks, Inc.

Thanks to the Local Organizing Committee

• Shinji Shimojo

• Susumu Date

• Kazunori Nozaki

• Tomomi Takeo

• Kae Nakagawa

• Many others

Welcome

Looking Forward to an Exciting Meeting

And see the second floor