Embed Size (px)
Citation preview
Korea Institute of Science and Technology Information
Visit to NeSC
Malcolm AtkinsonDirector
www.nesc.ac.uk
24th March 2004
Outline
The National e-Science Centre Role and missionThe e-Science Institute
The UK e-Science ProgrammeFunding and organisationThe UK GridThe European dimension
The Essence of e-Science
NeSC Roles
Help coordinate and lead UK e-ScienceCommunity building, training & outreach
Help establish the UK’s international roleThe focus for presenting UK e-Science
Run the e-Science InstituteA meeting placeWorkshops and conferencesResearch visitors and events
Undertake R&D projectsReliable middleware (OGSA-DAI, SunDCG, …)Engage industry (IBM, Sun, Microsoft, HP, Oracle, …)Stimulate the uptake of e-Science technology
Training Team
The Primary Requirement …
Enabling People to Work Together on Challenging Projects: Science, Engineering & Medicine
Events Held(from 1 Aug 2002 to 29 Feb 2004 – 31
months)We have run 197 events (just over 6 per
month):3 conferences (including GGF5 with 900 participants)20 project meetings 23 research meetings 61 workshops 4 schools32 training sessions27 outreach events9 international meetings18 e-Science management meetings
(though the definitions are fuzzy!)
16,444 delegate days197 events6,825 delegates 339 event days
The Website – a ResourceNational e-Science Centre http://www.nesc.ac.uk/
Mission, Background, Foundation, Locations, Staff, Resources, ProjectsRegister interest, Mailing lists, NeSCForgeRegional associations and CollaborationsNews, NoticesPresentations and Lectures http://www.nesc.ac.uk/presentations/
National e-Science Institute http://www.nesc.ac.uk/esi/
Mission, Events (Future and Past)Register for Events, Visitor Programme, GridNet
UK e-ScienceMap and Index of Centres http://www.nesc.ac.uk/centres/Technical Papers http://www.nesc.ac.uk/technical_papers/Index of >100 Projects http://www.nesc.ac.uk/projects/Task Forces http://www.nesc.ac.uk/teams/
General InformationGlossary, Bibliography, Who’s who
Widely used by UK, USA and the rest of the worldComprehensive and Growing Source of Information
Web site Statistics
Since going ‘live’ in 2001 to 31 Jan 2004 (figures in last week to 27 Feb 2004)> 3.0 million successful requests (‘hits’) transferring 166 gigabytes of data (2.20 GB)Average hits per day 3237 (5430)Distinct files served 18,980 (2821)… to 96,610 (3705) distinct hostsAverage data transferred per day 182 MB (typical file size about 100 kB) (322 MB)
Web site Statistics 2
0
2,000
4,000
6,000
8,000
10,000
12,000
14,000
16,000
18,0002
00
2/0
1
20
02
/02
20
02
/03
20
02
/04
20
02
/05
20
02
/06
20
02
/07
20
02
/08
20
02
/09
20
02
/10
20
02
/11
20
02
/12
20
03
/01
20
03
/02
20
03
/03
20
03
/04
20
03
/05
20
03
/06
20
03
/07
20
03
/08
20
03
/09
20
03
/10
20
03
/11
20
03
/12
20
04
/01
20
04
/02
Vo
lum
e (
MB
)
0
20000
40000
60000
80000
100000
120000
140000
160000
180000
200000
Su
cc
es
sfu
l H
its
AFRICA
AMERICA - NORTH
AMERICA - OTHER
ASIA
EUROPE - UK
EUROPE - NON UK
MIDDLE EAST
OCEANIA - PACIFIC
UNKNOWN
HITS
Technical ReportsThe Virtual Observatory as a Data Grid, Bob Mann, Sep 03UK Experience with OGSA, Dave Berry, Sep 03e-Science Gap Analysis, Geoffrey Fox, David Walker, Jun 03Scientific Data Mining, Integration and Visualisation, Bob Mann, Roy Williams, Malcolm Atkinson, Ken Brodlie, Amos Storkey, Chris Williams, Nov 02A Rough Guide to Grid Security, Mike Surridge, Sep 02Multi-Site Videoconferencing for the UK e-Science Programme, Stephen Booth, John Brooke, Kate Caldwell, Liz Carver, Michael Daw, David De Roure, Alan Flavell, Philippe Galvez, Brian Gilmore, Henry Hughes, Ben Juby, Ivan Judson, Jim Miller, Harvey Newman, Chris Osland, Sue Rogers, Oct 02Database Access and Integration Services on the Grid, Norman W Paton, Malcolm P Atkinson, Vijay Dialani, Dave Pearson, Tony Storey, Paul Watson, Feb 02Research Agenda for the Semantic Grid: A Future e-Science Infrastructure, David De Roure, Nicholas Jennings, Nigel Shadbolt, Dec 01Databases and the Grid, Paul Watson, Dec 01
Technical ReportsA Grid Application Framework based on Web Services Specifications and Practices, Savas Parastatidis, Jim Webber, Paul Watson, Thomas Rischbeck, Aug 03Grid Information Systems 2003 (Draft), Rob Allan, Dharmesh Chohan, Xiao Dong Wang, Andy Richards, Mark McKeown, John Colgrave, Matthew Dovey, Mark Baker, Steve Fisher, Dec 03Towards tractable toolkits for the Grid: a plea for lightweight, usable middleware, Jonathan Chin, Peter Coveney, Feb 04Portals and Portlets 2003, Rob Allan, Chris Awre, Mark Baker, Adrian Fish, Mar 04IMAGE 03: Images, Medical Analysis and Grid Environments, Dave Berry, Derek Hill, Steve Pieper, Joel Saltz, Cécile Germain-Renaud, Mar 04Open Issues in Grid Scheduling, Alain Andrieux, Dave Berry, Jon Garibaldi, Stephen Jarvis, Djamila Ouelhadj, Mar 04Data Provenance and Annotation, Peter Buneman, Michael Wilde.e-Science Workflow Services, Matthew Addis, Dave Berry, Earl Ecklund, Carole Goble
Outline
The National e-Science Centre Role and missionThe e-Science Institute
The UK e-Science ProgrammeFunding and organisationThe UK GridThe European dimension
The Essence of e-Science
NERC (£15M)7%
CLRC (£10M)5%
ESRC (£13.6M)6%
PPARC (£57.6M)27%
BBSRC (£18M)8%
MRC (£21.1M)10%
EPSRC (£77.7M)37%
Staff costs -Grid Resources
funded separately
Applied (£35M)45%
HPC (£11.5M)15%
Core (£31.2M)40%
EPSRC Breakdown
UK e-Science Budget (2001-2006)
Source: Science Budget 2003/4 – 2005/6, DTI(OST)
Total: £213M
+ Industrial Contributions
Globus Alliance
CeSC (Cambridge)
DigitalCurationCentre
e-Science Institute
Open Middleware
Infrastructure Institute
Grid Operations
Centre
?
The e-Science Centres
EGEE
Digital Curation Centre
Industry
research collaborators
standards bodies
testbeds& tools
communities of practice:
users
community support & outreach
research
development
servicesmanagement
& co-ordination
curation organisations
Collaborative Associates Network of DataOrganisations
Task ForcesDirectors’ Forum
Helped build a community
Engineering Task ForceBuilt the UK Grid
Architecture Task ForceUK Adoption of OGSAOGSA Grid MarketFuture approaches
Security Task ForceDatabase Task Force (now disbanded)
OGSA-DAI (www.ogsadai.org.uk)GGF DAIS-WG
Usability Task Force
CeSC (Cambridge)
The e-ScienceGrid
Engineering Task Force
(Contributions from e-Science
Centres)
Grid Support Centre / Grid Operations
Centre
OGSA Test Grid projects
HPC(x)
1280 x CPUAIX
64 x CPU4TB Disk
Linux
20 x CPU18TB Disk
Linux
512 x CPUIrix
Access Grid
Microphones
Cameras
Requires IP multicast
throughout the network
Crucial for management
meetings
Some UK e-Health Projects
eDIaMoND (with IBM and Mirada)Breast Cancer Project
IXI (with GSK and Philips Medical)Information from medical images
MIAS DevicesMobile sensors for healthcare
CLEFIntegrating medical information
eDiaMoND – Compute
Mammograms have different appearances, depending on image settings and acquisition systems
StandardMammoFormat
StandardMammoFormat
Temporal mammography
ComputerAidedDetection
3D View
EpidemiologyEpidemiology
TeachingTeaching
DiagnosisDiagnosis
ScreeningScreening
EpidemiologyEpidemiology
TeachingTeaching
DiagnosisDiagnosis
ScreeningScreening
eDiaMoND – Non-Functional
Grid
EthicsEthics
LegalLegal
SecuritySecurity
PerformancePerformance
ManageabilityManageability
…………
ScalabilityScalability
AuditabilityAuditabilityEpidemiologyEpidemiology
TeachingTeaching
DiagnosisDiagnosis
ScreeningScreening
EpidemiologyEpidemiology
TrainingTraining
ScreeningScreening
AnonymisationAnonymisation
256MB & 5 secs response
256MB & 5 secs response
Lossless CompressionLossless Compression
EncryptionEncryption
~100 Centres~100 Centres
Systems AdministrationSystems Administration
Non-RepudiationNon-Repudiation
KCL, Imperial and Oxfordhttp://www.ixi.org.uk
Automatic registration technology
Rigid registration of MR and CT imagesof the head
Inter-subject image warping
Need high quality, integrated clinical information for:
clinical research evidence-based health care the clinical application of genetic and genomic research
The capture, integration, and presentation of descriptive information is a major barrier to achieving an integrated frameworkData includes:
clinical historiesradiology and pathology reports annotations on genomic and image databases technical literature and Web based resources
CLEF - Integrating information
MIAS Devices Project
Easy Plug and Play of SensorsWireless connection using 802.11Positioning information from GPSMobile medical technologies on a distributed Grid
Sensor bus
GPS ariel
The European dimension
EGEE: Enabling Grids for E-Science in Europe
… and beyond32M Euro, 10 regions, 70 partnersAdditional funding from NSF (USA)50% production, 30% development, and 20% dissemination and training
“The Grid Infrastructure in Europe”Deploy a production Grid across EuropeInitially based on LHC Computing Grid
Grids for medical development
Preparation and follow-up of medical missions in developing countries
Support to local medical centres in terms of second diagnosis, patient follow-up and e-learning
2 missions (Ibagué & Chuxiong) with the french NPO « Chaîne de l’Espoir » used as test cases
IbaguéHand surgery Medical centre
Clermont-Ferrand/Paris
Chuxiong
Examples of HealthGRID applications
The grid impact :
•Improved telemedecine services
• Federation of patient databases
•Interactive e-learning (high bandwidth network required)
Request for
second diagnosis
Patient d
ata
consultatio
n
Second diagnostic
Patient follow-up
Patient dataRequest for
2nd diagnostic
Interactiv
e e-learn
ing
Video-conferences
DataGrid : status of biomedical
applications
Bio-informaticsPhylogenetics : BBE Lyon (T. Sylvestre)Search for primers : Centrale Paris (K. Kurata)Bio-informatics web portal : IBCP (C. Blanchet)Parasitology : LBP Clermont, Univ B. Pascal (N. Jacq)Data-mining on DNA chips : Karolinska (R. Médina, R. Martinez)Geometrical protein comparison : Univ. Padova (C. Ferrari)
Medical imagingMR image simulation : CREATIS (H. Benoit-Cattin)Medical data and metadata management : CREATIS (J. Montagnat)Mammographies analysis ERIC/Lyon 2 (S. Miguet, T. Tweed)Simulation platform for PET/SPECT based on Geant4 : GATE collaboration (L. Maigne) 0
20
40
60
80
100
120
140
160
180
Parallelisation
Tem
ps
en m
inu
tes
Local_Monopro1500MHzX10X20X50X100
deployedtested on EDGunder preparation
GATE Monte-Carlo simulation platform for nuclear medecine
eHealtheScience
Outline
The National e-Science Centre Role and missionThe e-Science Institute
The UK e-Science ProgrammeFunding and organisationThe UK GridThe European dimension
The Essence of e-Science
What is e-Science?Invention and exploitation of advanced computational methods
to generate, curate and analyse research data From experiments, observations and simulations Quality management, preservation and reliable evidence
to develop and explore models and simulations
Computation and data at extreme scales Trustworthy, economic, timely and relevant results
to enable dynamic distributed virtual organisations
Facilitating collaboration with information and resource sharing Security, reliability, accountability, manageability and agility
e-Science >> Grid & Web Services It is what you do with them that counts
Fundamental & Growing Assets
Understanding of Processes & RequirementsInternational and Multi-disciplinary Skill baseExperience composing & adapting existing technologies
and of building new components
Experience Supporting Developers and UsersExperience Establishing Virtual Organisations across Enterprise boundaries
Embedded in People & Teams, Growing – they need nurture
Primary Multi-Enterprise Issues
Combining subsystems built independently in different enterprisesDeploying, Starting and Managing Applications and Production Operations
Using a set of combined facilitiesIndependently builtAutonomously managed
Developing software independentlyExpecting to integrate later
All for VO communities that retain independence
Assume Benefits of Shared Infrastructure:How much?One size fits all?
Relative Importance
What envelopes you put your messages in
How they are deliveredInfrastructure to organise a common technical platform – the foundations of communication
Relative Importance
What envelopes you put your messages inHow they are deliveredInfrastructure to organise a common technical platform – the foundations of communication
What information you send in your messages
Their patterns of Use - sequences that mean somethingTheir ContentsThe Grammar and Vocabulary of CommunicationAgreed Interpretations
Relative ImportanceWhat envelopes you put your messages in
How they are delivered
Infrastructure to organise a common technical platform – the foundations of communication
What information you send in your messagesTheir patterns of Use - sequences that mean somethingTheir ContentsThe Grammar and Vocabulary of CommunicationAgreed Interpretations
What you do when you get a messageThe Application Code you ExecuteThe Middleware Services
Security, Privacy, Authorisation, Accounting, Registries, Brokers, …
Integration Services Multi-site Hierarchical Scheduling, Data Access & Integration, …
Portals, Workflow Systems, Virtual Data, Semantic GridsTools to support Application Developers, Users & Operations
TechnicalExperts
Relative ImportanceWhat envelopes you put your messages in
How they are deliveredInfrastructure to organise a common technical platform – the foundations of communication
What information you send in your messagesTheir patterns of Use - sequences that mean somethingTheir ContentsThe Grammar and Vocabulary of CommunicationAgreed Interpretations
What you do when you get a messageThe Application Code you ExecuteThe Middleware Services
Security, Privacy, Authorisation, Accounting, Registries, Brokers, …
Integration Services Multi-site Hierarchical Scheduling, Data Access & Integration, …
Portals, Workflow Systems, Virtual Data, Semantic GridsTools to support Application Developers, Users & Operations
Creative Actions and Judgements of Researchers, Designers & Clinicians
Data, Models & AnalysesIn Silico Experiments, Design, Diagnosis & PlanningCreating the Scientific Record
DomainSpecialists
Where Next for e-Infrastructure
Put people and teams firstThe creative forceThe repository of Experience, Skills and Knowledge
Focus on Major PrioritiesDeveloping well-defined Flexible Agreements
Embraced as standards
High-level Software Investment Applications & Requirements led
Explore & Evolve Common & Shared Infrastructure
Recognise and respond to differencesCelebrate and support commonalities
