Deploying the Deploying the AstroGrid: AstroGrid:

Science Use for the Science Use for the Black Hole CensusBlack Hole Census

Nicholas WaltonInstitute of Astronomy,

The University of Cambridge

A PPARC funded project

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p2 Printed: 08/11/04

X-ray cluster: Chandra X-ray (Mullis) overlaid on a deep BRI image (Clowe & Luppino).

ES

O

Multiple large image sources:registration &association

Source ID from multiplexed spectral data

Multi-TB λCDMmodels, e.g.Millennium Sim

Generate Shear Mapsc.f. CDM models> DM distributionwith redshift Remove stars

correlate galswith z

Colour-Colourrelationshipsclassification in multi-phase space

Automatic clusterfinding techniques

NA

SA

Recap: New & Improved Science:Recap: New & Improved Science:CosmologyCosmology

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p3 Printed: 08/11/04

Supernova Remnant Cassiopeia-A – a 300

year old Supernova

The Challenge and Opportunity of multi-

Wavelength data:Shocks seen in the X-ray Chandra image

Heavy elementsseen in the optical

Dust shows in the IR

Images from Chandra Science Centre

Mapping e¯s in the magnetic field as revealed by Radio data

N A Walton: AstroGrid SAG : Meeting 1 : IoA : June 19, 2003 p4 Printed: 08/11/04

The Need for Virtual Observatories: The Need for Virtual Observatories: Managing Technological ChangeManaging Technological Change

● The massive Growth of Data● Number + size of telescopes

● Optical: ESO's 4x8m VLT, 2x8m Gemini ● X-ray: XMM-Newton● sub-mm: ALMA

● Increase in size and multiplex capabilities of instrumentation:● Infra-Red: VISTA > 100 GB/nights● Radio: e-Merlin > data rates ~320 Gbps

● All sky at 0.1 arcsec – 100 TB

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p5 Printed: 08/11/04

AstroGrid (VO) Key GoalsAstroGrid (VO) Key Goals

Enable Science by:● Improving the quality, ease, speed and cost effectiveness

of on-line astronomy● Making comparison and integration of data from diverse

sources seamless and transparent● Removing data analysis barriers to multiwavelength

analysis● Enabling access and manipulation of large data sets

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p6 Printed: 08/11/04

AstroGrid 'Ten' Key Science DriversAstroGrid 'Ten' Key Science Drivers

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p7 Printed: 08/11/04

Partnerships in Partnerships in EuropeEuropedelivering technology delivering technology for the Astrophysical for the Astrophysical Virtual ObservatoryVirtual Observatory

AstroG

rid: Technology lead in the A

VO

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p8 Printed: 08/11/04

The International Virtual Observatory The International Virtual Observatory Alliance (IVOA) Alliance (IVOA)

agreeing vital low level standardsagreeing vital low level standards

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p9 Printed: 08/11/04

Deployment StrategyDeployment Strategy● Goal: provide rapid operational feedback to ongoing

development process● AstroGrid has an iterative release cycle● Each release is deployed during the following 'iteration'● Deployment

– Release s/w components installed on the AstroGrid Testbed– Associated release documentation and walk throughs– Dedicated feedback reporting system– In use with 'beta-testers'

● Integration of AstroGrid testbed with EU Astrophysical Virtual Observatory activities

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p10 Printed: 08/11/04

The AstroGrid TestbedThe AstroGrid Testbed

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p11 Printed: 08/11/04

AstroGrid nodes: AstroGrid nodes: connected to fast backboneconnected to fast backbone

2.5Gbit/s

>1 Gbit/sec

10 Gbit/s

AGnode

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p12 Printed: 08/11/04

Iteration 05 Deployment ReleaseIteration 05 Deployment Release● Conforms to IVOA

standards ● Single sign in● User MySpace

– secure● Query building

– Standard queries● Build up workflow

– reusability

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p13 Printed: 08/11/04

Iteration 05 Deployment ReleaseIteration 05 Deployment Releasecomplex workflowscomplex workflows

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p14 Printed: 08/11/04

Itn05: use in AVO Demo: Jan 2004Itn05: use in AVO Demo: Jan 2004discovering distant quasars from multi-discovering distant quasars from multi-λ dataλ data

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p15 Printed: 08/11/04

New Science with the AVO Demo ToolNew Science with the AVO Demo Tool

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p16 Printed: 08/11/04

11stst Science from the AVO Science from the AVOenabling mass scale data mining enabling mass scale data mining

● Search for high luminosity Type 2 QSO's – Optically obscured due to viewing thru the dust torus

● Use of deep multicolour data – GOODS– HST ACS, XMM/ChandraX-Ray

● Use of AVO demonstrator tool – Revealed 4 times more Type-2 quasars in sample– Tool demonstrates ease of access to data

● Enabled via interoperability standards– Enhancement: Workflow to enable mass scale redshifts

● Padovani et al: astro-ph/0406056

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p17 Printed: 08/11/04

Iteration 06 Deployment ReleaseIteration 06 Deployment Release● More complex IVOA

standard implementation– SIAP interface

● Query builder: interface● Workflow: programmable● Registry: harvesting● Applications: varied● Data: image and tabular

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p18 Printed: 08/11/04

Movie Maker WorkflowMovie Maker Workflow

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p19 Printed: 08/11/04

AstroGrid Itn06: use in AVO Demo 2005AstroGrid Itn06: use in AVO Demo 2005

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p20 Printed: 08/11/04

AstroGrid: Helper ApplicationsAstroGrid: Helper Applications● Range of externally provided applications: tools to analyse

and visualise end and intermediate data products– VOPlot: handles VOTable data– VOPlot3D: handles VOTable data – 3D visualisation– Topcat: tabular data and manipulation – VOSpec: spectral plotting and analysis package– Specview: spectral plotting and analysis package– Aladin: data visualisation and catalogue access

● MySpace browser capability (read-only)● See http://wiki.astrogrid.org/bin/view/Astrogrid/VoResources

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p21 Printed: 08/11/04

The Next Steps: The Next Steps: Participant in VO Science Demos 2005Participant in VO Science Demos 2005● AstroGrid: Consortium meeting: mid Dec 2004

— Brown dwarf discovery— Solar coronal mass ejections

● Euro-VO: ESAC, Madrid: 25-26 Jan 2005— Star formation histories— AGB to PN transitions

● A Widening range of capabilities, data, applications — Increasing scientific usefulness

GOAL: end 2005 – science papers enabled by VOs

N A Walton: SC2004 - Pittsburgh: Nov 10, 2004 p22 Printed: 08/11/04

AstroGrid Version 1 Release: Jan 2005AstroGrid Version 1 Release: Jan 2005Prototype Virtual Observatory for the UKPrototype Virtual Observatory for the UK

http://www.astrogrid.org/release

Deploying the Deploying the AstroGrid: AstroGrid:

Science Use for the Science Use for the Black Hole CensusBlack Hole Census

http://www.astrogrid.org

A PPARC funded project