Embed Size (px)
Citation preview
HAH 2007/05/09
Connecting LOFAR to the GRID
Hanno Holties, ASTRONIVOA - OGF Astro-RG Work Shop
Manchester, 9th May 2007
HAH 2007/05/09
HAH 2007/05/09
HAH 2007/05/09
First result:• 96 LBA antennas• Upto 400 m apart• Dynamic range: ~1000:1• Cas A (strongest source) removed from image
HAH 2007/05/09
LOFAR operational modelLOFAR operational model
HAH 2007/05/09
LOFAR Central systemsLOFAR Central systems
Process ‘raw’ dataProcess ‘raw’ dataCalibrationCalibration
Reduce in sizeReduce in size
Temporary StorageTemporary StorageRaw data: 5 daysRaw data: 5 daysProcessed dataproducts: 1 monthProcessed dataproducts: 1 month
GbE
sw
itch
GbE
switc
hG
bEsw
itch
GbE
switc
hG
bEsw
itch
GbE
switc
hG
bEsw
itch
GbE
switc
hG
bEsw
itch
GbE
switc
h
GbE
switc
h
Inp
ut
Se
ctio
n
A uxiliary p rocessingsection
Sto
rag
e sy
s te m
O ff-line processing/user softw are
Off-lineS torageOn-L ine
Long term A rch iving& Data E xportG
bEsw
itch
On-L ine p ipe line process ingB lue Gene/L
Fro
m S
tatio
n P
roce
ssin
g
W A N
Push data to usersPush data to usersScience centers subscribe & publish Science centers subscribe & publish storage locationstorage locationLOFAR scheduler initiatesLOFAR scheduler initiates……or interactiveor interactive
HAH 2007/05/09
The LOFAR Network & GRIDThe LOFAR Network & GRID
GbE
sw
itch
GbE
sw
itch
GbE
sw
itch
GbE
sw
itch
GbE
sw
itch
GbE
sw
itch
GbE
sw
itch
GbE
sw
itch
GbE
sw
itch
GbE
sw
itch
GbE
sw
itch
Inp
ut
Se
c tio
n
A uxiliary p rocessingsection
Sto
rag
e s y
ste
m
O ff-line processing/user softw are
Off-lineS torageOn-Line
Long term A rch iving& D ata E xportG
bEs
witc
h
On-Line pipeline process ingB lue Gene/L
Fro
m S
tatio
n P
roce
ssin
g
W AN
700 Gbpsdedicated fibre
2 Gbps lightpaths
20 Gbps lightpaths
GRID
Computing centers
Science centers
LOFARinstrument
(Dutch part)
International LOFAR stations
Science centerwith local storage
HAH 2007/05/09
GRID utilizationGRID utilization
Long term storageLong term storageIn general at computing centerIn general at computing center
Searchable databaseSearchable databaseData miningData mining
Virtual ObservatoryVirtual Observatory
Offline processingOffline processingReprocessingReprocessing
Source extractionSource extraction
DifferencingDifferencing(search for variable or new sources)(search for variable or new sources)
HAH 2007/05/09
Storage requirementsStorage requirements
0
2000
4000
6000
8000
10000
12000
2007 2008 2009 2010 2011 2012 2013
LOFAR Storage prognosis (TB)
Archived
To be processed
Required storage capacity depends onDatatype (timeseries, visibilities, images)
Number of stations involved
Required time, frequency, and spatial resolution
Prognosis1.8 PB/Yr
HAH 2007/05/09
Processing requirementsProcessing requirements
In process of being definedApplications still being developed
GRID awareness of scientists just starting
Proximity to, and available bandwidth for, storageIO limited
Operate on Multi-Terabyte datasetsMostly embarrassingly parallel
EnvironmentApplication requirements
HPC tuning requires system details
Shield from scientist
HAH 2007/05/09
Where are we?Where are we?
Working group LOFAR & GRIDMeets on monthly basis
Users, RCG, SARA, NIKHEF, ASTRON/LOFAR
EGEE Tutorial before the summer
LOFAR VO (in GRID context)Group for each KSP (to become per science center)
Resources at SARA; RCG to follow shortly
Glite TAR-UI installed on storage frontend
Some groups have started to get their feet wetKapteyn Institute
UvA Transients group
HAH 2007/05/09
eLOFAR: The extended LOFAReLOFAR: The extended LOFAR
Interest from international partners in:Germany (www.lofar.de)UK (www.lofar-uk.org)FranceSwedenItalyPoland
Aiming to extend LOFAR with:International stationsScience Centers.Computing centers
HAH 2007/05/09
LOFAR challenges for GRIDLOFAR challenges for GRID
Storage20 Gbps sustainable bandwidth
Multi-Petabyte growth per year
Interactive databases
ProcessingOperate on Multi-TB datasets
Applications with varying requirements
UsabilityReliable facilities
Technical details shielded from (general) user
HAH 2007/05/09
