Embed Size (px)
DESCRIPTION
Data Flow Operations Group (DFO): Past, Present, and Future David Silva Head, Data Flow Operations. Mission. Main Tasks Create master calibrations Derive and trend QC parameters Create science products (Service Mode) Prepare data packages (Service Mode) - PowerPoint PPT Presentation
Citation preview
ESO EWR 2004 – 1
Data Flow Operations Group (DFO):Past, Present, and Future
David SilvaHead, Data Flow Operations
ESO EWR 2004 – 2
Mission
Main Tasks• Create master calibrations• Derive and trend QC parameters• Create science products (Service Mode)• Prepare data packages (Service Mode)• Pipelines & QC parameters: requirements &
testing
Customers• Paranal Science Operations• ESO community (PIs, archive users)
Home Page: www.eso.org/qc
ESO EWR 2004 – 3
Current Staff
Danuta DobrzyckaNACO/VISIR
Paola SartorettiVIMOS
Roberto MignaniFORS1/FORS2
Reinhard HanuschikGIRAFFE
Burkhard WolffUVES/UVES-Fiber
Isabelle PercheronVLTI
Wolfgang HummelISAAC/SINFONI
David SilvaGroup Head
Complete VLT/VLTI/VST team
Past members: Bruno Leibundgut (Group Head,before Oct 2001), Paola Amico (1998 - 2001), NandoPatat (1999 - 2001)
ESO EWR 2004 – 4
Information by Instrument
Similar pages for every VLT/VLTI instrument
ESO EWR 2004 – 5
HealthCheck
Joint PSO/DFO project
Goal: organize all information needed by PSO in one place.
ESO EWR 2004 – 6
5 Years of Progress: Processing & Staff Growth
0
5,000
10,000
15,000
20,000
25,000
30,000
35,000
40,000
45,000
P63 P64 P65 P66 P67 P68 P69 P70 P71
Reduction Blocks
VIMOSGIRAFFENACOFORS2UVESISAACFORS1
0.0
20.0
40.0
60.0
80.0
100.0
120.0
P63 P64 P65 P66 P67 P68 P69 P70 P71
SCI Pixels (Gpix)
VIMOSGIRAFFENACOFORS2UVESISAACFORS1
0
50
100
150
200
250
300
350
400
P63 P64 P65 P66 P67 P68 P69 P70 P71
CAL Pixels (Gpix)
VIMOSGIRAFFENACOFORS2UVESISAACFORS1
0.0
20.0
40.0
60.0
80.0
100.0
120.0
P63 P64 P65 P66 P67 P68 P69 P70 P71
Gpix/Person
0
1
2
3
4
5
6
Number of Persons
ESO EWR 2004 – 7
5 Years of Progress:Data Delivery Growth
0
50
100
150
200
250
300
P63 P64 P65 P66 P67 P68 P69 P70 P71
Data Packages
VIMOSGIRAFFENACOFORS2UVESISAACFORS1
0
50
100
150
200
250
300
350
400
450
500
P63 P64 P65 P66 P67 P68 P69 P70 P71
DVDs Shipped
VIMOSGIRAFFENACOFORS2UVESISAACFORS1
0
5,000
10,000
15,000
20,000
25,000
30,000
35,000
40,000
45,000
50,000
P63 P64 P65 P66 P67 P68 P69 P70 P71
MasterCals
VIMOSGIRAFFENACOFORS2UVESISAACFORS1
ESO EWR 2004 – 8
IFU12%
MED88%
LW-IMG10%
LW-SPEC4%
SW-IMG62%
SW-SPEC24%
IFU44%
IMG46%
MOS10%
OTHER3%
SPEC5%
IMG92%
Green = science, calibration, and QC productsCollaborative development effort with DFS Pipeline team
ECH86%
FIBRE14%
FORS1 UVES VIMOS
FORS2 ISAAC GIRAFFE
IMG30%
IPOL7%
LSS40%
MOS9%
PMOS14%
IMG18%
LSS20%
MOS5%
MXU57%
NACO
0
500
1000
1500
2000
2500
3000
3500
FORS1 FORS2 GIRAFFE ISAAC NACO UVES VIMOS
Integration Time (Hours)
Service Mode 2003Scaled by Integration Time
5 Years of Progress: DFO Supported Modes
ESO EWR 2004 – 9
Three-Year Outlook: More Volume, More Complexity
• New VLT/VLTI Instruments• SINFONI, VISIR, CRIRES, Hawk-I (?)• MIDI, AMBER• Question: how many VLTI nights (UT+AT)?
• VST/Cam
• 15 Tbyte/year - unprocessed!• Cluster storage & computing
• VISTA (?)• New staff? Better efficiency?
• New, cross-instrument software systemCam + Cen
