19
The ALMA Online Control Software: An Overview and Ways to Improve Data Quality R. Rosen

The ALMA Online Control Software: An Overview and Ways to … · 2015. 9. 18. · Archive and Relational Database ARCHIVE: xml store, binary store Relational database: state database,

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

  • The ALMA Online Control Software: An Overview and Ways to Improve Data Quality

    R. Rosen

  • Bird’s Eye View

    R. HiriartR. Rosen

  • In More Detail

    R. HiriartR. Rosen

  • DC, TelCal & QuickLook

    R. HiriartR. Rosen

  • DataCapturer

    R. Rosen

  • Archive and Relational Database

    ARCHIVE: xml store, binary store Relational database: state database, scheduling working database (swdb), asdm database

    Users: pipeline, OT, WebAQUA, anyone retrieving an asdm

    Users: Scheduling, QuickLook, WebAQUA

    Pros: Can hold large amounts of data Pros: Query-able, lots of configuration options, lots of performance tools

    Cons: Not query-able Cons: relies on Oracle, possible performance issues with large databases

    R. Rosen

  • QuickLook

    R. Rosen

  • Scheduling

    R. Rosen R. Rosen

    SubmissionPhase I

    GeneratedSBs

    ARPC Meeting

    OBSERVED!

    Phase IIGenerated

    SBs

    P2G

    Simulation

    Simulation

  • Scheduling

    R. Rosen

    ARCHIVExml store

    StateArchive

    SchedulingWorking

    Database(SWDB)

    SchedulingUpdater

    SchedulingData

    Model(APDM)

    DynamicScheduling

    Algorithm (DSA)Scheduling

    Panel

    ReadyRunningSuspended

    ScienceCSVCal

  • Scheduling

    R. Rosen

  • Software branches

    ● Trunk: development● Release branch: “staging area” prior to branching● Major releases:

    – 2014.6 (Cycle 3)– 2015.8 (Cycle 4)

    ● Minor releases: (incremental testing)– 2014.4 (subarrays)– 2015.6 (new python version)

    R. Rosen

  • Testing Cycle

    ● Phase A: testing by us– Modular tests– Jenkins– TFINT

    ● Phase B: “Verification” by Software Operations● Phase C: “Validation” by EOC/Scientists

    R. Rosen

  • Jenkins

    R. Rosen

  • Release Cycle

    Cycle311/04/14: Requirements deadline

    12/01/14 – 12/14/14: Implementation Phase

    12/15/14 – 01/30/15: Verification Phase

    02/17/15: Delivery

    Cycle 410/30/15: Requirements deadline

    11/30/15 – 12/14/15: Implementation Phase

    12/14/15 – 01/22/16: Verification Phase

    01/27/16: Deliveryhttps://ictwiki.alma.cl/twiki/bin/view/IRM/ReleasesPlanning

    R. Rosen

  • Telescope Meta Data

    ObservedPassed

    9/18/15R. Rosen

  • Telescope Meta Data

    9/18/15

    Syscal TimesCSV-2555FixplanetNull StateIDInvalid UIDSyscal Missing AntennaTsys Error

    R. Rosen

  • Future Projects

    ● Short term– QA0 flags– QuickLook

    ● Middle term– Porting to 64 bit– WebAQUA

    ● Long term– Migrate to relational database

    R. Rosen

  • Control Team● Ralph Marson (Control lead): ObservingModes, Devices,

    everything else● Patrick Brandt: Total power processor, hardware● Alexis Tejeda: Scheduling, TMCDB● Rachel Rosen: DataCapturer, QuickLook, Scheduling● Rodrigo Amestica: Correlator● J. Perez: Correlator

    ● Jorge Avarias: Scheduling (through 01/01/16)● Rafael Hiriart: TMCDB, Pipeline (through 01/01/16)

    R. Rosen

  • Paths for Improvement

    ● Communication directly with software team● Advocate for changes in the policies

    – Relational database– Continuous development and deployment

    R. Rosen

    Slide 1Slide 2Slide 3Slide 4Slide 5Slide 6Slide 7Slide 8Slide 9Slide 10Slide 11Slide 12Slide 13Slide 14Slide 15Slide 16Slide 17Slide 18Slide 19