U.S. CMS Phase -1 and HL-LHC Upgrades€¦ · Trigger/HLT/DAQ • Track information in L1 -Trigger • L1-Trigger: 12.5 µslatency –output 750 kHz • HLT output 7.5 kHz Barrel

AndersRydU.S.CMSPhase-1andHL-LHCUpgradesHEPAPNov.21-22,2019p.1

U.S.CMSPhase-1andHL-LHCUpgrades

AndersRyd(Cornell)onbehalfofU.S.CMS

HEPAPMeetingNov.21-22,2019


§OverviewofCMSandHL-LHC§ Phase-1§HL-LHC§ Computing§ Summary

Outline


U.S.CMSandCMS

spring

51U.S.InstitutionsonCMSU.S.CMSplaysacrucialroleinCMS

(incl.2%nucl.)


LHC/HL-LHCUpgradeTimeline

Phase-1

HL-LHC


§ CMSfollowedanapproachofearlyinstallationofthePhase-1upgradesanddetectorimprovementsfromLS1(2013/14)toLS2(2019/20)

CMSPhase-1Upgrades

§NewpixeldetectorinstalledintheEYETS2016/17§ DC-DCproblemrequiredrepairsintheYETS2017/18

§ Barrellayer1replacement(plannedafterRun2)willbeinstalledduringLS2(2020)(notU.S.Scope)


§ L1Triggerupgradeinstalledin2015anddatataking2016

§Upgradedreadoutforhadroncalorimeter§ ForwardupgradestartedinLS1,completedintheEYETS2016/17

§ Endcap front-endelectronicsandphotosensorsupgradedunYETS2017/18

§ BarrelupgradecompletedinLS2

CMSPhase-1UpgradesCont.

§ TheU.S.(NSF+DOE)Phase-1contribution~$40M§ Theseupgradeswerecompletedthissummer

4ReadoutModules (RM)


§ TheHL-LHCupgradeswilladdressthreeofthefiveP5ScienceDrivers1. UsetheHiggsbosonasanewtoolfordiscovery2. Pursuethephysicsassociatedwithneutrinomass3. Identifythenewphysicsofdarkmatter4. Understandcosmicacceleration:darkenergyandinflation5. Exploretheunknown:newparticles,interactions,andphysical

principles.§ UpgradesdesignedtotakefulladvantageoftheHL-LHC

§ Designedfor3ab-1 – radiationtolerance§ Operatingat200PU– handlethehighoccupancyenvironment§ Keysciencerequirements:

§ Maintainlowtriggerthreshold§ Forwardjettagging§ EfficientHiggsreconstruction§ PUmitigation§ Secondaryvertextagging

CMSHL-LHCUpgradeGoals


TrackingUpgradesforHL-LHCTB2S

TiltedTBPSBarrelTBPSTEDD

BarrelPix ForwardPix

ExtendedPix

Service Cylinder

TFPX NSF

Scope

TBPX

TEPX

Cooling tubes

Power cables

Optical Fibers

§NewSibasedtracker§ OutertrackerinstrumentedwithpT discriminatingmodulesforL1tracking

§ pT>2GeV @40MHz§ Innertracker(‘pixeldetector’)extendsforwardtrackingto|η|<4


CalorimeterUpgradesforHL-LHC§NewHighGranularityforwardcalorimeter§ Highresolution4-Dreconstruction§ 28electromagneticlayers,siliconmodules(Cu/CuW/Pb absorber,25X0,1.3λ)

§ 22hadronic layers:Si+Si/SiPM(stainlesssteelabsorber,8.5λ)

§Upgradedbarrelreadout§ Crystallevelreadoutfortrigger§ Precisiontiming


MIPTimingDetector(MTD)§ ProvideprecisiontimingforMIPparticles– mitigatePU

§ LYSOcrystals+SIPMsinbarrel§ SILGADinendcap


SummaryofCMSHL-LHCUpgrades

DOE

NSFDOE andNSF

NSF

NSF

Trigger/HLT/DAQ• Trackinformation inL1-Trigger• L1-Trigger:12.5µs latency– output750kHz• HLToutput 7.5kHz

BarrelECAL/HCAL• ReplaceFE/BEelectronics• LowerECALoperating temp.(8⚬C)

Muon Systems• ReplaceDT&CSCFE/BEElectronics

• CompleteMuon coverageinregion1.5<η<2.4

• Muon tagging2.4<η<3NewEndcap Calorimeters• Rad.tolerant– highgranularity• 3Dcapable

NewTracker• Rad.tolerant– highgranularity– significant lessmaterial• 40MHzselectivereadout(pT>2GeV)inOuterTrackerforL1-Trigger

• Extendedcoveragetoη=4

DOEMIPPrecisionTimingDetector• Barrel:Crystal+SiPM• Endcap:LowGainAvalancheDiodes

DOE


CMSandCERNHL-LHCApproval§ TDRswrittenandapprovedbyLHCC/RRB:

§Next:§ L1Trigger(2020)§ DAQ/HLT(2021)§ BeamRadiation,InstrumentationandLuminosity(2020)§ Computing(2022)

TrackerMuons Endcap Calo.BarrelCalo.MIPTiming

InterimTDRsin2017


U.S.HL-LHCApprovalTimeline

ConstructionApr2020-Feb2026

Installation(notMREFC)

CDR PDR FDR

CD-0 CD-1 CD-2 CD-4CD-3

DOEO413.3B

NSFMREFC


§ FollowingtheP5reportin2014NSFformedasubcommittee(oftheMPSAdvisoryCommittee)torecommendNSF’sresponsetotheP5report§ RecommendedNSFpursueanMREFCfortheHL-LHCupgrades§ OneHL-LHCMREFCforCMS+ATLAS($75M+$75M)

§ CMShasproceededthroughtheMREFCapprovalprocess:§ ConceptualDesignReview– March2016§ PreliminaryDesignReview– December2017§ FinalDesignReview– September2019

§ PlanistostartconstructionprojectApril1,2020§ NationalScienceBoardapprovaltargetedforFeb.2020

§ InadditiontotheMREFCfundstheNSFhassupportedtheR&Dphase(~$11M)andwillsupportinstallation(~4M)§ Supporthascomethroughtheoperationsprogram

NSF- StatusforHL-LHCUpgrades


§ TheCMSHL-LHCUpgradeapprovalprocess§ CD-0(ApproveMissionNeeds)March2015§ CD-1(ApproveAlternativeSelectionandCostRange)Oct.2019

§ CD-3A(Earlyprocurements)March(2020)§ CD-2(ApprovePerformanceBaseline)Nov.2020

§ TheDOETotalProjectCost(TPC)is$162M(incl.installationandcommissioning)§ EarlyR&DsupportedbyU.S.CMSOperationsProgram

DOE– StatusofHL-LHCUpgrades


§ 48InstitutionsinvolvedwiththeHL-LHCupgrades§ Scientificlaboriseffortthatisnotontheproject:

§ GraduateStudents,Postdocs,Faculty/Scientists§ Graduatestudentandpostdocinvolvementisessentialforthetrainingoffuturescientists

§Withthetightfundingforresearchtheavailabilityofthescientificlaborisaconcernfortheupgradeproject

ScientificLabor

ScientificLaborEffort:141FTEyearsGrad.Students128FTEyearsPostdocs189FTEyearsScientists

Totaleffort458FTEyearsAtpeak~80FTEs

Wealsohave94FTEyearsofcostedundergraduateeffort


§ ATLAS/CMSareevaluating“FullLife-CycleCost”,includingComputing§ SolvingHL-LHCcomputingrequirestomodernizephysicssoftware§ CPUchallengeneeds innovativealgorithmsanddatastructures,includingML/AI

§ Newalgorithmstorunwellathighpile-uponmodernarchitecturesforCPUs,GPUs,FPGAs

§ Willallowforcosteffectivecomputingsolutionsbasedonindustrytrendsandemergingscienceinfrastructures,includingHPCandcomputingclouds

§ Storageisacostdriver,anddatastoragecannotbedone“opportunistically”§ NeedsR&DintoDataOrganization,ManagementandAccess

§ AreasofSoftwareandComputingResearchNeeds

HL-LHC:UnprecedentedComputingChallenges


§ OngoingR&DtodeveloptheblueprintforHL-LHCComputing§ InclosecoordinationandcollaborationintheUSandinternationally§ DOE— NSFpartnershipisessential:USLHCOpsPrograms,IRIS-HEP,CCE,etc

HL-LHCComputingR&DTimeline


§ Phase-1upgradescompleted§ CMSHL-LHCupgradesareexcitingandambitious

§ Newtrackerwithtriggerprimitive(pT discrimination)andextendedforwardcoverage

§ NewHigh-Granularityforwardcalorimeter§ NewMIPtimingdetector§ Upgradedreadoutandtriggerelectronics

§ HL-LHCupgradesproceeding§ CMS/CERNapprovalofTDRsformajordetectorcomponents§ NSFFinalDesignReviewheldinSept.2019

§ AnticipateprojectstartinApril2020§ DOECD-1ReviewheldOct.2012

§ CD-2expectedNov.2020

§ U.S.CMScollaborationenthusiasticallyengaged

Summary


BACKUP


NSFScopeBudgetProfileatFDR

Contingency (M$) 3.9 5.8 2.8 1.9 2.7 0.0 0.0 17.1

Obligation(M$) 8.8 14.9 18.1 11.7 3.6 0.6 0.1 57.9

Total (M$) 12.7 20.7 20.9 13.6 6.3 0.6 0.1 75.0


DOEFundingProfile


TrendsinCMS,USCMSauthorsbyregion&gender

FemaleauthorfractionU.S.CMSPhysicists:Postdocs:23±4%(faculty+researchers):Junior:35±10%Senior:12±2%


Trainingofgraduatestudents§ GiventhelargesizeandlongtimescalesofCMS,werecognizeourimportantroleinthestewardship of

ourfield, especiallyintermsoftrainingandmentoringstudents&postdocs

§ Concerns about15%decreaseingraduatestudents inthelastyear

§ Mentoringofearly-careerscientistsforleadershiprolesintheexperiment&industry§ MostU.S.CMSstudentswhocompletedtheirPh.D.since2008havefollowedscientific careers

andaredistinguishing themselves inacademic,research,andindustry environments.§ Outside academia,theyhavebroughtexpertiseondatascienceandadvancedcomputing

techniques e.g.machinelearningtoadiverse arrayofprojects inhigh-techindustry, medicine,andothersectors.

§ Autopilot developmentforTeslaMotors,AIresearchforDeepMind§ EducationaldataminingforPearsonNorthAmerica§ Softwaredevelopment fortheNationalCenterforMissingandExploitedChildren§ Cloud computingforAmazonWebServices, andapplicationsinthehealth-caresector.

160

170

180

190

200

210

220

2015 2016 2017 2018 2019

DoctoralStudentAuthors

15%


Decreasingtimeavailablefordoing“Science”

§ KeeptotalnumberofFTEavailable inFY17(portfolioreview)§ ProjectedoperationsFTEneedsassumedconstantperyear(portfolioreview)§ Projectedneedsforscientific laborprofileforcarryingoutHL-HCdetectorR&Dandconstruction§ Compute“fractionofFTEavailable” forcarryingout“Science tasks”afteraccountingforFTE

needsbyoperationsandupgrade§ ComparedtoFY17expect~40%decrease byFY22!!

§ Optimisticestimate asEFbudgetshavedecreasedconsistentlysincethen.

Sciencetasksdefinedas:• performinganalysis,• developinginnovativeanalysistechniques,• publications,• studiesforHL-LHC,• indulgingincommunityactivities

• (e.g snowmass,outreach,etc)

Itisgettinguntenableoverextension,workingweekendsnotveryconducivetoincreasingdiversityinthefield,alsodoesnotpromotefamilyfriendliness.

0

0.5

1

1.5

Year FY17 FY18 FY19 FY20 FY21 FY22

ScienceFTEfractioncomparedtoFY17

(innovations+analysis+publications)

Documents

U.S. CMS Phase -1 and HL-LHC Upgrades€¦ · Trigger/HLT/DAQ • Track information in L1 -Trigger • L1-Trigger: 12.5 µslatency –output 750 kHz • HLT output 7.5 kHz Barrel