News and AnnouncementsTom JunkDUNE General Software and Computing MeetingMarch 8, 2016

Home Directory Migration• Going away: /afs/fnal.gov/files/home/room[1,2,3]/- Self-service backup recovery: Daily snapshots in

/afs/fnal.gov/files/backup/home/room[1,2,3]/

• New home directories: /nashome//- Self-service backup recovery: three times daily snapshots in

/nashome/.snapshot/ where encodes the time of the snapshot

• Old quotas: 500 MB (was 300 MB). New quotas: 2 GB.• Early adopters haven’t complained. Watch out for scripts with

hard-coded afs paths.• More info: http://computing.fnal.gov/nasan/afs-mig/Home-Dir-Migration-OverView.pdf

March 8, 2016 Tom Junk | News and Announcements 2

Batch Resource Limits

March 8, 2016 Tom Junk | News and Announcements 3

• EnforcementhasbegunonFermilab’s GPGrid• Wall-clocktime (short=3hours,medium=8 hours,defaultrequest8hours)

• Currentenforcement isveryloose– onlyafter48hourswill itbechecked.• Diskspace: defaultlimit: 35GB.Strictlyenforced• Memoryusage(resident sizeIbelieve): Default2GB.Strictlyenforced.

• Seehttps://cdcvs.fnal.gov/redmine/projects/dune/wiki/Submitting_Jobs_at_Fermilabfortipsonspecifyingresourcerequesttojobsub_submit

• Youcanalwaysaskformoreresources,butyourjobmaynotstartuntilanodewithsuchresourcesexists

• Ifyourjobexceeds anyofitsrequested resourcelimits, itwillbeheld,notkilled.

• jobsub_q –hold gives infoonheld jobs

Disk Space Tight on /dune/app

March 8, 2016 Tom Junk | News and Announcements 4

2.4Toutof3.0Tused

I’mrunningadeepdf toseewho’susingwhat.

Somehistoricalrootfile usageon/dune/app

35-ton Ongoing Run

March 8, 2016 Tom Junk | News and Announcements 5

• ”sliced” datatierdefinedbutnotyetused

• Slicerratherslow– manysecondsperevent– mostlyrunningthefragmenttoraw::RawDigit converter.Differentmemorylayoutbetween fragmentsandraw::RawDigit objectsrequiresshufflingeachADCvalue.

• DavidAdamsrequested populating thesliced datatierwithpre-sliced,formatteddata.Onlyissue isthatthereformatter assigns offlinechannelnumbersandthechannelmapisnotfinalized.

That,andweneedtoagreeonasliced triggerdefinition.

Wecouldjustreformatandnotslice – KarlWarburtonfoundaninconsistency inthereformatter’s packagingofdataineventswithinternal gaps.Gapsgotsqueezedoutwithoutanyrecordofthathappening. Karlhasfixedthisbyfillinggapswithpedestal.

Pre-Sliced 35-ton RCE Data Layout

March 8, 2016 Tom Junk | News and Announcements 6

MattGraham