Computing for LHC Physics 7th March 2014 International Women's Day - CERN- GOOGLE Networking Event Maria Alandes Pradillo CERN IT Department 7th March 2014 International Women's Day - CERN- GOOGLE Networking Event How to make a discovery? 7th March 2014 International Women's Day - CERN- GOOGLE Networking Event Accelerator Particle Detector Analysis (grid/cloud) 7th March 2014 International Women's Day - CERN- GOOGLE Networking Event The LHC Data Challenge 600 million collisions per second, reduced by the trigger system to a few GB/s data rate 20PB to 30PB of data per year This huge amount of data needs to be stored and processed for many years Data analysis requires at least ~100K typical PC processor cores CERN provides up to 20%-30% of the storage and the CPU The WLCG Project (Worldwide LHC Computing Grid) provides the computing and storage resources needed to meet the LHC data analysis challenge Collaboration managing heterogeneous resources -> This is yet another challenge! 7th March 2014 International Women's Day - CERN- GOOGLE Networking Event 7th March 2014 International Women's Day - CERN- GOOGLE Networking Event Worldwide LHC Computing Grid 160 sites in 35 countries cores 200PB of storage 2 million jobs/day 8000 users 7th March 2014 International Women's Day - CERN- GOOGLE Networking Event Tier-2 sites (about 150) Tier-1 sites Gbit/s links 7th March 2014 International Women's Day - CERN- GOOGLE Networking Event MB/sec 1-2 GB/sec ~ 4 GB/sec 1-2 GB/sec Data flow to permanent storage: 4-6 GB/sec LHC Data Journey Tier 0 Data recording Initial Data reconstruction Data distribution Tier 1s Permanent Storage Re-processing Analysis Tier 2s Simulation End-user analysis 7th March 2014 International Women's Day - CERN- GOOGLE Networking Event Where is LHC in Big Data Terms? 7th March 2014 International Women's Day - CERN- GOOGLE Networking Event Businesss sent 3000PB/year (Doesnt count; not managed as a coherent data set) Google search 100PB Facebook uploads 180PB/year Kaiser Permanente 30PB LHC data 15PB/yr YouTube 15PB/yr US Census Lib of Congress Climate DB Nasdaq Wired 4/2013 In 2012: 2800 Exabytes created or replicated 1 Exabyte = 1000 PB Current ATLAS data set, all data products: 140 PBBig Data in 2012 ~14x growth expected ~14x growth expected 7th March 2014 International Women's Day - CERN- GOOGLE Networking Event CERN Computing Centre 2700m2 for computing equipment, capacity for 3.9 MW electricity plus cooling Since June 2013, Wigner Institute in Budapest operates as an extension of CERN Computing Centre 7th March 2014 International Women's Day - CERN- GOOGLE Networking Event CERN Computing Centre cores 100 PB tape storage 120 PB disk Internet Exchange Point CERN Openlab: Evaluation of cutting edge IT technologies in partnership with industry 7th March 2014 International Women's Day - CERN- GOOGLE Networking Event