October 24 2013， 1

Division ReportComputing Center

CHEN GangComputing Center

Oct. 24, 2013

October 24 2013， 2

Mission

• The Computing Centre (CC) is an IT supporting department to provide quality computing and network services to the Institute. – Deploy, operate and manage the high performance scientific

computing and network infrastructure– Provide Internet and other relevant services to the users. – Research and applications on cyber securities– Build and develop scientific database systems

• Some relevant R&Ds are carried out to foster the above tasks

October 24 2013， 3

History

• IHEP CC has been the pioneer of IT in China. – 1986 IHEP established the first Internet connection to CERN using point-to-point link

• largely promoted the collaborations on ALEPH and L3 experiments between China and CERN.

– 1988, an x.25 link was established between IHEP and CERN

– 1993, the network was upgraded to a 64 Kbps satellite link between IHEP and SLAC in

the US. • This was the first permanent Internet link from China to the rest of the world.

– 1994 the first China’s web site was set up at IHEP. • This web site made great contributions to the development and dissemination of Internet in

China.

– In last ten years, new technologies like Grid/Cloud computing have been developed and

implemented.

October 24 2013， 4

Organization

Computing Center

Computing Network Database Service

Cyber Security

October 24 2013， 5

Human Resource• 39 staff members, to the end of September

– ~2/3 have Master or Doctoral degrees.

– ~3/4 younger than 40 years old

• 19 graduate students

• Leading staff:– CHEN Gang, Director, with physics background. Distributed and HPC

– SUN Gongxing, Deputy Director, with physics background. HPC

– LIU Baoxu, Cyber security

– CHENG Yaodong, Storage Technology, Big data

– QI Fazhi, Network technology

Permanent staff

Age Academic Degree Title

39

≤30, 1631－ 40, 1341－ 50, 8≥51, 2

Doctor, 10Master, 15

Bachelor, 10

Full and assoc. professors, 11Engineers, 18 Technicians, 6

October 24 2013， 6

Infrastructure

• The IT infrastructure delivers 24x7x365 services to scientific and

administrative activities of the Institute. – 1500 computer nodes and servers are installed.

– The storage facility comprises PB-scale mass storage systems

– The campus network is equipped with a 10Gbps IPv4 and IPv6 dual-

stack link.

– The whole campus is covered with high speed wireless access points.

– Also dedicated high bandwidth links were established from IHEP to

other large HEP and cosmic ray experiments sites such as Daya Bay,

Dongguan and Yanbajing.

Computing platform• Independently developed (home-made) high

performance computing platform

October 24 ， 2013 7

~10000 CPU cores5PB tape library

Grid, Cloud, …>4PB disk space

October 24 2013， 8

Computing services

• The computing platform provides about 30 million CPU hours each year to scientific research projects.

October 24 2013， 9

WLCG Tier-2 site @IHEP• Support ATLAS and CMS experiments of LHC.

– Consists of 1000 CPU cores and 640 Terabytes of disk

space.

– 2.5 Gbps network link to Europe and a 1 Gbps network

link to the US.

• The operation quality of the Tier-2 site is ranked in the

first places among about 200 WLCG grid sites– especially ranked as a Leadership site for ATLAS

computing.

• More than 10 million CPU hours provided and more

than 5 millions of computing jobs processed every

year.– Contributed to François Englert and Peter W. Higgs.

– Science and Technology Award (2nd Place) by Beijing City

in 2012,

IHEP

October 24 2013， 10

Network Services

• Largest campus network in CAS, and largest int’l bandwidth for an institute.– 10G backbone

– IPv4/IPv6 dual-stack

– Wireless covered (>250 APs)

• ~500 network servers and devices

• Email/web/collaborative work/… services

• >3000 users

• ~4 PB of data exchanged every year with international collaborators

October 24 2013， 11

Technology R&D

• R&D activities are carried out. (some of them supported by NSFC and MoST)

• HPC, distributed (Grid, Cloud) computing systems.

• Mass storage system, High throughput distributed file systems. – Among the bests of worldwide HEP community

October 24 2013， 12

Technology R&D

• High throughput network, SDN, IPv6…– To build a fast network for HEP experiments

– Leading projects in the country

• Cyber security– Network information security research projects granted by

funding agencies.

– Researches include network attack and defense, intrusion

detection, forensics analysis.

– Technologies widely used in the country

• Scientific database– Create and develop the HEP data base.

– Important part of National Scientific

Data Resource Platform

October 24 2013， 13

Collaborations

• International collaborations with HEP labs were established. – CERN

– CC-IN2P3

– INFN

– ASGC

• Members of four EU FP6/FP7 projects, from 2007 to 2015,

collaborations on Grid and Cloud computing– EUChinaGrid

– EPIKH

– CHAIN

– CHAIN-REDS

October 24 2013， 14

Dissemination

• With its newly developed technologies and expertise, CC helped organizations to build or improve their IT systems– Computing and storage system, data management

system, network monitoring and management system, etc.

– Beneficiaries include Institutes, Universities, etc. • AMSS, IBCAS, ITPCAS, RCEES, SEMI, CASEBA, INEST of CAS; • Shandong Univ., Shanghai Jiaotong Univ., etc. • Industries

October 24 2013， 15

Dissemination• Launched first Chinese volunteer computing project, CAS@home.

– Harness public computing resources for scientific computing

– More than 100k public CPU cores registered.

– Applications of protein structure prediction, nanotechnology, cancer genomics,

HEP, etc. are supported.

• Built Open Scientific Big Data platform– Provide integrated services including data fetching, storage, computing, …

– Support Chinese First bigdata contest launched by CCF (Chinese Computer Federation).

– Thousands of public users

October 24 2013， 16

Challenges

• As IHEP is involved in more new large scale HEP related

projects, IT infrastructure needs to be ramped up very

quickly. This leads to new challenges to building,

operating and maintaining the system.

• Heavy burden of IT operations makes high level staff

difficult to focus on visioning R&D works.

• Stable support to fabric upgrade and renew is far from

enough.

October 24 2013， 17

Solutions and Prospects

• Adopt new technologies and improve the efficiency and quality of

IT operations

• Continue the R&D on the scientific computing and network, to

fulfill the computing requirements of new HEP projects. – Cloud computing, big data, IPv6, SDN, security, …

– International collaborations.

• Seek close collaborations with international and domestic labs and

industries.

• More efforts will be made to seek solid and stable financial

support from funding agencies

October 24 2013， 18

Summary

• IHEP CC has been the active IT player in the HEP community, as well as in other science disciplines.

• As a well-experienced team IHEP CC provides quality computing and network services to the Institute.

• More challenges we have to take up. But we will continue to move forward.

October 24 2013， 19

Thanks!