Storage review

Carmine CioffiDatabase Administrator and Developer

3D Workshop, Barcelona (ES),

20-21 April 2009

Outline

• Storage spec and configuration

• Performance

• Future plans

2

Storage spec and configuration

• Two disk arrays used by both databases (OGMA, LUGH):– Storage: 2 SAN, 2GBps FC – Single switch SANBOX 5200 2Gb/s– Physical disks available:

• Array 1: 16 disks SATA 260GB• Array 2: 6 disks SATA 550GB

– Arrays configured with RAID10

3

Storage spec and configuration

4

OGMA LUGH

FC switchSANBOX 5200 2Gb/s

OGMA (407 GB)

LUGH (407GB

)

OGMA (537GB

)

Disk array 1 Disk array 2

Storage spec and configuration

• ASM:– ATLAS:

• External redundancy• Single disk group• Two disks:

– disk 1 of 407 GB (205 free)– disk 2 of 537 GB (271 free)

– LHCb:• External redundancy• Single disk group• One disk 407 GB (337 free)

5

Performance MB/sec

6

MB/ sec

0

10

20

30

40

50

60

0 1 2 3 4 5 6 7 8 16 24 32 40 48 56 64 72 80 88 96 104 112 120 128 136 144 152 160

Small IO

Large IO 0

Large IO 1

Large IO 2

Large IO 3

Large IO 4

Performance IO/sec

7

IO/sec

0

100

200

300

400

500

600

700

800

900

1 2 3 4 5 6 7 8 16 24 32 40 48 56 64 72 80 88 96 104 112 120 128 136 144 152 160

Small IO

Large IO 0

Large IO 1

Large IO 2

Large IO 3

Large IO 4

Large IO 5

Performance Latency

8

latency

0

50

100

150

200

250

1 2 3 4 5 6 7 8 16 24 32 40 48 56 64 72 80 88 96 104 112 120 128 136 144 152 160

Small IO

Large IO 0 Large IO 1 Large IO 2 Large IO 3 Large IO 4 Large IO 5

Future Plans

9

OGMA LUGH

FC switch 1SANBOX 5200 2Gb/s

Disk array 1

LUGH

OGMA

FC switch 2SANBOX 5602 4Gb/s

Disk array 2mirror

LUGH

OGMAASM mirroring

Future Plans

• Two disk arrays used by all or systems except TAG:– Storage:

– 2 SAN, 2GBps FC– ? (third disk array)

– two switches:• SANBOX 5200 2Gb/s• SANBOX 5602 4Gb/s

– Physical disk available: • Array 1: 16 disks SATA 260GB (backup)• Array 2: 6 disks SATA 550GB ? (storage)• Array 3:? (storage)

– Arrays configured with RAID5 or RAID6

10

Future Plans

• ASM:– ATLAS:

• Normal redundancy• Single disk group two fail groups• Two or more disks• Mirror disks on different disk array

– LHCb:• Normal redundancy• Single disk group two fail groups• Two or more disks• Mirror disks on different disk array

11

Migration date estimation

• ATLAS by mid June• LHCb by the end August