1. Openstack+Ceph Icehouse/Firefly 2014/7/16 Open Programmable Infrastructure Environment 14/07/16 Copyright 2014(C) OSS Laboratories Inc. All Rights Reserved 1

2. Ceph l l l PCOS(Linux) l l l No SPOF l PB l l POSIX l l REST(AWS S3/SWIFT) l WANRGW l RW(LAN l Strong Consistency 214/07/16Copyright 2014(C) OSS Laboratories Inc. All Rights Reserved 3. RADOS Reliable, Autonomous, Distributed Object Store MDSMonitors OSDs Ceph 3 CephFS POSIX Kernel-client FUSE-client Librados C, C++, java, Python, Ruby, PHP RADOS API RADOSGW (RADOS Gateway) AWS S3 OpenStack SWIFT REST API http RBD (RADOS Block Device) Linux RADOS API Kernel Client vfs MDSMonitors OSDs MDSMonitors OSDs API librbd Kernel Client FUSE Client Ext4/xfs/btrfs vfs Ext4/xfs/btrfs 4. 14/07/16Copyright 2014(C) OSS Laboratories Inc. All Rights Reserved 4 Hypervisor V M V M V M RAID Hypervisor V M V M V M RAID FC SAN Hypervisor V M V M V M Linux Hypervisor V M V M V M Linux TCP/IP TCP FW Ceph 5. OpenStack 14/07/16Copyright 2014(C) OSS Laboratories Inc. All Rights Reserved 5 Volumes Ephemeral Copy-on-Write Snapshots 6. Cinder/Nova RBD Cinder Server Libvirt (QEMU/KVM) VM Boot from volume Volume Image Copy-on-write clone librbd Nova/compute VM Libvirt (QEMU/KVM) VM librbd VM 7. Ceph COW clone l COW:Copy-on-write l 14/07/16Copyright 2014(C) OSS Laboratories Inc. All Rights Reserved 7 WRITE READ 8. Cinder l Ceph COW clone l Juno 14/07/16Copyright 2014(C) OSS Laboratories Inc. All Rights Reserved 8 9. Cinder snapshot/backup on Ceph l CephRBD Snapshot l RBD snapshot l SnapshotCOW clone l Cinder backup on Ceph l Ceph RBD snapshot l PG 14/07/16Copyright 2014(C) OSS Laboratories Inc. All Rights Reserved 9 10. Glance RBD Glance Server /etc/glance/glance-api.conf default_store=rbd rbd_store_user=glance rbd_store_pool=images Store, Download Image 11. SWIFT/Keystone Keystone Server RADOSGW RESTful Object Store Query token Access with token Grant/revoke SWIFTCeph RADOS GW 12. OpenstackCeph 14/07/17Copyright 2014(C) OSS Laboratories Inc. All Rights Reserved 12 l l RBD Ceph l l l l l Cinder/Glance l librbd l Swift l RADOS GW 10gb Public Ceph Ceph Ceph HA Proxy HA Proxy NW 10gb 13. OpenStack+Ceph l OpenStack l MySQL l OS Ceph l Compute Ceph l Network l 14/07/16Copyright 2014(C) OSS Laboratories Inc. All Rights Reserved 13 14. Ceph 14/07/16Copyright 2014(C) OSS Laboratories Inc. All Rights Reserved 14 Virtualization and Private Cloud (traditional SAN/NAS) High Performance (traditional SAN) PerformanceCapacity NAS & Object Content Store (traditional NAS) Cloud Applications Traditional IT XaaS Compute Cloud Open Source Block XaaS Content Store Open Source NAS/Object Ceph Target Ceph Target 15. Multi-site Replication (RADOSGW) l l Read Only l l l AP(Eventually consistency) 1514/07/16Copyright 2014(C) OSS Laboratories Inc. All Rights Reserved 16. Erasure coding l Erasure Coding l Azure l 20% 40% () l Erasure Coding (2 ) 140%200% CPUHighLow 17. CEPH STORAGE CLUSTER Write ReadRead/Write SSD HDD 18. 14/07/16Copyright 2014(C) OSS Laboratories Inc. All Rights Reserved 18 http://www.mellanox.com/related-docs/whitepapers/ WP_Deploying_Ceph_over_High_Performance_Networks.pdf 19. 14/07/16Copyright 2014(C) OSS Laboratories Inc. All Rights Reserved 19 2,419MB/sec (8M Seq. READ) 110k IOPS (4k Seq. READ) 20. Ceph l https://groups.google.com/forum/#!forum/ceph-jp l Google l Google Group 14/07/16Copyright 2014(C) OSS Laboratories Inc. All Rights Reserved 20