Community cloud antonioseverien

Community  Network    Cloud  Middleware  

Supervisor  Leandro  Navarro  leandro@ac.upc.edu  

“A  Storage  Approach”  

Students  Antonio  Severien  

severien@kth.se    

Ioanna  Tsalochidou  ioannat@kth.se    

Outline  

•  IntroducCon  •  Cloud  Middleware  •  ObjecCves  •  OpenStack  •  Experimental  Setup  •  Results  •  Future  Work  •  Findings  •  Summary  06/12/12   2  

IntroducCon  

•  Community  Networks  Testbed  for  the  Future  Internet  –  Commodity  wireless  and  opCcal  links;  heterogeneous  nodes;  different  

rouCng  protocols;  different  applicaCons  

•  Cloud  middleware  running  on  “wild-­‐area”  resources  –   OpenStack,  OpenNebula  –   Evaluate  scalability  and  “suitability”  to  provide  either;  compu.ng  or  

storage  services  

06/12/12   3  

Cloud  Middleware  

•  Cloud  OperaCng  System  –  Controls  large  pools  of  compute,  networking  and  storage  resources  throughout  a  datacenter  

Your  ApplicaCons  

Cl  

Standard  Hardware  

Cloud  OperaCng    System  

Storage  Networking  Compute  Management  

GUI  

06/12/12   4  

ObjecCves  •  Observe  how  the  different  cloud  middlewares  behave    –  On  unstable  network  environment    –  On  scarce  hardware  resources    

•  Create  a  methodology  to  be  used  on  CONFINE    

•  Preliminary  benchmarking    •  TesCng  –  Inject  delays  on  network  (Netem)  – Measure  performance  (FileBench)  

06/12/12   5  

OpenStack  Conceptual  Architecture  

Figure  taken  from  h`p://docs.openstack.org/folsom/openstack-­‐compute/admin/content/figures/openstack-­‐conceptual-­‐arch-­‐folsom.jpg    06/12/12   6  

OpenStack  Logical  Architecture  

Figure  taken  from  h`p://docs.openstack.org/folsom/openstack-­‐compute/admin/content/figures/openstack-­‐logical-­‐arch-­‐folsom.jpg    06/12/12   7  

OpenStack  Logical  Architecture  

Figure  taken  from  h`p://docs.openstack.org/folsom/openstack-­‐compute/admin/content/figures/openstack-­‐logical-­‐arch-­‐folsom.jpg    06/12/12   8  

OpenStack  Storage  

Storage  Services  –  Block  Storage  (Cinder)  à  nova-­‐volume  (iSCSI/LVM)  

•  Uses  LVM  to  create  and  manage  volumes,  and  exports  them  via  iSCSI    

– Object  Storage  (Swif)  •  Low  level  of  abstracCon  •  Good  for  staCc  content  (e.g.,  CDN)  •  HTTP  interface  with  REST  API  

–  File  Storage      •  “none  na.ve  support”  (There  is  a  connector  for  GlusterFS)  

 06/12/12   9  

Cinder  (Nova-­‐volume)  

Instance  

Volume  

Instance   A  volume  can  be    a`ached/detached    from  running  instances  

Block  Storage  Store  

06/12/12   10  

Cinder  (Block  Storage)  

Block  Storage   Block  Storage   Block  Storage  

Compute  

Volume  Store  

Instance  

06/12/12   11  

Cinder  (Block  Storage)  

Block  Storage   Block  Storage   Block  Storage  

Compute  

Volume  Store  

Instance  

06/12/12   12  

Running  Compute  Node  

Figures  taken  from  h`p://docs.openstack.org/folsom/openstack-­‐compute/admin/content/images-­‐and-­‐instances.html    

06/12/12   13  

Experimental  Setup  

•  FileBench  Workload  Generator  –  File  system  and  storage  benchmark  –  Variety  of  workloads  and  pre-­‐defined  workloads  for  webserver,  file  server,  etc.  

–  Reports  throughput  and  latency  –  Uses  Workload  Model  Language  (WML)  

Cinder  Volume  Store  

Nova  Compute  &  Controller  

06/12/12   14  

Experimental  Setup  

1.  Off-­‐line  creaCon  of  volumes  2.  At-­‐runCme  a`achment  of  volumes  to  instances  hosted  within    

the  same  availability  zones  3.  Formakng  mounted  volumes  with  ext3  file  system  4. MounCng  the  forma`ed  volume  as  a  file  system  within  a  Linux    

instance  5.  Subsequent  benchmarking…  

Steps  for  experiments:  

06/12/12   15  

Experiment  Results  Read  Experiments  

 File  Size:  3GB    IO  Size:  1MB      Threads:  1    Caching:  disabled  

06/12/12   16  

Experiment  Results  Write  Experiments  

 File  Size:  3GB    IO  Size:  1MB      Threads:  1    Caching:  disabled  

06/12/12   17  

Future  Work  

•  Use  OpenNebula  and  perform  the  same  experiments  •  Expand  this  work  to  run  on  a  larger  scale  •  Use  CONFINE  testbed  for  experiments  

06/12/12   18  

Future  Work  (Real  Deal)  

06/12/12   19  

Summary  

•  Cloud  Middleware:  nothing  but  a  resource  manager  •  Deployed  OpenStack  in  a  micro  test-­‐environment  

•  Benchmarking:  diverse  workloads  

•  Community  Cloud…  it  is  possible,  but  with  restricCons  bounded  by  available  resources  

06/12/12   20  

Findings  

•  OpenStack  –  Is  evolving  –  Needs  to  be  more  user-­‐friendly  –  Dynamic  configuraCon    

•  Community  Cloud  –  Provide  services  that  require  less  resources  –  “Guarantee”  stability  and  availability  of  resources  

06/12/12   21  

Acknowledgments  

•  Thanks  to  Leandro  Navarro  •  Thanks  to  Ying  for  clearing  the  clouds  from  the  cloud  •  Thanks  to  Manos  and  Mudit  for  networking  assistance  

•  Thanks  to  Ioanna  for  accepCng  the  challenge    •  Thanks  to  the  OpenStack  community  •  Thanks  to  the  Linux  community  

06/12/12   22  

References  •  OpenStack:  h`p://www.openstack.org  •  Ubuntu  Cloud:  h`p://www.ubuntu.com/cloud    •  OpenNebula:  h`p://opennebula.org/  •  DevStack:  h`p://devstack.org/  •  CONFINE:  h`p://confine-­‐project.eu/  •  FileBench:  h`p://sourceforge.net/apps/mediawiki/filebench/    •  Netem:  

h`p://www.linuxfoundaCon.org/collaborate/workgroups/networking/netem    

06/12/12   23