MASTER'S THESIS - DiVA 1017693/ ¢  2016-10-04¢  ABSTRACT Lule£¥ University of eTchnology

  • View
    0

  • Download
    0

Embed Size (px)

Text of MASTER'S THESIS - DiVA 1017693/ ¢  2016-10-04¢  ABSTRACT Lule£¥...

  • MASTER'S THESIS

    CloudSimDisk Energy-Aware Storage Simulation in CloudSim

    Baptiste Louis 2015

    Master of Science (120 credits) Computer Science and Engineering

    Luleå University of Technology Department of Computer Science, Electrical and Space Engineering

  • Luleå University of Technology

    Department of Computer Science, Electrical and Space Engineering

    PERCCOM Master Program

    Master's Thesis in

    PERvasive Computing & COMmunications for sustainable development

    Baptiste Louis

    CLOUDSIMDISK: ENERGY-AWARE STORAGE SIMULATION IN CLOUDSIM

    2015

    Supervisors: Professor Christer Åhlund - Luleå University of Technology

    Doctor Karan Mitra - Luleå University of Technology

    Doctor Saguna Saguna -Luleå University of Technology

    Examiners: Assoc. Professor Karl Andersson - Luleå University of Technology

    Professor Eric Rondeau - University of Lorraine

    Professor Jari Porras - Lappeeranta University of Technology

  • This thesis is prepared as part of an European Erasmus Mundus program

    PERCCOM - Pervasive Computing & COMmunications for sustainable develop-

    ment.

    This thesis has been accepted by partner institutions of the consortium (cf. UDL-

    DAJ, no1524, 2012 PERCCOM agreement).

    Successful defense of this thesis is obligatory for graduation with the following na-

    tional diplomas:

    • Master in Complex Systems Engineering (University of Lorraine);

    • Master of Science in Technology (Lappeenranta University of Technology);

    • Degree of Master of Science (120 credits) - Major: Computer Science and Engineering; Specialisation: Pervasive Computing and Communications for

    Sustainable Development (Luleå University of Technology).

  • ABSTRACT

    Luleå University of Technology

    Department of Computer Science, Electrical and Space Engineering

    PERCCOM Master Program

    Baptiste Louis

    CloudSimDisk: Energy-Aware Storage Simulation in CloudSim

    Master's Thesis - 2015.

    99 pages, 51 �gures, 11 tables, and 4 appendices.

    Keywords: Modelling and Simulation, Energy Awareness, CloudSim, Storage, Cloud

    Computing.

    Cloud Computing paradigm is continually evolving, and with it, the size and the

    complexity of its infrastructure. Assessing the performance of a Cloud environment

    is an essential but strenuous task. Modeling and simulation tools have proved their

    usefulness and powerfulness to deal with this issue. This master thesis work con-

    tributes to the development of the widely used cloud simulator CloudSim and pro-

    poses CloudSimDisk, a module for modeling and simulation of energy-aware storage

    in CloudSim. As a starting point, a review of Cloud simulators has been conducted

    and hard disk drive technology has been studied in detail. Furthermore, CloudSim

    has been identi�ed as the most popular and sophisticated discrete event Cloud simu-

    lator. Thus, CloudSimDisk module has been developed as an extension of CloudSim

    v3.0.3. The source code has been published for the research community. The simula-

    tion results proved to be in accordance with the analytic models, and the scalability

    of the module has been presented for further development.

  • ACKNOWLEDGMENTS

    I would like to express my gratitude to my supervisor Professor Christer Åhlund for

    the con�dence that he has placed in me and for his continuous guidance during this

    research work. It is my honor to accomplish this master thesis under his supervision.

    As well, I would like to thank Doctor Karan Mitra for his support and his valuable

    knowledge in term of cloud computing and research work.

    Thanks to Doctor Saguna for her advices and her daily dose of joviality.

    Thanks to my PERCCOM classmates, especially Rohan Nanda and Khoi Ngo who

    were with me at Skellefteå.

    Thanks to Karl Anderson and Robert Brannstrom for their presence, their accessi-

    bility and their assistance during my thesis work.

    Thanks to Rodrigo Calheiros (Melbourne University) for his feedbacks on my im-

    plementation.

    Thanks to Eric Rondeau, PERCCOM coordinator, and all the PERCCOM team

    for these two years of Master.

    Skellefteå, May 26, 2015

    Baptiste Louis

  • 5

    CONTENTS

    1 INTRODUCTION 11

    1.1 Context . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11

    1.2 Fundamentals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12

    1.2.1 Data Growth . . . . . . . . . . . . . . . . . . . . . . . . . . . 12

    1.2.2 Cloud Computing . . . . . . . . . . . . . . . . . . . . . . . . 14

    1.2.3 Cloud Simulators . . . . . . . . . . . . . . . . . . . . . . . . . 18

    1.3 Research Challenges and Objective . . . . . . . . . . . . . . . . . . . 19

    1.4 Thesis Contribution . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

    1.5 Thesis Outline . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

    2 BACKGROUND AND RELATED WORK 21

    2.1 Energy E�cient Storage in Cloud Environment . . . . . . . . . . . . 21

    2.2 Cloud Simulators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24

    2.2.1 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24

    2.2.2 CloudSim: a Framework for Modeling and Simulation of Cloud

    Computing Infrastructures and Services . . . . . . . . . . . . . 28

    2.2.3 CloudSim and Storage Modeling . . . . . . . . . . . . . . . . . 30

    2.3 CloudSim Background . . . . . . . . . . . . . . . . . . . . . . . . . . 33

    2.3.1 Entities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33

    2.3.2 Life Cycle . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

    2.3.3 Events Passing . . . . . . . . . . . . . . . . . . . . . . . . . . 35

    2.3.4 Future Queue and Deferred Queue . . . . . . . . . . . . . . . 36

    2.4 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37

    3 CLOUDSIMDISK: ENERGY-AWARE STORAGE SIMULATION

    IN CLOUDSIM 38

    3.1 Module Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . 38

    3.2 CloudSimDisk Module . . . . . . . . . . . . . . . . . . . . . . . . . . 38

    3.2.1 HDD Model . . . . . . . . . . . . . . . . . . . . . . . . . . . 39

    3.2.2 HDD Power Model . . . . . . . . . . . . . . . . . . . . . . . . 41

    3.2.3 Data Cloudlet . . . . . . . . . . . . . . . . . . . . . . . . . . . 41

    3.2.4 Data Center Persistent Storage . . . . . . . . . . . . . . . . . 42

    3.3 Execution Flow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42

    3.4 Packages Description . . . . . . . . . . . . . . . . . . . . . . . . . . . 50

    3.5 Energy-Awareness . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53

    3.6 Scalability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55

    3.6.1 HDD Characteristics . . . . . . . . . . . . . . . . . . . . . . . 55

  • 6

    3.6.2 HDD Power Modes . . . . . . . . . . . . . . . . . . . . . . . . 56

    3.6.3 Randomized Characteristics . . . . . . . . . . . . . . . . . . . 56

    3.6.4 Data Center Persistent Storage Management . . . . . . . . . . 57

    3.6.5 Broker Request Arrival Distribution . . . . . . . . . . . . . . . 58

    3.7 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59

    4 RESULTS 60

    4.1 Inputs and Outputs . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60

    4.1.1 Input Parameters . . . . . . . . . . . . . . . . . . . . . . . . . 60

    4.1.2 Simulation Outputs . . . . . . . . . . . . . . . . . . . . . . . . 61

    4.2 Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64

    4.2.1 Request Arrival Distribution . . . . . . . . . . . . . . . . . . . 64

    4.2.2 Sequential Processing . . . . . . . . . . . . . . . . . . . . . . 65

    4.2.3 Seek Time Randomness . . . . . . . . . . . . . . . . . . . . . 69

    4.2.4 Rotation Latency Randomness . . . . . . . . . . . . . . . . . . 70

    4.2.5 Data Transfer Time Variation . . . . . . . . . . . . . . . . . . 71

    4.2.6 Seek Time, Rotation Latency and Data Transfer Time Com-

    pared with Energy Consumption per Transaction . . . . . . . 72

    4.2.7 Persistent Storage Energy Consumption . . . . . . . . . . . . 74

    4.2.8 Energy Consumption and File Sizes . . . . . . . . . . . . . . . 75

    4.2.9 Disk Array Management . . . . . . . . . . . . . . . . . . . . . 78

    4.3 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81

    5 CONCLUSIONS AND FUTURE WORK 82

    5.1 Thesis Contribution: CloudSimDisk . . . . . . . . . . . . . . . . . . . 82

    5.2 Limitations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 82

    5.3 Future Work . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83

    REFERENCES 83

    APPENDICES

    Appendix 1: CloudSimDisk Source Code

    Appendix 2: Run a First Example

    Appendix 3: Hard Drive Disk Model

    Appendix 4: Hard Drive Disk Power Model

  • 7

    List of Figures

    1 The Vostok ice core data [6]. . . . . . . . . . . . . . . . . . . . . . . . 11

    2 Cloud service delivery models: SaaS, PaaS, and IaaS, based on [29]. . 15

    3 Deployment models of Cloud solutions. . . . . . . . . . . . . . . .