Monitor-Based Testing of Elastic Cloud Computing Applications

Monitor-Based Testing of Elastic Cloud Computing

ApplicationsMichel Albonico

PhD Student - AtlanMod - EMN (Nantes, France)(michel.albonico@inria.fr)

Jean-Marie MottuGerson Sunyé

● Cloud Computing Elasticity● Motivation● Test Procedure● Experiments● Conclusion and Future Work

Outline

Cloud Computing Elasticity

● Cloud computing elasticity:

The ability of a cloud infrastructure/system modifying its resource

configuration according to demand.

● Thresholds: ○ Scale-out threshold: maximum resource usage, e.g., 80% of CPU

usage;○ Scale-in threshold: minimum resource usage, e.g., 20% of CPU

usage;○ Used to decide when varying a resource.

Resource AllocationResource DemandScale-out Threshold

Scale-in ThresholdScale-out Threshold BreachingScale-in Threshold Breaching

Time (s)

Legend

80% 0.8

20% 0.2

● Resource demand varies according to workload variations.○ Example:

■ number of users increases from 1 to 2, the resource

demand doubles.

Time (s)

Legend

80% 0.8

20% 0.2

● Resource demand varies over time;● Scale-out threshold breaching.

Time (s)

Legend

scale-out threshold breaching

80% 0.8

20% 0.2

● Resource demand varies over time;● Scale-out threshold breaching;● Scale-out reaction time;

Time (s)

Legend

scale-out reaction time

80% 0.8

20% 0.2

● Resource demand varies over time;● Scale-out threshold breaching;● Scale-out reaction time;● Scale-out time, then the thresholds are updated.

Time (s)

180% 0.8

Legend

scale-out time80% 1.6

20% 0.2

20% 0.4

● Scale-in:○ Scale-in threshold breaching;○ Scale-in reaction time (resource is no longer available);

■ Thresholds reconfiguration.○ Scale-in time.

Time (s)

Legend

scale-in time

scale-in reaction time

80% 0.8

80% 1.6

20% 0.2

20% 0.4

● Elasticity states transition.

scale-out threshold breaching

scale-in threshold breaching

● Elasticity states transition.

● Related work only test during the ready state;● Scaling states:

○ Considerable time: in our experiments, scaling-out takes more than 90 seconds (Amazon EC2);

○ Great part of the adaptation tasks: replication data, leader election, etc.

Motivation

Test Procedure

● Test cloud systems during all the elasticity states;● Execute tests dynamically:

○ Associate test cases to a set of elasticity states;○ Execute the test according to the current elasticity state.

● Test execution:○ Periodically monitor the resource during the test execution;

■ Current elasticity state.○ (Re)-execute the associated test cases during the current

elasticity state.

Experiments

● Research questions (answered by the experiments):

1. Is it necessary to run the test during different elasticity states?a. Does a cloud system react distinctly depending on the

elasticity state?

2. Is it possible to execute the test during different elasticity states and to assign the test verdicts accordingly?

Experiments

Question 1: system behavior during different elasticity state.

● First experiment:Measure the performance of a cloud system during different elasticity states.

○ Manually executed;

○ Workload (50% read / 50% write);

○ 2500 operations per second (ops).

Experiments

● First experiment results:○ 2000 ops: covers all the performance drops;○ Elasticity states extracted from the log files;

RQ1: It is necessary to run the test during different elasticity states.

Minimal PerformanceMeasured Performance

R R R R R RSISISO SO SOSI

120080

600 Time (s)

Question 2: test execution during different elasticity states + test verdicts assignment.

● Second experiment: (same workload)○ We use our test procedure;○ We monitor the elasticity states throughout the test

execution;○ Test Case:

■ answered operation >= 2000 ops -> pass■ otherwise -> fail

○ Same test case associated to every elasticity state.

■ Test case re-executed throughout the cloud system

execution.

Experiments

● Result of the second experiment:○ Test through different elasticity states;○ Assign test verdicts to different elasticity states;

■ Proportional to the previous experiment (correct elasticity

states).RQ2:

It is possible to execute the test according to the elasticity state, and we are able to assign the test verdicts correctly.

Conclusion and Future Work

● Identify all the performance problems;● Assign the test verdicts to the correct elasticity states (at

runtime);● Address the scaling states, which are not addressed by related

work;● Future work:

○ Write functional test cases;○ Apply to other study cases;○ Generate test cases based on elasticity states.

Monitor-Based Testing of Elastic Cloud Computing

ApplicationsMichel Albonico

PhD Student - AtlanMod - EMN (Nantes, France)(michel.albonico@inria.fr)

Jean-Marie MottuGerson Sunyé

Monitor-Based Testing of Elastic Cloud Computing Applications

Software

Computing Smooth Solutions of DAEs for Elastic Multibody ... · Keywords--Differential-algebraic equations, Elastic multibody systems, Stiff mechanical systems, ... flexible multibody

(ENT218) Elastic Bandwidth in a Cloud Computing World | AWS re:Invent 2014

Status of the Forward Elastic Scattering Luminosity Monitor

Fair & Elastic Resource Allocation in Cloud Computing Environments

July 2013 Elastic Offloading by Dale Denis. Dale Denis The Elastic Offloading of Computationally Intensive Tasks to the Cloud to Augment the Computing

Elastic Computing and Engineering Elastic Applications in

Fuzzy Vibration Suppression of a Smart Elastic Plate using Graphical Computing · PDF file · 2018-02-09Fuzzy Vibration Suppression of a Smart Elastic Plate using Graphical Computing

The HEPCloud Facility: elastic computing for High Energy Physics … · 2017. 3. 15. · FERMILAB-CONF-16-643-CD The HEPCloud Facility: elastic computing for High Energy Physics –

Using Elastic to Monitor Anything

Leveraging elastic web scale computing with AWS

ELASTIC COMPUTING: A FRAMEWORK FOR EFFECTIVE MULTI-CORE HETEROGENEOUS COMPUTINGufdcimages.uflib.ufl.edu/UF/E0/04/40/43/00001/WERNSING__.pdf · 2013. 2. 22. · ELASTIC COMPUTING:

Optimal Provisioning for Elastic Service Oriented Virtual Network Request in Cloud Computing

Applications and Infrastructure. Agenda " Architecture and Environments " Computing Environments " Computing Orientations " Transaction Processing Monitor

Virtualization and Cloud Computing with Elastic Server On Demand

Own the Core, Rent to Peaks: Hybrid Elastic Computing for Digital Commerce

Elastic Computing - Principles, Models, and Algorithms for ......Part 1: Elastic Computing Smart evolution –people, services and things ... Mgmt Storage policies Databas e Operations

Towards an Elastic Fog-Computing Framework for IoT Big

EUCALYPTUS: An Open Source Infrastructure for Elastic Computing Research

Elastic Transaction Platform - Heirloom-Computing · ELASTIC TRANSACTION PLATFORM USAGE ... 139 WAIT EXTERNAL ... The syserr protocol sends its output directly to the system error

The HEPCloud Facility: elastic computing for High Energy ...lss.fnal.gov/archive/2016/conf/fermilab-conf-16-643-cd.pdf · FERMILAB-CONF-16-643-CD The HEPCloud Facility: elastic computing