DC4Cities: an innovative approach for efficient and environmentally sustainable Data Centre for Smart Cities

Page 1

NOVE MBER 18 , 2015

DC4Cities: an innovative approach for efficient and environmentally sustainable

Data Centre for Smart Cities

DC4Cities @ Smart City Expo

Page 2

DC4Cities Origins

DC4Cities @ Smart City Expo Centers

Virtual Machine Dynamic

Consolidation and Turn off Servers

Green Service Level Agreements

Adapt to Renewable Energy Availability

Sep 2013 - Feb 2016Nov 2011- Apr 2014Jan 2010- Jun 2012

HP LabsNetZero

Parasol

Page 3

DC4Cities Rationale

Running a data centre at high levels of renewable energy sources is the great

challenge


Certain Services

require DCs to be close

to users

Smart Cities require

Services, hosted by

DCs

Smart Cities need Eco-

friendly DCs

Europe needs new metrics for DC energy efficiency

DC4Cities: an environmentally sustainable data centre for Smart

CitiesFP7-SMARTCITIES-2013 (ICT Call) Objective ICT-2013.6.2

Data Centres in an energy-efficient and environmentally friendly Internet

Page 4

DC4Cities Concept

DC4Cities: let DCs become energy adaptive


Eco-friendly DC energy policies needs to be capable of

adapting the power consumption to the availability

of renewable energy

being adapted to the requests received by the Smart City Energy Management authority

Trad.DC

PowerRenewablePower

Time

50%

50%

DC not using Renewable Power

DC using Renewable Power

DC4Cities

PowerRenewablePower

Time

20%

80%

DC not using Renewable Power

DC using Renewable Power

Page 5

DC4Cities Web Site and Partners


http://www.dc4cities.eu

http://www.dc4cities.eu/

Page 6

Data CentreEnergyController

User and Admin Task Scheduling Infrastructure Mgmt Energy Adaptive SW

Renewable Energy Adaptive Interface

Energy Adaptive Data Centre Operation Interface

Grid/Smart Grid Renewable Energy Providers Smart City Control

DC4Cities Overview

WP3

WP5

WP4

WP6

WP2


Page 7

DC4Cities System

North-boundSubSystem

South-boundSubSystem

D4C Control SubSystem

ERDS - Energy/Power Forecasts Data Environmental Data

Renewable Energy Forecasting Interface

Energy Adaptive Software Control Interface

Connector Connector

Local Forecaster

EA SW Ctrl 1 EA SW Ctrl n

SW 1 SW nEASW

DC4Cities Interfaces


Page 8



Grid/Smart Grid Renewable Energy Providers Smart City Control

DC4Cities Overview (North)


0:004:0

08:0

012

:0016

:0020

:000:00

020406080

100120140160

SunWindGasCoal

Energy Availability Forecast

Weather Forecast

Power/EnergyGoals

80%

Ren

0:003:0

06:0

09:0

012

:0015

:0018

:0021

:00 0:00

0204060

RenPct

0:00

3:00

6:00

9:0012

:0015

:0018

:0021

:00 0:00

010203040

PV power

Page 9




DC4Cities Overview (Control)


0:00

3:00

6:00

9:0012

:0015

:0018

:0021

:00 0:00

020406080

DC Ideal power

0:00

3:00

6:00

9:0012

:0015

:0018

:0021

:00 0:00

0

20

40

60

Serv CServ BServ. A

0:00

3:00

6:00

9:00

12:00

15:00

18:00

21:00 0:0

00

20

Quota A

0:00

3:00

6:00

9:00

12:00

15:00

18:00

21:00 0:0

00

20

Quota B

0:00

3:00

6:00

9:00

12:00

15:00

18:00

21:00 0:0

00

20

Quota C

ServiceQuotaSplit

Policies

Page 10

Working Modes: Admin Task

Working mode A : fast scan = 10000 files/hour 5 Anti Virus Scanners

Working mode B : reg scan= 4000 files/hour 2 Anti Virus Scanners

Working mode C : slow scan= 2000 files/hour 1 Anti Virus Scanners

System has 20000 files to scan (work to do)

A A

A

B BB

BB

B B

time

time

time

C

VariousOptionPlans


Page 11

Data CentreEnergyAdmin



DC4Cities Overview(Control/S)


0:00

4:00

8:0012

:0016

:0020

:00 0:00

05

101520

A1A2

0:00

4:00

8:0012

:0016

:0020

:00 0:00

0

10

20

30

B1B2

0:00

4:00

8:0012

:0016

:0020

:00 0:00

0

10

20

30

C1C2C3

0:00

3:00

6:00

9:0012

:0015

:0018

:0021

:00 0:00

0102030405060

C2B2A1

81%

B2 A1 C2

Smart CityEnergy Admin

Page 12

Federated Services

Service instances are FLAGGED at configuration level as:

Deploy ONLY on DCx [Ex. A, D] Service can run only inside one DC, can’t be moved/relocated

“not migratable”Deploy on DCx OR DCy (eXclusive OR) [Ex. B]

Service can potentially run on multiple DCs, but only one instance running at each time slot, i.e. only one 1 DC at the time “migratable” (select before start | stop&restart elsewhere)

Deploy on DCx AND/OR DCy [Ex. C] Service can potentially run on multiple DCs, multiple instances

running at each time slot, even in multiple DCs at the time “spreadable”


Page 13

Assisted/On demand Federation

!

Data Centre 1Manager

80%

?

Smart City Control

?Data Centre 2Manager

DC 1 Operators DC 2 OperatorsTechnical Aspects ofService Relocation

EASCEASC EASC

EASC EASC EASC

MigrationCandidates(Configuration)

Best Migration Candidate(s)

D4Cdashboard

tools(optional)

D4Cdashboard

tools


Page 14

84% 87%



Smart City Control

EASCEASC EASC EASCEASC EASC

Power Plan Splitter

Power Plan Consolidator

EASCEASC EASC EASCEASC EASC

Power Plan Splitter

Continuous Federation


Page 15

Proposal for New Metrics


Real Workloadsor Benchmarks

Output = Work Done

Total Work DoneTotal Energy

Renewable EnergyTotal Energy

Software ExecutionEnergy Efficiency

Renewable Energy Utilization Efficiency

Trigger =WorkRequests

Input = Non-RenewableEnergy

Input =Renewable Energy

Collaboration inside EU Project Cluster for common standardization proposal to CEN-CENELEC-ETSI Coordination Group on Green Data Centres (CG GDC)

Page 16

DC4Cities Trials


Trento

Page 17

WP6 – Barcelona TrialCloud Lab Platform

DC4CITIES MVInteracts with:- ONE controller- Zabbix [API]- VM’s [bizperf]- ILO’s (IPMI)

CSUC IMI


Page 18

WP6 – Barcelona Trial (CSUC & IMI)

Trial Scenario : Video transcoding

At CSUC there are several digital repositories of content in which among other content Videos are uploaded and broadcasted

To broadcast this videos a transcoding process is done in order to reduce and standarized the size and resolution

1. Diposit

Video metadata

Submit Form

Validation process

DSpace

Preservation version

Thumbnail

Item

2. Conversion

Media Converter

Broadcastversion

Media Server

3. Broadcast


Page 19

Trial Barcelona CSUC results & conclusions

Main results

- Improvements in RenPercent are lower than expected due to 2 very differentiated optimization approaches.

Optimization approach 1

Optimization approach 2

Very relevant increase in Ren Percent.

Percentage improvements vary in the range 7% -20 %, depending on the RES

availability.

Daily average values near from the %RES maximum in

the grid.

No increase in %RES usage.


Page 20

KPIs obtained for each day, and for the trial duration:

RenPercent has increased significantly, and APC values are over 0.9.

DCeP values obtained, compared to the baseline situation.

Conclusions: As in the case of CSUC, there has been an improvement in RenPercent. High flexibility achieved (DCA) and high accuracy following power plan (APC). Also, there is a very relevant improvement in energy efficiency terms (DCeP)

Trial BarcelonaIMI results & conclusions


Page 21

HP Italy Solar Lab


~2KW PV ArrayHP Italy HQMilan (Italy)

DC/AC InverterMeters &

Data Loggers HP InternalPower Grid

Moonshotat HP Italy TechnologyShow Room

ExternalEnergyProvider

Page 22

HP MoonshotHP Moonshot modern

server architecture with low power consumption Radically new system design with

1,000’s of servers per rack— significantly lowering complexity and TCO

Application-tuned configurations delivering best-of-breed performance per watt

www.hp.com full web site From • 46 Legacy servers• 115k WattsTo• 6 Moonshot systems• 6k watts

ILO with power meter for chassis, network switches and for each one of the cartridges (up to 45)

100%www.hp.com

300Mhits per day

94%Less power

89%Less space

(1)100%ftp.hp.com


Page 23

HP LIFE e-Learning for entrepreneurs

A best-in-class IT and business skills solution – free and online

Supporting individuals worldwide to start up and run successful enterprises

Students The unemployed and underemployed Micro- and small-business owners Mid-career changers

HP LIFE is a world wide program by Hp Corporate Affairs

IT platform Architecture and Operations by HP TSC Italy

Over 500’000 students (@February 15th, 2015)

www.life-global.org

• Supporting facilitators to strengthen their services using HP LIFE e-Learning

Integration in curriculum Career planning and

development Lifelong learning A condition of a micro-loan


http://www.life-global.org/

Page 24

HP Italy Solar Lab


HP Moonshot

avoided CO2-emission total: 1554 kg (March 18th 2014 – March 17th 2015)

Page 25

Phase 1 HP Trial Results


Metric DC4Cities vs. BaselineMin / Max

RenPercent +3.98% / +6.05%Total Power Consumption

-13.14% / -13.60%

Service Power Efficiency

+12.19% / +16.87%

HP Moonshot 17x M300 Cartridges

Power ~500 Watt

Page 26

For more info

Smart City Expo 2014 @ BCN

http://www.dc4cities.eu

@DC4Cities

DC4Cities Group

http://www.dc4cities.eu/