31

Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions
Page 2: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Company

A leading edge Cloud editor since 2007

Page 3: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Company

➢ Created from INRIA in october 2007

➢ Distribution, Parallelism, HPC, Grids, Cloud

➢ Develop solutions for many application domains:

Engineering, Bio Technologies, Finance, IT

➢ Our labels : DGA (French Dept of Defense), Pacte PME,

Initiative Achats de l’État pour PME innovantes

➢ Growth in France and worldwide

Page 4: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Mission

➢ Distribution, Parallelism, HPC, Grids, Cloud

for DSI Infrastructure and Critical Business Applications

➢ Anticipate technological challenges ➢ Innovation as a service to our clients ➢ Provide strong expertise in key areas such as Distributed

Systems and Cloud Computing ➢ Always be at the forefront of innovation through big

investment in R&D

Page 5: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

History

1999 2003 2007 2010 2012 2014

Page 6: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Customers Technologies de

l'Information Bio

Technologies Finance

Ingénierie Aéronautique Energie Espace

Medias Distribution

Page 7: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Cloud & Grid IaaS

Scheduling & Orchestration

HPC Workflow & Parallelization

Innovative Technology

Page 8: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Products

Page 9: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions
Page 10: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

ProActive Cloud Automation

Ø Automatic Deployment of Many Vms Applications Ø Synchronization of Composite Services Ø Monitoring (Physical, Virtual, Functional) Ø Auto-Scaling Ø Multi-Cloud Management with Bursting

Ø Reversibility (e.g. Vmware ó OpenStack)

Page 11: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions
Page 12: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Cloud Automation

Page 13: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Cloud Automation Services

Elasticity

Fault Management

Reversibility

Brokering

Scalable

Updates

Life Cycle Management

BackUp

Control and Monitoring

Deployment

Page 14: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

From Top to Bottom

Page 15: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Cloud Automation

Catalogue

Supervision" Orchestration" Gestion de ressources"Construction"Catalogue"

Service Catalogue ‣  Software ‣  Platform ‣  Infrastructure

Management Console ‣  LifeCycle ‣  Supervision ‣  (Re) configuration

Added Value Services: •  Elasticity •  Fault-Tolerance •  Reversibility •  Contextualization of

generic VMs

Page 16: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Workflows & Scheduling

Workflow builder

Easily build New workflows ‣  Web applications ‣  Java SDK ‣  XML files

Create any type of task ‣  Scripts ‣  Executables ‣  Java

Advanced workflows ‣  Loops ‣  Conditions ‣  Variables ‣  Execution control

Page 17: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Workflows Orchstration

Workflows orchestration

Generate reports ‣  Users ‣  Groups ‣  Usage

Plan your actions ‣  Unique ‣  Recurrent

Manage workflows execution ‣  Logs ‣  History ‣  Priority ‣  Pause, stop, etc.

Page 18: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Resource Management

Resource Management

All your resources in one view ‣  Physical machines ‣  Virtual machines ‣  Multi-OS ‣  Private clouds ‣  Public clouds

Secure your resources ‣  User rights ‣  Group rights

Page 19: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Monitoring

Monitoring

Monitor all your resources ‣  Physical machines ‣  Virtual machines ‣  Storage ‣  Network ‣  Applications

Expose your own metrics ‣  JMX ‣  API REST ‣  Flat file

Page 20: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

So looping back … from Bottom to Top

Page 21: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Live Demonstration

Page 22: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Live Demonstration

1.  Deployment of a Composite Service

2.  Update of the Application

3.  Applying a Security Patch

4.  Life Cycle Managment

Page 23: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Thanks for your attention!

Page 24: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Dedicated resources

Clusters

Static Policy

Amazon EC2

EC2, Azure, HP Cloud, …

Dynamic Workload Policy

Desktops

Desktops

Timing Policy 12/24

Integration: Scilab, Matlab & R Applications

Page 25: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

With High Availability

❏ Availability ❏ Recovery ❏ Performance ❏ Backup

Page 26: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

High Availability

What if?

❏  A node is lost ❏  Failure is detected and the task running (if any) is restarted on

another free node

❏  A crash happens while task are running ❏  Using the database, running tasks are recovered from the database

The unit of work is the task

Page 27: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

High Availability

On node side, failure is expected and failure management built in

❏  How to maintain computational capacity? ❏  The node can reconnect to the Scheduler automatically

❏  The Scheduler can redeploy new nodes ❏  Restart Down Nodes policy

Page 28: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

High Availability

On the server side, state is stored in:

❏  Database ❏  Real time replication

❏  MySQL Master-Master replication ❏  MySQL+DRBD Failover

❏  File system ❏  Real time replication

❏  DRBD ❏  SAN

Page 29: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

High Availability

FS/DB

ProActive Scheduler

Node

Node

Node

FS/DB

ProActive Scheduler

Node

Node

Node

Failover installation

Primary installation

Via Active-Passive architecture

Page 30: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Tools involved

Linux only

❏  Failover ❏  Corosync to communicate between primary/failover site

❏  Pacemaker to coordinate service states ❏  Also does IP failover via virtual IP

❏  Stonith to avoid brain split issues

❏  SSH Infrastructure & Restart Down Nodes policy for nodes deployment

❏  State Redundancy

❏  DRBD ❏  MySQL

Page 31: Companyskins.ow2.org/images/ow2con14/Slides/Denis_Caromel... · 2014-11-14 · Company Created from INRIA in october 2007 Distribution, Parallelism, HPC, Grids, Cloud Develop solutions

Disaster Recovery

❏  To Backup

❏  Database ❏  Task/Job queue (running, pending, finished)

❏  File system ❏  Task logs

❏  Monitoring history

❏  Recovery Point Objective ❏  all running tasks are lost and will be restarted from scratch

❏  all active user sessions are lost ❏  Recovery Time Objective

❏  time to start ProActive Scheduler