Extending TripleO for OpenStack Management

( slide ) previous | next#RedHatCloud

Extending TripleO for OpenStack Infrastructure Management

Keith BasilPrincipal Product Manager, Red Hat

OpenStack Summit AtlantaMay 2014

Keith Basil

๏ personalVirginia hare scrambler, plays chess..

๏ professionalRed Hat

Cloudscaling, Time Warner Cable,FederalCloud.com, Cisco and a couple of startups

๏ blendedskype/twitter/github/irc, life: noslzzp

( slide ) previous | next#RedHatCloud 3

๏ Setting Context๏ TripleO Explained (easy)๏ TripleO Explained (detail)

๏ OpenStack in a Minute or So

๏ OOO

๏ Tuskar

๏ Deployment Flow

๏ TripleO as Management Platform

๏ OpenStack Vendor Integration Profiles

๏ TripleO Momentum๏ Questions

Agenda

Setting Context

OpenStack Deployment and Management facilitates planning, deployment and on-going operations of OpenStack clouds.

Our Goal: A Deployed and Managed Cloud

๏ Planning๏ What will this OpenStack deployment look like? Topology? Resource

capacity?

๏ Deployment๏ Hardware and service lifecycle

management. Policy driven process.

๏ Operations and Management๏ Visualize capacity, metrics & instrumentation

“bla,bla,bla, OpenStack, bla,bla,bla, Cloud, bla,...”

COMPLEXITY!

Deployment & Management Landscape Today

Open Source Deployment Options Some Commercially Supported Options

DIY(do it yourself)

Crowbar

PackStack

Highly fragmented and mostly about solving the complexity of deployment!

Where’s the Love?

OpenStack Operators

OpenStack Developers

Over 16,000 community members!

138 countries!

Wait, how many operators?

Who cares!,

just +1 my code!

Operator Heroes..

need love too..

http://sharpwriter.deviantart.com/art/Welcome-to-the-Internet-Please-Follow-me-322248378http://creativecommons.org/licenses/by-nc-nd/3.0/

Operator headband, BOFH Slayer gun handle and OpenStack unicorn branding added for effect. Not for redistribution.

Provides a complete end-to-end infrastructure management solution for OpenStack business planning, system deployment and ongoing operations.

๏ Core features:๏ Comprehensive Operator Dashboard

๏ Cloud resource planning and modeling

๏ Deployment and provisioning

๏ Cloud metrics and instrumentation

TripleO For Infrastructure Management

block storage (NetApp)

TripleO Explained (easy)

OpenStack on OpenStack

... but let’s ignore the complexity for now.

Imagine if you will..

An OpenStack Deployment and Management Application

An Application Featuring ...

๏ Deploying OpenStack to bare metal

๏ OpenStack community adopted๏ Providing visual status of core

services and cloud infrastructure

๏ Offering platform extensibility๏ Providing integration via well

known APIs๏ Is cloud operator focused!๏ Naturally resilient and scalable

Sounds cool ... more please!

TripleO Explained (more detail)

OpenStack in a Minute or So

๏ OpenStack components* manage compute, network and storage resources

OpenStack - a quick review..

Glance

Neutron

VMOS image, network, disk,

instrumentation

Virtual MachineDeployment

Ceilometer

*Only a select subset of OpenStack components are shown here.

OpenStack - Nova, Heat & Ceilometer

Glance

Neutron

instrumentation

Ceilometer

Nova provides command and control services for compute nodes.

It orchestrates rendering of virtual machines.

Glance

Neutron

instrumentation

Ceilometer

Heat provides an orchestration engine to launch multiple cloud applications based on templates.

Heat manages the whole lifecycle of the application by managing the underlying virtual infrastructure

Glance

Neutron

instrumentation

Ceilometer

Ceilometer provides acquisition of usage data across OpenStack core

components.

Ceilometer data is used to reconcile billing or chargeback of consumed

cloud resources.

๏ Re-uses OpenStack components to deploy OpenStack on hardware.

The Concept of TripleO

Glance

Neutron

Hardware NodeDeployment & Management

Ceilometer

Bare MetalOS image, network, disk,

instrumentation

๏ TripleO uses Nova and Ironic to deploy to hardware

Nova provides command and control services for hardware

nodes. Nova’s scheduler matches bare metal flavors to hardware.

It orchestrates the rendering of bare metal* by treating Ironic’s API as a

special bare metal hypervisor.

Glance

Neutron

Ceilometer

* Today, TripleO uses Nova bare metal drivers. As Ironic matures these will be deprecated.

instrumentation

Hardware NodeDeployment

๏ For hardware, Heat templates encapsulate the equivalent of a cloud resource reference architecture

Here, Heat provides deployment orchestration for hardware nodes.

Heat templates capture hardware configuration for consistent and

repeatable deployment scenarios.

Glance

Neutron

Ceilometer Hardware NodeDeployment Orchestration

instrumentation

๏ Ceilometer provides the framework for metrics and instrumentation data collection

Ceilometer is used to collect metrics on the underlying OpenStack infrastructure.

Metrics and instrumentation data can be rolled up for visualization.

Glance

Neutron

Ceilometer Hardware NodeStatus

instrumentation

Tuskar

๏ Tuskar provides deployment management services for TripleO๏ Follows same component re-use model as TripleO๏ Introduces the Tuskar operator UI, CLI and API

Tuskar Overview

Ceilometer

Tuskar

Horizon

# create an overcloud with 1 controller and 1 compute nodetuskar overcloud-create overcloud \ --description "My overcloud" \ --attribute "AdminToken=${OVERCLOUD_ADMIN_TOKEN}" \ --attribute "AdminPassword=${OVERCLOUD_ADMIN_PASSWORD}" \ --attribute "CinderPassword=${OVERCLOUD_CINDER_PASSWORD}" \ --attribute "GlancePassword=${OVERCLOUD_GLANCE_PASSWORD}" \ --attribute "HeatPassword=${OVERCLOUD_HEAT_PASSWORD}" \ --attribute "NeutronPassword=${OVERCLOUD_NEUTRON_PASSWORD}" \ --attribute "NovaPassword=${OVERCLOUD_NOVA_PASSWORD}" \ --attribute "NeutronPublicInterface=$NeutronPublicInterface" \ --attribute "SwiftPassword=${OVERCLOUD_SWIFT_PASSWORD}" \ --attribute "SwiftHashSuffix=${OVERCLOUD_SWIFT_HASH}" \ --attribute "NovaComputeLibvirtType=$OVERCLOUD_LIBVIRT_TYPE" \ --attribute "GlanceLogFile=''" \ --attribute "NeutronDnsmasqOptions=dhcp-option-force=26,1400" \ --role-count $controller_role_id=1 \ --role-count $compute_role_id=$COMPUTESCALE \ --role-count $blockstorage_role_id=$BLOCKSTORAGESCALE \ --role-count $swiftstorage_role_id=$SWIFTSTORAGESCALE

tripleo wait_for_stack_ready 220 10 overcloud

echo "Overcloud CREATE_COMPLETE"

Tuskar

Ceilometer

Horizon

๏ OpenStack Programs are efforts which are essential to the completion of the OpenStack mission.๏ TripleO is the Deployment program

๏ Tuskar’s focus has been on infrastructure management

๏ Tuskar has been merged into TripleO

TripleO is an OpenStack Program

Deployment Flow

Remember this?

๏ Deploying OpenStack to bare metal

๏ OpenStack community adopted๏ Providing visual status of core

services and cloud infrastructure

๏ Offering platform extensibility๏ Providing integration via well

known APIs๏ Is cloud operator focused!๏ Naturally resilient and scalable

๏ Production cloud๏ The OpenStack you know and love

๏ The Cloud that your tenants will use

๏ Also known as the “Overcloud”

๏ Deployment and Management Application๏ Command and Control cloud (TripleO/OpenStack)

๏ Only for Cloud Operator use.

๏ Also known as the “Undercloud”

Key Concept: We Have Two Clouds

OpenStack as Deployment and Management Application

Our Goal? We Want an Operational Cloud

Deployment and Management Process

1. One or more Management Nodes are installed in the control rack.

2. Operator logs into Operator Dashboard to configure the infrastructure

3. Operator defines the Controller rack.

4. Operator defines the Resource racks.

5. Controller and Resource racks get provisioned.(Tuskar -> Heat -> Nova -> Ironic -> Hardware)

TripleO as Management Platform

OpenStack Management Application Platform๏ TripleO was initially focused on deployment. But, why stop there?

๏ Underlying OpenStack components are there for our use.

๏ Component APIs are well known and understood.

๏ Operations focused use cases are very natural here.

๏ Community partners can build on an open, distro agnostic platform.

๏ We believe TripleO can work as a platform foron-going cloud operations

๏ We believe this will significantly increase OpenStack adoption.

41* http://www.slideshare.net/ryan-lane/openstack-atlanta-user-survey

OpenStack Vendor FAQs

block storageobject storage

HPCcompute

security managementnetwork

service monitoring

What does this mean for ______________________ vendors?

๏ Operator Dashboard๏ Deployment Orchestration

๏ Roles, Services, Elements

๏ Instrumentation Agents๏ Bare Metal Drivers๏ Supporting Components

๏ Adding resources to the production cloud

๏ Special flavor support

๏ Scheduling modifications, etc.

Platform Integration Points (logical view)

hardware node hardware node hardware node

Ironic

hardware driver hardware driver

Ironic API

Ceilometer Tuskar Nova

Horizon

Community Vendor Integration Matrix

Integration Component Hardware Vendor Interest? Software Vendor Interest?

Operator Dashboard(Horizon/Tuskar UI) Yes Yes

Bare Metal Drivers(Ironic) Yes Probably Not

Instrumentation(Ceilometer) Yes Probably

Infrastructure Orchestration(Roles, Services, Elements) Yes Maybe / As needed

Supporting Components(scheduler, network, etc) Depends on resource Maybe / As needed

OpenStack Vendor Integration Profiles

Warning!

The profiles you are about to see are not promises, product roadmaps or availability announcements

made by the vendors shown or Red Hat.

These are sketches of what could be interesting for OpenStackand exist solely to illustrate possible TripleO integration points.

Got it?

Now back to our show.

NetApp๏ Conducting early work to bring NetApp product line to TripleO

๏ Storage utilization analysis๏ Storage efficiency metrics

๏ System reserve capacity

๏ Free/unused reserve capacity

๏ Cloning, dedupe, snapshot, etc

๏ Heat, Ceilometer, Ironic,Horizon integration points

block storage (NetApp)

Dell๏ Dell and Red Hat working on

TripleO integration๏ Hardware management and

metrics via Ironic(DRAC driver support)

๏ Orchestration of firmware, BIOS, drivers, etc, configuration via Heat

๏ Integration: Horizon, Ironic, Ceilometer, Heat

PrivateCore๏ “Privacy of computation” vision๏ Trusted boot, attestation, node

integrity services, etc.๏ Already using Horizon today

๏ Bare metal to tenant use cases๏ Integration points:

๏ Horizon, Ironic, Ceilometer, Tuskar, Overcloud scheduling

GroundWork๏ OpenStack Unified Monitoring ๏ Seurat Heat maps๏ GroundWork appliance as

Glance image

๏ Horizon plugin architecture blueprint may be needed

๏ Integration points:๏ Glance, Ceilometer, Tuskar, Horizon

Solinea๏ OpenStack infrastructure

monitoring and management ๏ Analysis, diagnostics and Ops

automation

๏ Topology discovery and reports๏ API performance, VM spawns, etc.

๏ Integration points:๏ Horizon, Glance, Heat

Ceph and Calamari๏ Ceph cluster visualization,

monitoring, performance statistics and diagnostics

๏ Rolling, continuous upgrades

๏ Heat stacks for Ceph clusters, pre-built images in Glance

๏ Integration points:๏ Glance, Ceilometer, Tuskar, Horizon

TripleO Momentum

Diverse and Strong Community Work

๏ Red Hat releases InStack, a TripleO based installer for RDO Icehouse๏ HP’s Helion uses TripleO for installation๏ Rackspace doing advanced work with Ironic

(solving for multi-tenancy use case)

IronicTripleOTuskar

Gaps๏ Auto-discovery of nodes๏ Complex hardware configuration needs to be supported๏ Infrastructure topology awareness

Questions?

Thank You!

Extending TripleO for OpenStack Management

Technology

Cisco ACI Installation Guide for Red Hat OpenStack Using ......4.2(3.20191220) tripleo-ciscoaci-13.0-749.noarch.rpm versionoftheOpenStackplug-in CiscoApplication PolicyInfrastructure

OpenStack on OpenStack

TripleO Documentation - OpenStack...TripleO Documentation, Release 0.0.1.dev1476 TripleO is a project aimed at installing, upgrading and operating OpenStack clouds using OpenStacks

Contrail Tripleo Documentation

Red Hat OpenStack Platform 16.0 Keeping Red Hat OpenStack … · 2020. 8. 7. · $ sudo dnf update -y python3-tripleoclient* openstack-tripleo-common openstack-tripleo-heat-templates

GDL OpenStack Community - Openstack Introduction

TripleO - object-storage-ca-ymq-1.vexxhost.net · TripleO is a project aimed at installing, upgrading and operating ... Heat to automate cloud management at datacenter scale. Product

Become An OpenStack TripleO ATC - Easy As ABC

Trystack.org · Support for driver-assisted share migration Possibility to optimize migrations between same vendor backends Official support for Red Hat OpenStack (tripleo) Support

VMware + OpenStack · VMware’s OpenStack Initiative Contribute to OpenStack •Integrate VMware compute, network, storage SW with OpenStack. •Make OpenStack better, helping customers

Extending OpenStack Access Control with Domain Trust

TripleO Updates - Liberty Edition

Extending Extending

Mellanox Support for TripleO Train Application Notes · Mellanox Technologies . Mellanox Support for TripleO Train Application Notes. Rev 1.0

Deploying OpenStack in a Virtual Machine Environment Using OpenStack Deployment (TripleO) - Red Hat Customer Portal

[OpenStack 스터디] OpenStack With Contrail

Владимир Еремин. Extending Openstack. PyCon Belarus 2015

Четырехлетие OpenStack - Mirantis OpenStack Overview

Mellanox Support for TripleO Queens Application · PDF fileNetworking with an Openstack Integration Plugin with the support of Network Function ... i. Configure the neutron-opendaylight-hw-offlad.yaml

HP Helion 標準搭載!! OpenStack TripleO解説課題 – OpenStack最新情報セミナー 2015年2月