Applications have changed and someone forgot to tell storage · Abhishek Jain Software Engineer...

Applications have changed and someone forgot to tell storage

India System Development Lab

2019 SNIA INDIA 23rd- 24th May | Bangalore

Abhishek Jain

Software Engineer

Yadavendra Yadav

Software Architect

Agenda• Application Modernization• Evolution of Container • Container Storage • Distributed File System – An Example• Container Native Storage

Monolithic

Microservice

Dev Ops

Automation

Business Agility

Rich User Interface

Cloud Native

Dynamic

Scalable

Architecture

Fast Time to Market

DecentralIndependent

Banking Services

Debit

Check Balance

Calculate Interest

Email Notification

Update Profile

Credit

Banking Services

Check balance

Email Service

Credit Debit

Calculate Interest

Example

Evolution of Container

2001

Process Container

LXC Container

Containers are Ephemeral,Storage is Not

Block, File and Object Storage

Block – Traditional storage is managed by OS i.e. LUN, DISK

File –Unstructured data is managed with folders i.e. FILE SYSTEMS

Object – Higher growth data is unstructured and managed by APPLICATIONS

Which Array/Volume/LUN

Which Directory/ Subdirectory/Filer

Container storage

LocalHost

storage

Host

Dedicated storage

Storage Appliance

Distributed File System

Host

Distributed storage

Host

Kubernetes Container Storage

Persistent Volumes:

A Persistent Volume (PV) is a piece of storage in the cluster that has been provisioned by an administrator.

Persistent Volume Claim:

A Persistent Volume Claim (PVC) is a request for storage by a user.

K8s HostPath

Plugin

Possible Ways to Configure Containers Storage:

K8s NFS Plugin

Possible Ways to Configure Containers Storage:

Container Storage Plugin

Docker Volume PluginMesos Volume Plugin

K8s dynamic Provisioner

K8s flexvolume plugin

K8s in-tree plugin

Persi

Container Storage Interface

CSI Plugin

Distributed File system – A solution

4321AvailabilityMobility Consistency Scalability

Global Namespace

Analytics

Transparent HDFSSpark

Powered by Clustered File SystemAutomated data placement and data migration

Disk TapeShared Nothing

ClusterFlash

SMBNFS

POSIX

File

JBOD/JBOF

Spectrum Scale RAID

Container Orchestrator

Worldwide Data Distribution

Site B

Site A

Site C

Encryption

DR Site

Container Granular Operations

Unified Orchestration for Apps and storage

Containerized Software-defined Storage

Seamless user experience for developers and devops

Container Native Storage Evolution

Seamless Scaling and upgrades

Run on any infrastructure

Lower TCO

Native Integration With Container Orchestrator

Container Native Storage Evolution

Container Orchestration Feature

Placement

Deployment

Scheduling

Update

Health

Horizontal Scaling

Failover

Rollout and Rollback

Configuration Management

Service Discovery

Rook Architecture A cloud Native Storage Example

Rook Architecture

Source : rook.io

Source : rook.io

Thank you