12
GURPREET SINGH Deploying ,backing up and restore with Datastax and Azure .

Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016

Embed Size (px)

Citation preview

Page 1: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016

GURPREET SINGH

Deploying ,backing up and restore with Datastax and Azure .

Page 2: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016

1 Introduction

2 What is ARM ?

3 Data Backup Strategy

4 Restore Data

5 Questions ?

© DataStax, All Rights Reserved. 2

Page 3: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016

© DataStax, All Rights Reserved. 3

About me :

• Currently working as a Cloud Architect At Albertsons/Safeway

• Passionate about cloud and Big data technologies, self-motivated

• I love to socialize and I believe in never giving up.

Page 4: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016

© DataStax, All Rights Reserved. 4

Page 5: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016

© DataStax, All Rights Reserved. 5

ARM (DEPLOYMENT)

• RESOURCE• RESOURCE GROUP• RESOURCE PROVIDER• RESOURCE MANAGER TEMPLATE• DECLARATVE SYNTAX

Page 6: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016

ARM (DEPLOYMENT CONTD ..)

• ARM : Azure Resource Manager , a template which is written in JSON a key–value pair .

• Template Format :

© DataStax, All Rights Reserved. 6

Page 7: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016

BACKUP

OpsCenter backups the data ,how ?

Page 8: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016

© DataStax, All Rights Reserved. 8

CHALLENGES/LIMITATIONS

• OpsCenter 5.X didn't have option to backup the data in Centralized location in Azure cloud , the way it has Amazon S3 .

• Network latency if we try to use one or two blob storage for multiple VMs (Causes failure) .

Page 9: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016

© DataStax, All Rights Reserved. 9

rsync – a mirror !

All the nodes MUST have custom script at location

“/usr/share/datastax-agent/bin/backup-scripts”

Or

./bin/backup-scripts for tarball

Using Opscenter ->Backups , you can schedule backups.

Page 10: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016

RESTORE

How and where to start Restore ?

Page 11: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016

© DataStax, All Rights Reserved. 11

STEPS TO RESTORE CASSANDRA ON AZURE• Standup new infrastructure with DSE software and with exact same no. of nodes as

in Production .

• Copy the mirror disks to the location where a restore should be performed

• Update cassandra.YAML with cluster name ,seeds ,broadcast_address,rpc_address ,num_tokens and data, commit logs and saved caches directory .

• Update cassandra-rackdc.properties with the dc and rack (Fault domains in Azure , Availability zones in amazon) .

• Clean-up the SYSTEM tables Peers, Local .

• Update Cluster name, data-center & Rack for LOCAL column family .

• NODETOOL FLUSH .

• START Your DSE .

Page 12: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016

12© DataStax, All Rights Reserved.