Upload
continuent
View
358
Download
4
Tags:
Embed Size (px)
DESCRIPTION
With more and more business moving into the cloud, the inclination is to use more cloud-based databases services, such as Amazon RDS. Deployment of Amazon RDS is capable with just a few buttons, but there are big differences between firing up a simple database for testing, and translating that into a full deployment to be used in production. For this to work properly, you have to consider many other aspects of the deployment, including high availability (HA), disaster recovery (DR), and scalability of your solution within your application's requirements. Continuent Tungsten provides a full data management solution that is already handling hundreds of millions of transactions daily for our customers. This webinar explores how your business can benefit from Continuent Tungsten, a flexible clustering solution that helps data-driven businesses handle billions of transactions daily across a wide range of environments. We'll focus on the following problems in particular: - Ensuring fully capable cloud DBMS operation - Avoiding lock-in by choosing solutions that run across clouds as well as on-premises - Spreading MySQL data over regions using flexible primary/DR and multi-master topologies - Controlling maintenance intervals and the DBMS stack directly - Integrating in real-time to data warehouses and on-premises DBMS like Oracle - Ensuring immediate access to top-notch, 24x7 support when things go south. Learn how you can use Continuent Tungsten to build scalable management solutions that offer the economic benefits of the cloud with the enterprise capabilities required by businesses that live and die by their data. Your data is too precious to take shortcuts.
Citation preview
Copyright © 2014 VMware, Inc.
MySQL in the Cloud,is Amazon RDS for you?
MC Brown, Senior Product Line Manager
Copyright © 2014 VMware, Inc.
Introducing Continuent
2
• The leading provider of clustering and replication for open source DBMS
• Our Product: Continuent Tungsten
• Clustering - Commercial-grade HA, performance scaling and data management for MySQL
• Replication - Flexible, high-performance data movement
Copyright © 2014 VMware, Inc.
Quick Continuent Facts
• Largest Tungsten installation by data volume processes over 800 million transactions per day on 225 terabytes of relational data
• Largest installation by transaction volume handles up to 8 billion transactions daily
• Wide variety of topologies including MySQL, Oracle, Vertica, and Hadoop in production
• Cross-site topologies widely deployed
3
Copyright © 2014 VMware, Inc. 4
Continuent Tungsten Customers
Copyright © 2014 VMware, Inc. 5
The Cloud Data Stampede
Copyright © 2014 VMware, Inc.
Enterprises Racing to the Cloud
6
Copyright © 2014 VMware, Inc.
Important Questions for Data
• What features are required for enterprise data management?
• How do you ensure full control over the DBMS environment and upgrades?
• How do you integrate cloud and on-premises operation?
• What is the right level of support for your business?
7
Copyright © 2014 VMware, Inc.
Point and Click DBMS: Amazon RDS
8
Copyright © 2014 VMware, Inc.
How it Works Inside
9
DRBDReplication
(Synchronous)
Read Replicas
MySQL NativeReplication(Async)
Active Primary
Inactive Standby
Applications
DNS CNAME
Amazon RDSArchitecture
Copyright © 2014 VMware, Inc.
RDS Illustrates Limits of Pure Cloud Data Services
• Operates only in Amazon cloud
• Replicas tied to a single AWS region
• Maintenance requires downtime
• Connectivity to replicas is an application problem
• No direct control over/access to DBMS
• Weak integration with other DBMS types
• Minimalist support model
10
Copyright © 2014 VMware, Inc.
Another Approach to Cloud Data Management
11
Database-as-a-Service enabled for easy
enterprise operation in any environment
Copyright © 2014 VMware, Inc. 12
Tungsten Cloud-Enabled Clusters for MySQL
Copyright © 2014 VMware, Inc.
Tungsten Database-as-a-Service
13
Tungsten clusters combine off-the-shelf open source DBMS servers into data services with:
• 24x7 data access • Scaling of load on replicas • Simple management commands
...without app changes or data migration
Amazon US West
apache /php
GonzoPortal.com
Connector Connector
Copyright © 2014 VMware, Inc.
Cluster Architecture
14
Application
Tungsten Connector
Application
Tungsten Connector
Replicator
Db2
Replicator
Db3Db1
Replicator
Slave SlaveMaster
Manager Manager Manager
Monitoring and Control
Monitoring and Control
Data Service: sjc
Copyright © 2014 VMware, Inc.
Tungsten Connector Basics
• Any MySQL client can connect
• Initiates connections using JDBC
15
App Native protocol COM_QUERY
COM_INIT_DBCOM_DROP_DB
Connector
Copyright © 2014 VMware, Inc.
Tungsten Connector Basics
• Pass-through operation after connection
• Full transparency & low overhead for clients
16
App
Protocol packet COM_QUERY
select * from t
ConnectorProtocol packet
OKResultSet Rows:1
Copyright © 2014 VMware, Inc.
Mapping Tungsten to Amazon Cloud
17
US-East-1
AZAZ
AZ AZ
EU-West-1
AZ
AZ AZ
US-West-1
AZ
AZ AZ AZAZ AZ AZAZ
AZ
Replicas across availability zones
Clusters across regions
Copyright © 2014 VMware, Inc.
Tungsten Primary/DR Deployment
18
Warm data and apps in secondary region(s)
ApplicationApplications ApplicationApplications
Amazon Region Amazon Region
Live data and apps
in primary region only
Multi-AZ deployment
Async replication between sites
Run in Amazon or on-premise
Copyright © 2014 VMware, Inc.
Tungsten Multi-Master Deployment
19
No app or data coupling across regions
ApplicationApplications ApplicationApplications
Amazon Region Amazon Region
Live data and apps
in all regions
Multi-AZ deployment
Async replication between sites
Run in Amazon or on-premise
Copyright © 2014 VMware, Inc. 20
Top-to-Bottom Control of DBMS Services
Copyright © 2014 VMware, Inc.
Cloud-Ready Automation
• Vagrant host provisioning
• Host configuration using Puppet
• Install cluster using .ini file
21
[defaults]application-password=secretapplication-port=3306application-user=appreplication-password=secretreplication-port=13306replication-user=tungstenstart-and-report=trueuser=tungsten
[alpha]connectors=web1,web2,web3master=db1members=db1,db2,db3
https://github.com/continuent-vagrant
Copyright © 2014 VMware, Inc. 22
Demo: Multi-AZ Continuent Tungsten
Clusters
Copyright © 2014 VMware, Inc.
A Familiar Trouble-Shooting Model
23
Login and fix it!
Copyright © 2014 VMware, Inc.
Zero-Downtime SQL Schema Upgrade
24
Final UpgradeSwitchSlave Upgrade Slave Upgrade
• Shun slave 1, run upgrade, and return to cluster (Discard and recover on failure)
• Upgrade old master
(Cluster schema is now fully upgraded)
• Repeat for additional slave(s)
(Discard and recover on failure)
• Switch master to an upgraded slave (Revert to old master on failure)
Copyright © 2014 VMware, Inc. 25
Hybrid Cloud Operation
Copyright © 2014 VMware, Inc.
Competing Economic Models
26
Copyright © 2014 VMware, Inc.
Perils of a Single Vendor
27
Date Duration Amazon Failure Description
Apr 2011 2 days US-East EBS failure - “Cloudpocalypse”
Aug 2011 1 day EU-West power outage causes multi-AZ EBS, EC2, and RDS failures
Jun 2012 1-2 days US-East AZs fail due to weather, EBS & other services down
Oct 2012 6+ hours US-East EBS failure triggered by bug brings down RDS and ELB
Aug 2013 1+ hours US-East EC2 networking failure
Dec 2013 3 hours US-East EC2 connectivity failures (again)
Copyright © 2014 VMware, Inc.
On-Ramp to Cloud with Hybrid Operation
28
Use Amazon as DR
location
ApplicationApplications ApplicationApplications
On-Prem Primary Cloud DR
Establish primary in
existing data center
Hardware-based cluster
Async replication between locations
Multi-AZ in Amazon
©Continuent 2014 29
Data Management Needs of Business-Critical
Applications
©Continuent 2014
What are the big trends in the market?
• High performance transaction processing with 24x7 availability
• Data distribution across sites
• Cloud and on-premises operation
• Real-time reporting on all corporate data
30
©Continuent 2014
Growth of Analytics Capabilities
31
©Continuent 2014
Most Valuable Features According to Continuent Customers
32
Automatic Failover
Zero-Downtime Maintenance
Load Balancing
Performance
Multi-Site Ops
Disaster Recovery
Percentage of Respondents
0% 20% 40% 60% 80%
25%
29%
30%
36%
53%
72%
©Continuent 2014
Customer Growth Trends
33
Increasing Clusters
Adding Analytics
Adding Both
Percentage of Respondents
0% 10% 20% 30% 40%
14%
32%
38%
50%
Copyright © 2014 VMware, Inc.
Continuent Tungsten 3.0
• Continuent Tungsten Clustering
• Certified Replication to Datawarehouse
• Straight from the cluster
• Hadoop (MapR, HortonWorks, Cloudera, IBM, Pivotal, Apache, Amazon EMR)
• HP Vertica
• Amazon RedShift
• Oracle (Bi-Directional)
34
©Continuent 2014
Real-time Loading from Clustered MySQL to Data Warehouses
35
TungstenReplicator
cluster1 AmazonRedshift
cluster2
Copyright © 2014 VMware, Inc.
Hybrid Data Integration
36
Web-facing transaction processing
ApplicationApplications
AmazonEnterpriseResourcePlanning(ERP)
Corporate DC
Private Cloud
Hadoop-based analytics
AsynchronousReplication
AsynchronousReplication
©Continuent 2014
Roadmap for CT 3.0 release
37
• All features described here are working with anchor customers
• We are polishing integrations and improving documentation
• We are looking for 3.0 beta customers now
• Full product release will occur during Q4
Copyright © 2014 VMware, Inc.
Enterprise-Class Support from Continuent
• Worldwide support team with 24x7 response
• Advice, workarounds, and bug fixes
• 1st line staffed by MySQL/clustering experts
• Fast escalation to engineering for problems
• Collaborative support model using Zendesk and GotoMeeting
• Implementation services for new deployments and upgrades
38
Copyright © 2014 VMware, Inc. 39
Wrap-Up
Copyright © 2014 VMware, Inc.
Tungsten clusters offer a better alternative to pure cloud services
• Cloud-only database services have significant limitations
• Tungsten enterprise-ready clusters function equally well in cloud and on-prem
• Continuent offers software and support to manage business-critical data for the most demanding applications
• Continued 24x7 transaction processing based on economical MySQL DBMS
• Certified hybrid multi-site operation
• Cloud-optimized Puppet/Chef provisioning
• Certified HA / analytics integration
40
Copyright © 2014 VMware, Inc.
www.continuent.comFollow us on Twitter @continuent
Tungsten Replicator:http://code.google.com/p/tungsten-replicator
Our Blogs: http://scale-out-blog.blogspot.com http://datacharmer.org/blog http://mcslp.com http://www.continuent.com/news/blogs http://flyingclusters.blogspot.com/
560 S. Winchester Blvd., Suite 500 San Jose, CA 95128 Tel +1 (866) 998-3642 Fax +1 (408) 668-1009 e-mail: [email protected]