Saturday, February 9, 2013 - Khan Kennels › presentations › pdf › replication_ssphp.pdfReplication With MySQL Ligaya Turmelle Principle Technical Support Engineer - MySQL Saturday,

1

Saturday, February 9, 2013

<Insert Picture Here>

Replication With MySQLLigaya Turmelle Principle Technical Support Engineer - MySQL https://joind.in/8017


https://joind.in/8017

https://joind.in/8017

3


[email protected] Support Engineer

MySQL ACE~8 years

@lig

About Me


4

TODO List

• Foundation• Overview• Asynchronous and Semi-Synchronous• Setup• Monitoring


5

Foundation


6

Baby Steps

Network


7

Why would you want to do that?


• Scale Out

8



• Scale Out• Data Redundancy

9



• Scale Out• Data Redundancy• Analytics

10



• Scale Out• Data Redundancy• Analytics• Long distance data distribution

11




12

MySQL Terminology


• Method of Sending the Data

13

Terminology


• Method of Sending the Data• Asynchronous Replication - since 3.23

14

Terminology


• Method of Sending the Data• Asynchronous Replication - since 3.23• Semi-Synchronous Replication - 5.5+

15

Terminology


• Where to Store the Changes

16

Terminology


• Where to Store the Changes• Binary Log - Master

17

Terminology


• Where to Store the Changes• Binary Log - Master• Relay Log - Slave

18

Terminology


• Method of Replication

19

Terminology


• Method of Replication• SBR - Statement Based Replication

20

Terminology


• Method of Replication• SBR - Statement Based Replication• RBR - Row Based Replication

21

Terminology


• Method of Replication• SBR - Statement Based Replication• RBR - Row Based Replication• Mixed Mode

• http://dev.mysql.com/doc/refman/5.5/en/binary-log-mixed.html

22

Terminology


• Replication Threads

23

Terminology


• Replication Threads • Slave Server

• IO Thread

24

Terminology


• Replication Threads • Slave Server

• IO Thread• SQL Thread

25

Terminology


• Replication Threads • Master Server

• Binlog Dump Thread

26

Terminology


27

Overviews



28

MySQL Replication


29

Highlevel Replication Overview

1Master


30


Binarylog

1

2

Master


31


RelayLog

Binarylog

1

3

2

Master


32


Slave

RelayLog

Binarylog

1

4

3

2

Master


33

Asynchronous vsSemi-Synchronous



34

Asynchronous Replication


35

Asynchronous

Master Slave


36

Asynchronous

Master SlaveIO Thread (3)

Binlog DumpThread created


37

Asynchronous

Master Slave

Binarylog

IO Thread (3)

Binlog DumpProcess


38

Asynchronous

Master Slave

RelayLog

Binarylog

IO Thread (3)

Binlog DumpProcess

IO Thread (3)


• Pros• Fast• slave can be disconnected

• Cons• Potential loss of transactions and data integrity

39

Asynchronous



40

Semi-Synchronous Replication


41

Semi-Synchronous

Master Slave

semi-synccapable

semi-synccapable


42

Semi-Synchronous

Master SlaveIO Thread (3)

Binlog DumpThread created

semi-sync capablesemi-synccapable

semi-synccapable


43

Semi-Synchronous(optimal)


44


Master SlaveIO Thread

Binlog DumpThreadCreated

semi-synccapable

semi-synccapable

1


45


Master Slave

RelayLog

Binarylog

IO Thread

Binlog DumpProcess

IO Thread (save)

semi-synccapable

semi-synccapable

1

x


46


Master SlaveIO Thread semi-synccapable

semi-synccapable

1

RelayLog

Binarylog

Binlog DumpProcess

IO Thread (ack)


47

Semi-Synchronous(timeout)


48


Master SlaveIO Thread

Binlog DumpThreadCreated

semi-synccapable

semi-synccapable

1


49


Master Slave

Binarylog

IO Thread

Binlog DumpProcess

semi-synccapable IO Thread (save)

semi-synccapable

1

xNetwork


50


Master Slave

Binarylog

IO Thread

Binlog DumpProcess

semi-synccapable IO Thread (save)

semi-synccapable

1

xNetwork

TIMEOUT


51


Master Slave

Binarylog

IO Thread

Binlog DumpProcess

async semi-synccapable

1


52


Master Slave

RelayLog

Binarylog

IO Thread

Binlog DumpProcess

IO Thread (save)



53


Master Slave

RelayLog

Binarylog

IO Thread

Binlog DumpProcess

IO Thread (save)


resync


54


Master Slave

RelayLog

Binarylog

IO Thread (synced)

Binlog DumpProcess


resync


55


Master Slave

RelayLog

Binarylog

Binlog DumpProcess

semi-synccapable

IO Thread semi-synccapable


• Pros• Tries to improve data integrity

• Cons• Performance Implications

56

Semi-Synchronous


57

Setting it Up



58

Asynchronous -Master


• Config/Option file• my.cnf/my.ini

59

Asynchronous - Master

log-bin=mysql_binserver_id=1


60

Asynchronous - Mastermysql> CREATE USER 'repl'@'%.mydomain.com' IDENTIFIED BY 'slavepass';

mysql> GRANT REPLICATION SLAVE ON *.* TO 'repl'@'%.mydomain.com';

• Create replication user• requires

REPLICATION SLAVE privilege


61

Asynchronous - Mastermysql> FLUSH TABLES WITH READ LOCK;

mysql> SHOW MASTER STATUS; • Master server binary log coordinates• requires

REPLICATION SLAVE privilege


• While the tables are locked• if you need a copy of the master, this is the time to make it

• Once you have a copy, release the locks

62

Asynchronous - Master

mysql> UNLOCK TABLES;



63

Asynchronous -Slave



64

Asynchronous - Slave

server_id=2read-only


• Load in the copy/backup from the master• always verify that the backup works

65

Asynchronous - Slave


66

Asynchronous - Slavemysql> CHANGE MASTER TO

MASTER_HOST = 'master.mycompany.com', MASTER_USER = 'repl', MASTER_PASSWORD='slavepass', MASTER_PORT=3306, MASTER_LOG_FILE='master-bin. 001', MASTER_LOG_POS=4;

mysql> START SLAVE;

• Issue CHANGE MASTER command• info from MASTER

STATUS



67

Semi-Synchronous -Master


68

Semi-Synchronous - Mastermysql> INSTALL PLUGIN rpl_semi_sync_master SONAME 'semisync_master.so';

mysql> SHOW PLUGINS;• Install PLUGIN

• Server must support dynamic loading (see have_dynamic_loading)


69

Semi-Synchronous - Mastermysql> SET GLOBAL rpl_semi_sync_master_enabled = 1;

mysql> SET GLOBAL rpl_semi_sync_master_timeout = N;

• Enable PLUGIN• default is off



70

Semi-Synchronous - Master

log-bin=mysql_binserver_id=1

# semi-sync replrpl_semi_sync_master_enabled = 1rpl_semi_sync_master_timeout = 1000 # 1 sec



71

Semi-Synchronous -Slave


72

Semi-Synchronous - Slavemysql> INSTALL PLUGIN rpl_semi_sync_slave SONAME 'semisync_slave.so';

mysql> SHOW PLUGINS;• Install PLUGIN

• Server must support dynamic loading (see have_dynamic_loading)


73

Semi-Synchronous - Slavemysql> SET GLOBAL rpl_semi_sync_slave_enabled = 1;

• Enable PLUGIN• Default is Off


74

Semi-Synchronous - Slavemysql> STOP SLAVE IO_THREAD;

mysql> START SLAVE IO THREAD;• Runtime



75

Semi-Synchronous - Slave

server_id=2read-only

# semi-sync replrpl_semi_sync_slave_enabled=1


76

Monitoring



77

Monitoring -Master


• Gives file name and position• Lists filtering done on Master

78

Master Status

mysql> SHOW MASTER STATUS;+---------------+----------+--------------+------------------+| File | Position | Binlog_Do_DB | Binlog_Ignore_DB |+---------------+----------+--------------+------------------+| mysql-bin.003 | 73 | test | manual,mysql |+---------------+----------+--------------+------------------+


• Gives the binary logs on the server

79

Binary Logs

mysql> SHOW BINARY LOGS;+---------------+-----------+| Log_name | File_size |+---------------+-----------+| binlog.000015 | 724935 || binlog.000016 | 733481 |+---------------+-----------+



80

Monitoring -Slave


81

Slave Statusmysql> SHOW SLAVE STATUS\G*************************** 1. row *************************** Slave_IO_State: Waiting for master to send event Master_Host: localhost Master_User: root Master_Port: 3306 Connect_Retry: 3 Master_Log_File: mysql-bin.003 Read_Master_Log_Pos: 73 Relay_Log_File: mysql-relay-bin.005 Relay_Log_Pos: 548 Relay_Master_Log_File: mysql-bin.003 Slave_IO_Running: Yes Slave_SQL_Running: Yes Replicate_Do_DB: Replicate_Ignore_DB: Replicate_Do_Table: Replicate_Ignore_Table: Replicate_Wild_Do_Table: Replicate_Wild_Ignore_Table:


82

Slave Status Last_Errno: 0 Last_Error: Skip_Counter: 0 Exec_Master_Log_Pos: 73 Relay_Log_Space: 552 Until_Condition: None Until_Log_File: Last_SQL_Error: Until_Log_Pos: 0 Master_SSL_Allowed: No Master_SSL_CA_File: Master_SSL_CA_Path: Master_SSL_Cert: Master_SSL_Cipher: Master_SSL_Key: Seconds_Behind_Master: 8Master_SSL_Verify_Server_Cert: No Last_IO_Errno: 0 Last_IO_Error: Last_SQL_Errno: 0 Last_SQL_Error:


• State Slave_IO_State: Waiting for master to send event

• Running Slave_IO_Running: Yes

Slave_SQL_Running: Yes

• Last Error Last_IO_Errno: 0 Last_IO_Error: Last_SQL_Errno: 0 Last_SQL_Error:

83

Slave Status - Basic Stuff


• Where everything is• IO Thread

Master_Log_File: mysql-bin.003 Read_Master_Log_Pos: 73

84

Slave Status - Important Stuff


• Where everything is• SQL Thread

• Relay Log Relay_Log_File: mysql-relay-bin.005 Relay_Log_Pos: 548

• Binary Log Relay_Master_Log_File: mysql-bin.003 .... Exec_Master_Log_Pos: 73

85

Slave Status - Important Stuff


• Show Caution

Seconds_Behind_Master: 8

86

Slave Status - Caution


• Lot of changes• Global Transaction ID• Binary Log Group Commit• Parallel execution of transactions on the slave• Crash-safe Replication• And more

87

MySQL 5.6


88

Questions?


89


Documents

Saturday, February 9, 2013 - Khan Kennels › presentations › pdf › replication_ssphp.pdfReplication With MySQL Ligaya Turmelle Principle Technical Support Engineer - MySQL Saturday,