Simple canal client demo for Cloud Bigtable

Provision src and target dbs

• Install MySQL if necessary Please refer to the doc to install MySQL by using homebrew.

• Create source table

Create table test(id number, col1 char(30), col2 char(30));

• Create cloud bigtable table by using cbt

cbt createtble test
cbt createfamily test cf1

Install and start canal

• Configure source MySQL instance: IP, user, password, etc. Please refer to the doc

• Start the canal Please refer to the doc

Start the simple canal client for bigtable

• Configure target Cloud Bigtable: projectId, instanceId, tableId, etc in the simple.conf file.
• Start the simple canal client

mvn package assembly:single
java -jar xxx.jar

Generate workloads and observe the result

mysql> insert into test values(1111, "mike","kushimoto");
mysql> commit;
cbt -project learning-centre -instance test read test;

mysql> update test set col2="Osaka" where id=111;
mysql> commit;
cbt -project learning-centre -instance test read test;

mysql> delete from test where id=111;
mysql> commit;
cbt -project learning-centre -instance test read test;

To Do list

Please help to ignore the operations from maintenance in Cloud SQL for MySQL