This project provides a set of source connectors for Apache Flink® directly ingesting changes coming from different databases using Change Data Capture(CDC). CDC Connectors for Apache Flink® is a set of source connectors for Apache Flink®, ingesting changes from different databases using change data capture (CDC). CDC Connectors for Apache Flink® integrates Debezium as the engine to capture data changes. So it can fully leverage the ability of Debezium. Supports reading database snapshot and continues to read transaction logs with exactly-once processing even failures happen. CDC connectors for DataStream API, users can consume changes on multiple databases and tables in a single job without Debezium and Kafka deployed. CDC connectors for Table/SQL API, users can use SQL DDL to create a CDC source to monitor changes on a single table. CDC Connectors for Apache Flink® supports ingesting snapshot data and real time changes from databases to Flink®.
Features
- Exactly-once Semantics
- Table/SQL API
- DataStream API
- Users can use SQL DDL to create a CDC source to monitor changes on a single table
- Users can consume changes on multiple databases and tables in a single job
- CDC Connectors for Apache Flink® supports reading database snapshots and continues to read binlogs