[Flink-36980] [cdc-connect] Build a new introductory practice "Streaming ELT from MySQL to Kafka" #4033
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
MOBIN-F
reviewed
Jun 3, 2025
| - MYSQL_USER=mysqluser | ||
| - MYSQL_PASSWORD=mysqlpw | ||
| ``` | ||
| 注意：文件里面的 192.168.67.2 为内网 IP，可通过 ifconfig 查找。 |
There was a problem hiding this comment.
192.168.67.2 -> kafka or zookeeper?
In the same docker network, we can use service names to communicate directly
| parallelism: 1 | ||
|
|
||
|
|
||
| ``` |
| ```yaml | ||
| version: '2.1' | ||
| services: | ||
| Zookeeper: |
|
Hi @Sukang1002, Thanks for your contribution, I left some comments~ |
mielientiev
reviewed
Aug 10, 2025
|
|
||
| # Streaming ELT from MySQL to Kafka | ||
|
|
||
| This tutorial is to show how to quickly build a Streaming ELT job from MySQL to StarRocks using Flink CDC, including the |
There was a problem hiding this comment.
Suggested change
| This tutorial is to show how to quickly build a Streaming ELT job from MySQL to StarRocks using Flink CDC, including the | |
| This tutorial is to show how to quickly build a Streaming ELT job from MySQL to Kafka using Flink CDC, including the |
mielientiev
reviewed
Aug 10, 2025
| docker-compose exec mysql mysql -uroot -p123456 | ||
| ``` | ||
|
|
||
| Then, modify schema and record in MySQL, and the tables of StarRocks will change the same in real time： |
mielientiev
reviewed
Aug 10, 2025
| sink-table: kafka_ods_orders | ||
| ``` | ||
|
|
||
| In this way, we can synchronize sharding tables like `app_db.order01`、`app_db.order02`、`app_db.order03` into one kafka_ods_orders tables.By using the built-in tools of kafka, you can view the successful establishment of the corresponding Topic. Data details can be queried using kafka-console-Consumer.sh: |
There was a problem hiding this comment.
Suggested change
| In this way, we can synchronize sharding tables like `app_db.order01`、`app_db.order02`、`app_db.order03` into one kafka_ods_orders tables.By using the built-in tools of kafka, you can view the successful establishment of the corresponding Topic. Data details can be queried using kafka-console-Consumer.sh: | |
| In this way, we can synchronize sharding tables like `app_db.order01`、`app_db.order02`、`app_db.order03` into one kafka_ods_orders topic. By using the built-in tools of kafka, you can view the successful establishment of the corresponding Topic. Data details can be queried using kafka-console-Consumer.sh: |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Desc: FLINK-36980