[FLINK-37959][postgres]Supports all pgsql field types like debezium #4086
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Mrart
force-pushed
the
types
branch
4 times, most recently
from
25d88b3 to
fb20587
Compare
|
@tchivs @lvyanquan Hi , Can you help me review the code? |
Mrart
changed the title
|
There are some failed cases in postgres-pipeline... |
tchivs
reviewed
Aug 15, 2025
...postgres/src/main/java/org/apache/flink/cdc/connectors/postgres/utils/PostgresTypeUtils.java
Outdated
Show resolved
Hide resolved
|
#4042 will supported array. |
tchivs
approved these changes
Aug 19, 2025
...postgres/src/main/java/org/apache/flink/cdc/connectors/postgres/utils/PostgresTypeUtils.java
Show resolved
Hide resolved
lvyanquan
reviewed
Aug 19, 2025
docs/content.zh/docs/connectors/pipeline-connectors/postgres.md
Outdated
Show resolved
Hide resolved
docs/content.zh/docs/connectors/pipeline-connectors/postgres.md
Outdated
Show resolved
Hide resolved
[FLINK-38141][pipeline-connector/iceberg] Fix iceberg connector incorrect type mapping (apache#4070) --------- Co-authored-by: zhangchao.doovvv <zhangchao.doovvv@bytedance.com> [minor] Fix potential sql connection statement issue (apache#4069) [FLINK-38185][pipeline-connector][iceberg] Correctly handle the type conversion of TIMESTAMP_TITH_TIME_ZONE. (apache#4074) [tests][pipeline-connector/fluss] Add MySQL to Fluss E2e IT case (apache#4057) * [ci][fluss] Add MySQL to Fluss E2e IT case Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com> * add: comments Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com> --------- Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com> [FLINK-38184] one time of GetCopyOfBuffer is enough When serializing split. (apache#4073) [FLINK-38164][pipeline-connector/mysql] support mysql long and long varchar type (apache#4076) --------- Co-authored-by: zhangchao.doovvv <zhangchao.doovvv@bytedance.com> [FLINK-37828] Enable scan.incremental.snapshot.unbounded-chunk-first by default for improved stability (apache#4082) [FLINK-38194][pipeline-connector/iceberg] Iceberg connector supports auto-creating namespace (apache#4080) --------- Co-authored-by: zhangchao.doovvv <zhangchao.doovvv@bytedance.com> [FLINK-37905][runtime] Fix transform failure with non-ascii string literals (apache#4038) * [FLINK-37905] Fix transform failure with non-ascii string literals * address comments Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com> --------- Signed-off-by: yuxiqian <34335406+yuxiqian@users.noreply.github.com> [FLINK-38142] Upgrading the Paimon version to 1.2.0 (apache#4066) [FLINK-37963] Fix potential NPE when triggering JobManager failover prematurely (apache#4044) fixed decimal add test fixed decimal mode test add all types [FLINK-38059][doc] Add fluss pipeline connector documentation (apache#4088) Co-authored-by: wangjunbo <wangjunbo@qiyi.com> [FLINK-37835] Fix NoPointException when start with latest-offset. (apache#4091) --------- Co-authored-by: wuzexian <shanqing.wzx@alibaba-inc.com> [FLINK-38188][pipeline-connector][postgres] Fix database name validation logic in PostgresDataSourceFactory (apache#4075) --------- Co-authored-by: lvyanquan <lvyanquan.lyq@alibaba-inc.com> [hotfix][doc] Update uses of Upload documentation in build_docs.yml. (apache#4093) [FLINK-38204][pipeline-connector][maxcompute] Use getLatestEvolvedSchema to get Schema in SessionManageOperator in case of using route. apache#4094 Co-authored-by: wuzexian <shanqing.wzx@alibaba-inc.com> back
…fter an existed column. (apache#4100) fixed docs
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
After https://issues.apache.org/jira/browse/FLINK-35670, we have the first version for postgres sql pipeline
Next step we need work for this.
https://issues.apache.org/jira/browse/FLINK-37959, to supported all postgres sql field types.