SeaTunnel 社区月报
2025-02期
“
各位热爱 Apache SeaTunnel 的小伙伴们,SeaTunnel 社区月报来啦!”
SeaTunnel 正在迅猛发展,这将有利于提升数据同步的高可扩展性、高性能及高可靠性。
SeaTunnel Monthly Merge Stars
感谢以下小伙伴上个月为 Apache SeaTunnel 做的精彩贡献(排名不分先后):
@hawk9821 | @fcb-xiaobo | @akulabs8 |
---|---|---|
@realcpf | @lyne7-sc | @litiliu |
@uniding | @mickeyzzm | @MyeoungDev |
@thakralgarvit | @xiaochen-zhou | @zhangshenghang |
@remones | @Gemini147258 | @Scorpio777888 |
@lm-ylj | @joyCurry30 | @hailin0 |
@CosmosNi | @duzhendi | @jw-itq |
@wuchunfu | @liunaijie | @corgy-w |
@wattt3 | @Hisoka-X | @SplitfireUptown |
@quicklyfast | @wgzhao | @liugddx |
近期修复和改进
修复内容
- [Fix解决冲突的
file_format_type
需求 ]( https://github.com/apache/seatunnel/pull/8823 " Fix解决冲突的file_format_type
需求 ") @litiliu - [ [Fix]修复SourceSplitEnumerator实现类中的错误日志名称 ]( https://github.com/apache/seatunnel/pull/8817 " [Fix]修复SourceSplitEnumerator实现类中的错误日志名称 ") @fcb-xiaobo
- [Fix修复S3文件文档 ]( https://github.com/apache/seatunnel/pull/8798 " Fix修复S3文件文档 ") @litiliu
- [Fix修复解析SqlServer JDBC URL错误 ]( https://github.com/apache/seatunnel/pull/8784 " Fix修复解析SqlServer JDBC URL错误 ") @Hisoka-X
- [Fix修复连接器中CUSTOM_SQL的描述 ]( https://github.com/apache/seatunnel/pull/8778 " Fix修复连接器中CUSTOM_SQL的描述 ") @xiaochen-zhou
- [ [Bugfix]修复ExceptionUtil的ClassCastException ]( https://github.com/apache/seatunnel/pull/8776 " [Bugfix]修复ExceptionUtil的ClassCastException ") @hailin0
- [Fix优化后的POM文件名称标签 ]( https://github.com/apache/seatunnel/pull/8770 " Fix优化后的POM文件名称标签 ") @corgy-w
- [Fix修复在 request_tablet_size 小于 BUCKETS 数量的场景中可能的数据丢失问题 ]( https://github.com/apache/seatunnel/pull/8768 " Fix修复在 request_tablet_size 小于 BUCKETS 数量的场景中可能的数据丢失问题 ") @xiaochen-zhou
- [Fix将DateMilliConvertor添加到将DateMilliVector转换为默认时区 ]( https://github.com/apache/seatunnel/pull/8736 " Fix将DateMilliConvertor添加到将DateMilliVector转换为默认时区 ") @xiaochen-zhou
- [Fix修复FieldMapper转换时丢失字段约束信息 ]( https://github.com/apache/seatunnel/pull/8697 " Fix修复FieldMapper转换时丢失字段约束信息 ") @quicklyfast
- [Bugfix修复运河序列化为json ]( https://github.com/apache/seatunnel/pull/8695 " Bugfix修复运河序列化为json ") @hailin0
- [Fix修复JDBC Sink语句缓冲区错误的时间清除问题 ]( https://github.com/apache/seatunnel/pull/8653 " Fix修复JDBC Sink语句缓冲区错误的时间清除问题 ") @Hisoka-X
- [Fix修复无法读取空字符串的文件阅读问题 ]( https://github.com/apache/seatunnel/pull/8646 " Fix修复无法读取空字符串的文件阅读问题 ") @corgy-w
- [Fix大型语言模型转换提供者切换案例缺少中断 ]( https://github.com/apache/seatunnel/pull/8643 " Fix大型语言模型转换提供者切换案例缺少中断 ") @realcpf
- [Fix[DorisIT]修复DorisIT无法运行本地的问题 ]( https://github.com/apache/seatunnel/pull/8630 " Fix[DorisIT]修复DorisIT无法运行本地的问题 ") @zhangshenghang
- [FixSQL转换支持最大/最小函数 ]( https://github.com/apache/seatunnel/pull/8625 " FixSQL转换支持最大/最小函数 ") @CosmosNi
- [hotfixHdfsFile 文档 ]( https://github.com/apache/seatunnel/pull/8613 " hotfixHdfsFile 文档 ") @wgzhao
- [Fix优化插件发现机制 ]( https://github.com/apache/seatunnel/pull/8603 " Fix优化插件发现机制 ") @corgy-w
- [Fix修复因binlog删除导致的恢复任务失败 ]( https://github.com/apache/seatunnel/pull/8587 " Fix修复因binlog删除导致的恢复任务失败 ") @lm-ylj
improve
- [Doc support chinese [docs/zh/connector-v2/sink/Vertica.md]系统 ]( https://github.com/apache/seatunnel/pull/8852 " Doc support chinese [docs/zh/connector-v2/sink/Vertica.md]系统 ") @Scorpio777888
- [Doc support chinese [docs/zh/connector-v2/sink/SqlServer.md]系统 ]( https://github.com/apache/seatunnel/pull/8851 " Doc support chinese [docs/zh/connector-v2/sink/SqlServer.md]系统 ") @Scorpio777888
- [Doc support chinese [docs/zh/connector-v2/sink/SelectDB-Cloud.md]系统 ]( https://github.com/apache/seatunnel/pull/8850 " Doc support chinese [docs/zh/connector-v2/sink/SelectDB-Cloud.md]系统 ") @Scorpio777888
- [Doc support chinese [docs/zh/connector-v2/sink/S3File.md]系统 ]( https://github.com/apache/seatunnel/pull/8849 " Doc support chinese [docs/zh/connector-v2/sink/S3File.md]系统 ") @Scorpio777888
- [Doc support chinese [docs/zh/connector-v2/source/FtpFile.md]系统 ]( https://github.com/apache/seatunnel/pull/8848 " Doc support chinese [docs/zh/connector-v2/source/FtpFile.md]系统 ") @Scorpio777888
- [Doc support chinese [docs/zh/connector-v2/source/FakeSource.md]系统 ]( https://github.com/apache/seatunnel/pull/8847 " Doc support chinese [docs/zh/connector-v2/source/FakeSource.md]系统 ") @Scorpio777888
- [Doc support chinese [docs/zh/connector-v2/sink/Snowflake.md]系统 ]( https://github.com/apache/seatunnel/pull/8845 " Doc support chinese [docs/zh/connector-v2/sink/Snowflake.md]系统 ") @Scorpio777888
- [Doc support chinese [docs/zh/connector-v2/sink/SftpFile.md]系统 ]( https://github.com/apache/seatunnel/pull/8844 " Doc support chinese [docs/zh/connector-v2/sink/SftpFile.md]系统 ") @Scorpio777888
- [Doc support chinese [docs/zh/connector-v2/source/Easysearch.md]系统 ]( https://github.com/apache/seatunnel/pull/8843 " Doc support chinese [docs/zh/connector-v2/source/Easysearch.md]系统 ") @Scorpio777888
- [Doc support chinese [docs/zh/connector-v2/source/DB2.md]系统 ]( https://github.com/apache/seatunnel/pull/8842 " Doc support chinese [docs/zh/connector-v2/source/DB2.md]系统 ") @Scorpio777888
- [Improve优化的Redis连接参数 ]( https://github.com/apache/seatunnel/pull/8841 " Improve优化的Redis连接参数 ") @fcb-xiaobo
- [Doc support chinese [docs/zh/connector-v2/sink/S3-Redshift.md]系统 ]( https://github.com/apache/seatunnel/pull/8835 " Doc support chinese [docs/zh/connector-v2/sink/S3-Redshift.md]系统 ") @Gemini147258
- [Doc support chinese [docs/zh/connector-v2/sink/RocketMQ.md]系统 ]( https://github.com/apache/seatunnel/pull/8834 " Doc support chinese [docs/zh/connector-v2/sink/RocketMQ.md]系统 ") @Gemini147258
- [Doc support chinese [docs/zh/connector-v2/sink/OssJindoFile.md]系统 ]( https://github.com/apache/seatunnel/pull/8833 " Doc support chinese [docs/zh/connector-v2/sink/OssJindoFile.md]系统 ") @Gemini147258
- [Doc support chinese [docs/zh/connector-v2/sink/OssFile.md]系统 ]( https://github.com/apache/seatunnel/pull/8832 " Doc support chinese [docs/zh/connector-v2/sink/OssFile.md]系统 ") @Gemini147258
- [Doc support chinese [docs/zh/connector-v2/sink/Oracle.md]系统 ]( https://github.com/apache/seatunnel/pull/8831 " Doc support chinese [docs/zh/connector-v2/sink/Oracle.md]系统 ") @Gemini147258
- [Doc support chinese [docs/zh/connector-v2/sink/OceanBase.md]系统 ]( https://github.com/apache/seatunnel/pull/8830 " Doc support chinese [docs/zh/connector-v2/sink/OceanBase.md]系统 ") @Gemini147258
- [Doc support chinese [docs/zh/connector-v2/sink/ObsFile.md]系统 ]( https://github.com/apache/seatunnel/pull/8827 " Doc support chinese [docs/zh/connector-v2/sink/ObsFile.md]系统 ") @Gemini147258
- [Doc support chinese [docs/zh/connector-v2/source/CosFile.md]系统 ]( https://github.com/apache/seatunnel/pull/8826 " Doc support chinese [docs/zh/connector-v2/source/CosFile.md]系统 ") @Gemini147258
- [Doc support chinese [docs/zh/connector-v2/source/Clickhouse.md]系统 ]( https://github.com/apache/seatunnel/pull/8824 " Doc support chinese [docs/zh/connector-v2/source/Clickhouse.md]系统 ") @Gemini147258
- [Doc support chinese [docs/zh/connector-v2/sink/Mysql.md]系统 ]( https://github.com/apache/seatunnel/pull/8818 " Doc support chinese [docs/zh/connector-v2/sink/Mysql.md]系统 ") @Gemini147258
- [Improve删除无用的工具。 ]( https://github.com/apache/seatunnel/pull/8793 " Improve删除无用的工具。 ") @joyCurry30
- [Feature在嵌入模块和LLM模块中添加对智谱AI的支持 ]( https://github.com/apache/seatunnel/pull/8790 " Feature在嵌入模块和LLM模块中添加对智谱AI的支持 ") @xiaochen-zhou
- [Feature为读写文件功能添加
filename_extension
参数。 ]( https://github.com/apache/seatunnel/pull/8769 " Feature为读写文件功能添加filename_extension
参数。 ") @Hisoka-X - [Improve默认禁用RESTful API v1 ]( https://github.com/apache/seatunnel/pull/8766 " Improve默认禁用RESTful API v1 ") @Hisoka-X
- [ [improve]更新ClickHouse连接器配置选项 ]( https://github.com/apache/seatunnel/pull/8755 " [improve]更新ClickHouse连接器配置选项 ") @lyne7-sc
- [Improve[activemq]移除重复的依赖项 ]( https://github.com/apache/seatunnel/pull/8753 " Improve[activemq]移除重复的依赖项 ") @wuchunfu
- [Improve改进兽人阅读错误信息 ]( https://github.com/apache/seatunnel/pull/8751 " Improve改进兽人阅读错误信息 ") @Hisoka-X
- [ [improve]德瑞选项 ]( https://github.com/apache/seatunnel/pull/8745 " [improve]德瑞选项 ") @liunaijie
- [ [improve]数据枢纽接收选项 ]( https://github.com/apache/seatunnel/pull/8744 " [improve]数据枢纽接收选项 ") @liunaijie
- [ [improve]控制台接收选项 ]( https://github.com/apache/seatunnel/pull/8743 " [improve]控制台接收选项 ") @liunaijie
- [ [improve]钉钉接收器选项 ]( https://github.com/apache/seatunnel/pull/8742 " [improve]钉钉接收器选项 ") @liunaijie
- [ [improve]重新组织Zeta引擎配置选项 ]( https://github.com/apache/seatunnel/pull/8741 " [improve]重新组织Zeta引擎配置选项 ") @liunaijie
- [ [improve]RabbitMQ 选项 ]( https://github.com/apache/seatunnel/pull/8740 " [improve]RabbitMQ 选项 ") @liunaijie
- [Feature支持自定义配置键用于加密/解密 ]( https://github.com/apache/seatunnel/pull/8739 " Feature支持自定义配置键用于加密/解密 ") @remones
- [ [improve]Slack连接器选项 ]( https://github.com/apache/seatunnel/pull/8738 " [improve]Slack连接器选项 ") @akulabs8
- [Improve为RocketMQ连接器添加可选标志,以跳过解析错误而不是失败 ]( https://github.com/apache/seatunnel/pull/8737 " Improve为RocketMQ连接器添加可选标志,以跳过解析错误而不是失败 ") @xiaochen-zhou
- [Doc support chinese [docs/zh/connector-v2/sink/TDengine.md]系统 ]( https://github.com/apache/seatunnel/pull/8732 " Doc support chinese [docs/zh/connector-v2/sink/TDengine.md]系统 ") @duzhendi
- [Doc support chinese [docs/zh/connector-v2/sink/Tablestore.md]系统 ]( https://github.com/apache/seatunnel/pull/8731 " Doc support chinese [docs/zh/connector-v2/sink/Tablestore.md]系统 ") @duzhendi
- [Doc support chinese [docs/zh/connector-v2/sink/Socket.md]系统 ]( https://github.com/apache/seatunnel/pull/8729 " Doc support chinese [docs/zh/connector-v2/sink/Socket.md]系统 ") @duzhendi
- [Doc support chinese [docs/zh/connector-v2/sink/Milvus.md]系统 ]( https://github.com/apache/seatunnel/pull/8727 " Doc support chinese [docs/zh/connector-v2/sink/Milvus.md]系统 ") @duzhendi
- [Doc support chinese [docs/zh/connector-v2/sink/Kudu.md]系统 ]( https://github.com/apache/seatunnel/pull/8725 " Doc support chinese [docs/zh/connector-v2/sink/Kudu.md]系统 ") @duzhendi
- [Doc support chinese [docs/zh/connector-v2/sink/IoTDB.md]系统 ]( https://github.com/apache/seatunnel/pull/8722 " Doc support chinese [docs/zh/connector-v2/sink/IoTDB.md]系统 ") @duzhendi
- [Doc support chinese [docs/zh/connector-v2/source/Phoenix.md]系统 ]( https://github.com/apache/seatunnel/pull/8711 " Doc support chinese [docs/zh/connector-v2/source/Phoenix.md]系统 ") @mickeyzzm
- [Doc support chinese [docs/zh/connector-v2/source/OpenMldb.md]系统 ]( https://github.com/apache/seatunnel/pull/8710 " Doc support chinese [docs/zh/connector-v2/source/OpenMldb.md]系统 ") @mickeyzzm
- [Doc support chinese [docs/zh/connector-v2/source/Maxcompute.md]系统 ]( https://github.com/apache/seatunnel/pull/8708 " Doc support chinese [docs/zh/connector-v2/source/Maxcompute.md]系统 ") @mickeyzzm
- [Doc support chinese [docs/zh/connector-v2/source/GoogleSheets.md]系统 ]( https://github.com/apache/seatunnel/pull/8706 " Doc support chinese [docs/zh/connector-v2/source/GoogleSheets.md]系统 ") @mickeyzzm
- [Doc support chinese [docs/zh/connector-v2/source/Cassandra.md]系统 ]( https://github.com/apache/seatunnel/pull/8704 " Doc support chinese [docs/zh/connector-v2/source/Cassandra.md]系统 ") @mickeyzzm
- [Doc support chinese [docs/zh/connector-v2/source/AmazonSqs.md]系统 ]( https://github.com/apache/seatunnel/pull/8703 " Doc support chinese [docs/zh/connector-v2/source/AmazonSqs.md]系统 ") @mickeyzzm
- [Doc support chinese [docs/zh/connector-v2/sink/Slack.md]系统 ]( https://github.com/apache/seatunnel/pull/8701 " Doc support chinese [docs/zh/connector-v2/sink/Slack.md]系统 ") @mickeyzzm
- [Doc support chinese [docs/zh/connector-v2/sink/CosFile.md]系统 ]( https://github.com/apache/seatunnel/pull/8700 " Doc support chinese [docs/zh/connector-v2/sink/CosFile.md]系统 ") @mickeyzzm
- [Doc support chinese [docs/zh/connector-v2/source/AmazonDynamoDB.md]系统 ]( https://github.com/apache/seatunnel/pull/8694 " Doc support chinese [docs/zh/connector-v2/source/AmazonDynamoDB.md]系统 ") @mickeyzzm
- [Improve更新文档中的旧链接 ]( https://github.com/apache/seatunnel/pull/8690 " Improve更新文档中的旧链接 ") @thakralgarvit
- [Doc support chinese [docs/zh/connector-v2/sink/Sentry.md]#8497 ]( https://github.com/apache/seatunnel/pull/8672 " Doc support chinese [docs/zh/connector-v2/sink/Sentry.md]#8497 ") @mickeyzzm
- [ [improve]更新Kafka源默认模式从 content<ROW<content STRING>> 到 content<STRING> ]( https://github.com/apache/seatunnel/pull/8642 " [improve]更新Kafka源默认模式从 content<ROW<content STRING>> 到 content<STRING> ") @liunaijie
- [Improve减少Docker镜像的大小 ]( https://github.com/apache/seatunnel/pull/8641 " Improve减少Docker镜像的大小 ") @quicklyfast
- [Improve[Paimon]派蒙目录关闭错误信息更新 ]( https://github.com/apache/seatunnel/pull/8640 " Improve[Paimon]派蒙目录关闭错误信息更新 ") @uniding
- [ [improve]添加StarRocks选项 ]( https://github.com/apache/seatunnel/pull/8639 " [improve]添加StarRocks选项 ") @fcb-xiaobo
- [ [Improve]重构连接器通用选项 ]( https://github.com/apache/seatunnel/pull/8634 " [Improve]重构连接器通用选项 ") @liunaijie
- [ [improve]更新Redis连接器配置选项 ]( https://github.com/apache/seatunnel/pull/8631 " [improve]更新Redis连接器配置选项 ") @akulabs8
- [Improve移除重复的依赖项 ]( https://github.com/apache/seatunnel/pull/8628 " Improve移除重复的依赖项 ") @wuchunfu
- [Improve支持在OpenGauss中使用upsert ]( https://github.com/apache/seatunnel/pull/8627 " Improve支持在OpenGauss中使用upsert ") @hailin0
- [Improve改进目录连接缓存 ]( https://github.com/apache/seatunnel/pull/8626 " Improve改进目录连接缓存 ") @hailin0
- [ [improve]添加Elasticsearch选项 ]( https://github.com/apache/seatunnel/pull/8623 " [improve]添加Elasticsearch选项 ") @fcb-xiaobo
- [Improve作业主中的类加载器拆分 ]( https://github.com/apache/seatunnel/pull/8622 " Improve作业主中的类加载器拆分 ") @Hisoka-X
- [ [improve]添加断言选项 ]( https://github.com/apache/seatunnel/pull/8620 " [improve]添加断言选项 ") @liunaijie
- [ [improve]Kafka连接器选项 ]( https://github.com/apache/seatunnel/pull/8616 " [improve]Kafka连接器选项 ") @wattt3
- [ [improve]更新S3File连接器配置选项 ]( https://github.com/apache/seatunnel/pull/8615 " [improve]更新S3File连接器配置选项 ") @litiliu
- [ [improve]Cassandra连接器选项 ]( https://github.com/apache/seatunnel/pull/8608 " [improve]Cassandra连接器选项 ") @liunaijie
- [ [improve]亚马逊SQS连接器更新 ]( https://github.com/apache/seatunnel/pull/8602 " [improve]亚马逊SQS连接器更新 ") @liunaijie
- [ [improve]更新 Amazon DynamoDB 连接器 ]( https://github.com/apache/seatunnel/pull/8601 " [improve]更新 Amazon DynamoDB 连接器 ") @liunaijie
- [ [improve]添加连接器选项类存在检查 ]( https://github.com/apache/seatunnel/pull/8600 " [improve]添加连接器选项类存在检查 ") @liunaijie
- [ [improve]更新Druid连接器配置选项 ]( https://github.com/apache/seatunnel/pull/8594 " [improve]更新Druid连接器配置选项 ") @akulabs8
- [Doc翻译与Redis/派蒙相关的中文文档 ]( https://github.com/apache/seatunnel/pull/8584 " Doc翻译与Redis/派蒙相关的中文文档 ") @lyne7-sc
- [Feature支持多表的MaxCompute源 ]( https://github.com/apache/seatunnel/pull/8582 " Feature支持多表的MaxCompute源 ") @Hisoka-X
- [ [improve]更新ActiveMQ连接器配置选项 ]( https://github.com/apache/seatunnel/pull/8580 " [improve]更新ActiveMQ连接器配置选项 ") @liunaijie
- [FeatureJSONPath 支持 Map 数组类型 ]( https://github.com/apache/seatunnel/pull/8577 " FeatureJSONPath 支持 Map 数组类型 ") @CosmosNi
others
- [Doc修复FTP文档中的死链接。 ]( https://github.com/apache/seatunnel/pull/8860 " Doc修复FTP文档中的死链接。 ") @joyCurry30
- [ [Doc]添加 Milvus 源中文文档 ]( https://github.com/apache/seatunnel/pull/8709 " [Doc]添加 Milvus 源中文文档 ") @mickeyzzm
- [Docs"Orc 数据类型" 应在文档中更正为 "Parquet 数据类型" ]( https://github.com/apache/seatunnel/pull/8705 " Docs"Orc 数据类型" 应在文档中更正为 "Parquet 数据类型" ") @MyeoungDev
- [Refactor统一转换工厂(transformFactory)的创建逻辑 ]( https://github.com/apache/seatunnel/pull/8574 " Refactor统一转换工厂(transformFactory)的创建逻辑 ") @liugddx
apache/seatunnel
fix
- [Fix用户选择CSV字符串模式 ]( https://github.com/apache/seatunnel/pull/8572 " Fix用户选择CSV字符串模式 ") @corgy-w
- [Fix在启动时修复GTID以正确从检查点恢复 ]( https://github.com/apache/seatunnel/pull/8528 " Fix在启动时修复GTID以正确从检查点恢复 ") @jw-itq
- [Fix当帖子包含参数时进行修复 ]( https://github.com/apache/seatunnel/pull/8434 " Fix当帖子包含参数时进行修复 ") @CosmosNi
improve
- [Improve过滤心跳事件 ]( https://github.com/apache/seatunnel/pull/8569 " Improve过滤心跳事件 ") @hailin0
- [Feature处理大型语言模型非标准格式响应 ]( https://github.com/apache/seatunnel/pull/8551 " Feature处理大型语言模型非标准格式响应 ") @SplitfireUptown
- [Feature支持达梦数据库的sink DDL ]( https://github.com/apache/seatunnel/pull/8380 " Feature支持达梦数据库的sink DDL ") @hawk9821
- [Feature增加槽位分配策略 ]( https://github.com/apache/seatunnel/pull/8233 " Feature增加槽位分配策略 ") @zhangshenghang
apache/seatunnel-website
improve
- [Improve添加名为张东浩的新提交者 ]( https://github.com/apache/seatunnel-website/pull/360 " Improve添加名为张东浩的新提交者 ") @hawk9821
- [ [Improve]更新提交代码指南 ]( https://github.com/apache/seatunnel-website/pull/359 " [Improve]更新提交代码指南 ") @Hisoka-X
本文由 白鲸开源科技 提供发布支持!
**粗体** _斜体_ [链接](http://example.com) `代码` - 列表 > 引用
。你还可以使用@
来通知其他用户。