各位热爱 SeaTunnel 的小伙伴们,SeaTunnel 社区 4 月份月报来啦!这里将记录 SeaTunnel 社区每月的重要更新,欢迎关注!
月度 Merge 之星
感谢以下小伙伴 4 月为 Apache SeaTunnel 做的精彩贡献(排名不分先后):
@TyrantLucifer,@sunxiaojian,@CosmosNi,@corgy-w,@litiliu,@LeonYoah,@hailin0,@taohaozhi1129,@L-Gryps,@Hisoka-X,@xiaochen-zhou,@shangeyao,@lightzhao,@haneeshmv,@liunaijie,@nianhua99,@dailai,@dzygoon,@ruanwenjun,@xxzuo,@liugddx,@EricJoy2048,@baicie,@YalikWang,@gitfortian
apache/seatunnel
fix
- [fix修复死链 ]( https://github.com/apache/seatunnel/pull/6764 " fix修复死链 ") @liunaijie
- [fix修复无法释放资源的问题 ]( https://github.com/apache/seatunnel/pull/6763 " fix修复无法释放资源的问题 ") @liunaijie
- [ [Fix]修复Oracle类型转换器在数值类型中处理负数比例的问题 ]( https://github.com/apache/seatunnel/pull/6758 " [Fix]修复Oracle类型转换器在数值类型中处理负数比例的问题 ") @Hisoka-X
- [ [Bug Fix]将Doris的错误状态(#6753)记录下来。 ]( https://github.com/apache/seatunnel/pull/6755 " [Bug Fix]将Doris的错误状态(#6753)记录下来。 ") @taohaozhi1129
- [Hotfix将aws-java-sdk-bundle的版本更新以修复任务无法运行的问题。 ]( https://github.com/apache/seatunnel/pull/6700 " Hotfix将aws-java-sdk-bundle的版本更新以修复任务无法运行的问题。 ") @EricJoy2048
- [Fix修复 JVM 选项文件末尾没有
\n
时丢失 JVM 选项的问题 ]( https://github.com/apache/seatunnel/pull/6693 " Fix修复 JVM 选项文件末尾没有\n
时丢失 JVM 选项的问题 ") @Hisoka-X - [ [fix]修复SeaTunnel获取row size时的NPE问题 ]( https://github.com/apache/seatunnel/pull/6681 " [fix]修复SeaTunnel获取row size时的NPE问题 ") @liunaijie
- [Fix修复 Doris 和 StarRocks 数据库中创建表的 SQL 语句错误 ]( https://github.com/apache/seatunnel/pull/6679 " Fix修复 Doris 和 StarRocks 数据库中创建表的 SQL 语句错误 ") @dailai
- [Fix修复了一些文档中的链接 ]( https://github.com/apache/seatunnel/pull/6673 " Fix修复了一些文档中的链接 ") @xxzuo
- [Fix将正确的偏移量提交给broker,并减少ThreadInterruptedException日志 ]( https://github.com/apache/seatunnel/pull/6668 " Fix将正确的偏移量提交给broker,并减少ThreadInterruptedException日志 ") @YalikWang
- [Fix修复Apache SeaTunnel KafkaSinkFactory选项规则 ]( https://github.com/apache/seatunnel/pull/6657 " Fix修复Apache SeaTunnel KafkaSinkFactory选项规则 ") @liunaijie
- [Fix修复一些拼写错误 ]( https://github.com/apache/seatunnel/pull/6628 " Fix修复一些拼写错误 ") @xiaochen-zhou
- [Fix修复FTPSink配置键
username
为user
。 ]( https://github.com/apache/seatunnel/pull/6627 " Fix修复FTPSink配置键username
为user
。 ") @Hisoka-X - [fix修复了当checkpoint.interval设置过小时引发的空指针异常问题(#6624) ]( https://github.com/apache/seatunnel/pull/6625 " fix修复了当checkpoint.interval设置过小时引发的空指针异常问题(#6624) ") @YalikWang
- [ [Hotfix]修复了Apache SeaTunnel中HTTP源读取yyyy-MM-dd HH:mm:ss格式数据的bug,并优化了DateTimeUtils。 ]( https://github.com/apache/seatunnel/pull/6601 " [Hotfix]修复了Apache SeaTunnel中HTTP源读取yyyy-MM-dd HH:mm:ss格式数据的bug,并优化了DateTimeUtils。 ") @EricJoy2048
- [ [Bug] [formats]修复当内容包含文件分隔符时解析行失败的问题 ]( https://github.com/apache/seatunnel/pull/6589 " [Bug] [formats]修复当内容包含文件分隔符时解析行失败的问题 ") @litiliu
- [Fix修复当分区已存在时,Apache SeaTunnel增加Hive分区的错误 ]( https://github.com/apache/seatunnel/pull/6577 " Fix修复当分区已存在时,Apache SeaTunnel增加Hive分区的错误 ") @Hisoka-X
- [Fix解决因保存点检查机制导致的线程挂起问题 ]( https://github.com/apache/seatunnel/pull/6568 " Fix解决因保存点检查机制导致的线程挂起问题 ") @Hisoka-X
- [ [Bug]修复OrcWriteStrategy/ParquetWriteStrategy在使用Kerberos身份验证时的登录问题。 ]( https://github.com/apache/seatunnel/pull/6472 " [Bug]修复OrcWriteStrategy/ParquetWriteStrategy在使用Kerberos身份验证时的登录问题。 ") @ruanwenjun
- [BugConnector-v2修复当源为空时的行为,支持SourceConfig.SOURCE字段为空。 ]( https://github.com/apache/seatunnel/pull/6425 " BugConnector-v2修复当源为空时的行为,支持SourceConfig.SOURCE字段为空。 ") @CosmosNi
- [ [Hotfix]解决 DEFAULT TABLE 问题 ]( https://github.com/apache/seatunnel/pull/6352 " [Hotfix]解决 DEFAULT TABLE 问题 ") @EricJoy2048
improve
- [Improve为Zeta任务添加Minio作为检查点存储的文档 ]( https://github.com/apache/seatunnel/pull/6732 " Improve为Zeta任务添加Minio作为检查点存储的文档 ") @gitfortian
- [ [Improve] [Clickhouse]当设置allow_experimental_lightweight_delete为false时,移除检查 (#6727) ]( https://github.com/apache/seatunnel/pull/6728 " [Improve] [Clickhouse]当设置allow_experimental_lightweight_delete为false时,移除检查 (#6727) ") @shangeyao
- [Improve修复资源泄漏的风险。 ]( https://github.com/apache/seatunnel/pull/6721 " Improve修复资源泄漏的风险。 ") @lightzhao
- [Improve禁用Apache SeaTunnel检查点的HDFS文件系统缓存。 ]( https://github.com/apache/seatunnel/pull/6718 " Improve禁用Apache SeaTunnel检查点的HDFS文件系统缓存。 ") @LeonYoah
- [Doc为Config-Encryption-Decryption.md添加中文支持 ]( https://github.com/apache/seatunnel/pull/6715 " Doc为Config-Encryption-Decryption.md添加中文支持 ") @xxzuo
- [Doc介绍文档中的多行文本功能 ]( https://github.com/apache/seatunnel/pull/6713 " Doc介绍文档中的多行文本功能 ") @nianhua99
- [Feature启用了Iceberg-sink模式变更测试 ]( https://github.com/apache/seatunnel/pull/6711 " Feature启用了Iceberg-sink模式变更测试 ") @sunxiaojian
- [Improve支持MySQL 5.5版本 ]( https://github.com/apache/seatunnel/pull/6710 " Improve支持MySQL 5.5版本 ") @hailin0
- [ [Improve]优化CDC连接器中的表架构读取 ]( https://github.com/apache/seatunnel/pull/6702 " [Improve]优化CDC连接器中的表架构读取 ") @Hisoka-X
- [Improve当
SHOW CREATE TABLE
命令失败时,回退到描述表 ]( https://github.com/apache/seatunnel/pull/6701 " Improve当SHOW CREATE TABLE
命令失败时,回退到描述表 ") @hailin0 - [Improve更新Hive 3版本 ]( https://github.com/apache/seatunnel/pull/6699 " Improve更新Hive 3版本 ") @EricJoy2048
- [Feature冰山sink支持将数据写入分支 ]( https://github.com/apache/seatunnel/pull/6697 " Feature冰山sink支持将数据写入分支 ") @sunxiaojian
- [Improve移除找不到字段异常 ]( https://github.com/apache/seatunnel/pull/6691 " Improve移除找不到字段异常 ") @xiaochen-zhou
- [Feature在作业配置中支持配置任务重试次数。 ]( https://github.com/apache/seatunnel/pull/6690 " Feature在作业配置中支持配置任务重试次数。 ") @Hisoka-X
- [ [Improve]优化Doris流加载客户端侧的错误信息 ]( https://github.com/apache/seatunnel/pull/6688 " [Improve]优化Doris流加载客户端侧的错误信息 ") @Hisoka-X
- [ [Improve]优化Parquet类型转换时的读取性能 ]( https://github.com/apache/seatunnel/pull/6683 " [Improve]优化Parquet类型转换时的读取性能 ") @Hisoka-X
- [Improve当任务完成后,检查点将不会写入文件。 ]( https://github.com/apache/seatunnel/pull/6674 " Improve当任务完成后,检查点将不会写入文件。 ") @liunaijie
- [Improve在SQL中添加引号标识符 ]( https://github.com/apache/seatunnel/pull/6669 " Improve在SQL中添加引号标识符 ") @hailin0
- [Improve优化RestHttpGetCommandProcessor#getSeaTunnelServer()方法的逻辑 ]( https://github.com/apache/seatunnel/pull/6666 " Improve优化RestHttpGetCommandProcessor#getSeaTunnelServer()方法的逻辑 ") @xiaochen-zhou
- [DocSink部分支持中文 ]( https://github.com/apache/seatunnel/pull/6663 " DocSink部分支持中文 ") @corgy-w
- [Doc为Kafka连接器添加Kerberos身份验证支持 (#6653) ]( https://github.com/apache/seatunnel/pull/6660 " Doc为Kafka连接器添加Kerberos身份验证支持 (#6653) ") @gitfortian
- [Doc为seatunnel-engine添加中文支持 ]( https://github.com/apache/seatunnel/pull/6656 " Doc为seatunnel-engine添加中文支持 ") @xxzuo
- [ImproveHive连接器支持多个文件系统。 ]( https://github.com/apache/seatunnel/pull/6648 " ImproveHive连接器支持多个文件系统。 ") @dailai
- [Improve移除解析转换过程中的Fallback ]( https://github.com/apache/seatunnel/pull/6644 " Improve移除解析转换过程中的Fallback ") @xiaochen-zhou
- [Feature为问题6199添加连接器检查脚本 ]( https://github.com/apache/seatunnel/pull/6635 " Feature为问题6199添加连接器检查脚本 ") @dailai
- [Feature在cdc数据源中支持监听消息延迟事件。 ]( https://github.com/apache/seatunnel/pull/6634 " Feature在cdc数据源中支持监听消息延迟事件。 ") @hailin0
- [Improve修复
ResourceManager
和EventReport
模块上测试的不稳定问题。 ]( https://github.com/apache/seatunnel/pull/6620 " Improve修复ResourceManager
和EventReport
模块上测试的不稳定问题。 ") @Hisoka-X - [Improve在自动创建表时增加类型转换器 ]( https://github.com/apache/seatunnel/pull/6617 " Improve在自动创建表时增加类型转换器 ") @hailin0
- [Improve支持PaimonSink的Hadoop HA和Kerberos认证。 ]( https://github.com/apache/seatunnel/pull/6585 " Improve支持PaimonSink的Hadoop HA和Kerberos认证。 ") @dailai
- [Improve当记录不包含模式字段时,提升读取性能。 ]( https://github.com/apache/seatunnel/pull/6571 " Improve当记录不包含模式字段时,提升读取性能。 ") @Hisoka-X
- [feature添加xugudb连接器 ]( https://github.com/apache/seatunnel/pull/6561 " feature添加xugudb连接器 ") @L-Gryps
- [Improve在增量阶段优化split状态的内存分配 ]( https://github.com/apache/seatunnel/pull/6554 " Improve在增量阶段优化split状态的内存分配 ") @hailin0
- [Improve[storage]更新HDFS配置,支持更多参数 ]( https://github.com/apache/seatunnel/pull/6547 " Improve[storage]更新HDFS配置,支持更多参数 ") @liunaijie
- [Doc为start-v2/locally/quick-start-flink.md和start-v2/locally/quick-start-spark.md添加中文支持。 ]( https://github.com/apache/seatunnel/pull/6412 " Doc为start-v2/locally/quick-start-flink.md和start-v2/locally/quick-start-spark.md添加中文支持。 ") @dzygoon
- [Feature支持在Spark/Flink引擎上用户自定义参数。 ]( https://github.com/apache/seatunnel/pull/6387 " Feature支持在Spark/Flink引擎上用户自定义参数。 ") @liunaijie
- [ [Feature]Hive源/ sink支持多个表。 ]( https://github.com/apache/seatunnel/pull/5929 " [Feature]Hive源/ sink支持多个表。 ") @ruanwenjun
others
- [ [Chore]删除无用的接口 ]( https://github.com/apache/seatunnel/pull/6746 " [Chore]删除无用的接口 ") @TyrantLucifer
- 2.3.5版本发布 @liugddx
- [Release[release-note]添加发布说明 ]( https://github.com/apache/seatunnel/pull/6712 " Release[release-note]添加发布说明 ") @liugddx
- [ [Docs]更新Debezium JSON文档 ]( https://github.com/apache/seatunnel/pull/6652 " [Docs]更新Debezium JSON文档 ") @liunaijie
- [ [E2E]修复Amazon DynamoDB IT的不稳定问题 ]( https://github.com/apache/seatunnel/pull/6640 " [E2E]修复Amazon DynamoDB IT的不稳定问题 ") @hailin0
- [ [Docs]修复Kafka格式文档 ]( https://github.com/apache/seatunnel/pull/6633 " [Docs]修复Kafka格式文档 ") @liunaijie
- [ [E2E]启用StarRocksCDCSinkIT ]( https://github.com/apache/seatunnel/pull/6626 " [E2E]启用StarRocksCDCSinkIT ") @liunaijie
apache/seatunnel-website
- [ [Docs]更新并支持选择语言 ]( https://github.com/apache/seatunnel-website/pull/302 " [Docs]更新并支持选择语言 ") @baicie
apache/seatunnel-web
- [feature主要添加数据源-jdbc-db2 ]( https://github.com/apache/seatunnel-web/pull/159 " feature主要添加数据源-jdbc-db2 ") @haneeshmv
本文由 白鲸开源科技 提供发布支持!
**粗体** _斜体_ [链接](http://example.com) `代码` - 列表 > 引用
。你还可以使用@
来通知其他用户。