大数据 - Pulsar Community Weekly｜2021-06-14～2021-06-20 - ApachePulsar

About Apache Pulsar
Apache Pulsar is the top-level project of the Apache Software Foundation. It is the next-generation cloud-native distributed message flow platform. It integrates messaging, storage, and lightweight functional computing. It uses a separate architecture design for computing and storage to support multi-tenancy, persistent storage, Multi-computer room and cross-regional data replication, with strong consistency, high throughput, low latency and high scalability and other streaming data storage characteristics.

GitHub address: http://github.com/apache/pulsar/

Lead

Dear friends, the Pulsar community weekly update is coming!

This Pulsar community weekly report presents Pulsar client, broker, transactions and other content to help community friends master the Pulsar project and the weekly progress of the community, and also facilitates everyone to better participate in the Pulsar community!

Thank you to the following friends this week for their contributions to Apache Pulsar (in no particular order, see if you are on the list):

mattisonchao、newur、rdhabalia、lhotari、merlimat、eolivelli、aloyszhang、congbobo184、315157973、codelipenghui、lbenc135、BewareMyPower、wuzhanpeng、vmalloc、Yiyiyimu、murong00、massakam、mostafij-rahman、Anonymitaet、ericsyh、michaeljmarshall、xuesongxs、yangl

Next, let's take a look at the progress that deserves your attention from June 14th to June 20th!

Highlights of the week

Broker: failed and timed out topics will stop the replicator and clean up failed topics.

https://github.com/apache/pulsar/pull/10847

Contributor: @rdhabalia

Broker: After enabling Replicator, the managedLedger will not be created when the number of partitions is updated.

https://github.com/apache/pulsar/pull/10910

Contributors: @315157973

Important features

Because there are many PRs, only the progress of the larger PRs will be listed, excluding all the current week

The following PRs have been merged into the main branch of Pulsar

Security: Exclude and delete FreeBuilder dependencies.

https://github.com/apache/pulsar/pull/10869

Contributor: @lhotari

Security: Upgrade BouncyCastle to version 1.69.

https://github.com/apache/pulsar/pull/10867

Contributor: @lhotari

Security: Upgrade the Kubernetes Java client to version 12.0.1.

https://github.com/apache/pulsar/pull/10866

Contributor: @lhotari

Security: Upgrade Caffeine to version 2.9.1.

https://github.com/apache/pulsar/pull/10865

Contributor: @lhotari

Python: Add Python 3.9 to manylinux2014 build support.

https://github.com/apache/pulsar/pull/10954

Contributor: @lbenc135

Broker: Delete the redundant method of CompletableFuture

https://github.com/apache/pulsar/pull/10970

Contributor: @lhotari

Test: Added some tests NamespaceBundleSplitAlgorithmTest

https://github.com/apache/pulsar/pull/10987

Contributor: @mattisonchao

Broker: failed and timed out topics will stop the replicator and clean up failed topics.

https://github.com/apache/pulsar/pull/10847

Contributor: @rdhabalia

Refactor: Refactored some methods to adapt to Java 8.

https://github.com/apache/pulsar/pull/10879

Contributor: @mattisonchao

Test: Increase the stability of org.apache.pulsar.metadata.ZKSessionTest

https://github.com/apache/pulsar/pull/10955

Contributor: @eolivelli

Broker: After enabling Replicator, the managedLedger will not be created when the number of partitions is updated.

https://github.com/apache/pulsar/pull/10910

Contributors: @315157973

Important bug fixes

Due to the large number of repairs, only the more important repairs are listed, excluding all the updates this week

The following fixes have been merged into the main branch of Pulsar

Broker: Fix the getLastMessageId of direct memory leak caused by 060dd993064417.

https://github.com/apache/pulsar/pull/10977

Contributor: @lhotari

Broker: Fix the problem that Reader will throw NonRecoverableLedgerException when getting the latest Message ID.

https://github.com/apache/pulsar/pull/10957

Contributor: @codelipenghui

Build: io.airlift.aircompressor to version 19.

https://github.com/apache/pulsar/pull/10983

Contributor: @newur

Common: Update the implementation logic of TopicName#getPartitionIndex

https://github.com/apache/pulsar/pull/10902

Contributor: @yangl

Proxy: Fix the connection problem of the string in the loop.

https://github.com/apache/pulsar/pull/10986

Contributor: @mattisonchao

Metadata: Delete duplicate awaitility dependencies.

https://github.com/apache/pulsar/pull/10979

Contributor: @yangl

CLI: Fix incorrect use list.remove

https://github.com/apache/pulsar/pull/10935

Contributor: @mattisonchao

parseMessageMetadata error caused by not skipping broker entry metadata.

https://github.com/apache/pulsar/pull/10968

Contributor: @aloyszhang

Client: Fix the problem that ConsumerImpl#internalGetLastMessageIdAsync

https://github.com/apache/pulsar/pull/10974

Contributor: @eolivelli

C++: Fix the problem of windows construction in static library files.

https://github.com/apache/pulsar/pull/10956

Contributor: @BewareMyPower

Client: Fix the issue of obtaining partition metadata during discovery for non-persistent topics.

https://github.com/apache/pulsar/pull/10806

Contributor: @aloyszhang

Build: Fix the problem main configuration file of Pulsar Functions is activated.

https://github.com/apache/pulsar/pull/10887

Contributor: @murong00

Transactions: to prevent the execution is not successful startAsync() invoked in the case of closeAsync() occur null pointer exception.

https://github.com/apache/pulsar/pull/10948

Contributor: @eolivelli

Broker: Fix the problem that compaction does not work on system topics.

https://github.com/apache/pulsar/pull/10941

Contributor: @codelipenghui

Broker: Fix the problem that some exceptions were not thrown.

https://github.com/apache/pulsar/pull/10931

Contributor: @mattisonchao