v3.3.7

2025-05-23

Library updates

• [fix][sec] Upgrade Jetty to 9.4.57.v20241219 to mitigate CVE-2024-6763 (#24232)
• [improve] Upgrade Apache Commons library versions to compatible versions (#24205)
• [improve] Upgrade Netty to 4.1.121.Final (#24214)
• [improve] Upgrade pulsar-client-python to 3.7.0 in Docker image (#24302)
• [improve][build] Upgrade commons-compress version from 1.27.0 to 1.27.1 (#24270)

Broker

• [fix][broker] Consumer stuck when delete subscription __compaction failed (#23980)
• [fix][broker] Fix broker shutdown delay by resolving hanging health checks (#24210)
• [fix][broker] Fix ByteBuf memory leak in REST API for publishing messages (#24228)
• [fix][broker] Fix cluster level OffloadedReadPriority to bookkeeper-first does not work (#24151)
• [fix][broker] Fix compaction service log's wrong condition (#24207)
• [fix][broker] fix ExtensibleLoadManager to override the ownerships concurrently without blocking load manager thread (#24156)
• [fix][broker] Fix HashedWheelTimer leak in PulsarService by stopping it in shutdown (#24275)
• [fix][broker] Fix HealthChecker deadlock in shutdown (#24216)
• [fix][broker] Fix potential deadlock when creating partitioned topic (#24313)
• [fix][broker] Fix seeking by timestamp can be reset the cursor position to earliest (#23919)
• [fix][broker] Fix some problems in calculate totalAvailableBookies in method getExcludedBookiesWithIsolationGroups when some bookies belongs to multiple isolation groups. (#24091)
• [fix][broker] Fix tenant creation and update with null value (#24209)
• [fix][broker] fix wrong method name checkTopicExists. (#24293)
• [fix][broker] Orphan schema after disabled a cluster for a namespace (#24223)
• [fix][broker] The feature brokerDeleteInactivePartitionedTopicMetadataEnabled leaves orphan topic policies and topic schemas (#24150)
• [fix][broker] Unregister non-static metrics collectors registered in Prometheus default registry (#24257)
• [fix][broker]Fix incorrect priority between topic policies and global topic policies (#24254)
• [fix][broker]fix memory leak, messages lost, incorrect replication state if using multiple schema versions(auto_produce) (#24178)
• [fix][admin] Backlog quota's policy is null which causes a NPE (#24192)
• [fix][ml] Fix ML thread blocking issue in internalGetPartitionedStats API (#24167)
• [fix][ml] Skip deleting cursor if it was already deleted before calling unsubscribe (#24098)
• [improve][broker] Optimize subscription seek (cursor reset) by timestamp (#22792)
• [improve][broker]Improve the feature "Optimize subscription seek (cursor reset) by timestamp": search less entries (#24219)

Client

• [fix][client] Fix incorrect producer.getPendingQueueSize due to incomplete queue implementation (#24184)
• [fix][client] Fix producer publishing getting stuck after message with incompatible schema is discarded (#24282)
• [improve][client] validate ClientConfigurationData earlier to avoid resource leaks (#24187)
• [improve][client]Improve transaction log when a TXN command timeout (#24230)

Pulsar IO and Pulsar Functions

• [fix][io] Fix SyntaxWarning in Pulsar Python functions (#24297)
• [improve][io] Add configuration parameter for disabling aggregation for Kinesis Producers (#24289)
• [improve][io] support kafka connect transforms and predicates (#24221)
• [improve][io] Upgrade Kafka client and compatible Confluent platform version (#24201)
• [improve][io][kca] support fully-qualified topic names in source records (#24248)

Others

• [cleanup][misc] Add override annotation (#24033)
• [fix][cli] Refactor scripts to detect major Java version and pass correct add-opens parameters (#22927)
• [fix][misc] Fix ByteBuf leak in SchemaUtils (#24274)
• [fix][proxy] Fix incorrect client error when calling get topic metadata (#24181)
• [fix][proxy] Propagate client connection feature flags through Pulsar Proxy to Broker (#24158)
• [fix][schema] Reject unsupported Avro schema types during schema registration (#24103)
• [improve][cli] Make pulsar-perf termination more responsive by using Thread interrupt status (#24309)
• [improve][misc] Migrate from multiple nullness annotation libraries to JSpecify annotations (#24239)

Tests & CI

• [fix][build] Ensure that buildtools is Java 8 compatible and fix remaining compatibility issue (#24307)
• [fix][build] Fix docker image building by replacing deprecated and removed compress argument (#24155)
• [fix][test] Fix flaky BatchMessageWithBatchIndexLevelTest.testBatchMessageAck (#24212)
• [fix][test] Fix flaky BrokerServiceChaosTest (#24162)
• [fix][test] Fix flaky BrokerServiceChaosTest.testFetchPartitionedTopicMetadataWithCacheRefresh (#24161)
• [fix][test] Fix flaky ManagedCursorTest.testLastActiveAfterResetCursor and disable failing SchemaTest (#24261)
• [fix][test] Fix flaky ManagedCursorTest.testSkipEntriesWithIndividualDeletedMessages (#24244)
• [fix][test] Fix flaky NamespacesTest.testNamespacesApiRedirects (#24194)
• [fix][test] Fix invalid test CompactionTest.testDeleteCompactedLedgerWithSlowAck (#24166)
• [fix][test] Fix more Netty ByteBuf leaks in tests (#24299)
• [fix][test] Fix multiple ByteBuf leaks in tests (#24281)
• [fix][test] Fix multiple resource leaks in tests (#24218)
• [fix][test] Fix remaining UnfinishedStubbingException issue with AuthZTests (#24174)
• [fix][test] Fix resource leaks in ProxyTest and fix invalid tests (#24204)
• [fix][test] Fix resource leaks in PulsarBrokerStarterTest (#24235)
• [fix][test] Fix TestNG BetweenTestClassesListenerAdapter listener (#24258)
• [fix][test] Fix UnfinishedStubbing issue in AuthZTests (#24165)
• [fix][test] Improve reliability of IncrementPartitionsTest (#24172)
• [fix][test] Simplify BetweenTestClassesListenerAdapter and fix issue with BeforeTest/AfterTest annotations (#24304)
• [fix][test] Update partitioned topic subscription assertions in IncrementPartitionsTest (#24056)
• [fix][test]flaky-test:ManagedLedgerInterceptorImplTest.testManagedLedgerPayloadInputProcessorFailure (#24170)
• [improve][test] Use configured session timeout for MockZooKeeper and TestZKServer in PulsarTestContext (#24171)
• [cleanup][test] Remove unused parameter from deleteNamespaceWithRetry method in MockedPulsarServiceBaseTest (#24283)
• [improve] Adapt startup scripts for Java 24 changes (#24236)
• [improve][build] Build apachepulsar/pulsar-io-kinesis-sink-kinesis_producer with Alpine 3.21 (#24180)
• [improve][build] Improve thread leak detector by ignoring "Attach Listener" thread (#24277)
• [improve][build] Upgrade Gradle Develocity Maven Extension...

v4.0.5

2025-05-22

Library updates

• [fix][sec] Upgrade Jetty to 9.4.57.v20241219 to mitigate CVE-2024-6763 (#24232)
• [improve] Upgrade Netty to 4.1.121.Final (#24214)
• [improve] Upgrade Apache Commons library versions to compatible versions (#24205)
• [improve] Upgrade pulsar-client-python to 3.7.0 in Docker image (#24302)
• [improve][build] Upgrade commons-compress version from 1.27.0 to 1.27.1 (#24270)
• [improve][build] Upgrade Lombok to 1.18.38 to support JDK 24 (#24237)

Broker

• [fix][broker] Consumer stuck when delete subscription __compaction failed (#23980)
• [fix][broker] Fix broker shutdown delay by resolving hanging health checks (#24210)
• [fix][broker] Fix ByteBuf memory leak in REST API for publishing messages (#24228)
• [fix][broker] Fix cluster level OffloadedReadPriority to bookkeeper-first does not work (#24151)
• [fix][broker] Fix compaction service log's wrong condition (#24207)
• [fix][broker] fix ExtensibleLoadManager to override the ownerships concurrently without blocking load manager thread (#24156)
• [fix][broker] Fix HashedWheelTimer leak in PulsarService by stopping it in shutdown (#24275)
• [fix][broker] Fix HealthChecker deadlock in shutdown (#24216)
• [fix][broker] Fix NPE from the wrong iterator in the ownership cleanup job(ExtensibleLoadManagerImpl only) (#24196)
• [fix][broker] Fix potential deadlock when creating partitioned topic (#24313)
• [fix][broker] Fix some problems in calculate totalAvailableBookies in method getExcludedBookiesWithIsolationGroups when some bookies belongs to multiple isolation groups. (#24091)
• [fix][broker] Fix tenant creation and update with null value (#24209)
• [fix][broker] fix wrong method name checkTopicExists. (#24293)
• [fix][broker] Fixes Inconsistent ServiceUnitStateData View (ExtensibleLoadManagerImpl only) (#24186)
• [fix][broker] Orphan schema after disabled a cluster for a namespace (#24223)
• [fix][broker] The feature brokerDeleteInactivePartitionedTopicMetadataEnabled leaves orphan topic policies and topic schemas (#24150)
• [fix][broker] Unregister non-static metrics collectors registered in Prometheus default registry (#24257)
• [fix][broker]Fix incorrect priority between topic policies and global topic policies (#24254)
• [fix][broker]fix memory leak, messages lost, incorrect replication state if using multiple schema versions(auto_produce) (#24178)
• [fix][admin] Backlog quota's policy is null which causes a NPE (#24192)
• [fix][ml] Fix ML thread blocking issue in internalGetPartitionedStats API (#24167)
• [fix][ml] Skip deleting cursor if it was already deleted before calling unsubscribe (#24098)

Client

• [fix][client] Fix incorrect producer.getPendingQueueSize due to incomplete queue implementation (#24184)
• [fix][client] Fix producer publishing getting stuck after message with incompatible schema is discarded (#24282)
• [improve][client] validate ClientConfigurationData earlier to avoid resource leaks (#24187)
• [improve][client]Improve transaction log when a TXN command timeout (#24230)

Pulsar IO and Pulsar Functions

• [fix][io] Fix SyntaxWarning in Pulsar Python functions (#24297)
• [improve][io] Add configuration parameter for disabling aggregation for Kinesis Producers (#24289)
• [improve][io] support kafka connect transforms and predicates (#24221)
• [improve][io] Upgrade Kafka client and compatible Confluent platform version (#24201)
• [improve][io][kca] support fully-qualified topic names in source records (#24248)

Others

• [cleanup] Remove unused config autoShrinkForConsumerPendingAcksMap (#24315)
• [cleanup] remove unused config messagePublishBufferCheckIntervalInMillis (#24252)
• [cleanup] Remove unused static fields in BrokerService (#24251)
• [cleanup][misc] Add override annotation (#24033)
• [cleanup][test] Remove unused parameter from deleteNamespaceWithRetry method in MockedPulsarServiceBaseTest (#24283)
• [fix] chore: remove unused preciseTopicPublishRateLimiterEnable (#24249)
• [fix][misc] Fix ByteBuf leak in SchemaUtils (#24274)
• [fix][misc] Fix ByteBuf leaks in tests by making ByteBufPair.coalesce release the input ByteBufPair (#24273)
• [fix][misc]: ignore deleted ledger when tear down cluster (#23831)
• [fix][proxy] Fix incorrect client error when calling get topic metadata (#24181)
• [fix][proxy] Propagate client connection feature flags through Pulsar Proxy to Broker (#24158)
• [fix][schema] Reject unsupported Avro schema types during schema registration (#24103)
• [improve][cli] Make pulsar-perf termination more responsive by using Thread interrupt status (#24309)
• [improve][misc] Migrate from multiple nullness annotation libraries to JSpecify annotations (#24239)

Tests & CI

• [fix][build] Ensure that buildtools is Java 8 compatible and fix remaining compatibility issue (#24307)
• [fix][build] Fix docker image building by replacing deprecated and removed compress argument (#24155)
• [fix][build] Fix errorprone maven profile configuration (#24246)
• [fix][build] Fix skipTag and use explicit tag for image name (#24168)
• [improve] Adapt startup scripts for Java 24 changes (#24236)
• [improve][broker]Improve the feature "Optimize subscription seek (cursor reset) by timestamp": search less entries (#24219)
• [improve][build] Allow building and running tests on JDK 24 and upcoming JDK 25 LTS (#24268)
• [improve][build] Build apachepulsar/pulsar-io-kinesis-sink-kinesis_producer with Alpine 3.21 (#24180)
• [improve][build] Improve thread leak detector by ignoring "Attach Listener" thread (#24277)
• [improve][build] Suppress JVM class sharing warning when running tests (#24278)
• [improve][build] Upgrade errorprone to 2.38.0 (#24242)
• [improve][build] Upgrade Gradle Develocity Maven Extension dependencies (#24260)
• [improve][build] Upgrade Mockito to 5.17.0 and byte-buddy to 1.15.11 (#24241)
• [improve][build] Upgrade SpotBugs to 4.9.x (#24243)
• [improve][build] Upgrade to jacoco 0.8.13 (#24240)
• [improve][build] Upgrade zstd version from 1.5.2-3 to 1.5.7-3 (#24263)
• [improve][ci] Add Netty leak detection reporting to Pulsar CI (#24272)
• [improve][ci] Disable detailed console logging for integration tests in CI (#24266)
• [improve][test] Use configured session timeout for MockZooKeeper and TestZKServer in PulsarTestContext (#24171)
• [fix][test] Fix flaky BatchMessageWithBatchIndexLevelTest.testBatchMessageAck (#24212)
• [fix][test] Fix flaky BrokerServiceChaosTest (#24162)
• [fix][test] Fix flaky BrokerServiceChaosTest.testFetchPartitionedTopicMetadataW...

v3.0.12

2025-05-22

Library updates

• [fix][sec] Upgrade Jetty to 9.4.57.v20241219 to mitigate CVE-2024-6763 (#24232)
• [improve] Upgrade Netty to 4.1.121.Final (#24214)
• [improve] Upgrade pulsar-client-python to 3.7.0 in Docker image (#24302)
• [improve][build] Upgrade Lombok to 1.18.38 to support JDK 24 (#24237)

Broker

• [fix][broker] Consumer stuck when delete subscription __compaction failed (#23980)
• [fix][broker] Fix broker shutdown delay by resolving hanging health checks (#24210)
• [fix][broker] Fix ByteBuf memory leak in REST API for publishing messages (#24228)
• [fix][broker] Fix compaction service log's wrong condition (#24207)
• [fix][broker] Fix HashedWheelTimer leak in PulsarService by stopping it in shutdown (#24275)
• [fix][broker] Fix HealthChecker deadlock in shutdown (#24216)
• [fix][broker] Fix missing validation when setting retention policy on topic level (#24032)
• [fix][broker] Fix potential deadlock when creating partitioned topic (#24313)
• [fix][broker] Fix seeking by timestamp can be reset the cursor position to earliest (#23919)
• [fix][broker] Fix some problems in calculate totalAvailableBookies in method getExcludedBookiesWithIsolationGroups when some bookies belongs to multiple isolation groups. (#24091)
• [fix][broker] Fix tenant creation and update with null value (#24209)
• [fix][broker] fix wrong method name checkTopicExists. (#24293)
• [fix][broker] Orphan schema after disabled a cluster for a namespace (#24223)
• [fix][broker] The feature brokerDeleteInactivePartitionedTopicMetadataEnabled leaves orphan topic policies and topic schemas (#24150)
• [fix][broker] Unregister non-static metrics collectors registered in Prometheus default registry (#24257)
• [fix][broker]Fix incorrect priority between topic policies and global topic policies (#24254)
• [fix][broker]fix memory leak, messages lost, incorrect replication state if using multiple schema versions(auto_produce) (#24178)
• [fix][admin] Backlog quota's policy is null which causes a NPE (#24192)
• [fix][bk] Fix the var name for IsolationGroups (#21320)
• [fix][ml] Fix ML thread blocking issue in internalGetPartitionedStats API (#24167)
• [fix][ml] Skip deleting cursor if it was already deleted before calling unsubscribe (#24098)
• [improve][broker] Optimize subscription seek (cursor reset) by timestamp (#22792)
• [improve][broker]Improve the feature "Optimize subscription seek (cursor reset) by timestamp": search less entries (#24219)

Client

• [fix][client] Fix incorrect producer.getPendingQueueSize due to incomplete queue implementation (#24184)
• [fix][client] Fix producer publishing getting stuck after message with incompatible schema is discarded (#24282)
• [improve][client] validate ClientConfigurationData earlier to avoid resource leaks (#24187)
• [improve][client]Improve transaction log when a TXN command timeout (#24230)

Pulsar IO and Pulsar Functions

• [fix][io] Fix SyntaxWarning in Pulsar Python functions (#24297)
• [improve][io] Add configuration parameter for disabling aggregation for Kinesis Producers (#24289)
• [improve][io] support kafka connect transforms and predicates (#24221)
• [improve][io] Upgrade Kafka client and compatible Confluent platform version (#24201)
• [improve][io][kca] support fully-qualified topic names in source records (#24248)

Others

• [cleanup][misc] Add override annotation (#24033)
• [fix][misc] Fix ByteBuf leak in SchemaUtils (#24274)
• [fix][proxy] Fix incorrect client error when calling get topic metadata (#24181)
• [fix][proxy] Propagate client connection feature flags through Pulsar Proxy to Broker (#24158)
• [fix][schema] Reject unsupported Avro schema types during schema registration (#24103)

Tests & CI

• [fix][build] Ensure that buildtools is Java 8 compatible and fix remaining compatibility issue (#24307)
• [fix][test] Fix flaky BatchMessageWithBatchIndexLevelTest.testBatchMessageAck (#24212)
• [fix][test] Fix flaky BrokerServiceChaosTest (#24162)
• [fix][test] Fix flaky BrokerServiceChaosTest.testFetchPartitionedTopicMetadataWithCacheRefresh (#24161)
• [fix][test] Fix flaky ManagedCursorTest.testLastActiveAfterResetCursor and disable failing SchemaTest (#24261)
• [fix][test] Fix flaky ManagedCursorTest.testSkipEntriesWithIndividualDeletedMessages (#24244)
• [fix][test] Fix invalid test CompactionTest.testDeleteCompactedLedgerWithSlowAck (#24166)
• [fix][test] Fix more Netty ByteBuf leaks in tests (#24299)
• [fix][test] Fix multiple ByteBuf leaks in tests (#24281)
• [fix][test] Fix multiple resource leaks in tests (#24218)
• [fix][test] Fix resource leaks in ProxyTest and fix invalid tests (#24204)
• [fix][test] Fix TestNG BetweenTestClassesListenerAdapter listener (#24258)
• [fix][test] Improve reliability of IncrementPartitionsTest (#24172)
• [fix][test] Simplify BetweenTestClassesListenerAdapter and fix issue with BeforeTest/AfterTest annotations (#24304)
• [fix][test] Update partitioned topic subscription assertions in IncrementPartitionsTest (#24056)
• [fix][test]flaky-test:ManagedLedgerInterceptorImplTest.testManagedLedgerPayloadInputProcessorFailure (#24170)
• [improve][test] Use configured session timeout for MockZooKeeper and TestZKServer in PulsarTestContext (#24171)
• [improve][build] Upgrade Gradle Develocity Maven Extension dependencies (#24260)
• [improve][ci] Disable detailed console logging for integration tests in CI (#24266)
• [improve][build] Upgrade SpotBugs to 4.9.x (#24243)
• [improve][build] Upgrade to jacoco 0.8.13 (#24240)
• [improve][build] Upgrade zstd version from 1.5.2-3 to 1.5.7-3 (#24263)
• [cleanup][test] Remove unused parameter from deleteNamespaceWithRetry method in MockedPulsarServiceBaseTest (#24283)

For the complete list, check the full changelog.

v4.0.4

2025-04-09

Library updates

• [fix][sec] Upgrade jwt/v5 to 5.2.2 to address CVE-2025-30204 (#24140)
• [fix][sec] Upgrade pulsar-function-go dependencies to address CVE-2025-22870 (#24135)
• [improve] Upgrade Netty to 4.1.119.Final (#24049)

Broker

• [fix] Avoid negative estimated entry count (#24055)
• [fix][broker] Add expire check for replicator (#23975)
• [fix][broker] Avoid IllegalStateException when marker_type field is not set in publishing (#24087)
• [fix][broker] fix delay queue sequence issue. (#24035)
• [fix][broker] Fix Metadata Event Synchronizer producer creation retry so that the producer gets created eventually (#24081)
• [fix][broker] Fix Metadata event synchronizer should not fail with bad version (#24080)
• [fix][broker] Fix missing validation when setting retention policy on topic level (#24032)
• [fix][broker] Fix NPE while publishing Metadata-Event with not init producer (#24079)
• [fix][broker] Fix UnsupportedOperationException while setting subscription level dispatch rate policy (#24048)
• [fix][broker] http metric endpoint get compaction latency stats always be 0 (#24067)
• [fix][broker] Pattern subscription doesn't work when the pattern excludes the topic domain. (#24072)
• [fix][broker] Restore the behavior to dispatch batch messages according to consumer permits (#24092)
• [fix][broker] topics infinitely failed to delete after remove cluster from replicated clusters modifying when using partitioned system topic (#24097)
• [fix][broker]Fix failed consumption after loaded up a terminated topic (#24063)
• [fix][ml] Corrected pulsar_storage_size metric to not multiply offloaded storage by the write quorum (#24054)
• [fix][ml] Don't estimate number of entries when ledgers are empty, return 1 instead (#24125)
• [fix][ml] Fix issues in estimateEntryCountBySize (#24089)
• [fix][ml] Return 1 when bytes size is 0 or negative for entry count estimation (#24131)
• [improve][broker] Change topic exists log to warn (#24116)
• [improve][broker] extract getMaxEntriesInThisBatch into a method and add unit test for it (#24117)
• [improve][broker] Optimize message expiration rate repeated update issues (#24073)
• [improve][broker] Optimize ThresholdShedder with improved boundary checks and parameter reuse (#24064)
• [improve][broker][branch-4.0] PIP-406: Introduce metrics related to dispatch throttled events (#24111)
• [improve][meta] Change log level from error to warn for unknown notification types in OxiaMetadataStore (#24126)

Client

• [fix][client] Copy eventTime to retry letter topic and DLQ messages (#24059)
• [fix][client] Fix building broken batched message when publishing (#24061)
• [fix][client] Fix consumer leak when thread is interrupted before subscribe completes (#24100)
• [fix][client] Pattern subscription regression when broker-side evaluation is disabled (#24104)
• [fix][client] PIP-409 retry/dead letter topic producer config don't take effect. (#24071)
• [improve][client] PIP-409: support producer configuration for retry/dead letter topic producer (#24020)
• [improve][client] Prevent NullPointException when closing ClientCredentialsFlow (#24123)
• [clean][client] Clean code for the construction of retry/dead letter topic name (#24082)

Pulsar IO and Pulsar Functions

• [fix][io] Fix KinesisSink json flattening for AVRO's SchemaType.BYTES (#24132)
• [improve][fn] Introduce NewOutputMessageWithError to enable error handling (#24122)
• [improve][io] Enhance Kafka connector logging with focused bootstrap server information (#24128)
• [improve][io] Remove sleep when sourceTask.poll of kafka return null (#24124)

Others

• [fix][doc] fix doc related to chunk message feature. (#24023)
• [fix][doc] Workaround Go Yaml issue go-yaml/yaml#789 in docker-compose example (#24040)
• [improve][monitor] Add version=0.0.4 to /metrics content type for Prometheus 3.x compatibility (#24060)

Tests & CI

• [fix][ci] Bump dependency-check to 12.1.0 to fix OWASP Dependency Check job (#24083)
• [fix][test] Fix flaky NonPersistentTopicTest.testMsgDropStat (#24134)
• [fix][test] Fix flaky PrometheusMetricsTest.testBrokerMetrics (#24042)

For the complete list, check the full changelog.

v3.3.6

2025-04-09

Library updates

• [fix] Bump google.golang.org/protobuf from 1.32.0 to 1.33.0 in /pulsar-function-go (#22261)
• [fix][sec] Upgrade jwt/v5 to 5.2.2 to address CVE-2025-30204 (#24140)
• [fix][sec] Upgrade pulsar-function-go dependencies to address CVE-2025-22870 (#24135)
• [improve] Upgrade Netty to 4.1.119.Final (#24049)

Broker

• [fix] Avoid negative estimated entry count (#24055)
• [fix][broker] Add expire check for replicator (#23975)
• [fix][broker] Avoid IllegalStateException when marker_type field is not set in publishing (#24087)
• [fix][broker] Fix Metadata Event Synchronizer producer creation retry so that the producer gets created eventually (#24081)
• [fix][broker] Fix Metadata event synchronizer should not fail with bad version (#24080)
• [fix][broker] Fix missing validation when setting retention policy on topic level (#24032)
• [fix][broker] Fix NPE while publishing Metadata-Event with not init producer (#24079)
• [fix][broker] Pattern subscription doesn't work when the pattern excludes the topic domain. (#24072)
• [fix][broker] topics infinitely failed to delete after remove cluster from replicated clusters modifying when using partitioned system topic (#24097)
• [fix][broker]Fix failed consumption after loaded up a terminated topic (#24063)
• [fix][ml] Corrected pulsar_storage_size metric to not multiply offloaded storage by the write quorum (#24054)
• [fix][ml] Don't estimate number of entries when ledgers are empty, return 1 instead (#24125)
• [fix][ml] Fix issues in estimateEntryCountBySize (#24089)
• [fix][ml] Return 1 when bytes size is 0 or negative for entry count estimation (#24131)
• [improve][broker] Change topic exists log to warn (#24116)
• [improve][broker] Optimize message expiration rate repeated update issues (#24073)
• [improve][broker] Optimize ThresholdShedder with improved boundary checks and parameter reuse (#24064)
• [improve][broker] Separate offload read and write thread pool (#24025)
• [improve][meta] Change log level from error to warn for unknown notification types in OxiaMetadataStore (#24126)

Client

• [fix][client] Copy eventTime to retry letter topic and DLQ messages (#24059)
• [fix][client] Fix building broken batched message when publishing (#24061)
• [fix][client] Fix consumer leak when thread is interrupted before subscribe completes (#24100)
• [fix][client] Pattern subscription regression when broker-side evaluation is disabled (#24104)
• [improve][client] Prevent NullPointException when closing ClientCredentialsFlow (#24123)
• [clean][client] Clean code for the construction of retry/dead letter topic name (#24082)

Pulsar IO and Pulsar Functions

• [fix][io] Fix KinesisSink json flattening for AVRO's SchemaType.BYTES (#24132)
• [improve][io] Enhance Kafka connector logging with focused bootstrap server information (#24128)
• [improve][io] Remove sleep when sourceTask.poll of kafka return null (#24124)

Others

• [fix][doc] fix doc related to chunk message feature. (#24023)
• [improve][monitor] Add version=0.0.4 to /metrics content type for Prometheus 3.x compatibility (#24060)

Tests & CI

• [fix][ci] Bump dependency-check to 12.1.0 to fix OWASP Dependency Check job (#24083)
• [fix][test] Fix flaky NonPersistentTopicTest.testMsgDropStat (#24134)
• [fix][test] Fix flaky PrometheusMetricsTest.testBrokerMetrics (#24042)

For the complete list, check the full changelog.

v3.0.11

2025-04-09

Library updates

• [fix] Bump google.golang.org/protobuf from 1.32.0 to 1.33.0 in /pulsar-function-go (#22261)
• [fix][sec] Upgrade jwt/v5 to 5.2.2 to address CVE-2025-30204 (#24140)
• [fix][sec] Upgrade pulsar-function-go dependencies to address CVE-2025-22870 (#24135)
• [improve] Upgrade Netty to 4.1.119.Final (#24049)

Broker

• [fix] Avoid negative estimated entry count (#24055)
• [fix][admin] Verify is policies read only before revoke permissions on topic (#23730)
• [fix][broker] Add expire check for replicator (#23975)
• [fix][broker] Avoid IllegalStateException when marker_type field is not set in publishing (#24087)
• [fix][broker] fix broker identifying incorrect stuck topic (#24006)
• [fix][broker] Fix BucketDelayedDeliveryTracker thread safety (#24014)
• [fix][broker] Fix get outdated compactedTopicContext after compactionHorizon has been updated (#20984)
• [fix][broker] Fix Metadata Event Synchronizer producer creation retry so that the producer gets created eventually (#24081)
• [fix][broker] Fix Metadata event synchronizer should not fail with bad version (#24080)
• [fix][broker] Fix NPE while publishing Metadata-Event with not init producer (#24079)
• [fix][broker] Fix UnsupportedOperationException while setting subscription level dispatch rate policy (#24048)
• [fix][broker] Geo Replication lost messages or frequently fails due to Deduplication is not appropriate for Geo-Replication (#23697)
• [fix][broker] http metric endpoint get compaction latency stats always be 0 (#24067)
• [fix][broker] Pattern subscription doesn't work when the pattern excludes the topic domain. (#24072)
• [fix][broker] topics infinitely failed to delete after remove cluster from replicated clusters modifying when using partitioned system topic (#24097)
• [fix][broker]Fix failed consumption after loaded up a terminated topic (#24063)
• [fix][ml] Corrected pulsar_storage_size metric to not multiply offloaded storage by the write quorum (#24054)
• [fix][ml] Don't estimate number of entries when ledgers are empty, return 1 instead (#24125)
• [fix][ml] Fix issues in estimateEntryCountBySize (#24089)
• [fix][ml] Return 1 when bytes size is 0 or negative for entry count estimation (#24131)
• [improve][broker] Change topic exists log to warn (#24116)
• [improve][broker] Fix non-persistent system topic schema compatibility (#23286)
• [improve][broker] Improve CompactedTopicImpl lock (#20697)
• [improve][broker] Make the estimated entry size more accurate (#23931)
• [improve][broker] Optimize message expiration rate repeated update issues (#24073)
• [improve][broker] Optimize ThresholdShedder with improved boundary checks and parameter reuse (#24064)
• [improve][ml] Use lock-free queue in InflightReadsLimiter since there's no concurrent access (#23962)

Client

• [fix][client] Copy eventTime to retry letter topic and DLQ messages (#24059)
• [fix][client] Fix building broken batched message when publishing (#24061)
• [fix][client] Fix consumer leak when thread is interrupted before subscribe completes (#24100)
• [fix][client] Pattern subscription regression when broker-side evaluation is disabled (#24104)
• [improve][client] Prevent NullPointException when closing ClientCredentialsFlow (#24123)
• [clean][client] Clean code for the construction of retry/dead letter topic name (#24082)

Pulsar IO and Pulsar Functions

• [fix][io] Fix KinesisSink json flattening for AVRO's SchemaType.BYTES (#24132)
• [improve][fn] Set default tenant and namespace for ListFunctions cmd (#23881)
• [improve][io] Enhance Kafka connector logging with focused bootstrap server information (#24128)
• [improve][io] Remove sleep when sourceTask.poll of kafka return null (#24124)

Others

• [fix][doc] fix doc related to chunk message feature. (#24023)
• [improve][cli] Support additional msg metadata for V1 topic on peek message cmd (#23978)
• [improve][monitor] Add version=0.0.4 to /metrics content type for Prometheus 3.x compatibility (#24060)

Tests & CI

• [fix][test] Fix flaky test OneWayReplicatorUsingGlobalZKTest.testConfigReplicationStartAt (#24011)
• [fix][test]Fix flaky test V1_ProducerConsumerTest.testConcurrentConsumerReceiveWhileReconnect (#24019)
• [fix][ci] Bump dependency-check to 12.1.0 to fix OWASP Dependency Check job (#24083)
• [improve][test] Upgrade Testcontainers to 1.20.4 and docker-java to 3.4.0 (#24003)
• [improve][ci] Upgrade Gradle Develocity Maven Extension to 1.23.1 (#24004)

For the complete list, check the full changelog.

v4.0.3

2025-02-27

Known issues

There's a potential regression where consuming messages could fail due to #23931 changes. This is being addressed in #24055 and #24089. No workarounds currently exist.

Library updates

• [feat][misc] upgrade oxia java client to 0.5.0 (#23871)
• [fix] Bump org.apache.solr:solr-core from 8.11.3 to 9.8.0 in /pulsar-io/solr (#23899)
• [fix] Use Alpine 3.21 in base image (#23964)
• [fix][build] Upgrade json-smart to 2.5.2 (#23966)
• [improve] Upgrade to Netty 4.1.117.Final (#23863)
• [fix][sec] Upgrade to Netty 4.1.118 to address CVE-2025-24970 (#23965)

Broker

• [fix][broker] Fix bug in RangeCache where different instance of the key wouldn't ever match (#23903)
• [fix][broker] Apply dispatcherMaxReadSizeBytes also for replay reads for Shared and Key_Shared subscriptions (#23894)
• [fix][broker] Closed topics won't be removed from the cache (#23884)
• [fix][broker] Fix BucketDelayedDeliveryTracker thread safety (#24014)
• [fix][broker] Fix NPE during active consumer is disconnected (#24008)
• [fix][broker] Fix incorrect blockedConsumerOnUnackedMsgs value when maxUnackedMessagesPerConsumer is 1 (#23796)
• [fix][broker] Fix rate limiter token bucket and clock consistency issues causing excessive throttling and connection timeouts (#23930)
• [fix][broker] Fix repeatedly acquired pending reads quota (#23869)
• [fix][broker] Fix seeking by timestamp can be reset the cursor position to earliest (#23919)
• [fix][broker] Geo Replication lost messages or frequently fails due to Deduplication is not appropriate for Geo-Replication (#23697)
• [fix][broker] Make InflightReadsLimiter asynchronous and apply it for replay queue reads (#23901)
• [fix][broker] PIP-322 Fix issue with rate limiters where rates can exceed limits initially and consumption pauses until token balance is positive (#24012)
• [fix][broker] PIP-379 Key_Shared implementation race condition causing out-of-order message delivery (#23874)
• [fix][broker] Skip to persist cursor info if it failed by cursor closed (#23615)
• [fix][broker] fix broker identifying incorrect stuck topic (#24006)
• [fix][broker] fix broker may lost rack information (#23331)
• [fix][meta] Fix ephemeral Zookeeper put which creates a persistent znode (#23984)
• [fix][meta] Fix ephemeral handling of ZK nodes and fix MockZooKeeper ephemeral and ZK stat handling (#23988)
• [fix][ml] Fix cursor metadata compatability issue when switching the config unackedRangesOpenCacheSetEnabled (#23759)
• [fix][ml] Fix deadlock in PendingReadsManager (#23958)
• [fix][ml] Fix memory leak due to duplicated RangeCache value retain operations (#23955)
• [fix][ml] Fix memory leaks in ManagedCursorInfo and ManagedLedgerInfo decompression and compression (#23960)
• [fix][ml] incorrect non-durable cursor's backlog due to concurrently trimming ledger and non-durable cursor creation (#23951)
• [improve][broker] Avoid PersistentReplicator.expireMessages logic compute backlog twice (#23957)
• [improve][broker] Avoid logging errors when there is a connection issue during subscription. (#23939)
• [improve][broker] Avoid printing log for IncompatibleSchemaException in ServerCnx (#23938)
• [improve][broker] Do not print error logs for NotFound or Conflict errors when using the Admin API (#23928)
• [improve][broker] Don't print error logs for ProducerBusyException (#23929)
• [improve][broker] Fix non-persistent system topic schema compatibility (#23286)
• [improve][broker] Improve Consumer.equals performance (#23864)
• [improve][broker] Make the estimated entry size more accurate (#23931)
• [improve][broker] Refactor a private method to eliminate an unnecessary parameter (#23915)
• [improve][broker] Remove spamming logs for customized managed ledger (#23862)
• [improve][broker] Support values up to 2^32 in ConcurrentBitmapSortedLongPairSet (#23878)
• [improve][meta] Simplify getting parent path in ZKMetadataStore without using java.io.File (#23996)
• [improve][ml] Use lock-free queue in InflightReadsLimiter since there's no concurrent access (#23962)

Client

• [feat][client] Support forward proxy for the ZTS server in pulsar-client-auth-athenz (#23947)
• [fix] Avoid NPE when closing an uninitialized SameAuthParamsLookupAutoClusterFailover (#23911)
• [fix] Initialize UrlServiceProvider before trying to use transaction coordinator (#23914)
• [fix][client] Fix LoadManagerReport not found (#23886)
• [fix][client] Fix memory leak in ClientCnx.newLookup when there's TooManyRequestsException (#23971)
• [fix][client] Fix memory leak when message size exceeds max message size and batching is enabled (#23967)
• [fix][client] call redeliver 1 msg but did 2 msgs (#23943)
• [fix][client] fix retry topic with exclusive mode. (#23859)
• [improve][client] Avoid logging errors for retriable errors when creating producer (#23935)
• [improve][client] Update TypedMessageBuilder deliverAfter and deliverAt api comment (#23969)
• [improve][cli] Support additional msg metadata for V1 topic on peek message cmd (#23978)

Pulsar IO and Pulsar Functions

• [fix][io] Fix pulsar-io:pom not found (#23979)
• [improve][fn] Set default tenant and namespace for ListFunctions cmd (#23881)
• [improve][io] Allow skipping connector deployment (#23932)

Others

• [fix] fix for code scanning alert no. 48: Uncontrolled data used in path expression (#23985)
• [fix][build] Use amazoncorretto:21-alpine3.20 JDK build for Alpine 3.20 (#23898)
• [fix][build] Add develops for buildtools (#23992)
• [improve][proxy] Make keep-alive interval configurable in Pulsar Proxy (#23981)

Tests & CI

• [fix][test] Fix flaky DelayedDeliveryTest.testEnableTopicDelayedDelivery (#23893)
• [fix][test] Fix flaky test MetadataStoreTest.emptyStoreTest (#23998)
• [fix][test] Fix flaky test OneWayReplicatorUsingGlobalZKTest.testConfigReplicationStartAt (#24011)
• [fix][test] Fix quiet time implementation in BrokerTestUtil.receiveMessages (#23876)
• [fix][test] fix flaky testNegativeAcksWithBackoff when batch enabled. (#23986)
• [fix][test]Fix flaky test V1_ProducerConsumerTest.testConcurrentConsumerReceiveWhileReconnect (#24019)
• [improve][test] Add solution to PulsarMockBookKeeper for intercepting reads (#23875)
• [improve][test] Support decorating topic, subscription, dispatcher, ManagedLedger and ManagedCursors instances in tests (#23892)
• [improve][test] Upgrade Testcontainers to 1.20.4 and docker-java to 3.4.0 (#24003)
• [fix][ci] Configure Docker data-root to /mnt/doc...

v3.3.5

2025-02-27

Known issues

There's a potential regression where consuming messages could fail due to #23931 changes. This is being addressed in #24055 and #24089. No workarounds currently exist.

Library updates

• [feat][misc] upgrade oxia java client to 0.5.0 (#23871)
• [fix] Use Alpine 3.21 in base image (#23964)
• [fix][build] Upgrade json-smart to 2.5.2 (#23966)
• [improve] Upgrade to Netty 4.1.117.Final (#23863)
• [fix][sec] Upgrade to Netty 4.1.118 to address CVE-2025-24970 (#23965)

Broker

• [fix][broker] Fix bug in RangeCache where different instance of the key wouldn't ever match (#23903)
• [fix][broker] Closed topics won't be removed from the cache (#23884)
• [fix][broker] Continue using the next provider for http authentication if one fails (#23842)
• [fix][broker] Fix BucketDelayedDeliveryTracker thread safety (#24014)
• [fix][broker] Fix NPE during active consumer is disconnected (#24008)
• [fix][broker] Fix acknowledgeCumulativeAsync block when ackReceipt is enabled (#23841)
• [fix][broker] Fix incorrect blockedConsumerOnUnackedMsgs value when maxUnackedMessagesPerConsumer is 1 (#23796)
• [fix][broker] Fix possible mark delete NPE when batch index ack is enabled (#23833)
• [fix][broker] Fix rate limiter token bucket and clock consistency issues causing excessive throttling and connection timeouts (#23930)
• [fix][broker] Fix repeatedly acquired pending reads quota (#23869)
• [fix][broker] Fix the retry mechanism in MetadataCache#readModifyUpdateOrCreate (#23686)
• [fix][broker] Geo Replication lost messages or frequently fails due to Deduplication is not appropriate for Geo-Replication (#23697)
• [fix][broker] Make InflightReadsLimiter asynchronous and apply it for replay queue reads (#23901)
• [fix][broker] PIP-322 Fix issue with rate limiters where rates can exceed limits initially and consumption pauses until token balance is positive (#24012)
• [fix][broker] PIP-399: Fix Metric Name for Delayed Queue (#23712)
• [fix][broker] Remove blocking calls from internalGetPartitionedStats (#23832)
• [fix][broker] Revert "[fix][broker] Cancel possible pending replay read in cancelPendingRead (#23384)" (#23855)
• [fix][broker] Support large number of unack message store for cursor recovery (#9292)
• [fix][broker] fix broker identifying incorrect stuck topic (#24006)
• [fix][broker] fix broker may lost rack information (#23331)
• [fix][meta] Fix ephemeral Zookeeper put which creates a persistent znode (#23984)
• [fix][meta] Fix ephemeral handling of ZK nodes and fix MockZooKeeper ephemeral and ZK stat handling (#23988)
• [fix][ml] Fix cursor metadata compatability issue when switching the config unackedRangesOpenCacheSetEnabled (#23759)
• [fix][ml] Fix deadlock in PendingReadsManager (#23958)
• [fix][ml] Fix memory leak due to duplicated RangeCache value retain operations (#23955)
• [fix][ml] Fix memory leaks in ManagedCursorInfo and ManagedLedgerInfo decompression and compression (#23960)
• [fix][ml] incorrect non-durable cursor's backlog due to concurrently trimming ledger and non-durable cursor creation (#23951)
• [improve][broker] Avoid PersistentReplicator.expireMessages logic compute backlog twice (#23957)
• [improve][broker] Avoid logging errors when there is a connection issue during subscription. (#23939)
• [improve][broker] Avoid printing log for IncompatibleSchemaException in ServerCnx (#23938)
• [improve][broker] Do not print error logs for NotFound or Conflict errors when using the Admin API (#23928)
• [improve][broker] Don't print error logs for ProducerBusyException (#23929)
• [improve][broker] Fix non-persistent system topic schema compatibility (#23286)
• [improve][broker] Improve Consumer.equals performance (#23864)
• [improve][broker] Make the estimated entry size more accurate (#23931)
• [improve][broker] Reduce unnecessary REPLICATED_SUBSCRIPTION_SNAPSHOT_REQUEST (#23839)
• [improve][broker] Remove spamming logs for customized managed ledger (#23862)
• [improve][broker] Support values up to 2^32 in ConcurrentBitmapSortedLongPairSet (#23878)
• [improve][meta] Simplify getting parent path in ZKMetadataStore without using java.io.File (#23996)
• [improve][ml] Use lock-free queue in InflightReadsLimiter since there's no concurrent access (#23962)

Client

• [fix] Avoid NPE when closing an uninitialized SameAuthParamsLookupAutoClusterFailover (#23911)
• [fix] Initialize UrlServiceProvider before trying to use transaction coordinator (#23914)
• [fix][client] Fix LoadManagerReport not found (#23886)
• [fix][client] Fix memory leak in ClientCnx.newLookup when there's TooManyRequestsException (#23971)
• [fix][client] Fix memory leak when message size exceeds max message size and batching is enabled (#23967)
• [fix][client] Orphan producer when concurrently calling producer closing and reconnection (#23853)
• [fix][client] call redeliver 1 msg but did 2 msgs (#23943)
• [fix][client] fix retry topic with exclusive mode. (#23859)
• [improve][client] Avoid logging errors for retriable errors when creating producer (#23935)
• [improve][cli] Support additional msg metadata for V1 topic on peek message cmd (#23978)

Pulsar IO and Pulsar Functions

• [fix][io] Fix pulsar-io:pom not found (#23979)
• [improve] Validate user paths in Functions utils (#22833)
• [improve][fn] Set default tenant and namespace for ListFunctions cmd (#23881)
• [improve][io] Allow skipping connector deployment (#23932)

Others

• [fix] fix for code scanning alert no. 48: Uncontrolled data used in path expression (#23985)
• [fix][build] Use amazoncorretto:21-alpine3.20 JDK build for Alpine 3.20 (#23898)
• [fix][build] Add develops for buildtools (#23992)
• [fix][misc] Honor dynamic log levels in log4j2.yaml (#23847)
• [improve][proxy] Make keep-alive interval configurable in Pulsar Proxy (#23981)

Tests & CI

• [improve][test] Add solution to PulsarMockBookKeeper for intercepting reads (#23875)
• [improve][test] Upgrade Testcontainers to 1.20.4 and docker-java to 3.4.0 (#24003)
• [fix][test] Add reconsumeLater call in RetryTopicTest#testRetryTopicWithMultiTopic. (#23857)
• [fix][test] Fix flaky DelayedDeliveryTest.testEnableTopicDelayedDelivery (#23893)
• [fix][test] Fix flaky test MetadataStoreTest.emptyStoreTest (#23998)
• [fix][test] Fix flaky test OneWayReplicatorUsingGlobalZKTest.testConfigReplicationStartAt (#24011)
• [fix][test] Fix qui...

v3.0.10

2025-02-27

Library updates

• [improve] Upgrade to Netty 4.1.117.Final (#23863)
• [fix][sec] Upgrade to Netty 4.1.118 to address CVE-2025-24970 (#23965)
• [fix] Bump org.apache.solr:solr-core from 8.11.3 to 9.8.0 in /pulsar-io/solr (#23899)
• [fix][build] Upgrade json-smart to 2.5.2 (#23966)

Broker

• [fix][broker] Fix bug in RangeCache where different instance of the key wouldn't ever match (#23903)
• [fix][broker] Closed topics won't be removed from the cache (#23884)
• [fix][broker] Continue using the next provider for http authentication if one fails (#23842)
• [fix][broker] Fix acknowledgeCumulativeAsync block when ackReceipt is enabled (#23841)
• [fix][broker] Fix incorrect blockedConsumerOnUnackedMsgs value when maxUnackedMessagesPerConsumer is 1 (#23796)
• [fix][broker] Fix possible mark delete NPE when batch index ack is enabled (#23833)
• [fix][broker] Fix repeatedly acquired pending reads quota (#23869)
• [fix][broker] Fix the retry mechanism in MetadataCache#readModifyUpdateOrCreate (#23686)
• [fix][broker] Make InflightReadsLimiter asynchronous and apply it for replay queue reads (#23901)
• [fix][broker] PIP-399: Fix Metric Name for Delayed Queue (#23712)
• [fix][broker] Remove blocking calls from internalGetPartitionedStats (#23832)
• [fix][broker] Revert "[fix][broker] Cancel possible pending replay read in cancelPendingRead (#23384)" (#23855)
• [fix][broker] Support large number of unack message store for cursor recovery (#9292)
• [fix][broker] fix broker may lost rack information (#23331)
• [cleanup][admin] Do not print full stacktrace when get partitioned metadata not found (#20979)
• [fix][meta] Fix ephemeral Zookeeper put which creates a persistent znode (#23984)
• [fix][meta] Fix ephemeral handling of ZK nodes and fix MockZooKeeper ephemeral and ZK stat handling (#23988)
• [fix][misc] Honor dynamic log levels in log4j2.yaml (#23847)
• [fix][ml] Fix cursor metadata compatability issue when switching the config unackedRangesOpenCacheSetEnabled (#23759)
• [fix][ml] Fix deadlock in PendingReadsManager (#23958)
• [fix][ml] Fix memory leak due to duplicated RangeCache value retain operations (#23955)
• [fix][ml] Fix memory leaks in ManagedCursorInfo and ManagedLedgerInfo decompression and compression (#23960)
• [fix][ml] incorrect non-durable cursor's backlog due to concurrently trimming ledger and non-durable cursor creation (#23951)
• [improve][broker] Avoid PersistentReplicator.expireMessages logic compute backlog twice (#23957)
• [improve][broker] Avoid logging errors when there is a connection issue during subscription. (#23939)
• [improve][broker] Avoid printing log for IncompatibleSchemaException in ServerCnx (#23938)
• [improve][broker] Do not print error logs for NotFound or Conflict errors when using the Admin API (#23928)
• [improve][broker] Don't print error logs for ProducerBusyException (#23929)
• [improve][broker] Improve Consumer.equals performance (#23864)
• [improve][broker] Reduce unnecessary REPLICATED_SUBSCRIPTION_SNAPSHOT_REQUEST (#23839)
• [improve][broker] Remove spamming logs for customized managed ledger (#23862)
• [improve][broker] Support values up to 2^32 in ConcurrentBitmapSortedLongPairSet (#23878)
• [improve][meta] Simplify getting parent path in ZKMetadataStore without using java.io.File (#23996)

Client

• [feat][client] Support forward proxy for the ZTS server in pulsar-client-auth-athenz (#23947)
• [fix] Avoid NPE when closing an uninitialized SameAuthParamsLookupAutoClusterFailover (#23911)
• [fix] Initialize UrlServiceProvider before trying to use transaction coordinator (#23914)
• [fix][client] Fix LoadManagerReport not found (#23886)
• [fix][client] Fix memory leak in ClientCnx.newLookup when there's TooManyRequestsException (#23971)
• [fix][client] Fix memory leak when message size exceeds max message size and batching is enabled (#23967)
• [fix][client] Orphan producer when concurrently calling producer closing and reconnection (#23853)
• [fix][client] call redeliver 1 msg but did 2 msgs (#23943)
• [fix][client] fix retry topic with exclusive mode. (#23859)
• [improve][client] Avoid logging errors for retriable errors when creating producer #23935

Pulsar IO and Pulsar Functions

• [fix][io] Fix pulsar-io:pom not found (#23979)
• [improve] Validate user paths in Functions utils (#22833)
• [improve][io] Allow skipping connector deployment (#23932)

Others

• [improve][proxy] Make keep-alive interval configurable in Pulsar Proxy (#23981)
• [fix] fix for code scanning alert no. 48: Uncontrolled data used in path expression (#23985)
• [fix][build] Add develops for buildtools (#23992)
• [improve] Support overriding java.net.preferIPv4Stack with OPTS (#23846)

Tests & CI

• [improve][test] Add solution to PulsarMockBookKeeper for intercepting reads (#23875)
• [fix][test] Add reconsumeLater call in RetryTopicTest#testRetryTopicWithMultiTopic. (#23857)
• [fix][test] Fix flaky DelayedDeliveryTest.testEnableTopicDelayedDelivery (#23893)
• [fix][test] Fix quiet time implementation in BrokerTestUtil.receiveMessages (#23876)
• [fix][test] fix flaky testNegativeAcksWithBackoff when batch enabled. (#23986)
• [fix][test]Fix flaky test testTopicUnloadAfterSessionRebuild (#23852)
• [fix][ci] Configure Docker data-root to /mnt/docker to avoid running out of disk space (#23909)
• [improve][ci] Increase Maven max heap size to 2048M and tune GCLockerRetryAllocationCount (#23883)
• [improve][ci] Publish build scans to develocity.apache.org (#23851)
• [improve][ci] Skip "OWASP dependency check" when data wasn't found in cache (#23970)
• [improve][ci] Update GitHub Workflows to Ubuntu 22.04 (#20729)

For the complete list, check the full changelog.

v4.0.2

2025-01-20

Known Major Issues in this Release

This release contains a known issue impacting the seek method by timestamp. This issue was reported after the release was published.

• [Bug] Seeking by timestamp causes the subscription to reset to the earliest position (#23910)

Workaround for the issue:

The issue is caused by changes introduced in #22792. To resolve this, disable the functionality by setting the following configuration:

managedLedgerCursorResetLedgerCloseTimestampMaxClockSkewMillis=-1

Workaround Configuration Notes:

• This configuration key needs to be manually added to your broker.conf file as it doesn't exist by default
• For Apache Pulsar Helm Chart Kubernetes deployments, add the following to your values.yaml file under the broker/configData section:

broker:
  configData:
    PULSAR_PREFIX_managedLedgerCursorResetLedgerCloseTimestampMaxClockSkewMillis: "-1"

Library updates

• [fix][sec] Bump commons-io version to 2.18.0 (#23684)
• [fix][sec] Mitigate CVE-2024-53990 by disabling AsyncHttpClient CookieStore (#23725)
• [fix][sec] Upgrade async-http-client to 2.12.4 to address CVE-2024-53990 (#23732)
• [fix][sec] Upgrade golang.org/x/crypto from 0.21.0 to 0.31.0 in pulsar-function-go (#23743)
• [improve] Upgrade lombok to 1.18.36 (#23752)
• [improve] Upgrade to Netty 4.1.116.Final and io_uring to 0.0.26.Final (#23813)
• [improve][monitor] Upgrade OTel to 1.45.0 (#23756)

Broker

• [fix][admin] Fix exception loss in getMessageId method (#23766)
• [fix][admin] Fix exception thrown in getMessageId method (#23784)
• [fix][admin] Listen partitioned topic creation event (#23680)
• [fix][admin] Verify is policies read only before revoke permissions on topic (#23730)
• [fix][broker] Add consumer name for subscription stats (#23671)
• [fix][broker] Avoid block markDeletePosition forward when skip lost entries (#21210)
• [fix][broker] Catch exception for entry payload interceptor processor (#23683)
• [fix][broker] Continue using the next provider for authentication if one fails (#23797)
• [fix][broker] Continue using the next provider for http authentication if one fails (#23842)
• [fix][broker] Fix acknowledgeCumulativeAsync block when ackReceipt is enabled (#23841)
• [fix][broker] Fix bug causing loss of migrated information when setting other localPolicies in namespace (#23764)
• [fix][broker] Fix config replicationStartAt does not work when set it to earliest (#23719)
• [fix][broker] Fix deadlock in Key_Shared PIP-379 implementation (#23854)
• [fix][broker] Fix enableReplicatedSubscriptions (#23781)
• [fix][broker] Fix items in dispatcher.recentlyJoinedConsumers are out-of-order, which may cause a delivery stuck (#23802)
• [fix][broker] Fix possible mark delete NPE when batch index ack is enabled (#23833)
• [fix][broker] Fix the retry mechanism in MetadataCache#readModifyUpdateOrCreate (#23686)
• [fix][broker] Invoke custom BrokerInterceptor's onFilter method if it's defined (#23676)
• [fix][broker] Msg delivery is stuck due to items in the collection recentlyJoinedConsumers are out-of-order (#23795)
• [fix][broker] PIP-399: Fix Metric Name for Delayed Queue (#23712)
• [fix][broker] Remove blocking calls from internalGetPartitionedStats (#23832)
• [fix][broker] Remove failed OpAddEntry from pendingAddEntries (#23817)
• [fix][broker] Revert "[fix][broker] Cancel possible pending replay read in cancelPendingRead (#23384)" (#23855)
• [fix][broker] System topic should not be migrated during blue-green cluster migration (#23767)
• [fix][broker] fix NPE when calculating a topic's backlogQuota (#23720)
• [fix][broker] support missing cluster level fine-granted permissions (#23675)
• [fix][broker] topic policy deadlock block metadata thread. (#23786)
• [fix][ml] Topic load timeout due to ml data ledger future never finishes (#23772)
• [improve][admin] Opt-out of topic-existence check (#23709)
• [improve][broker] Improve SystemTopicBasedTopicPoliciesService reader to reduce GC pressure (#23780)
• [improve][broker] Optimize subscription seek (cursor reset) by timestamp (#22792)
• [improve][broker] Reduce unnecessary REPLICATED_SUBSCRIPTION_SNAPSHOT_REQUEST (#23839)
• [improve][log] Print ZK path if write to ZK fails due to data being too large to persist (#23652)
• [improve][ml] Optimize BlobStoreManagedLedgerOffloader.getOffloadPolicies (#23776)
• [improve][txn] Improve Reader in TransactionBuffer to reduce GC pressure (#23779)

Client

• [Fix][Client] Fix pending message not complete when closeAsync (#23761)
• [fix][client] Cannot access message data inside ProducerInterceptor#onSendAcknowledgement (#23791)
• [fix][client] Fix compatibility between kerberos and tls (#23798)
• [fix][client] Fix enableRetry for consumers using legacy topic naming where cluster name is included (#23753)
• [fix][client] Fix memory leak when publishing encountered a corner case error (#23738)
• [fix][client] Fix reader message filtering issue during blue-green cluster switch (#23693)
• [fix][client] Fix wrong start message id when it's a chunked message id (#23713)
• [fix][client] Make DeadLetterPolicy & KeySharedPolicy serializable (#23718)
• [fix][client] Orphan producer when concurrently calling producer closing and reconnection (#23853)
• [fix][client] Prevent retry topic and dead letter topic producer leaks when sending of message fails (#23824)
• [fix][doc] Refine ClientBuilder#memoryLimit and ConsumerBuilder#autoScaledReceiverQueueSizeEnabled javadoc (#23687)
• [improve][client] Make replicateSubscriptionState nullable (#23757)
• [improve][client] PIP-393: Improve performance of Negative Acknowledgement (#23600)
• [improve][client] PIP-393: Support configuring NegativeAckPrecisionBitCnt while building consumer. (#23804)
• [improve][client] Print consumer stats log if prefetched messages are not zero (#23698)

Pulsar IO and Pulsar Functions

• [improve][fn] Improve closing of producers in Pulsar Functions ProducerCache invalidation (#23734)
• [improve][fn] Improve implementation for maxPendingAsyncRequests async concurrency limit when return type is CompletableFuture<Void> (#23708)
• [improve][io] Bump io.lettuce:lettuce-core from 5.0.2.RELEASE to 6.5.1.RELEASE in /pulsar-io/redis (#23685)

Others

• [fix][common] TopicName: Throw IllegalArgumentException if localName is whitespace only (#23691)
• [fix] Fix issues with Pulsar Alpine docker image stability: remove glibc-compat (#23762)
• [fix][cli] Fix set topic retention policy failed (#23688)
• [fix][cli] Fix set-retention with >2GB size value for topic policy (#23689)
• [fix][misc] Honor dynamic log levels in log4j2.yaml (#23847)
• [improve] Sup...