You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This release adds these features to the original Apache Pulsar 4.0 release:
Stability improvements
Third party libraries updates for security fixes
Dependency upgrades (for security, stability and performances)
An enhanced ElasticSearch Pulsar IO Sink
An enhanced version of Apache BookKeeper with security fixes
Note: The DataStax Luna Streaming Distribution is designed for Java 17.
However, because the product releases Docker images, you do not need to install
Java (8 or 17) in advance. Java 17 is bundled in the Docker image.
Security
Luna Streaming is developed with great attention to security.
Since it is based on Apache Pulsar™, Luna Streaming Pulsar distribution
has all the security processes and requirements required by the Apache Software
Foundation™, such as:
Peer to peer code reviews.
Clear process for handling possible security vulnerabilities.
On top of that, Luna Streaming development processes are enhanced with
additional security best practices for all the components involved:
Robust Continuous Integration and reproducible Release pipeline in a secure
monitored environment. Such monitoring improves the overall security of the
application.
Reactivity to third-party vulnerabilities. Every component is scanned and
monitored daily, ensuring quick fixes in case of vulnerability disclosure.
Regular docker images vulnerability scans on latest Luna Streaming releases,
with a well-defined release procedure.
Packaging
Luna Streaming Distribution comes with different packages tooled for different
purposes. The distributions are available as Docker images and tarballs, and
both methods follow the same packaging patterns.
Patterns
lunastreaming: the basic Luna Streaming Distribution including Pulsar
SQL feature.
lunastreaming-core: the basic Luna Streaming Distribution without Pulsar
SQL feature. Pick this distribution if you don't need Pulsar SQL features.
lunastreaming-all: contains the Core Luna Streaming Distribution,
including Pulsar Offloaders and the DataStax Pulsar IO Connectors
listed above. Pick this distribution if you want the DataStax connectors or
the offloading feature.
Releases
Luna Streaming Distribution 4.0 7.2
This maintenance release of the DataStax Luna Streaming Distribution for 4.0 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.
758fdae fix licence for org.apache.commons-commons-collections4
88d536a [fix][client] Producer stuck or geo-replication stuck due to wrong value of message.numMessagesInBatch (#25106)
c4d3018 [fix][broker] pulsar_ml_reads_inflight_bytes and pulsar_ml_reads_available_inflight_bytes are 0 at the same time (#25105)
eeab23e [fix][sec] Upgrade log4j to 2.25.3 to address CVE-2025-68161 (#25102)
8c7b7f0 [fix][sec] Upgrade jose4j to 0.9.6 to address CVE-2024-29371 (#25095)
294cf65 [fix][broker] Fix cursor position persistence in ledger trimming (#25087)
adcb209 [improve][io] Replace Qpid in tests with RabbitMQ in Testcontainers and upgrade RabbitMQ client version (#25085)
a1fad07 [fix][build] Activate jdk21 and jdk24 profiles on Java 25 (#25084)
ef75b40 [fix][sec] Upgrade Netty to 4.1.130.Final (#25078)
f62ab36 [fix][broker] Infinitely failed to delete topic if the first time failed and enabled transaction (#25073)
2488d31 [fix][broker] Fix incorrect backlog if use multiple acknowledge types on the same subscription (#25047)
b4572db [fix][broker] PIP-442: Fix race condition in async semaphore permit updates that causes memory limits to become ineffective (#25066)
c339936 [fix][broker] fix prepareInitPoliciesCacheAsync in SystemTopicBasedTopicPoliciesService (#24980)
b616398 [improve][broker] Optimize Reader creation in TopicPoliciesService (#24658)
d618367 [improve][broker] Use atomic counter for ongoing transaction count (#25053)
8ceb610 [fix][client] Fix invalid parameter type passed to Map.get in TopicsImpl.getListAsync method (#25069)
6b27381 [improve][broker] Improve replicated subscription snapshot cache so that subscriptions can be replicated when mark delete position update is not frequent (#25044)
be235b1 [fix][broker] Force EnsemblePolicies to resolve network location after rackInfoMap is updated due to changes in /ledgers/available znode (#25067)
8fb6b29 [fix][admin] Refactor bookie affinity group sync operations to async in rest api (#25050)
6f040ae [fix][broker] Fix various error-prone detected errors mainly in logging and String.format parameters (#25059)
6b94167 [improve][build] Upgrade errorprone to 2.45.0 version (#25054)
c8a45b9 [fix][cli] Fix output of --print-metadata in cli consume (#25056)
bc70480 [fix][cli] Fix some pulsar-admin topicPolicies commands exiting before async operations complete (#25051)
807e76f [fix][sec] Bump at.yawk.lz4:lz4-java from 1.9.0 to 1.10.1 in /pulsar-common (#25045)
This maintenance release of the DataStax Luna Streaming Distribution for 4.0 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.
Most notable commits
d28392d [fix][broker][branch-4.0] Fix failed testFinishTakeSnapshotWhenTopicLoading due to topic future cache conflicts (#24947)
1510ecf [fix][txn] fix concurrent error cause txn stuck in TransactionBufferHandlerImpl#endTxn (#23551)
eb17c66 [fix][broker] Avoid recursive update in ConcurrentHashMap during policy cache cleanup (#24939)
354c517 [fix][monitor] Fix the incorrect metrics name (#21981)
a97a9dd [improve][broker] Add tests for using absolute FQDN for advertisedAddress and remove extra dot from brokerId (#24787)
e6dd5ef [fix][admin] Set local policies overwrites "number of bundles" passed during namespace creation (#24762)
14a6749 [fix][sec] Override nimbus-jose-jwt to remediate CVE-2023-52428 and CVE-2025-53864 (#24937)
d03cf00 [fix][broker] Fix bug in PersistentMessageExpiryMonitor which blocked further expirations (#24941)
4fb254d [fix][test] Stabilize testMsgDropStat by reliably triggering non-persistent publisher drop (#24929)
5ca3b8c [fix][sec] Override commons-beanutils and commons-configuration2 to remediate CVEs (#24936)
563e58c [fix][sec] Override kafka-clients in kinesis-kpl-shaded to remediate CVE-2024-31141 and CVE-2025-27817 (#24935)
9e47425 [fix][broker] Fix stack overflow caused by race condition when closing a connection (#24934)
176e07d [fix][broker] ExtensibleLoadManager: handle SessionReestablished and Reconnected events to re-register broker metadata (#24932)
fb87033 [fix][broker] Use poll instead remove to avoid NoSuchElementException (#24933)
891aa50 [fix][broker] fix getMaxReadPosition in TransactionBufferDisable should return latest (#24898)
5998856 [improve][broker] Don't log an error when updatePartitionedTopic is called on a non-partitioned topic (#24943)
b2ff7e6 [improve][broker] Optimize lookup result warn log (#24942)
91ba207 [fix][client] Fix thread leak in reloadLookUp method which is used by ServiceUrlProvider (#24794)
2cf6dc0 [fix][broker] Run ResourceGroup tasks only when tenants/namespaces registered (#24859)
3eff549 [fix][sec] Upgrade BouncyCastle FIPS to 2.0.10 to remediate CVE-2025-8916 (#24923)
73808c4 [fix][broker] BacklogMessageAge is not reset when cursor mdPosition is on an open ledger (#24915)
0c68377 [fix][broker] Fix wrong behaviour when using namespace.allowed_clusters, such as namespace deletion and namespace policies updating (#24860)
4cfc53b [improve][ci] Move replication tests to new group Broker Group 5 in Pulsar CI (#24917)
7ac7438 [fix][sec] Upgrade Spring to 6.2.12 to remediate CVE-2025-22233 and CVE-2025-41249 (#24903)
10d9820 [improve][misc] Upgrade Netty to 4.1.128.Final (#24911)
This maintenance release of the DataStax Luna Streaming Distribution for 4.0 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.
Most notable commits
0bb2c25 [improve][misc] Cherrypick Add API endpoint for function-worker for liveness check with configurable flag into 4.x (#530)
This maintenance release of the DataStax Luna Streaming Distribution for 4.0 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.
This maintenance release of the DataStax Luna Streaming Distribution for 4.0 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.
Most notable commits
c179c99bd66 [fix][client] Prevent NPE when seeking with null topic in TopicMessageId (#24404)
46a5bf7a6ee [fix][ml] Enhance OpFindNewest to support skip non-recoverable data (#24441)
cdb952c7aad [improve][broker][branch-4.0] Update to Oxia 0.6.0 and use new group-id (#24454)
11d7afdb575 [refactor][broker] Expose the managedLedger field for the sub class (#24448)
3387d98bcd3 [fix][ml]Still got BK ledger, even though it has been deleted after offloaded (#24432)
623841b50ca [improve][broker] Deny removing local cluster from topic level replicated cluster policy (#24351)
9164a2351ff [fix][broker] Once the cluster is configured incorrectly, the broker maintains the incorrect cluster configuration even if you removed it (#24419)
452397d566e [fix][ml]Received more than once callback when calling cursor.delete (#24405)
75f91c2a147 [fix][ml] Cursor ignores the position that has an empty ack-set if disabled deletionAtBatchIndexLevelEnabled (#24406)
9e88dda06b3 [fix][broker] Fix the wrong cache name (#24407)
014ad5d2a96 [fix][client] Fix some potential resource leak (#24402)
cb388d2355f [fix][broker][branch-4.0] Revert "[improve][broker] Reduce memory occupation of the delayed message queue (#23611)" (#24429)
c3d99c65a71 [fix][txn] Fix deadlock when loading transaction buffer snapshot (#24401)
a2859bd7760 [fix] [broker] No longer allow creating subscription that contains slash (#23594)
cf0b0ee9250 [fix][ml]Revert a behavior change of releasing idle offloaded ledger handle: only release idle BlobStoreBackedReadHandle (#24384)
6034e76667a [improve][misc] Upgrade Netty to 4.1.122.Final and tcnative to 2.0.72.Final (#24397)
deee63e3a62 [improve][broker] Add managedCursor/LedgerInfoCompressionType settings to broker.conf (#24391)
ccd54371a2d [improve][broker] Make maxBatchDeletedIndexToPersist configurable and document other related configs (#24392)
7721c2c4895 [fix][client] Fix consumer not returning encrypted messages on decryption failure with compression enabled (#24356)
b682de9cbf4 [improve][broker] Added synchronized for sendMessages in Non-Persistent message dispatchers (#24386)
93ee1375f25 [improve][ml]Release idle offloaded read handle only the ref count is 0 (#24381)
209aa342719 [fix][broker]Fix deadlock when compaction and topic deletion execute concurrently (#24366)
e1cfe3f564e [fix][broker] expose consumer name for partitioned topic stats (#24360)
113f8bc8aa1 [fix][broker] Fix issue that topic policies was deleted after a sub topic deleted, even if the partitioned topic still exists (#24350)
89bdc3141c2 [fix][io] Acknowledge RabbitMQ message after processing the message successfully (#24354)
7f638dfd6d3 [fix][broker] Ignore metadata changes when broker is not in the Started state (#24352)
ca1983c5963 [improve][broker] Enable concurrent processing of pending read Entries to avoid duplicate Reads (#24346)
f31ecb2f3c7 [fix][broker] Resolve the issue of frequent updates in message expiration deletion rate (#24190)
This maintenance release of the DataStax Luna Streaming Distribution for 4.0 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.
Most notable commits
fff5e69 Fix code style in DefaultLookupProxyHandler
eb3fc87 [fix][proxy] Fix incorrect client error when calling get topic metadata (#24181)
32392a2 [fix][broker] Fix some problems in calculate totalAvailableBookies in method getExcludedBookiesWithIsolationGroups when some bookies belongs to multiple isolation groups. (#24091)
8fefcdc [fix][test] Fix remaining UnfinishedStubbingException issue with AuthZTests (#24174)
ac38706 [improve][test] Use configured session timeout for MockZooKeeper and TestZKServer in PulsarTestContext (#24171)
2a269d4 [fix][test] Improve reliability of IncrementPartitionsTest (#24172)
53d43ee [fix][build] Fix skipTag and use explicit tag for image name (#24168)
d049244 [fix][broker] The feature brokerDeleteInactivePartitionedTopicMetadataEnabled leaves orphan topic policies and topic schemas (#24150)
07dc37a modified test to use newConnect method & Getter for FeatureFlags obj in ServerCnx
bc01ae8 [fix][proxy] Propagate client connection feature flags through Pulsar Proxy to Broker (#24158)
5fde2a6 [fix][build] Fix docker image building by replacing deprecated and removed compress argument (#24155)
1e55dc0 [fix][misc]: ignore deleted ledger when tear down cluster (#23831)
05de7ce [fix] [broker] topics infinitely failed to delete after remove cluster from replicated clusters modifying when using partitioned system topic (#24097)
10c3dbd [improve][broker] extract getMaxEntriesInThisBatch into a method and add unit test for it (#24117)
38eb99f [fix][sec] Upgrade jwt/v5 to 5.2.2 to address CVE-2025-30204 (#24140)
3164e2d [fix][sec] Upgrade pulsar-function-go dependencies to address CVE-2025-22870 (#24135)
f9bde70 [improve][fn] Introduce NewOutputMessageWithError to enable error handling (#24122)
This is the initial release of the DataStax Luna Streaming Distribution for 4.0. This release contains all the commits included in the Apache Pulsar v4.0.3 release plus the following changes specific to Luna Streaming:
Most notable commits
96f25cd [improve][meta] Change log level from error to warn for unknown notification types in OxiaMetadataStore (#24126)
ba8037d [fix][ml] Return 1 when bytes size is 0 or negative for entry count estimation (#24131)
167ffea [improve][io] Enhance Kafka connector logging with focused bootstrap server information (#24128)
5edc57c [improve][client] Prevent NullPointException when closing ClientCredentialsFlow (#24123)
21f0750 [fix][ml] Don't estimate number of entries when ledgers are empty, return 1 instead (#24125)
f8816e1 [improve][io] Remove sleep when sourceTask.poll of kafka return null (#24124)
71330c4 [improve][broker] Change topic exists log to warn (#24116)
d699029 [improve][broker][branch-4.0] PIP-406: Introduce metrics related to dispatch throttled events (#24111)
e53623d [fix][client] Pattern subscription regression when broker-side evaluation is disabled (#24104)
3ffcbfc [fix][client] Fix consumer leak when thread is interrupted before subscribe completes (#24100)
83ba1ab [fix][ci] Bump dependency-check to 12.1.0 to fix OWASP Dependency Check job (#24083)
2b933c7 [fix][broker] Restore the behavior to dispatch batch messages according to consumer permits (#24092)