Luna_Streaming_3.1_Release_Notes.md

# Release notes for DataStax Luna Streaming Distribution

## About DataStax Luna Streaming Distribution

Luna Streaming Distribution 3.1 is compatible with Apache Pulsar™ 3.1
and subsequent releases.

### Components

- [DataStax Luna Streaming](https://github.com/datastax/pulsar) (Apache Pulsar
  3.1 fork)
- [DataStax BookKeeper](https://github.com/datastax/bookkeeper) (Apache
  BookKeeper fork)
- DataStax Burnell
- DataStax Pulsar Admin Console
- DataStax Pulsar Heartbeat
- DataStax Apache Pulsar Cassandra Sink
- DataStax Apache Pulsar Cassandra Source
- DataStax Starlight For Kafka
- DataStax Starlight For RabbitMQ
- DataStax Starlight For JMS Broker filter
- DataStax Snowflake connector

This release adds these features to the original Apache Pulsar 3.1 release:

- Stability improvements
- Third party libraries updates for security fixes
- Dependency upgrades (for security, stability and performances)
- An enhanced ElasticSearch Pulsar IO Sink
- An enhanced version of Apache BookKeeper with security fixes

*Note:* The DataStax Luna Streaming Distribution is designed for Java 17.
However, because the product releases Docker images, you do not need to install
Java (8 or 17) in advance. Java 17 is bundled in the Docker image.

### Security

Luna Streaming is developed with great attention to security.

Since it is based on Apache Pulsar™, Luna Streaming Pulsar distribution
has all the security processes and requirements required by the Apache Software
Foundation™, such as:

- Peer to peer code reviews.
- Clear process for handling possible security vulnerabilities.

On top of that, Luna Streaming development processes are enhanced with
additional security best practices for all the components involved:

- Robust Continuous Integration and reproducible Release pipeline in a secure
  monitored environment. Such monitoring improves the overall security of the
  application.
- Reactivity to third-party vulnerabilities. Every component is scanned and
  monitored daily, ensuring quick fixes in case of vulnerability disclosure.
- Regular docker images vulnerability scans on latest Luna Streaming releases,
  with a well-defined release procedure.


### Packaging

Luna Streaming Distribution comes with different packages tooled for different
purposes. The distributions are available as Docker images and tarballs, and
both methods follow the same packaging patterns.

#### Patterns

- **lunastreaming**: the basic Luna Streaming Distribution **including Pulsar
  SQL** feature.
- **lunastreaming-core**: the basic Luna Streaming Distribution **without Pulsar
  SQL** feature. Pick this distribution if you don't need Pulsar SQL features.
- **lunastreaming-all**: contains the Core Luna Streaming Distribution,
  including **Pulsar Offloaders** and the **DataStax Pulsar IO Connectors**
  listed above. Pick this distribution if you want the DataStax connectors or
  the offloading feature.

# Releases

## Luna Streaming Distribution 3.1 4.23
This maintenance release of the DataStax Luna Streaming Distribution for 3.1 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

### Most notable commits

* [3a76a50ab70](https://github.com/datastax/pulsar/commit/3a76a50ab70) [fix][test] Fix ResourceQuotaCalculatorImplTest#testNeedToReportLocalUsage (#25247)
* [279887bafb9](https://github.com/datastax/pulsar/commit/279887bafb9) [improve][ci] revisit tune-runner-vm action,  drop tuning for docker (#22448)
* [9776b6f8de6](https://github.com/datastax/pulsar/commit/9776b6f8de6) [fix][build][branch-3.0] Ignore SpotBugs check for NegativeAcksTracker
* [5db5b27bb8e](https://github.com/datastax/pulsar/commit/5db5b27bb8e) [improve][broker] Give the detail error msg when authenticate failed with AuthenticationException (#25221)
* [671461d9204](https://github.com/datastax/pulsar/commit/671461d9204) [fix][broker] Fix transactionMetadataFuture completeExceptionally with null value (#25231)
* [05798f34980](https://github.com/datastax/pulsar/commit/05798f34980) Backport "[fix][client] Fix deadlock of NegativeAcksTracker (#23651)"
* [85fb99118b2](https://github.com/datastax/pulsar/commit/85fb99118b2) [improve][test][branch-3.0] Add test for issue #25220
* [1bfc908c232](https://github.com/datastax/pulsar/commit/1bfc908c232) Revert "[improve] [broker] replace HashMap with inner implementation ConcurrentLongLongPairHashMap in Negative Ack Tracker. (#23582)"
* [fa69a359dbf](https://github.com/datastax/pulsar/commit/fa69a359dbf) [fix][broker] Fix incomplete futures in topic property update/delete methods (#25228)
* [18c6cd81b5b](https://github.com/datastax/pulsar/commit/18c6cd81b5b) [fix][client] Fix invalid parameter type passed to Map.get in TopicsImpl.getListAsync method (#25069)
* [c5764a7b6c7](https://github.com/datastax/pulsar/commit/c5764a7b6c7) [fix][broker] Force EnsemblePolicies to resolve network location after rackInfoMap is updated due to changes in /ledgers/available znode (#25067)
* [e9b4792e4d0](https://github.com/datastax/pulsar/commit/e9b4792e4d0) [fix][broker] Fix httpProxyTimeout config (#25223)
* [bcecc2c4581](https://github.com/datastax/pulsar/commit/bcecc2c4581) [fix][client] Fix producer synchronous retry handling in failPendingMessages method (#25207)
* [08369d2a536](https://github.com/datastax/pulsar/commit/08369d2a536) [fix][client]Producer stuck or geo-replication stuck due to wrong value of message.numMessagesInBatch (#25106)
* [e58890914bb](https://github.com/datastax/pulsar/commit/e58890914bb) [improve][proxy] Add regression tests for package upload with 'Expect: 100-continue' (#25211)
* [771ac2e9c23](https://github.com/datastax/pulsar/commit/771ac2e9c23) [fix][ci][branch-3.0] Apply change from #22327 which was missing in branch-3.0
* [08aa6dcaa5b](https://github.com/datastax/pulsar/commit/08aa6dcaa5b) [fix][client] Fix race condition between isDuplicate() and flushAsync() method in PersistentAcknowledgmentsGroupingTracker due to incorrect use Netty Recycler (#25208)
* [18575dc1245](https://github.com/datastax/pulsar/commit/18575dc1245) [fix] [test] Upgrade docker-java to 3.7.0 (#25209)
* [074de3ac12e](https://github.com/datastax/pulsar/commit/074de3ac12e) [fix][misc] Allow JWT tokens in OpenID auth without nbf claim (#25197)
* [7ca145e1f47](https://github.com/datastax/pulsar/commit/7ca145e1f47) [fix][proxy] Close client connection immediately when credentials expire and forwardAuthorizationCredentials is disabled (#25179)
* [96fc5ddad71](https://github.com/datastax/pulsar/commit/96fc5ddad71) [fix][ml] Fix NoSuchElementException in EntryCountEstimator caused by a race condition (#25177)
* [d1d21cbf1ef](https://github.com/datastax/pulsar/commit/d1d21cbf1ef) [fix][sec] Upgrade log4j to 2.25.3 to address CVE-2025-68161 (#25102)
* [2f2f77b3266](https://github.com/datastax/pulsar/commit/2f2f77b3266) [fix][test] Fix flaky AdminApiTransactionTest.testGetTransactionBufferInternalStats
* [70e44ff0be9](https://github.com/datastax/pulsar/commit/70e44ff0be9) [fix][build] Remove Confluent and Restlet maven repositories from top level pom.xml (#24981)
* [0eec79fc958](https://github.com/datastax/pulsar/commit/0eec79fc958) [fix][fn] Fix graceful Pulsar Function shutdown so that consumers and producers are closed (#25157)
* [42fcc4d76e4](https://github.com/datastax/pulsar/commit/42fcc4d76e4) [fix][broker] Fix regex matching of namespace name which might contain a regex char (#25136)
* [edf15549458](https://github.com/datastax/pulsar/commit/edf15549458) [fix][sec] Upgrade vertx to address CVE-2026-1002 (#25152)
* [754d3d5a79e](https://github.com/datastax/pulsar/commit/754d3d5a79e) [fix][proxy] Fix memory leaks in ParserProxyHandler (#25142)
* [71aef0308e4](https://github.com/datastax/pulsar/commit/71aef0308e4) [fix][fn] complete flushAsync before closeAsync in ProducerCache and wait for completion in closing the cache (#25140)
* [9524c2b5269](https://github.com/datastax/pulsar/commit/9524c2b5269) [fix][admin] Fix asyncGetRequest to handle 204 (#25124)
* [ba8b014bf26](https://github.com/datastax/pulsar/commit/ba8b014bf26) [fix][broker] Fix MultiRolesTokenAuthorizationProvider error when subscription prefix doesn't match. (#25121)
* [ecf71922c68](https://github.com/datastax/pulsar/commit/ecf71922c68) [fix][broker] Fix chunked message loss when no consumers are available (#25077)
* [be99e4f8233](https://github.com/datastax/pulsar/commit/be99e4f8233) [fix][sec] Upgrade jose4j to 0.9.6 to address CVE-2024-29371 (#25095)

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|---------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.14  | cassandra-enhanced-pulsar-sink-1.6.14-nar.nar |
| [cloud-storage](https://github.com/datastax/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.6   | pulsar-io-cloud-storage-3.2.6.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.23 | pulsar-io-data-generator-3.1.4.23.nar          |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.23 | pulsar-io-elastic-search-3.1.4.23.nar          |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.23 | pulsar-io-http-3.1.4.23.nar                    |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.23 | pulsar-io-jdbc-clickhouse-3.1.4.23.nar         |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.23 | pulsar-io-jdbc-mariadb-3.1.4.23.nar            |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.23 | pulsar-io-jdbc-openmldb-3.1.4.23.nar           |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.23 | pulsar-io-jdbc-postgres-3.1.4.23.nar           |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.23 | pulsar-io-jdbc-sqlite-3.1.4.23.nar             |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.23 | pulsar-io-kafka-3.1.4.23.nar                   |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.23 | pulsar-io-kinesis-3.1.4.23.nar                 |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.2.3  | pulsar-snowflake-connector-0.2.3.nar         |
| [lakehouse](https://github.com/datastax/pulsar-io-lakehouse)         | Lakehouse Connector                                                                                          | 3.3.5.4 | pulsar-io-lakehouse-3.3.5.4.nar               |
| [lakehouse-cloud](https://github.com/datastax/pulsar-io-lakehouse)   | Lakehouse Cloud Connector                                                                                    | 3.3.5.4 | pulsar-io-lakehouse-3.3.5.4-cloud.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version | File                                    |
|--------------------------------------------------------------------------|--------------------------------------|---------|-----------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-apache-cassandra) | Read data from Cassandra             | 2.3.6   | pulsar-cassandra-source-2.3.6.nar       |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.23 | pulsar-io-data-generator-3.1.4.23.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.23 | pulsar-io-debezium-mongodb-3.1.4.23.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.23 | pulsar-io-debezium-mssql-3.1.4.23.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.23 | pulsar-io-debezium-mysql-3.1.4.23.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.23 | pulsar-io-debezium-oracle-3.1.4.23.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.23 | pulsar-io-debezium-postgres-3.1.4.23.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.23 | pulsar-io-kafka-3.1.4.23.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.23 | pulsar-io-kinesis-3.1.4.23.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.5  | pulsar-kafka-proxy-3.1.0.5.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version  | File                                      |
|----------------------------------------------------------------|----------------------------------------|----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.5  | pulsar-protocol-handler-kafka-3.1.0.5.nar |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://github.com/datastax/cdc-apache-cassandra) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.3.6   | pulsar-cassandra-admin-2.3.6-nar.nar |
| [jms](https://github.com/datastax/pulsar-jms)           | Starlight for JMS - Pulsar Admin Custom Commands | 6.0.7   | pulsar-jms-admin-6.0.7-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://github.com/datastax/pulsar-jms) | Starlight for JMS - support for server side filters | 6.0.7   | pulsar-jms-6.0.7-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://github.com/datastax/pulsar-transformations)   | Generative AI tools     | 3.2.3   | pulsar-ai-tools-3.2.3.nar        |
| [transforms](https://github.com/datastax/pulsar-transformations) | Transformation function | 3.2.3   | pulsar-transformations-3.2.3.nar |
</details>


## Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls_3.1.4_23/build.json) used for the build


### Builtin connectors

- cassandra-enhanced-pulsar-sink-1.6.14-nar.nar
- pulsar-cassandra-source-2.3.6.nar
- pulsar-io-cloud-storage-3.2.6.nar
- pulsar-io-debezium-mongodb-3.1.4.23.nar 
- pulsar-io-jdbc-sqlite-3.1.4.23.nar
- pulsar-io-kinesis-3.1.4.23.nar
- pulsar-io-data-generator-3.1.4.23.nar
- pulsar-io-elastic-search-3.1.4.23.nar
- pulsar-io-jdbc-clickhouse-3.1.4.23.nar
- pulsar-io-debezium-oracle-3.1.4.23.nar
- pulsar-io-jdbc-openmldb-3.1.4.23.nar
- pulsar-io-jdbc-postgres-3.1.4.23.nar
- pulsar-io-debezium-mssql-3.1.4.23.nar
- pulsar-io-debezium-mysql-3.1.4.23.nar
- pulsar-io-jdbc-mariadb-3.1.4.23.nar
- pulsar-io-debezium-postgres-3.1.4.23.nar
- pulsar-io-http-3.1.4.23.nar
- pulsar-io-kafka-3.1.4.23.nar 
- pulsar-snowflake-connector-0.2.3.nar
- pulsar-protocol-handler-kafka-3.1.0.5.nar
- starlight-rabbitmq-2.10.1.1.nar
- pulsar-kafka-proxy-3.1.0.5.nar
- pulsar-jms-6.0.7-nar.nar


## Luna Streaming Distribution 3.1 4.22
This maintenance release of the DataStax Luna Streaming Distribution for 3.1 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

### Most notable commits

* [18c004c](https://github.com/datastax/pulsar/commit/18c004c) [fix][sec] Upgrade Netty to 4.1.130.Final (#25078)
* [7167f6f](https://github.com/datastax/pulsar/commit/7167f6f) [fix][broker] Fix various error-prone detected errors mainly in logging and String.format parameters (#25059)
* [33b5171](https://github.com/datastax/pulsar/commit/33b5171) [fix][broker][branch-3.0] fix prepareInitPoliciesCacheAsync in SystemTopicBasedTopicPoliciesService (#24978)
* [fb173d6](https://github.com/datastax/pulsar/commit/fb173d6) [improve][ml] Optimize ledger opening by skipping fully acknowledged ledgers (#24655)
* [2d27791](https://github.com/datastax/pulsar/commit/2d27791) [fix][test][branch-3.0] Add missing trueFalse DataProvider
* [9a934d5](https://github.com/datastax/pulsar/commit/9a934d5) [fix] Upgrade gson to 2.13.2 (#25022)
* [7675837](https://github.com/datastax/pulsar/commit/7675837) [fix][broker] Fix creation of replicated subscriptions for partitioned topics (#24997)
* [51c4fb4](https://github.com/datastax/pulsar/commit/51c4fb4) [improve] Eliminate unnecessary duplicate schema lookups for partitioned topics in client and geo-replication (#25011)
* [c34cf12](https://github.com/datastax/pulsar/commit/c34cf12) [improve][client] Test no exception could be thrown for invalid epoch in message (#25013)
* [c9b7118](https://github.com/datastax/pulsar/commit/c9b7118) [fix][client] Fix double recycling of the message in isValidConsumerEpoch method (#25008)
* [11d3e04](https://github.com/datastax/pulsar/commit/11d3e04) [fix][client] PIP-84: Skip processing a message in the message listener if the consumer epoch is no longer valid (#25007)
* [faf5dd4](https://github.com/datastax/pulsar/commit/faf5dd4) [fix][client] Skip processing messages in the listener when the consumer has been closed (#25006)
* [bcb6a6c](https://github.com/datastax/pulsar/commit/bcb6a6c) [fix][meta] Use getChildrenFromStore to read children data to avoid lost data (#24665)
* [509a2a6](https://github.com/datastax/pulsar/commit/509a2a6) [fix] Handle TLS close_notify to avoid SslClosedEngineException: SSLEngine closed already (#24986)
* [9dca697](https://github.com/datastax/pulsar/commit/9dca697) [fix][broker] Use poll instead remove to avoid NoSuchElementException (#24933)
* [de486df](https://github.com/datastax/pulsar/commit/de486df) [fix][sec] Bump github.com/dvsekhvalnov/jose2go from 1.6.0 to 1.7.0 in /pulsar-function-go (#24987)

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|---------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.14  | cassandra-enhanced-pulsar-sink-1.6.14-nar.nar |
| [cloud-storage](https://github.com/datastax/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.6   | pulsar-io-cloud-storage-3.2.6.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.22 | pulsar-io-data-generator-3.1.4.22.nar          |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.22 | pulsar-io-elastic-search-3.1.4.22.nar          |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.22 | pulsar-io-http-3.1.4.22.nar                    |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.22 | pulsar-io-jdbc-clickhouse-3.1.4.22.nar         |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.22 | pulsar-io-jdbc-mariadb-3.1.4.22.nar            |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.22 | pulsar-io-jdbc-openmldb-3.1.4.22.nar           |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.22 | pulsar-io-jdbc-postgres-3.1.4.22.nar           |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.22 | pulsar-io-jdbc-sqlite-3.1.4.22.nar             |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.22 | pulsar-io-kafka-3.1.4.22.nar                   |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.22 | pulsar-io-kinesis-3.1.4.22.nar                 |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.2.2  | pulsar-snowflake-connector-0.2.2.nar         |
| [lakehouse](https://github.com/datastax/pulsar-io-lakehouse)         | Lakehouse Connector                                                                                          | 3.3.5.3 | pulsar-io-lakehouse-3.3.5.3.nar               |
| [lakehouse-cloud](https://github.com/datastax/pulsar-io-lakehouse)   | Lakehouse Cloud Connector                                                                                    | 3.3.5.3 | pulsar-io-lakehouse-3.3.5.3-cloud.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version | File                                    |
|--------------------------------------------------------------------------|--------------------------------------|---------|-----------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-apache-cassandra) | Read data from Cassandra             | 2.3.4   | pulsar-cassandra-source-2.3.4.nar       |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.22 | pulsar-io-data-generator-3.1.4.22.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.22 | pulsar-io-debezium-mongodb-3.1.4.22.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.22 | pulsar-io-debezium-mssql-3.1.4.22.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.22 | pulsar-io-debezium-mysql-3.1.4.22.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.22 | pulsar-io-debezium-oracle-3.1.4.22.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.22 | pulsar-io-debezium-postgres-3.1.4.22.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.22 | pulsar-io-kafka-3.1.4.22.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.22 | pulsar-io-kinesis-3.1.4.22.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.5  | pulsar-kafka-proxy-3.1.0.5.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version  | File                                      |
|----------------------------------------------------------------|----------------------------------------|----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.5  | pulsar-protocol-handler-kafka-3.1.0.5.nar |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://github.com/datastax/cdc-apache-cassandra) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.3.4   | pulsar-cassandra-admin-2.3.4-nar.nar |
| [jms](https://github.com/datastax/pulsar-jms)           | Starlight for JMS - Pulsar Admin Custom Commands | 6.0.6   | pulsar-jms-admin-6.0.6-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://github.com/datastax/pulsar-jms) | Starlight for JMS - support for server side filters | 6.0.6   | pulsar-jms-6.0.6-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://github.com/datastax/pulsar-transformations)   | Generative AI tools     | 3.2.3   | pulsar-ai-tools-3.2.3.nar        |
| [transforms](https://github.com/datastax/pulsar-transformations) | Transformation function | 3.2.3   | pulsar-transformations-3.2.3.nar |
</details>


## Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls_3.1.4_22/build.json) used for the build


### Builtin connectors

- cassandra-enhanced-pulsar-sink-1.6.14-nar.nar
- pulsar-cassandra-source-2.3.4.nar
- pulsar-io-cloud-storage-3.2.6.nar
- pulsar-io-debezium-mongodb-3.1.4.22.nar 
- pulsar-io-jdbc-sqlite-3.1.4.22.nar
- pulsar-io-kinesis-3.1.4.22.nar
- pulsar-io-data-generator-3.1.4.22.nar
- pulsar-io-elastic-search-3.1.4.22.nar
- pulsar-io-jdbc-clickhouse-3.1.4.22.nar
- pulsar-io-debezium-oracle-3.1.4.22.nar
- pulsar-io-jdbc-openmldb-3.1.4.22.nar
- pulsar-io-jdbc-postgres-3.1.4.22.nar
- pulsar-io-debezium-mssql-3.1.4.22.nar
- pulsar-io-debezium-mysql-3.1.4.22.nar
- pulsar-io-jdbc-mariadb-3.1.4.22.nar
- pulsar-io-debezium-postgres-3.1.4.22.nar
- pulsar-io-http-3.1.4.22.nar
- pulsar-io-kafka-3.1.4.22.nar 
- pulsar-snowflake-connector-0.2.2.nar
- pulsar-protocol-handler-kafka-3.1.0.4.nar
- starlight-rabbitmq-2.10.1.1.nar
- pulsar-kafka-proxy-3.1.0.4.nar
- pulsar-jms-6.0.6-nar.nar


## Luna Streaming Distribution 3.1 4.21
This maintenance release of the DataStax Luna Streaming Distribution for 3.1 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

### Most notable commits

* [6a3b447](https://github.com/datastax/pulsar/commit/6a3b447) Update kinesis producer version to 1.0.6
* [e4f26a9](https://github.com/datastax/pulsar/commit/e4f26a9) [fix][client] Fix deduplication for getPartitionedTopicMetadata to include method parameters (#24965)
* [463ad53](https://github.com/datastax/pulsar/commit/463ad53) [fix][broker] Trigger topic creation event only once for non-existent topic (#24802)
* [c74e273](https://github.com/datastax/pulsar/commit/c74e273) [fix][test] Fix flaky KeySharedSubscriptionBrokerCacheTest.testReplayQueueReadsGettingCached (#24955)
* [0df2596](https://github.com/datastax/pulsar/commit/0df2596) [fix][test] Fix invalid test NonPersistentTopicTest.testProducerRateLimit (#24957)
* [bd38d15](https://github.com/datastax/pulsar/commit/bd38d15) [fix][test] Fix flaky NonPersistentTopicTest.testProducerRateLimit (#24951)
* [58e7414](https://github.com/datastax/pulsar/commit/58e7414) [cleanup][broker][branch-3.0] Remove no-op configurations caused by cherry-picking (#24960)
* [ca9b26c](https://github.com/datastax/pulsar/commit/ca9b26c) [fix][txn] fix concurrent error cause txn stuck in TransactionBufferHandlerImpl#endTxn (#23551)
* [df379e7](https://github.com/datastax/pulsar/commit/df379e7) [fix][broker] Avoid recursive update in ConcurrentHashMap during policy cache cleanup (#24939)
* [37d84a0](https://github.com/datastax/pulsar/commit/37d84a0) [fix][admin] Set local policies overwrites "number of bundles" passed during namespace creation (#24762)
* [4ddab9c](https://github.com/datastax/pulsar/commit/4ddab9c) [fix][test] Stabilize testMsgDropStat by reliably triggering non-persistent publisher drop (#24929)
* [a52d40f](https://github.com/datastax/pulsar/commit/a52d40f) [fix][broker] Fix stack overflow caused by race condition when closing a connection (#24934)
* [497ab0f](https://github.com/datastax/pulsar/commit/497ab0f) [fix][broker] fix getMaxReadPosition in TransactionBufferDisable should return latest (#24898)

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|---------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.14  | cassandra-enhanced-pulsar-sink-1.6.14-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.4   | pulsar-io-cloud-storage-3.2.4.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.21 | pulsar-io-data-generator-3.1.4.21.nar          |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.21 | pulsar-io-elastic-search-3.1.4.21.nar          |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.21 | pulsar-io-http-3.1.4.21.nar                    |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.21 | pulsar-io-jdbc-clickhouse-3.1.4.21.nar         |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.21 | pulsar-io-jdbc-mariadb-3.1.4.21.nar            |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.21 | pulsar-io-jdbc-openmldb-3.1.4.21.nar           |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.21 | pulsar-io-jdbc-postgres-3.1.4.21.nar           |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.21 | pulsar-io-jdbc-sqlite-3.1.4.21.nar             |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.21 | pulsar-io-kafka-3.1.4.21.nar                   |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.21 | pulsar-io-kinesis-3.1.4.21.nar                 |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.2.1  | pulsar-snowflake-connector-0.2.1.nar         |
| [lakehouse](https://github.com/streamnative/pulsar-io-lakehouse)         | Lakehouse Connector                                                                                          | 3.3.3.1 | pulsar-io-lakehouse-3.3.3.1.nar               |
| [lakehouse-cloud](https://github.com/streamnative/pulsar-io-lakehouse)   | Lakehouse Cloud Connector                                                                                    | 3.3.3.1 | pulsar-io-lakehouse-3.3.3.1-cloud.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version | File                                    |
|--------------------------------------------------------------------------|--------------------------------------|---------|-----------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.3.1   | pulsar-cassandra-source-2.3.1.nar       |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.21 | pulsar-io-data-generator-3.1.4.21.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.21 | pulsar-io-debezium-mongodb-3.1.4.21.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.21 | pulsar-io-debezium-mssql-3.1.4.21.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.21 | pulsar-io-debezium-mysql-3.1.4.21.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.21 | pulsar-io-debezium-oracle-3.1.4.21.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.21 | pulsar-io-debezium-postgres-3.1.4.21.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.21 | pulsar-io-kafka-3.1.4.21.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.21 | pulsar-io-kinesis-3.1.4.21.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.5  | pulsar-kafka-proxy-3.1.0.5.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version  | File                                      |
|----------------------------------------------------------------|----------------------------------------|----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.5  | pulsar-protocol-handler-kafka-3.1.0.5.nar |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.3.2   | pulsar-cassandra-admin-2.3.2-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 6.0.6   | pulsar-jms-admin-6.0.6-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 6.0.6   | pulsar-jms-6.0.6-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.2.1   | pulsar-ai-tools-3.2.1.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.2.1   | pulsar-transformations-3.2.1.nar |
</details>


## Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls_3.1.4_21/build.json) used for the build


### Builtin connectors

- cassandra-enhanced-pulsar-sink-1.6.14-nar.nar
- pulsar-cassandra-source-2.3.2.nar
- pulsar-io-cloud-storage-3.2.4.nar
- pulsar-io-debezium-mongodb-3.1.4.21.nar 
- pulsar-io-jdbc-sqlite-3.1.4.21.nar
- pulsar-io-kinesis-3.1.4.21.nar
- pulsar-io-data-generator-3.1.4.21.nar
- pulsar-io-elastic-search-3.1.4.21.nar
- pulsar-io-jdbc-clickhouse-3.1.4.21.nar
- pulsar-io-debezium-oracle-3.1.4.21.nar
- pulsar-io-jdbc-openmldb-3.1.4.21.nar
- pulsar-io-jdbc-postgres-3.1.4.21.nar
- pulsar-io-debezium-mssql-3.1.4.21.nar
- pulsar-io-debezium-mysql-3.1.4.21.nar
- pulsar-io-jdbc-mariadb-3.1.4.21.nar
- pulsar-io-debezium-postgres-3.1.4.21.nar
- pulsar-io-http-3.1.4.21.nar
- pulsar-io-kafka-3.1.4.21.nar 
- pulsar-snowflake-connector-0.2.1.nar
- pulsar-protocol-handler-kafka-3.1.0.4.nar
- starlight-rabbitmq-2.10.1.1.nar
- pulsar-kafka-proxy-3.1.0.4.nar
- pulsar-jms-6.0.6-nar.nar


## Luna Streaming Distribution  3.1.4 20
This is a maintenance release containing important security updates.
### Most notable commits
* [74833716214](https://github.com/datastax/pulsar/commit/74833716214) [fix][client] Fix thread leak in reloadLookUp method which is used by ServiceUrlProvider (#24794)
* [34a9fcd39d1](https://github.com/datastax/pulsar/commit/34a9fcd39d1) [fix][broker] Run ResourceGroup tasks only when tenants/namespaces registered (#24859)
* [e81c0dff539](https://github.com/datastax/pulsar/commit/e81c0dff539) [fix][sec] Upgrade BouncyCastle FIPS to 2.0.10 to remediate CVE-2025-8916 (#24923)
* [b3e0f5748c6](https://github.com/datastax/pulsar/commit/b3e0f5748c6) [fix][broker] BacklogMessageAge is not reset when cursor mdPosition is on an open ledger (#24915)
* [5acbd363a64](https://github.com/datastax/pulsar/commit/5acbd363a64) [improve][ci] Move replication tests to new group Broker Group 5 in Pulsar CI (#24917)
* [6af148f3622](https://github.com/datastax/pulsar/commit/6af148f3622) [fix][sec] Upgrade Spring to 6.2.12 to remediate CVE-2025-22233 and CVE-2025-41249 (#24903)
* [3aa3d655b91](https://github.com/datastax/pulsar/commit/3aa3d655b91) [fix][ci][branch-3.0] Drop UBUNTU_MIRROR/UBUNTU_SECURITY_MIRROR support in Dockerfile since it's broken
* [067eb03f533](https://github.com/datastax/pulsar/commit/067eb03f533) [improve][misc] Upgrade Netty to 4.1.128.Final (#24911)
* [02964e34e05](https://github.com/datastax/pulsar/commit/02964e34e05) [fix][test] Fix flaky ReplicatorTest.testResumptionAfterBacklogRelaxed (#24904)
* [602ec3f3f99](https://github.com/datastax/pulsar/commit/602ec3f3f99) [fix][broker] Fix totalAvailablePermits not reduced when removing consumer from non-persistent dispatcher (#24885)
* [f11f7e3cd0a](https://github.com/datastax/pulsar/commit/f11f7e3cd0a) [improve][client]Add null check for Pulsar client clock configuration (#24848)
* [042e1049e53](https://github.com/datastax/pulsar/commit/042e1049e53) [fix][broker] Stop to retry to read entries if the replicator has terminated (#24880)
* [82e4977634f](https://github.com/datastax/pulsar/commit/82e4977634f) [fix][test] Fix flaky SubscriptionSeekTest.testSeekWillNotEncounteredFencedError by counting subscription is fenced only after seek (#24865)
* [a246fd36503](https://github.com/datastax/pulsar/commit/a246fd36503) [fix][test] Stabilize SequenceIdWithErrorTest by fencing after first publish to avoid empty-ledger deletion and send timeout (#24861)
* [5f220117db9](https://github.com/datastax/pulsar/commit/5f220117db9) Fix presto distribution LICENSE
* [4b80388b5dc](https://github.com/datastax/pulsar/commit/4b80388b5dc) [fix][sec] Upgrade Jetty to 9.4.58.v20250814 to address CVE-2025-5115 (#24897)
* [b553d9f7243](https://github.com/datastax/pulsar/commit/b553d9f7243) [fix][sec] Bump io.vertx:vertx-web from 4.5.10 to 4.5.22 (#24889)
* [c2ea63105aa](https://github.com/datastax/pulsar/commit/c2ea63105aa) Fix compile-time issues
* [9b01ed8400c](https://github.com/datastax/pulsar/commit/9b01ed8400c) [fix][ml] Fix `getNumberOfEntries` may point to deleted ledger (#24852)
* [dd51b74fcd9](https://github.com/datastax/pulsar/commit/dd51b74fcd9) Fixed pick ubuntu mirror issue
* [ece27084d3a](https://github.com/datastax/pulsar/commit/ece27084d3a) [improve][ci] Upgrade GitHub Actions workflows to use ubuntu-24.04 (#24841)
* [1f9e89efc4a](https://github.com/datastax/pulsar/commit/1f9e89efc4a) [fix][client] Fix getPendingQueueSize for PartitionedTopicProducerStatsRecorderImpl: avoid NPE and implement aggregation (#24830)
* [a50f0793ef2](https://github.com/datastax/pulsar/commit/a50f0793ef2) [fix] Fix mixed lookup/partition metadata requests causing reliability issues and incorrect responses (#24832)
* [60d09034c92](https://github.com/datastax/pulsar/commit/60d09034c92) [fix][client] Make auto partitions update work for old brokers without PIP-344 (#24822)
* [cd1e8f15b49](https://github.com/datastax/pulsar/commit/cd1e8f15b49) [fix][build] Remove invalid profile in settings.xml that caused gpg signing to fail (#24812)
* [b1a01b6c5a4](https://github.com/datastax/pulsar/commit/b1a01b6c5a4) [fix][broker] Flaky-test: ExtensibleLoadManagerImplTest.testDisableBroker (#24770)
* [ce3f2e3ba5f](https://github.com/datastax/pulsar/commit/ce3f2e3ba5f) Bump org.apache.zookeeper:zookeeper from 3.9.3 to 3.9.4 (#24779)
* [cde090c5a38](https://github.com/datastax/pulsar/commit/cde090c5a38) [fix][misc] Fix compareTo contract violation for NamespaceBundleStats, TimeAverageMessageData and ResourceUnitRanking (#24772)
* [22e6c98fa46](https://github.com/datastax/pulsar/commit/22e6c98fa46) [fix][test] Flaky-test: BrokerServiceTest.testShutDownWithMaxConcurrentUnload (#24769)
* [82291c2dd68](https://github.com/datastax/pulsar/commit/82291c2dd68) [fix][ci] Fix CI for Java 25 including upgrade of Gradle Develocity Maven extension (#24767)
* [2ef4418265a](https://github.com/datastax/pulsar/commit/2ef4418265a) [improve][build] Upgrade Lombok to 1.18.42 to fully support JDK25 (#24763)
* [e101000e678](https://github.com/datastax/pulsar/commit/e101000e678) [improve][broker] If there is a deadlock in the service, the probe should return a failure because the service may be unavailable (#23634)
* [6e3fe8d34d8](https://github.com/datastax/pulsar/commit/6e3fe8d34d8) [fix][broker] First entry will be skipped if opening NonDurableCursor while trimmed ledger is adding first entry. (#24738)
* [8dce5f99c57](https://github.com/datastax/pulsar/commit/8dce5f99c57) [fix][ml]Fix EOFException after enabled topics offloading (#24753)

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|---------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.14  | cassandra-enhanced-pulsar-sink-1.6.14-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.4   | pulsar-io-cloud-storage-3.2.4.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.20 | pulsar-io-data-generator-3.1.4.20.nar          |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.20 | pulsar-io-elastic-search-3.1.4.20.nar          |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.20 | pulsar-io-http-3.1.4.20.nar                    |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.20 | pulsar-io-jdbc-clickhouse-3.1.4.20.nar         |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.20 | pulsar-io-jdbc-mariadb-3.1.4.20.nar            |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.20 | pulsar-io-jdbc-openmldb-3.1.4.20.nar           |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.20 | pulsar-io-jdbc-postgres-3.1.4.20.nar           |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.20 | pulsar-io-jdbc-sqlite-3.1.4.20.nar             |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.20 | pulsar-io-kafka-3.1.4.20.nar                   |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.20 | pulsar-io-kinesis-3.1.4.20.nar                 |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.2.1  | pulsar-snowflake-connector-0.2.1.nar         |
| [lakehouse](https://github.com/streamnative/pulsar-io-lakehouse)         | Lakehouse Connector                                                                                          | 3.3.3.1 | pulsar-io-lakehouse-3.3.3.1.nar               |
| [lakehouse-cloud](https://github.com/streamnative/pulsar-io-lakehouse)   | Lakehouse Cloud Connector                                                                                    | 3.3.3.1 | pulsar-io-lakehouse-3.3.3.1-cloud.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version | File                                    |
|--------------------------------------------------------------------------|--------------------------------------|---------|-----------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.3.1   | pulsar-cassandra-source-2.3.1.nar       |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.20 | pulsar-io-data-generator-3.1.4.20.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.20 | pulsar-io-debezium-mongodb-3.1.4.20.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.20 | pulsar-io-debezium-mssql-3.1.4.20.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.20 | pulsar-io-debezium-mysql-3.1.4.20.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.20 | pulsar-io-debezium-oracle-3.1.4.20.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.20 | pulsar-io-debezium-postgres-3.1.4.20.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.20 | pulsar-io-kafka-3.1.4.20.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.20 | pulsar-io-kinesis-3.1.4.20.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.5  | pulsar-kafka-proxy-3.1.0.5.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version  | File                                      |
|----------------------------------------------------------------|----------------------------------------|----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.5  | pulsar-protocol-handler-kafka-3.1.0.5.nar |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.3.2   | pulsar-cassandra-admin-2.3.2-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 6.0.6   | pulsar-jms-admin-6.0.6-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 6.0.6   | pulsar-jms-6.0.6-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.2.1   | pulsar-ai-tools-3.2.1.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.2.1   | pulsar-transformations-3.2.1.nar |
</details>


## Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls_3.1.4_19/build.json) used for the build


### Builtin connectors

- cassandra-enhanced-pulsar-sink-1.6.14-nar.nar
- pulsar-cassandra-source-2.3.2.nar
- pulsar-io-cloud-storage-3.2.4.nar
- pulsar-io-debezium-mongodb-3.1.4.20.nar 
- pulsar-io-jdbc-sqlite-3.1.4.20.nar
- pulsar-io-kinesis-3.1.4.20.nar
- pulsar-io-data-generator-3.1.4.20.nar
- pulsar-io-elastic-search-3.1.4.20.nar
- pulsar-io-jdbc-clickhouse-3.1.4.20.nar
- pulsar-io-debezium-oracle-3.1.4.20.nar
- pulsar-io-jdbc-openmldb-3.1.4.20.nar
- pulsar-io-jdbc-postgres-3.1.4.20.nar
- pulsar-io-debezium-mssql-3.1.4.20.nar
- pulsar-io-debezium-mysql-3.1.4.20.nar
- pulsar-io-jdbc-mariadb-3.1.4.20.nar
- pulsar-io-debezium-postgres-3.1.4.20.nar
- pulsar-io-http-3.1.4.20.nar
- pulsar-io-kafka-3.1.4.20.nar 
- pulsar-snowflake-connector-0.2.1.nar
- pulsar-protocol-handler-kafka-3.1.0.5.nar
- starlight-rabbitmq-2.10.1.1.nar
- pulsar-kafka-proxy-3.1.0.5.nar
- pulsar-jms-6.0.6-nar.nar

## Luna Streaming Distribution 3.1 4.19
This maintenance release of the DataStax Luna Streaming Distribution for 3.1 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

### Most notable commits

* [58c31d9](https://github.com/datastax/pulsar/commit/58c31d9) [fix][broker][branch-3.0] Prevent NPE in ownedBundlesCountPerNamespace on first bundle load (#24758)
* [c5fa5e1](https://github.com/datastax/pulsar/commit/c5fa5e1) [fix][client] rollback TopicListWatcher retry behavior (#24752)
* [fbc362c](https://github.com/datastax/pulsar/commit/fbc362c) [fix][client]TopicListWatcher not closed when calling PatternMultiTopicsConsumerImpl.closeAsync() method (#24698)
* [a511567](https://github.com/datastax/pulsar/commit/a511567) Dispatcher did unnecessary sort for recentlyJoinedConsumers and printed noisy error logs (#24634)
* [a91b54c](https://github.com/datastax/pulsar/commit/a91b54c) [fix][broker] Ensure KeyShared sticky mode consumer respects assigned ranges (#24730)
* [1b5aecd](https://github.com/datastax/pulsar/commit/1b5aecd) [fix][client] Fix receiver queue auto-scale without memory limit (#24743)
* [c3d2ba6](https://github.com/datastax/pulsar/commit/c3d2ba6) [fix][broker] Fix cannot shutdown broker gracefully by admin api (#24731)
* [10be3b4](https://github.com/datastax/pulsar/commit/10be3b4) [fix][io] Improve Kafka Connect source offset flushing logic (#24654)
* [561fd91](https://github.com/datastax/pulsar/commit/561fd91) [fix][client] Avoid recycling the same ConcurrentBitSetRecyclable among different threads (#24725)
* [6d8f641](https://github.com/datastax/pulsar/commit/6d8f641) [fix][broker] Fix memory leak when metrics are updated in a thread other than FastThreadLocalThread (#24719)
* [ca51b8e](https://github.com/datastax/pulsar/commit/ca51b8e) [improve][build] Disable javadoc build failure (#24594)
* [5803123](https://github.com/datastax/pulsar/commit/5803123) [fix][broker]Fix never recovered metadata store bad version issue if received a large response from ZK (#24580)
* [f1ab4ca](https://github.com/datastax/pulsar/commit/f1ab4ca) [fix][sec] Upgrade Netty to 4.1.127.Final to address CVEs (#24717)
* [e1ae3d4](https://github.com/datastax/pulsar/commit/e1ae3d4) [fix][client] Fix ArrayIndexOutOfBoundsException when using SameAuthParamsLookupAutoClusterFailover (#23336)
* [8a53387](https://github.com/datastax/pulsar/commit/8a53387) LS-1362 : added zkCli in bin directory
* [286632c](https://github.com/datastax/pulsar/commit/286632c) Fix groupId in pulsar-io-kinesis-kpl-shaded module, remove redundant import & fixes.
* [42449b5](https://github.com/datastax/pulsar/commit/42449b5) [fix][broker] Invalid regex in PulsarLedgerManager causes zk data notification to be ignored (#23977)
* [c81d40d](https://github.com/datastax/pulsar/commit/c81d40d) [fix][broker][branch-3.0] Fix wrong backlog age metrics when the mark delete position point to a deleted ledger (#24518) (#24671)
* [4de3181](https://github.com/datastax/pulsar/commit/4de3181) [fix][build] Import isNotBlank
* [9090e0b](https://github.com/datastax/pulsar/commit/9090e0b) [fix][client] Skip schema validation when sending messages to DLQ to avoid infinite loop when schema validation fails on an incoming message (#24663)
* [461bd2b](https://github.com/datastax/pulsar/commit/461bd2b) [improve][io] Support specifying Kinesis KPL native binary path with 1.0 version specific path (#24669)
* [9f3001a](https://github.com/datastax/pulsar/commit/9f3001a) [improve][build] Use org.apache.nifi:nifi-nar-maven-plugin:2.1.0 with skipDocGeneration=true (#24668)
* [e6e5319](https://github.com/datastax/pulsar/commit/e6e5319) [improve][io] Upgrade AWS SDK v1 & v2, Kinesis KPL and KPC versions (#24661)
* [808613b](https://github.com/datastax/pulsar/commit/808613b) [fix][broker] Fix race condition in MetadataStoreCacheLoader causing inconsistent availableBroker list caching (#24639)
* [d01f8d1](https://github.com/datastax/pulsar/commit/d01f8d1) [improve][build] Increase maven resolver's sync context timeout (#24666)
* [95719c3](https://github.com/datastax/pulsar/commit/95719c3) [fix][client] fix ArrayIndexOutOfBoundsException in SameAuthParamsLookupAutoClusterFailover (#24662)
* [f116b0e](https://github.com/datastax/pulsar/commit/f116b0e) [fix][offload] Exclude unnecessary dependencies from tiered storage provider / offloader nar files (#24649)
* [4e131d3](https://github.com/datastax/pulsar/commit/4e131d3) [fix][sec] Upgrade bouncycastle bcpkix-fips version to 1.79 to address CVE-2025-8916 (#24650)
* [45a087b](https://github.com/datastax/pulsar/commit/45a087b) [fix][broker] Add double-check for non-durable cursor creation (#24643)
* [9c91038](https://github.com/datastax/pulsar/commit/9c91038) [fix][sec] Upgrade to Netty 4.1.124.Final to address CVE-2025-55163 (#24637)
* [da49b1f](https://github.com/datastax/pulsar/commit/da49b1f) [fix][test]fix flaky ZeroQueueSizeTest.testZeroQueueGetExceptionWhenReceiveBatchMessage (#24633)
* [aabcec4](https://github.com/datastax/pulsar/commit/aabcec4) [fix][test] Fix ConcurrentModificationException in Ipv4Proxy (#24632)
* [3cedeab](https://github.com/datastax/pulsar/commit/3cedeab) [fix][test]fix flaky ZeroQueueSizeTest.testZeroQueueGetExceptionWhenReceiveBatchMessage (#24630)
* [de3ad1d](https://github.com/datastax/pulsar/commit/de3ad1d) [fix][proxy] Fix TooLongFrameException with Pulsar Proxy (#24626)
* [76ca811](https://github.com/datastax/pulsar/commit/76ca811) [fix][broker] Fix duplicate watcher registration after SessionReestablished (#24621)
* [ffd0427](https://github.com/datastax/pulsar/commit/ffd0427) [fix][client]Prevent ZeroQueueConsumer from receiving batch messages when using MessagePayloadProcessor (#24610)
* [41e1e3e](https://github.com/datastax/pulsar/commit/41e1e3e) [improve][io] Add dependency file name information to error message when .nar file validation fails with ZipException (#24604)
* [4ef8a75](https://github.com/datastax/pulsar/commit/4ef8a75) [improve][broker] Optimize and clean up aggregation of topic stats (#21361)
* [c47eae2](https://github.com/datastax/pulsar/commit/c47eae2) [improve][doc] Improve the JavaDocs of sendAsync to avoid improper use (#24601)
* [7c42d74](https://github.com/datastax/pulsar/commit/7c42d74) [fix][client] Retry for unknown exceptions when creating a producer or consumer (#24599)
* [24a93bc](https://github.com/datastax/pulsar/commit/24a93bc) [fix][broker] Fix REST API to produce messages to single-partitioned topics (#24450)
* [8e3effa](https://github.com/datastax/pulsar/commit/8e3effa) [fix][ci] Fix code coverage metrics in Pulsar CI (#24595)
* [4f49406](https://github.com/datastax/pulsar/commit/4f49406) [improve][client] Support load RSA PKCS#8 private key (#24582)
* [741ecaf](https://github.com/datastax/pulsar/commit/741ecaf) [improve][test] Add test for dead letter topic with max unacked messages blocking (#24535)
* [bd3cf47](https://github.com/datastax/pulsar/commit/bd3cf47) [fix][misc] Upgrade dependencies to fix critical security vulnerabilities (#24532)
* [efb51e6](https://github.com/datastax/pulsar/commit/efb51e6) [improve][build] Bump org.apache.commons:commons-lang3 from 3.17.0 to 3.18.0 (#24514)
* [8859ba6](https://github.com/datastax/pulsar/commit/8859ba6) [improve][test] Refactor the way way pulsar-io-debezium-oracle nar file is patched when building the test image (#24586)
* [19a2888](https://github.com/datastax/pulsar/commit/19a2888) [fix][broker] Fix flaky testReplicatorsInflightTaskListIsEmptyAfterReplicationFinished (#24590)

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|---------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.14  | cassandra-enhanced-pulsar-sink-1.6.14-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.4   | pulsar-io-cloud-storage-3.2.4.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.19 | pulsar-io-data-generator-3.1.4.19.nar          |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.19 | pulsar-io-elastic-search-3.1.4.19.nar          |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.19 | pulsar-io-http-3.1.4.19.nar                    |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.19 | pulsar-io-jdbc-clickhouse-3.1.4.19.nar         |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.19 | pulsar-io-jdbc-mariadb-3.1.4.19.nar            |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.19 | pulsar-io-jdbc-openmldb-3.1.4.19.nar           |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.19 | pulsar-io-jdbc-postgres-3.1.4.19.nar           |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.19 | pulsar-io-jdbc-sqlite-3.1.4.19.nar             |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.19 | pulsar-io-kafka-3.1.4.19.nar                   |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.19 | pulsar-io-kinesis-3.1.4.19.nar                 |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.2.1  | pulsar-snowflake-connector-0.2.1.nar         |
| [lakehouse](https://github.com/streamnative/pulsar-io-lakehouse)         | Lakehouse Connector                                                                                          | 3.3.3.1 | pulsar-io-lakehouse-3.3.3.1.nar               |
| [lakehouse-cloud](https://github.com/streamnative/pulsar-io-lakehouse)   | Lakehouse Cloud Connector                                                                                    | 3.3.3.1 | pulsar-io-lakehouse-3.3.3.1-cloud.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version | File                                    |
|--------------------------------------------------------------------------|--------------------------------------|---------|-----------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.3.1   | pulsar-cassandra-source-2.3.1.nar       |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.19 | pulsar-io-data-generator-3.1.4.19.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.19 | pulsar-io-debezium-mongodb-3.1.4.19.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.19 | pulsar-io-debezium-mssql-3.1.4.19.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.19 | pulsar-io-debezium-mysql-3.1.4.19.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.19 | pulsar-io-debezium-oracle-3.1.4.19.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.19 | pulsar-io-debezium-postgres-3.1.4.19.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.19 | pulsar-io-kafka-3.1.4.19.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.19 | pulsar-io-kinesis-3.1.4.19.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.4  | pulsar-kafka-proxy-3.1.0.4.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version  | File                                      |
|----------------------------------------------------------------|----------------------------------------|----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.4  | pulsar-protocol-handler-kafka-3.1.0.4.nar |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.3.2   | pulsar-cassandra-admin-2.3.2-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 6.0.6   | pulsar-jms-admin-6.0.6-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 6.0.6   | pulsar-jms-6.0.6-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.2.1   | pulsar-ai-tools-3.2.1.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.2.1   | pulsar-transformations-3.2.1.nar |
</details>


## Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls_3.1.4_19/build.json) used for the build


### Builtin connectors

- cassandra-enhanced-pulsar-sink-1.6.14-nar.nar
- pulsar-cassandra-source-2.3.2.nar
- pulsar-io-cloud-storage-3.2.4.nar
- pulsar-io-debezium-mongodb-3.1.4.19.nar 
- pulsar-io-jdbc-sqlite-3.1.4.19.nar
- pulsar-io-kinesis-3.1.4.19.nar
- pulsar-io-data-generator-3.1.4.19.nar
- pulsar-io-elastic-search-3.1.4.19.nar
- pulsar-io-jdbc-clickhouse-3.1.4.19.nar
- pulsar-io-debezium-oracle-3.1.4.19.nar
- pulsar-io-jdbc-openmldb-3.1.4.19.nar
- pulsar-io-jdbc-postgres-3.1.4.19.nar
- pulsar-io-debezium-mssql-3.1.4.19.nar
- pulsar-io-debezium-mysql-3.1.4.19.nar
- pulsar-io-jdbc-mariadb-3.1.4.19.nar
- pulsar-io-debezium-postgres-3.1.4.19.nar
- pulsar-io-http-3.1.4.19.nar
- pulsar-io-kafka-3.1.4.19.nar 
- pulsar-snowflake-connector-0.2.1.nar
- pulsar-protocol-handler-kafka-3.1.0.4.nar
- starlight-rabbitmq-2.10.1.1.nar
- pulsar-kafka-proxy-3.1.0.4.nar
- pulsar-jms-6.0.6-nar.nar


## Luna Streaming Distribution 3.1 4.18
This maintenance release of the DataStax Luna Streaming Distribution for 3.1 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

### Most notable commits
* [86a5ff5ed46](https://github.com/datastax/pulsar/commit/86a5ff5ed46) Release 3.1.4.18
* [3f69c8d9cd1](https://github.com/datastax/pulsar/commit/3f69c8d9cd1) Revert "[fix][broker]Fix thread safety issues in BucketDelayedDeliveryTracker with StampedLock optimistic reads (#24542)"
* [af0cf6715d1](https://github.com/datastax/pulsar/commit/af0cf6715d1) [fix][client][branch-4.0] Partitioned topics are unexpectedly created by client after deletion (#24554) (#24571)
* [b3508cefdbf](https://github.com/datastax/pulsar/commit/b3508cefdbf) [fix][test] fix flaky GrowableArrayBlockingQueueTest.testPollBlockingThreadsTermination (#24576)
* [5d1a856ee4d](https://github.com/datastax/pulsar/commit/5d1a856ee4d) [fix][broker] Fix ManagedCursor state management race conditions and lifecycle issues (#24569)
* [2ef2e4b15d9](https://github.com/datastax/pulsar/commit/2ef2e4b15d9) [improve][client] Terminate consumer.receive() when consumer is closed (#24550)
* [c8a35e2c7cb](https://github.com/datastax/pulsar/commit/c8a35e2c7cb) fix cherry-pick: corrected imports and removed unwanted ones
* [be32a296c86](https://github.com/datastax/pulsar/commit/be32a296c86) [fix][sec] Upgrade Kafka connector and clients version to 3.9.1 to address CVE-2025-27818 (#24564)
* [3853b407c48](https://github.com/datastax/pulsar/commit/3853b407c48) [improve][build] replace org.apache.commons.lang to org.apache.commons.lang3 (#24473)
* [f4f5ce5374c](https://github.com/datastax/pulsar/commit/f4f5ce5374c) [fix][broker] Fix maxTopicsPerNamespace might report a false failure (#24560)
* [8171c687e5f](https://github.com/datastax/pulsar/commit/8171c687e5f) [fix][test]fix flaky test BrokerServiceAutoTopicCreationTest.testDynamicConfigurationTopicAutoCreationPartitioned (#24505)
* [df2d8ec62c8](https://github.com/datastax/pulsar/commit/df2d8ec62c8) [fix] Prevent IllegalStateException: Field 'message' is not set (#24472)
* [0a46b222c6a](https://github.com/datastax/pulsar/commit/0a46b222c6a) [fix][broker]Fix thread safety issues in BucketDelayedDeliveryTracker with StampedLock optimistic reads (#24542)
* [5dbad4e7831](https://github.com/datastax/pulsar/commit/5dbad4e7831) [fix][broker] Fix Broker OOM due to too many waiting cursors and reuse a recycled OpReadEntry incorrectly (#24551)
* [55676cf0a92](https://github.com/datastax/pulsar/commit/55676cf0a92) [fix][broker] Fix deduplication replay might never complete for exceptions (#24511)
* [88ee67b2285](https://github.com/datastax/pulsar/commit/88ee67b2285) [fix][ml] Fix the possibility of message loss or disorder when ML PayloadProcessor processing fails (#24522)
* [e76eefdd4d5](https://github.com/datastax/pulsar/commit/e76eefdd4d5) [fix][test][branch-3.0] Correct topic policy loading logic and improve related tests (#24451)
* [17f1275d498](https://github.com/datastax/pulsar/commit/17f1275d498) [improve][test] Remove EntryCacheCreator from ManagedLedgerFactoryImpl (#24552)
* [978af706dac](https://github.com/datastax/pulsar/commit/978af706dac) fix cherry-pick: fixed check style issues and modified code as per existing class
* [f59b6e967ad](https://github.com/datastax/pulsar/commit/f59b6e967ad) [improve][io] Add support for the complete KinesisProducerConfiguration in KinesisSinkConfig (#24489)
* [26fd41b90fc](https://github.com/datastax/pulsar/commit/26fd41b90fc) [fix][sec] Upgrade pulsar-function-go dependencies to address CVE-2025-22868 (#24547)
* [1724692c388](https://github.com/datastax/pulsar/commit/1724692c388) [improve] Upgrade pulsar-client-python to 3.8.0 in Docker image (#24544)
* [c52a4c0d8d2](https://github.com/datastax/pulsar/commit/c52a4c0d8d2) [fix][broker] Fix exclusive producer creation when last shared producer closes (#24516)
* [c522e8bd624](https://github.com/datastax/pulsar/commit/c522e8bd624) [fix][broker] Fix duplicate increment of ADD_OP_COUNT_UPDATER in OpAddEntry (#24506)
* [0bd2df4b3f3](https://github.com/datastax/pulsar/commit/0bd2df4b3f3) [fix][broker] Fix matching of topicsPattern for topic names which contain non-ascii characters (#24543)
* [c56eb8953ca](https://github.com/datastax/pulsar/commit/c56eb8953ca) [fix][client] Close orphan producer or consumer when the creation is interrupted (#24539)
* [fb828f0cc07](https://github.com/datastax/pulsar/commit/fb828f0cc07) [fix][client] Fix ClientCnx handleSendError NPE (#24517)
* [053d5415c9f](https://github.com/datastax/pulsar/commit/053d5415c9f) [fix][ml] Fix asyncReadEntries might never complete if empty entries are read from BK (#24515)
* [5789899f9a6](https://github.com/datastax/pulsar/commit/5789899f9a6) fix cherry-pick: deleted empty file
* [1b55f20b7d8](https://github.com/datastax/pulsar/commit/1b55f20b7d8) fix cherry-pick: imported assertTrue
* [cd407df7500](https://github.com/datastax/pulsar/commit/cd407df7500) [improve][broker][branch-3.0] Upgrade BookKeeper to 4.16.7
* [9adf0378fa3](https://github.com/datastax/pulsar/commit/9adf0378fa3) [fix][ci][branch-3.0] Fix issue in GitHub Actions when /etc/docker/daemon.json file doesn't exist
* [bdfb3a759ff](https://github.com/datastax/pulsar/commit/bdfb3a759ff) [improve][misc] Optimize topic list hashing so that potentially large String allocation is avoided (#24525)
* [2e8904c45e2](https://github.com/datastax/pulsar/commit/2e8904c45e2) [fix][client] Fix issue in auto releasing of idle connection with topics pattern consumer (#24528)
* [03b4b4c13bf](https://github.com/datastax/pulsar/commit/03b4b4c13bf) [improve][test][branch-3.0] Backport MockedPulsarServiceBaseTest.registerCloseable to branch-3.0
* [d45c6d0e353](https://github.com/datastax/pulsar/commit/d45c6d0e353) [fix][proxy] Fix default value of connectionMaxIdleSeconds in Pulsar Proxy (#24529)
* [1bb0bc14283](https://github.com/datastax/pulsar/commit/1bb0bc14283) [fix][client] NPE in MultiTopicsConsumerImpl.negativeAcknowledge (#24476)
* [57b319f1497](https://github.com/datastax/pulsar/commit/57b319f1497) [fix][proxy] Fix proxy OOM by replacing TopicName with a simple conversion method (#24465)
* [f107d158e34](https://github.com/datastax/pulsar/commit/f107d158e34) [fix][test] Move ExtensibleLoadManagerImplTest to flaky tests (#22495)
* [b9471959779](https://github.com/datastax/pulsar/commit/b9471959779) [fix][test] Fix flaky test SimpleProducerConsumerStatTest#testPartitionTopicStats (#21642)
* [92441847c3e](https://github.com/datastax/pulsar/commit/92441847c3e) [improve][broker]Rmove unused imports
* [8353108572c](https://github.com/datastax/pulsar/commit/8353108572c) [fix][broker] Fix the non-persistenttopic's replicator always get error "Producer send queue is full" if set a small value of the config replicationProducerQueueSize (#24424)
* [fee35e15add](https://github.com/datastax/pulsar/commit/fee35e15add) [fix][broker]excessive replication speed leads to error: Producer send queue is full (#24189)
* [1b99324c8fd](https://github.com/datastax/pulsar/commit/1b99324c8fd) [Fix][broker] Limit replication rate based on bytes (#22674)
* [4c4de8433aa](https://github.com/datastax/pulsar/commit/4c4de8433aa) [fix][broker] Fix ack hole in cursor for geo-replication (#20931)
* [626d5afa0ec](https://github.com/datastax/pulsar/commit/626d5afa0ec) [fix][txn] Fix negative unacknowledged messages in transactions by ensuring that the batch size is added into CommandAck (#24443)


### `lunastreaming-all` distribution
<details><summary>CLI extensions</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- | 
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands | 2.3.2 | pulsar-cassandra-admin-2.3.2-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - Pulsar Admin Custom Commands | 6.0.5 | pulsar-jms-admin-6.0.5-nar.nar |
</details>

<details><summary>Filters</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- | 
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 6.0.5 | pulsar-jms-6.0.5-nar.nar |
</details>

<details><summary>Protocol handlers</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- | 
| [kafka](https://github.com/datastax/starlight-for-kafka) | Kafka Protocol Handler | 3.1.0.4 | pulsar-protocol-handler-kafka-3.1.0.4.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar |
</details>

<details><summary>Proxy extensions</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- | 
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar |
| [kafka](https://github.com/datastax/starlight-for-kafka) | Kafka Proxy Extension | 3.1.0.4 | pulsar-kafka-proxy-3.1.0.4.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar |
</details>

<details><summary>Sinks</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- | 
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink) | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.14 | cassandra-enhanced-pulsar-sink-1.6.14-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage | 3.2.4 | pulsar-io-cloud-storage-3.2.4.nar |
| [data-generator](https://pulsar.apache.org/docs/io-connectors) | Test data generator source | 3.1.4.18 | pulsar-io-data-generator-3.1.4.18.nar |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors) | Writes data into Elastic Search | 3.1.4.18 | pulsar-io-elastic-search-3.1.4.18.nar |
| [http](https://pulsar.apache.org/docs/io-connectors) | Writes data to an HTTP server (Webhook) | 3.1.4.18 | pulsar-io-http-3.1.4.18.nar |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for ClickHouse | 3.1.4.18 | pulsar-io-jdbc-clickhouse-3.1.4.18.nar |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for MariaDB | 3.1.4.18 | pulsar-io-jdbc-mariadb-3.1.4.18.nar |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for OpenMLDB | 3.1.4.18 | pulsar-io-jdbc-openmldb-3.1.4.18.nar |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for PostgreSQL | 3.1.4.18 | pulsar-io-jdbc-postgres-3.1.4.18.nar |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for SQLite | 3.1.4.18 | pulsar-io-jdbc-sqlite-3.1.4.18.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors) | Kafka source and sink connector | 3.1.4.18 | pulsar-io-kafka-3.1.4.18.nar |
| [kinesis](https://pulsar.apache.org/docs/io-connectors) | Kinesis connectors | 3.1.4.18 | pulsar-io-kinesis-3.1.4.18.nar |
| [lakehouse](https://pulsar.apache.org/docs/io-connectors) | Lakehouse connectors | 3.3.3.1 | pulsar-io-lakehouse-3.3.3.1-cloud.nar |
| [snowflake](https://github.com/datastax/snowflake-connector) | Snowflake Connector | 0.2.1 | pulsar-snowflake-connector-0.2.1.nar |
</details>

<details><summary>Sources</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- | 
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra | 2.3.2 | pulsar-cassandra-source-2.3.2.nar |
| [data-generator](https://pulsar.apache.org/docs/io-connectors) | Test data generator source | 3.1.4.18 | pulsar-io-data-generator-3.1.4.18.nar |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors) | Debezium MongoDb Source | 3.1.4.18 | pulsar-io-debezium-mongodb-3.1.4.18.nar |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors) | Debezium Microsoft SQL Server Source | 3.1.4.18 | pulsar-io-debezium-mssql-3.1.4.18.nar |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors) | Debezium MySql Source | 3.1.4.18 | pulsar-io-debezium-mysql-3.1.4.18.nar |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors) | Debezium Oracle Source | 3.1.4.18 | pulsar-io-debezium-oracle-3.1.4.18.nar |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors) | Debezium Postgres Source | 3.1.4.18 | pulsar-io-debezium-postgres-3.1.4.18.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors) | Kafka source and sink connector | 3.1.4.18 | pulsar-io-kafka-3.1.4.18.nar |
| [kinesis](https://pulsar.apache.org/docs/io-connectors) | Kinesis connectors | 3.1.4.18 | pulsar-io-kinesis-3.1.4.18.nar |
| [lakehouse](https://pulsar.apache.org/docs/io-connectors) | Lakehouse connectors | 3.3.3.1 | pulsar-io-lakehouse-3.3.3.1-cloud.nar |
</details>

<details><summary>Functions</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- | 
| [ai-tools](https://pulsar.apache.org/docs/io-connectors) | Generative AI tools | 3.2.1 | pulsar-ai-tools-3.2.1.nar |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.2.1 | pulsar-transformations-3.2.1.nar |
</details>

### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/release/ls31/build.json) used for the build.


## Luna Streaming Distribution 3.1 4.17
This maintenance release of the DataStax Luna Streaming Distribution for 3.1 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

### Most notable commits
* [5c6816825c1](https://github.com/datastax/pulsar/commit/5c6816825c1) [fix][ml] Enhance OpFindNewest to support skip non-recoverable data (#24441)
* [bb3c0279df3](https://github.com/datastax/pulsar/commit/bb3c0279df3) [improve][broker] change to warn log level for ack validation error (#24459)
* [bfaa79364b2](https://github.com/datastax/pulsar/commit/bfaa79364b2) [improve][broker] Improve the log when namespace bundle is not available (#24434)
* [acd3a247915](https://github.com/datastax/pulsar/commit/acd3a247915) Remove unused imports
* [47f63a3fe77](https://github.com/datastax/pulsar/commit/47f63a3fe77) Remove unnecessary .get() call due to method returning Bookkeeper directly
* [a10e9c87ee1](https://github.com/datastax/pulsar/commit/a10e9c87ee1) [fix][ml]Still got BK ledger, even though it has been deleted after offloaded (#24432)
* [5f7fec3e8b5](https://github.com/datastax/pulsar/commit/5f7fec3e8b5) [fix][test] Cleanup resources if starting PulsarService fails in PulsarTestContext (#21467)
* [dfb797f4963](https://github.com/datastax/pulsar/commit/dfb797f4963) [improve][broker] Deny removing local cluster from topic level replicated cluster policy (#24351)
* [e08aca0d6a2](https://github.com/datastax/pulsar/commit/e08aca0d6a2) [fix][broker] Once the cluster is configured incorrectly, the broker maintains the incorrect cluster configuration even if you removed it (#24419)
* [fc91996afd7](https://github.com/datastax/pulsar/commit/fc91996afd7) [fix][client] Prevent NPE when seeking with null topic in TopicMessageId (#24404)
* [4e7d63f0f2b](https://github.com/datastax/pulsar/commit/4e7d63f0f2b) [fix][ml]Received more than once callback when calling cursor.delete (#24405)
* [bf515f31ee6](https://github.com/datastax/pulsar/commit/bf515f31ee6) [fix][ml] Cursor ignores the position that has an empty ack-set if disabled deletionAtBatchIndexLevelEnabled (#24406)
* [58bcfda9215](https://github.com/datastax/pulsar/commit/58bcfda9215) [fix][txn] Fix deadlock when loading transaction buffer snapshot (#24401)
* [9ca3fac3236](https://github.com/datastax/pulsar/commit/9ca3fac3236) [fix][client] Fix some potential resource leak (#24402)
* [957727794e4](https://github.com/datastax/pulsar/commit/957727794e4) [fix][build] Fix potential insufficient protostuff-related configs (#21629)
* [afe545e4804](https://github.com/datastax/pulsar/commit/afe545e4804) Fix codestyle in RawReaderTest
* [49ab382a0e7](https://github.com/datastax/pulsar/commit/49ab382a0e7) Update LICENSE to reflect Netty 4.1.122.Final upgrade
* [24f193e3e40](https://github.com/datastax/pulsar/commit/24f193e3e40) [improve][misc] Upgrade Netty to 4.1.122.Final and tcnative to 2.0.72.Final (#24397)
* [90dc1cc6a80](https://github.com/datastax/pulsar/commit/90dc1cc6a80) [fix] [broker] No longer allow creating subscription that contains slash (#23594)
* [4b71a198d81](https://github.com/datastax/pulsar/commit/4b71a198d81) remove unnecessary codes
* [7080537bc4b](https://github.com/datastax/pulsar/commit/7080537bc4b) [fix][broker]Fix deadlock when compaction and topic deletion execute concurrently (#24366)
* [bfa6aebb60f](https://github.com/datastax/pulsar/commit/bfa6aebb60f) [fix][broker] Fix issue that topic policies was deleted after a sub topic deleted, even if the partitioned topic still exists (#24350)
* [5289b49691e](https://github.com/datastax/pulsar/commit/5289b49691e) [fix][ml]Revert a behavior change of releasing idle offloaded ledger handle: only release idle BlobStoreBackedReadHandle (#24384)
* [42b0f812f17](https://github.com/datastax/pulsar/commit/42b0f812f17) [improve][broker] Add managedCursor/LedgerInfoCompressionType settings to broker.conf (#24391)
* [36a80aef747](https://github.com/datastax/pulsar/commit/36a80aef747) [improve][broker] Make maxBatchDeletedIndexToPersist configurable and document other related configs (#24392)
* [ce43873fbd8](https://github.com/datastax/pulsar/commit/ce43873fbd8) [improve][broker] Added synchronized for sendMessages in Non-Persistent message dispatchers (#24386)
* [b1cf8966f23](https://github.com/datastax/pulsar/commit/b1cf8966f23) [improve][ml]Release idle offloaded read handle only the ref count is 0 (#24381)
* [9a61ae5549c](https://github.com/datastax/pulsar/commit/9a61ae5549c) [fix][broker] expose consumer name for partitioned topic stats (#24360)
* [8e8127b3b1a](https://github.com/datastax/pulsar/commit/8e8127b3b1a) [improve][broker]Improve the log when encountered in-flight read limitation (#24359)
* [33f615f2893](https://github.com/datastax/pulsar/commit/33f615f2893) [fix][io] Acknowledge RabbitMQ message after processing the message successfully (#24354)
* [63141fc3398](https://github.com/datastax/pulsar/commit/63141fc3398) [fix][broker] Ignore metadata changes when broker is not in the Started state (#24352)
* [b04ac1b4dd2](https://github.com/datastax/pulsar/commit/b04ac1b4dd2) [fix][broker] Resolve the issue of frequent updates in message expiration deletion rate (#24190)
* [a4219c215c4](https://github.com/datastax/pulsar/commit/a4219c215c4) [fix][ml] Fix ManagedCursorImpl.individualDeletedMessages concurrent issue (#24338)
* [37937ee7f29](https://github.com/datastax/pulsar/commit/37937ee7f29) [fix][offload] Complete the future outside of the reading loop in BlobStoreBackedReadHandleImplV2.readAsync (#24331)
* [3bff0a49125](https://github.com/datastax/pulsar/commit/3bff0a49125) [fix][test] Fix flaky AutoScaledReceiverQueueSizeTest.testNegativeClientMemory (#24324)
* [6fb1d58eb6c](https://github.com/datastax/pulsar/commit/6fb1d58eb6c) [fix][io] Fix kinesis avro bytes handling (#24316)
* [c8becf917e0](https://github.com/datastax/pulsar/commit/c8becf917e0) Fix checkstyle errors after previous cherry-picks
* [f5a282ebe91](https://github.com/datastax/pulsar/commit/f5a282ebe91) [improve][ml] Offload ledgers without check ledger length (#24344)
* [adacd4d773c](https://github.com/datastax/pulsar/commit/adacd4d773c) [fix][broker]Non-global topic policies and global topic policies overwrite each other (#24286)
* [5d50b2eb65f](https://github.com/datastax/pulsar/commit/5d50b2eb65f) [fix][broker]Global topic policies do not affect after unloading topic and persistence global topic policies never affect (#24279)
* [2c3fddf6de0](https://github.com/datastax/pulsar/commit/2c3fddf6de0) remove unused import
* [b0d1f917113](https://github.com/datastax/pulsar/commit/b0d1f917113) [fix][broker]fix memory leak, messages lost, incorrect replication state if using multiple schema versions(auto_produce) (#24178)
* [9249813b5b1](https://github.com/datastax/pulsar/commit/9249813b5b1) [fix][io][branch-3.0] Backport Kinesis Sink custom native executable support #23762 (#24349)
* [3e5be18ff76](https://github.com/datastax/pulsar/commit/3e5be18ff76) [fix][io][branch-3.0]Pulsar-SQL: Fix classcast ex when decode decimal value (#24317)
* [919f62bf37e](https://github.com/datastax/pulsar/commit/919f62bf37e) [fix][broker] Fix potential deadlock when creating partitioned topic (#24313)
* [71822595a5e](https://github.com/datastax/pulsar/commit/71822595a5e) [fix][broker] fix wrong method name checkTopicExists. (#24293)
* [3ab7965b2c9](https://github.com/datastax/pulsar/commit/3ab7965b2c9) [fix][build] Ensure that buildtools is Java 8 compatible and fix remaining compatibility issue (#24307)
* [507be8e6d0a](https://github.com/datastax/pulsar/commit/507be8e6d0a) [fix][test] Simplify BetweenTestClassesListenerAdapter and fix issue with BeforeTest/AfterTest annotations (#24304)


### `lunastreaming-all` distribution
<details><summary>CLI extensions</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- | 
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands | 2.3.1 | pulsar-cassandra-admin-2.3.1-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - Pulsar Admin Custom Commands | 6.0.5 | pulsar-jms-admin-6.0.5-nar.nar |
</details>

<details><summary>Filters</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- | 
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 6.0.5 | pulsar-jms-6.0.5-nar.nar |
</details>

<details><summary>Protocol handlers</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- | 
| [kafka](https://github.com/datastax/starlight-for-kafka) | Kafka Protocol Handler | 3.1.0.4 | pulsar-protocol-handler-kafka-3.1.0.4.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar |
</details>

<details><summary>Proxy extensions</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- | 
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar |
| [kafka](https://github.com/datastax/starlight-for-kafka) | Kafka Proxy Extension | 3.1.0.4 | pulsar-kafka-proxy-3.1.0.4.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar |
</details>

<details><summary>Sinks</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- | 
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink) | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.14 | cassandra-enhanced-pulsar-sink-1.6.14-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage | 3.2.4 | pulsar-io-cloud-storage-3.2.4.nar |
| [data-generator](https://pulsar.apache.org/docs/io-connectors) | Test data generator source | 3.1.4.17 | pulsar-io-data-generator-3.1.4.17.nar |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors) | Writes data into Elastic Search | 3.1.4.17 | pulsar-io-elastic-search-3.1.4.17.nar |
| [http](https://pulsar.apache.org/docs/io-connectors) | Writes data to an HTTP server (Webhook) | 3.1.4.17 | pulsar-io-http-3.1.4.17.nar |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for ClickHouse | 3.1.4.17 | pulsar-io-jdbc-clickhouse-3.1.4.17.nar |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for MariaDB | 3.1.4.17 | pulsar-io-jdbc-mariadb-3.1.4.17.nar |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for OpenMLDB | 3.1.4.17 | pulsar-io-jdbc-openmldb-3.1.4.17.nar |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for PostgreSQL | 3.1.4.17 | pulsar-io-jdbc-postgres-3.1.4.17.nar |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for SQLite | 3.1.4.17 | pulsar-io-jdbc-sqlite-3.1.4.17.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors) | Kafka source and sink connector | 3.1.4.17 | pulsar-io-kafka-3.1.4.17.nar |
| [kinesis](https://pulsar.apache.org/docs/io-connectors) | Kinesis connectors | 3.1.4.17 | pulsar-io-kinesis-3.1.4.17.nar |
| [lakehouse](https://pulsar.apache.org/docs/io-connectors) | Lakehouse connectors | 3.3.3.1 | pulsar-io-lakehouse-3.3.3.1-cloud.nar |
| [snowflake](https://github.com/datastax/snowflake-connector) | Snowflake Connector | 0.2.1 | pulsar-snowflake-connector-0.2.1.nar |
</details>

<details><summary>Sources</summary>

| Name                                                                     | Description | Version | File | 
| ------------------------------------------------------------------------ | ----------- | ------- | ---- | 
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra | 2.3.1 | pulsar-cassandra-source-2.3.1.nar |
| [data-generator](https://pulsar.apache.org/docs/io-connectors) | Test data generator source | 3.1.4.17 | pulsar-io-data-generator-3.1.4.17.nar |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors) | Debezium MongoDb Source | 3.1.4.17 | pulsar-io-debezium-mongodb-3.1.4.17.nar |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors) | Debezium Microsoft SQL Server Source | 3.1.4.17 | pulsar-io-debezium-mssql-3.1.4.17.nar |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors) | Debezium MySql Source | 3.1.4.17 | pulsar-io-debezium-mysql-3.1.4.17.nar |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors) | Debezium Oracle Source | 3.1.4.17 | pulsar-io-debezium-oracle-3.1.4.17.nar |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors) | Debezium Postgres Source | 3.1.4.17 | pulsar-io-debezium-postgres-3.1.4.17.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors) | Kafka source and sink connector | 3.1.4.17 | pulsar-io-kafka-3.1.4.17.nar |
| [kinesis](https://pulsar.apache.org/docs/io-connectors) | Kinesis connectors | 3.1.4.17 | pulsar-io-kinesis-3.1.4.17.nar |
| [lakehouse](https://pulsar.apache.org/docs/io-connectors) | Lakehouse connectors | 3.3.3.1 | pulsar-io-lakehouse-3.3.3.1-cloud.nar |
</details>

<details><summary>Functions</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- | 
| [ai-tools](https://pulsar.apache.org/docs/io-connectors) | Generative AI tools | 3.2.1 | pulsar-ai-tools-3.2.1.nar |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.2.1 | pulsar-transformations-3.2.1.nar |
</details>

### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/release/ls31/build.json) used for the build.

## Luna Streaming Distribution 3.1 4.16
This maintenance release of the DataStax Luna Streaming Distribution for 3.1 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

### Most notable commits

* [e7962d8](https://github.com/datastax/pulsar/commit/e7962d8) testAvroToJson test fix
* [f87e880](https://github.com/datastax/pulsar/commit/f87e880) Licence check fix. Removed unused import
* [32236fe](https://github.com/datastax/pulsar/commit/32236fe) Fix Kinesis AVRO BYTES handling The AVRO codec uses ByteBuffer for the BYTES schema and not byte[]
* [b0b4d80](https://github.com/datastax/pulsar/commit/b0b4d80) [improve][io] Add configuration parameter for disabling aggregation for Kinesis Producers (#24289)
* [fd46979](https://github.com/datastax/pulsar/commit/fd46979) [improve] [broker] Separate offload read and write thread pool (#24025)
* [67df47b](https://github.com/datastax/pulsar/commit/67df47b) [fix][client] Fix producer publishing getting stuck after message with incompatible schema is discarded (#24282)
* [980d215](https://github.com/datastax/pulsar/commit/980d215) [improve] Upgrade pulsar-client-python to 3.7.0 in Docker image (#24302)
* [1c9ae92](https://github.com/datastax/pulsar/commit/1c9ae92) [fix][test] Fix more Netty ByteBuf leaks in tests (#24299)
* [27935b9](https://github.com/datastax/pulsar/commit/27935b9) [fix][io] Fix SyntaxWarning in Pulsar Python functions (#24297)
* [f20c0f1](https://github.com/datastax/pulsar/commit/f20c0f1) [cleanup][test] Remove unused parameter from deleteNamespaceWithRetry method in MockedPulsarServiceBaseTest (#24283)
* [b5f0b8e](https://github.com/datastax/pulsar/commit/b5f0b8e) [improve][build] Upgrade zstd version from 1.5.2-3 to 1.5.7-3 (#24263)
* [8bd87fd](https://github.com/datastax/pulsar/commit/8bd87fd) [fix][test] Fix multiple ByteBuf leaks in tests (#24281)
* [ad70fbc](https://github.com/datastax/pulsar/commit/ad70fbc) [fix][broker] Fix HashedWheelTimer leak in PulsarService by stopping it in shutdown (#24275)
* [9143237](https://github.com/datastax/pulsar/commit/9143237) [fix][misc] Fix ByteBuf leak in SchemaUtils (#24274)
* [b0f5c2a](https://github.com/datastax/pulsar/commit/b0f5c2a) [fix][broker]Fix incorrect priority between topic policies and global topic policies (#24254)
* [6606e9c](https://github.com/datastax/pulsar/commit/6606e9c) [improve][ci] Disable detailed console logging for integration tests in CI (#24266)
* [b0cadf6](https://github.com/datastax/pulsar/commit/b0cadf6) [fix][test] Fix flaky ManagedCursorTest.testLastActiveAfterResetCursor and disable failing SchemaTest (#24261)
* [541e913](https://github.com/datastax/pulsar/commit/541e913) [fix][test] Fix flaky ManagedCursorTest.testSkipEntriesWithIndividualDeletedMessages (#24244)
* [f1b09ac](https://github.com/datastax/pulsar/commit/f1b09ac) [improve][io][kca] support fully-qualified topic names in source records (#24248)
* [3e9b72e](https://github.com/datastax/pulsar/commit/3e9b72e) [improve][build] Upgrade Gradle Develocity Maven Extension dependencies (#24260)
* [3557f9b](https://github.com/datastax/pulsar/commit/3557f9b) [fix][test] Fix TestNG BetweenTestClassesListenerAdapter listener (#24258)
* [702c8a8](https://github.com/datastax/pulsar/commit/702c8a8) [fix][broker] Unregister non-static metrics collectors registered in Prometheus default registry (#24257)
* [7e7ab9f](https://github.com/datastax/pulsar/commit/7e7ab9f) [fix][broker] Orphan schema after disabled a cluster for a namespace (#24223)
* [9d93892](https://github.com/datastax/pulsar/commit/9d93892) [improve][broker]Improve the feature "Optimize subscription seek (cursor reset) by timestamp": search less entries (#24219)
* [df4b70c](https://github.com/datastax/pulsar/commit/df4b70c) [fix][broker] Fix seeking by timestamp can be reset the cursor position to earliest (#23919)
* [839ab4a](https://github.com/datastax/pulsar/commit/839ab4a) [improve][broker] Optimize subscription seek (cursor reset) by timestamp (#22792)
* [42b5db2](https://github.com/datastax/pulsar/commit/42b5db2) [improve][build] Upgrade SpotBugs to 4.9.x (#24243)
* [96a570a](https://github.com/datastax/pulsar/commit/96a570a) [improve][build] Upgrade to jacoco 0.8.13 (#24240)
* [d4e835f](https://github.com/datastax/pulsar/commit/d4e835f) [improve][build] Upgrade Lombok to 1.18.38 to support JDK 24 (#24237)
* [3e5cd80](https://github.com/datastax/pulsar/commit/3e5cd80) [improve][io] support kafka connect transforms and predicates (#24221)
* [e075c76](https://github.com/datastax/pulsar/commit/e075c76) [fix][sec] Upgrade Jetty to 9.4.57.v20241219 to mitigate CVE-2024-6763 (#24232)
* [4315d08](https://github.com/datastax/pulsar/commit/4315d08) [improve][client]Improve transaction log when a TXN command timeout (#24230)


### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version  | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|----------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.14   | cassandra-enhanced-pulsar-sink-1.6.14-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.4    | pulsar-io-cloud-storage-3.2.4.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.16 | pulsar-io-data-generator-3.1.4.16.nar         |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.16 | pulsar-io-elastic-search-3.1.4.16.nar         |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.16 | pulsar-io-http-3.1.4.16.nar                   |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.16 | pulsar-io-jdbc-clickhouse-3.1.4.16.nar        |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.16 | pulsar-io-jdbc-mariadb-3.1.4.16.nar           |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.16 | pulsar-io-jdbc-openmldb-3.1.4.16.nar          |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.16 | pulsar-io-jdbc-postgres-3.1.4.16.nar          |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.16 | pulsar-io-jdbc-sqlite-3.1.4.16.nar            |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.16 | pulsar-io-kafka-3.1.4.16.nar                  |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.16 | pulsar-io-kinesis-3.1.4.16.nar                |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.2.1    | pulsar-snowflake-connector-0.2.1.nar          |
| [lakehouse](https://github.com/streamnative/pulsar-io-lakehouse)         | Lakehouse Connector                                                                                          | 3.3.1.6  | pulsar-io-lakehouse-3.3.1.6.nar               |
| [lakehouse-cloud](https://github.com/streamnative/pulsar-io-lakehouse)   | Lakehouse Cloud Connector                                                                                    | 3.3.1.6  | pulsar-io-lakehouse-3.3.1.6-cloud.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version  | File                                     |
|--------------------------------------------------------------------------|--------------------------------------|----------|------------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.3.1    | pulsar-cassandra-source-2.3.1.nar        |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.16 | pulsar-io-data-generator-3.1.4.16.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.16 | pulsar-io-debezium-mongodb-3.1.4.16.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.16 | pulsar-io-debezium-mssql-3.1.4.16.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.16 | pulsar-io-debezium-mysql-3.1.4.16.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.16 | pulsar-io-debezium-oracle-3.1.4.16.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.16 | pulsar-io-debezium-postgres-3.1.4.16.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.16 | pulsar-io-kafka-3.1.4.16.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.16 | pulsar-io-kinesis-3.1.4.16.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.4  | pulsar-kafka-proxy-3.1.0.4.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version  | File                                      |
|----------------------------------------------------------------|----------------------------------------|----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.4  | pulsar-protocol-handler-kafka-3.1.0.4.nar |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.3.1   | pulsar-cassandra-admin-2.3.1-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 6.0.5   | pulsar-jms-admin-6.0.5-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 6.0.5   | pulsar-jms-6.0.5-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.2.1   | pulsar-ai-tools-3.2.1.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.2.1   | pulsar-transformations-3.2.1.nar |
</details>


### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/release/ls31/build.json) used for the build.


## Luna Streaming Distribution 3.1 4.15
This maintenance release of the DataStax Luna Streaming Distribution for 3.1 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

### Most notable commits

* [04c8914](https://github.com/datastax/pulsar/commit/04c8914) Fix presto-distribution/LICENSE
* [9424527](https://github.com/datastax/pulsar/commit/9424527) Fix ByteBuf memory leak in REST API for publishing messages (#24228)
* [3518ee8](https://github.com/datastax/pulsar/commit/3518ee8) Fix incorrect producer.getPendingQueueSize due to incomplete queue implementation (#24184)
* [6af888b](https://github.com/datastax/pulsar/commit/6af888b) Upgrade Netty to 4.1.121.Final (#24214)
* [7975e58](https://github.com/datastax/pulsar/commit/7975e58) Fix flaky BatchMessageWithBatchIndexLevelTest.testBatchMessageAck (#24212)
* [d8cef80](https://github.com/datastax/pulsar/commit/d8cef80) Fix multiple resource leaks in tests (#24218)
* [07c87ff](https://github.com/datastax/pulsar/commit/07c87ff) Validate ClientConfigurationData earlier to avoid resource leaks (#24187)
* [baeac2c](https://github.com/datastax/pulsar/commit/baeac2c) Fix HealthChecker deadlock in shutdown (#24216)
* [99461b7](https://github.com/datastax/pulsar/commit/99461b7) Fix tenant creation and update with null value (#24209)
* [52325f6](https://github.com/datastax/pulsar/commit/52325f6) Backlog quota's policy is null which causes a NPE (#24192)
* [c10bc05](https://github.com/datastax/pulsar/commit/c10bc05) Fix broker shutdown delay by resolving hanging health checks (#24210)
* [d6d0c7c](https://github.com/datastax/pulsar/commit/d6d0c7c) Fix compaction service log's wrong condition (#24207)
* [2a281b2](https://github.com/datastax/pulsar/commit/2a281b2) Fix resource leaks in ProxyTest and fix invalid tests (#24204)
* [8781230](https://github.com/datastax/pulsar/commit/8781230) Upgrade Kafka client and compatible Confluent platform version (#24201)
* [1899cea](https://github.com/datastax/pulsar/commit/1899cea) Revert "[fix][broker] Add topic consistency check (#24118)"
* [a4bc50b](https://github.com/datastax/pulsar/commit/a4bc50b) Revert "[fix][broker] Directly query single topic existence when the topic is partitioned (#24154)"
* [c0ac76c](https://github.com/datastax/pulsar/commit/c0ac76c) Fix missing validation when setting retention policy on topic level (#24032)
* [1078142](https://github.com/datastax/pulsar/commit/1078142) Skip deleting cursor if it was already deleted before calling unsubscribe (#24098)
* [f3186ea](https://github.com/datastax/pulsar/commit/f3186ea) Modified test to use newConnect method & Getter for FeatureFlags obj in ServerCnx
* [1423151](https://github.com/datastax/pulsar/commit/1423151) Propagate client connection feature flags through Pulsar Proxy to Broker (#24158)
* [0f3859d](https://github.com/datastax/pulsar/commit/0f3859d) Reject unsupported Avro schema types during schema registration (#24103)
* [3ab24b2](https://github.com/datastax/pulsar/commit/3ab24b2) Fix some problems in calculate totalAvailableBookies in getExcludedBookiesWithIsolationGroups (#24091)
* [d1368ed](https://github.com/datastax/pulsar/commit/d1368ed) Fix the var name for IsolationGroups (#21320)
* [b9fef05](https://github.com/datastax/pulsar/commit/b9fef05) Use configured session timeout for MockZooKeeper and TestZKServer in PulsarTestContext (#24171)
* [84a7920](https://github.com/datastax/pulsar/commit/84a7920) Improve reliability of IncrementPartitionsTest (#24172)
* [72eb9ef](https://github.com/datastax/pulsar/commit/72eb9ef) Fix flaky test ManagedLedgerInterceptorImplTest.testManagedLedgerPayloadInputProcessorFailure (#24170)
* [214eca8](https://github.com/datastax/pulsar/commit/214eca8) Consumer stuck when delete subscription __compaction failed (#23980)
* [7d0c41f](https://github.com/datastax/pulsar/commit/7d0c41f) Fix ML thread blocking issue in internalGetPartitionedStats API (#24167)
* [2e3e5c5](https://github.com/datastax/pulsar/commit/2e3e5c5) Fix invalid test CompactionTest.testDeleteCompactedLedgerWithSlowAck (#24166)
* [f597fd4](https://github.com/datastax/pulsar/commit/f597fd4) The feature brokerDeleteInactivePartitionedTopicMetadataEnabled leaves orphan topic policies and topic schemas (#24150)
* [52b352c](https://github.com/datastax/pulsar/commit/52b352c) Directly query single topic existence when the topic is partitioned (#24154)
* [eea4946](https://github.com/datastax/pulsar/commit/eea4946) Add topic consistency check (#24118)
* [698628c](https://github.com/datastax/pulsar/commit/698628c) Update partitioned topic subscription assertions in IncrementPartitionsTest (#24056)
* [8bbd263](https://github.com/datastax/pulsar/commit/8bbd263) Add override annotation (#24033)
* [23898dd](https://github.com/datastax/pulsar/commit/23898dd) Revert "[cleanup][misc] Add override annotation (#24033)"
* [9ba415d](https://github.com/datastax/pulsar/commit/9ba415d) Add override annotation (#24033)
* [bc0ae57](https://github.com/datastax/pulsar/commit/bc0ae57) Fix flaky BrokerServiceChaosTest.testFetchPartitionedTopicMetadataWithCacheRefresh (#24161)
* [c0567df](https://github.com/datastax/pulsar/commit/c0567df) Fix flaky BrokerServiceChaosTest (#24162)
* [8bd16d0](https://github.com/datastax/pulsar/commit/8bd16d0) Topics infinitely failed to delete after removing cluster from replicated clusters (#24097)
* [115b5a8](https://github.com/datastax/pulsar/commit/115b5a8) Upgrade jwt/v5 to 5.2.2 to address CVE-2025-30204 (#24140)
* [7beefa6](https://github.com/datastax/pulsar/commit/7beefa6) Upgrade pulsar-function-go dependencies to address CVE-2025-22870 (#24135)
* [76537df](https://github.com/datastax/pulsar/commit/76537df) Bump google.golang.org/protobuf from 1.32.0 to 1.33.0 in /pulsar-function-go (#22261)
* [fd1e3bb](https://github.com/datastax/pulsar/commit/fd1e3bb) Fix KinesisSink json flattening for AVRO's SchemaType.BYTES (#24132)
* [ec5af37](https://github.com/datastax/pulsar/commit/ec5af37) Fixed the groupId for tests modules

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version  | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|----------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.14   | cassandra-enhanced-pulsar-sink-1.6.14-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.4    | pulsar-io-cloud-storage-3.2.4.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.15 | pulsar-io-data-generator-3.1.4.15.nar         |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.15 | pulsar-io-elastic-search-3.1.4.15.nar         |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.15 | pulsar-io-http-3.1.4.15.nar                   |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.15 | pulsar-io-jdbc-clickhouse-3.1.4.15.nar        |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.15 | pulsar-io-jdbc-mariadb-3.1.4.15.nar           |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.15 | pulsar-io-jdbc-openmldb-3.1.4.15.nar          |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.15 | pulsar-io-jdbc-postgres-3.1.4.15.nar          |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.15 | pulsar-io-jdbc-sqlite-3.1.4.15.nar            |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.15 | pulsar-io-kafka-3.1.4.15.nar                  |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.15 | pulsar-io-kinesis-3.1.4.15.nar                |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.2.1    | pulsar-snowflake-connector-0.2.1.nar          |
| [lakehouse](https://github.com/streamnative/pulsar-io-lakehouse)         | Lakehouse Connector                                                                                          | 3.3.1.6  | pulsar-io-lakehouse-3.3.1.6.nar               |
| [lakehouse-cloud](https://github.com/streamnative/pulsar-io-lakehouse)   | Lakehouse Cloud Connector                                                                                    | 3.3.1.6  | pulsar-io-lakehouse-3.3.1.6-cloud.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version  | File                                     |
|--------------------------------------------------------------------------|--------------------------------------|----------|------------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.3.1    | pulsar-cassandra-source-2.3.1.nar        |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.15 | pulsar-io-data-generator-3.1.4.15.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.15 | pulsar-io-debezium-mongodb-3.1.4.15.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.15 | pulsar-io-debezium-mssql-3.1.4.15.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.15 | pulsar-io-debezium-mysql-3.1.4.15.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.15 | pulsar-io-debezium-oracle-3.1.4.15.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.15 | pulsar-io-debezium-postgres-3.1.4.15.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.15 | pulsar-io-kafka-3.1.4.15.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.15 | pulsar-io-kinesis-3.1.4.15.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.4  | pulsar-kafka-proxy-3.1.0.4.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version  | File                                      |
|----------------------------------------------------------------|----------------------------------------|----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.1 | starlight-rabbitmq-2.10.1.1.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.4  | pulsar-protocol-handler-kafka-3.1.0.4.nar |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.3.1   | pulsar-cassandra-admin-2.3.1-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 6.0.4   | pulsar-jms-admin-6.0.4-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 6.0.4   | pulsar-jms-6.0.4-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.2.1   | pulsar-ai-tools-3.2.1.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.2.1   | pulsar-transformations-3.2.1.nar |
</details>


### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/release/ls31/build.json) used for the build.

## Luna Streaming Distribution 3.1 4.14
This maintenance release of the DataStax Luna Streaming Distribution for 3.1 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

### Most notable commits

* [735927b](https://github.com/datastax/pulsar/commit/735927b) [fix][ml] Return 1 when bytes size is 0 or negative for entry count estimation (#24131)
* [3836ee8](https://github.com/datastax/pulsar/commit/3836ee8) [improve][io] Enhance Kafka connector logging with focused bootstrap server information (#24128)
* [69b1f1c](https://github.com/datastax/pulsar/commit/69b1f1c) [fix][ml] Don't estimate number of entries when ledgers are empty, return 1 instead (#24125)
* [e7c4a66](https://github.com/datastax/pulsar/commit/e7c4a66) [improve][client] Prevent NullPointException when closing ClientCredentialsFlow (#24123)
* [321c8a4](https://github.com/datastax/pulsar/commit/321c8a4) [improve][io] Remove sleep when sourceTask.poll of kafka return null (#24124)
* [49566bc](https://github.com/datastax/pulsar/commit/49566bc) [improve][broker] Change topic exists log to warn (#24116)
* [07bc922](https://github.com/datastax/pulsar/commit/07bc922) [fix][client] Pattern subscription regression when broker-side evaluation is disabled (#24104)
* [6b97e8f](https://github.com/datastax/pulsar/commit/6b97e8f) [fix][client] Fix consumer leak when thread is interrupted before subscribe completes (#24100)
* [663e6bd](https://github.com/datastax/pulsar/commit/663e6bd) [fix][ml] Fix issues in estimateEntryCountBySize (#24089)
* [08afc82](https://github.com/datastax/pulsar/commit/08afc82) [improve][broker] Optimize message expiration rate repeated update issues (#24073)
* [3c5318d](https://github.com/datastax/pulsar/commit/3c5318d) [fix][ci] Bump dependency-check to 12.1.0 to fix OWASP Dependency Check job (#24083)
* [354466d](https://github.com/datastax/pulsar/commit/354466d) [clean][client] Clean code for the construction of retry/dead letter topic name (#24082)
* [9d52676](https://github.com/datastax/pulsar/commit/9d52676) [fix][broker] Fix NPE while publishing Metadata-Event with not init producer (#24079)
* [aa950d8](https://github.com/datastax/pulsar/commit/aa950d8) [fix][broker] Fix Metadata event synchronizer should not fail with bad version (#24080)
* [77b655f](https://github.com/datastax/pulsar/commit/77b655f) [fix][broker] Fix Metadata Event Synchronizer producer creation retry so that the producer gets created eventually (#24081)
* [bdf3df5](https://github.com/datastax/pulsar/commit/bdf3df5) [fix][broker] Fix UnsupportedOperationException while setting subscription level dispatch rate policy (#24048)
* [1cdaccc](https://github.com/datastax/pulsar/commit/1cdaccc) [fix][ml] Corrected pulsar_storage_size metric to not multiply offloaded storage by the write quorum (#24054)
* [f04964e](https://github.com/datastax/pulsar/commit/f04964e) [fix][broker] http metric endpoint get compaction latency stats always be 0 (#24067)
* [b1604c3](https://github.com/datastax/pulsar/commit/b1604c3) [improve][broker] Optimize ThresholdShedder with improved boundary checks and parameter reuse (#24064)
* [ab5237d](https://github.com/datastax/pulsar/commit/ab5237d) [fix] Avoid negative estimated entry count (#24055)
* [5ff986c](https://github.com/datastax/pulsar/commit/5ff986c) [improve][monitor] Add version=0.0.4 to /metrics content type for Prometheus 3.x compatibility (#24060)
* [ad5b14c](https://github.com/datastax/pulsar/commit/ad5b14c) [fix][client] Copy eventTime to retry letter topic and DLQ messages (#24059)
* [a087c6e](https://github.com/datastax/pulsar/commit/a087c6e) [fix][client] Fix building broken batched message when publishing (#24061)
* [8937af5](https://github.com/datastax/pulsar/commit/8937af5) [fix][broker] Fix failed consumption after loaded up a terminated topic (#24063)
* [cdf2a53](https://github.com/datastax/pulsar/commit/cdf2a53) [fix][broker] Pattern subscription doesn't work when the pattern excludes the topic domain. (#24072)
* [b5f08b5](https://github.com/datastax/pulsar/commit/b5f08b5) Fix presto LICENSE after Netty 4.1.119.Final upgrade
* [5dd4b8e](https://github.com/datastax/pulsar/commit/5dd4b8e) [improve] Upgrade Netty to 4.1.119.Final (#24049)
* [13fb338](https://github.com/datastax/pulsar/commit/13fb338) [fix][broker] Add expire check for replicator (#23975)
* [117b605](https://github.com/datastax/pulsar/commit/117b605) [fix][doc] fix doc related to chunk message feature. (#24023)

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version  | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|----------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.13   | cassandra-enhanced-pulsar-sink-1.6.13-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.2    | pulsar-io-cloud-storage-3.2.2.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.14 | pulsar-io-data-generator-3.1.4.14.nar         |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.14 | pulsar-io-elastic-search-3.1.4.14.nar         |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.14 | pulsar-io-http-3.1.4.14.nar                   |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.14 | pulsar-io-jdbc-clickhouse-3.1.4.14.nar        |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.14 | pulsar-io-jdbc-mariadb-3.1.4.14.nar           |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.14 | pulsar-io-jdbc-openmldb-3.1.4.14.nar          |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.14 | pulsar-io-jdbc-postgres-3.1.4.14.nar          |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.14 | pulsar-io-jdbc-sqlite-3.1.4.14.nar            |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.14 | pulsar-io-kafka-3.1.4.14.nar                  |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.14 | pulsar-io-kinesis-3.1.4.14.nar                |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.1.15   | pulsar-snowflake-connector-0.1.15.nar         |
| [lakehouse](https://github.com/streamnative/pulsar-io-lakehouse)         | Lakehouse Connector                                                                                          | 3.3.1.6  | pulsar-io-lakehouse-3.3.1.6.nar               |
| [lakehouse-cloud](https://github.com/streamnative/pulsar-io-lakehouse)   | Lakehouse Cloud Connector                                                                                    | 3.3.1.6  | pulsar-io-lakehouse-3.3.1.6-cloud.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version  | File                                     |
|--------------------------------------------------------------------------|--------------------------------------|----------|------------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.3.1    | pulsar-cassandra-source-2.3.1.nar        |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.14 | pulsar-io-data-generator-3.1.4.14.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.14 | pulsar-io-debezium-mongodb-3.1.4.14.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.14 | pulsar-io-debezium-mssql-3.1.4.14.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.14 | pulsar-io-debezium-mysql-3.1.4.14.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.14 | pulsar-io-debezium-oracle-3.1.4.14.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.14 | pulsar-io-debezium-postgres-3.1.4.14.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.14 | pulsar-io-kafka-3.1.4.14.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.14 | pulsar-io-kinesis-3.1.4.14.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.3  | pulsar-kafka-proxy-3.1.0.3.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version  | File                                      |
|----------------------------------------------------------------|----------------------------------------|----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.3  | pulsar-protocol-handler-kafka-3.1.0.3.nar |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.3.0   | pulsar-cassandra-admin-2.3.0-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 6.0.1   | pulsar-jms-admin-6.0.1-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 6.0.1   | pulsar-jms-6.0.1-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.2.0   | pulsar-ai-tools-3.2.0.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.2.0   | pulsar-transformations-3.2.0.nar |
</details>


### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls31_3.1/build.json) used for the build.

## Luna Streaming Distribution 3.1 4.13
This maintenance release of the DataStax Luna Streaming Distribution for 3.1 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

### Most notable commits

* [261d0d5](https://github.com/datastax/pulsar/commit/261d0d5) Revert "[fix][broker] Geo Replication lost messages or frequently fails due to Deduplication is not appropriate for Geo-Replication (#23697)"
* [561c833](https://github.com/datastax/pulsar/commit/561c833) [improve][ml] Use lock-free queue in InflightReadsLimiter since there's no concurrent access  (#23962)
* [457b580](https://github.com/datastax/pulsar/commit/457b580) [improve][cli] Support additional msg metadata for V1 topic on peek message cmd (#23978)
* [7e52b06](https://github.com/datastax/pulsar/commit/7e52b06) [fix][broker] Fix BucketDelayedDeliveryTracker thread safety (#24014)
* [8816923](https://github.com/datastax/pulsar/commit/8816923) [fix][test]Fix flaky test V1_ProducerConsumerTest.testConcurrentConsumerReceiveWhileReconnect (#24019)
* [8cbd802](https://github.com/datastax/pulsar/commit/8cbd802) [fix][test] Fix flaky test OneWayReplicatorUsingGlobalZKTest.testConfigReplicationStartAt (#24011)
* [adf4274](https://github.com/datastax/pulsar/commit/adf4274) [improve] [broker] Make the estimated entry size more accurate (#23931)
* [e313738](https://github.com/datastax/pulsar/commit/e313738) [improve][ci] Upgrade Gradle Develocity Maven Extension to 1.23.1 (#24004)
* [d794dd4](https://github.com/datastax/pulsar/commit/d794dd4) [fix][broker] Geo Replication lost messages or frequently fails due to Deduplication is not appropriate for Geo-Replication (#23697)
* [2a8931e](https://github.com/datastax/pulsar/commit/2a8931e) [fix][broker] fix broker identifying incorrect stuck topic (#24006)
* [b37569b](https://github.com/datastax/pulsar/commit/b37569b) [improve][broker] Fix non-persistent system topic schema compatibility (#23286)
* [59e90e6](https://github.com/datastax/pulsar/commit/59e90e6) [improve][fn] Set default tenant and namespace for ListFunctions cmd (#23881)
* [b697140](https://github.com/datastax/pulsar/commit/b697140) [fix][admin] Verify is policies read only before revoke permissions on topic (#23730)
* [cd8c2d9](https://github.com/datastax/pulsar/commit/cd8c2d9) [improve][test] Upgrade Testcontainers to 1.20.4 and docker-java to 3.4.0 (#24003)
* [3f5b080](https://github.com/datastax/pulsar/commit/3f5b080) Fix presto-distribution LICENSE
* [d2407fc](https://github.com/datastax/pulsar/commit/d2407fc) Removed update-datastax-license-version.sh & skip license check for datastax
* [6bde41a](https://github.com/datastax/pulsar/commit/6bde41a) [fix][client] fix retry topic with exclusive mode. (#23859)
* [05260b3](https://github.com/datastax/pulsar/commit/05260b3) [improve][meta] Simplify getting parent path in ZKMetadataStore without using java.io.File (#23996)
* [6302f09](https://github.com/datastax/pulsar/commit/6302f09) [fix][meta] Fix ephemeral handling of ZK nodes and fix MockZooKeeper ephemeral and ZK stat handling (#23988)
* [3982daf](https://github.com/datastax/pulsar/commit/3982daf) [fix][broker] Fix the retry mechanism in `MetadataCache#readModifyUpdateOrCreate` (#23686)
* [ff1ccba](https://github.com/datastax/pulsar/commit/ff1ccba) [fix][build] Add develops for buildtools (#23992)
* [d4395cb](https://github.com/datastax/pulsar/commit/d4395cb) [fix] fix for code scanning alert no. 48: Uncontrolled data used in path expression (#23985)
* [5d4a8b6](https://github.com/datastax/pulsar/commit/5d4a8b6) [fix][test] fix flaky testNegativeAcksWithBackoff when batch enabled. (#23986)
* [42496a5](https://github.com/datastax/pulsar/commit/42496a5) [improve] Validate user paths in Functions utils (#22833)
* [2c884db](https://github.com/datastax/pulsar/commit/2c884db) [fix][broker] fix broker may lost rack information (#23331)
* [53fd958](https://github.com/datastax/pulsar/commit/53fd958) [fix][meta] Fix ephemeral Zookeeper put which creates a persistent znode (#23984)
* [c915c9d](https://github.com/datastax/pulsar/commit/c915c9d) [fix][broker] Fix incorrect blockedConsumerOnUnackedMsgs value when maxUnackedMessagesPerConsumer is 1 (#23796)
* [314ecfe](https://github.com/datastax/pulsar/commit/314ecfe) [improve][proxy] Make keep-alive interval configurable in Pulsar Proxy (#23981)
* [9ea66d8](https://github.com/datastax/pulsar/commit/9ea66d8) [fix][io] Fix pulsar-io:pom not found (#23979)
* [23365f0](https://github.com/datastax/pulsar/commit/23365f0) [fix][client] Fix memory leak when message size exceeds max message size and batching is enabled (#23967)
* [81fd0e6](https://github.com/datastax/pulsar/commit/81fd0e6) [fix][client] Fix memory leak in ClientCnx.newLookup when there's TooManyRequestsException (#23971)
* [dd243c9](https://github.com/datastax/pulsar/commit/dd243c9) [fix] Bump org.apache.solr:solr-core from 8.11.3 to 9.8.0 in /pulsar-io/solr (#23899)
* [dc6a4b5](https://github.com/datastax/pulsar/commit/dc6a4b5) [improve][ci] Skip "OWASP dependency check" when data wasn't found in cache (#23970)
* [6049fc6](https://github.com/datastax/pulsar/commit/6049fc6) [fix][build] Upgrade json-smart to 2.5.2 (#23966)
* [6bb1c10](https://github.com/datastax/pulsar/commit/6bb1c10) [improve][broker] Avoid PersistentReplicator.expireMessages logic compute backlog twice (#23957)
* [6e9eb06](https://github.com/datastax/pulsar/commit/6e9eb06) [fix][ml] Fix memory leaks in ManagedCursorInfo and ManagedLedgerInfo decompression and compression (#23960)
* [f0091fb](https://github.com/datastax/pulsar/commit/f0091fb) [fix][sec] Upgrade to Netty 4.1.118 (#23965)
* [0a44d3b](https://github.com/datastax/pulsar/commit/0a44d3b) [fix][ml] Fix deadlock in PendingReadsManager (#23958)
* [3ba8a00](https://github.com/datastax/pulsar/commit/3ba8a00) [fix][client][branch-3.0] Fix cherry-pick issue in f6166c7
* [f106e37](https://github.com/datastax/pulsar/commit/f106e37) [fix] [ml] incorrect non-durable cursor's backlog due to concurrently trimming ledger and non-durable cursor creation (#23951)
* [b17a00a](https://github.com/datastax/pulsar/commit/b17a00a) [fix] [client] call redeliver 1 msg but did 2 msgs (#23943)
* [63b65a5](https://github.com/datastax/pulsar/commit/63b65a5) [fix][ml] Fix memory leak due to duplicated RangeCache value retain operations  (#23955)
* [7ba8163](https://github.com/datastax/pulsar/commit/7ba8163) [fix][ci][branch-3.0] Modify existing /etc/docker/daemon.json file if it exists
* [c9e5750](https://github.com/datastax/pulsar/commit/c9e5750) [feat][client] Support forward proxy for the ZTS server in pulsar-client-auth-athenz (#23947)
* [057099b](https://github.com/datastax/pulsar/commit/057099b) [improve][io] Allow skipping connector deployment (#23932)
* [26a990b](https://github.com/datastax/pulsar/commit/26a990b) [improve][broker] Avoid printing log for IncompatibleSchemaException in ServerCnx (#23938)
* [634666c](https://github.com/datastax/pulsar/commit/634666c) [improve][broker] Avoid logging errors when there is a connection issue during subscription. (#23939)
* [cbacd52](https://github.com/datastax/pulsar/commit/cbacd52) [improve][broker] Do not print error logs for NotFound or Conflict errors when using the Admin API (#23928)
* [de1bf0c](https://github.com/datastax/pulsar/commit/de1bf0c) [cleanup][admin] Do not print full stacktrace when get partitioned metadata not found (#20979)
* [b34ce5e](https://github.com/datastax/pulsar/commit/b34ce5e) [improve][broker] Don't print error logs for ProducerBusyException (#23929)
* [617cb71](https://github.com/datastax/pulsar/commit/617cb71) Cherry-pick #23935
* [86f1982](https://github.com/datastax/pulsar/commit/86f1982) [fix][broker] Closed topics won't be removed from the cache (#23884)
* [fecfdff](https://github.com/datastax/pulsar/commit/fecfdff) Revert "[fix][ci] Configure Docker data-root to /mnt/docker to avoid running out of disk space (#23909)"
* [e3774d7](https://github.com/datastax/pulsar/commit/e3774d7) [fix] Initialize UrlServiceProvider before trying to use transaction coordinator (#23914)
* [c0f9210](https://github.com/datastax/pulsar/commit/c0f9210) [fix] Avoid NPE when closing an uninitialized SameAuthParamsLookupAutoClusterFailover (#23911)
* [8d78269](https://github.com/datastax/pulsar/commit/8d78269) [fix][broker] Make InflightReadsLimiter asynchronous and apply it for replay queue reads (#23901)
* [f6d6d9e](https://github.com/datastax/pulsar/commit/f6d6d9e) [fix][ci] Configure Docker data-root to /mnt/docker to avoid running out of disk space (#23909)
* [511405a](https://github.com/datastax/pulsar/commit/511405a) [fix][broker Fix bug in RangeCache where different instance of the key wouldn't ever match (#23903)
* [2848554](https://github.com/datastax/pulsar/commit/2848554) [fix][test] Fix flaky DelayedDeliveryTest.testEnableTopicDelayedDelivery (#23893)
* [4549802](https://github.com/datastax/pulsar/commit/4549802) [fix][broker] Fix repeatedly acquired pending reads quota (#23869)
* [7da2753](https://github.com/datastax/pulsar/commit/7da2753) [fix][client] Fix LoadManagerReport not found (#23886)
* [d7eae6b](https://github.com/datastax/pulsar/commit/d7eae6b) [fix] [ml] Fix cursor metadata compatability issue when switching the config unackedRangesOpenCacheSetEnabled (#23759)
* [2bb2b12](https://github.com/datastax/pulsar/commit/2bb2b12) [fix][broker] Support large number of unack message store for cursor recovery (#9292)
* [b351f65](https://github.com/datastax/pulsar/commit/b351f65) [improve][broker] Support values up to 2^32 in ConcurrentBitmapSortedLongPairSet (#23878)
* [53f76b9](https://github.com/datastax/pulsar/commit/53f76b9) [improve][ci] Increase Maven max heap size to 2048M and tune GCLockerRetryAllocationCount (#23883)
* [c8eadc1](https://github.com/datastax/pulsar/commit/c8eadc1) [fix][test] Fix quiet time implementation in BrokerTestUtil.receiveMessages (#23876)
* [094f1ba](https://github.com/datastax/pulsar/commit/094f1ba) [improve][test] Add solution to PulsarMockBookKeeper for intercepting reads (#23875)
* [c7877a4](https://github.com/datastax/pulsar/commit/c7877a4) [improve][broker] Improve Consumer.equals performance (#23864)
* [0f22042](https://github.com/datastax/pulsar/commit/0f22042) [improve] Upgrade to Netty 4.1.117.Final (#23863)
* [bf6a33b](https://github.com/datastax/pulsar/commit/bf6a33b) [improve][broker] Remove spamming logs for customized managed ledger (#23862)
* [e64b4fa](https://github.com/datastax/pulsar/commit/e64b4fa) [revert][sql][branch-3.0] Revert invalid cherry-pick merge conflict resolution result
* [c85b987](https://github.com/datastax/pulsar/commit/c85b987) [fix][test] Add reconsumeLater call in RetryTopicTest#testRetryTopicWithMultiTopic. (#23857)
* [a9905c3](https://github.com/datastax/pulsar/commit/a9905c3) [fix][client] Orphan producer when concurrently calling producer closing and reconnection (#23853)
* [61e7e45](https://github.com/datastax/pulsar/commit/61e7e45) [fix][broker] Revert "[fix][broker] Cancel possible pending replay read in cancelPendingRead (#23384)" (#23855)
* [9c8d06b](https://github.com/datastax/pulsar/commit/9c8d06b) [improve][ci] Publish build scans to develocity.apache.org (#23851)
* [bd74e96](https://github.com/datastax/pulsar/commit/bd74e96) [fix][test]Fix flaky test testTopicUnloadAfterSessionRebuild (#23852)
* [bd864f4](https://github.com/datastax/pulsar/commit/bd864f4) [improve] Support overriding java.net.preferIPv4Stack with OPTS (#23846)
* [ea7775d](https://github.com/datastax/pulsar/commit/ea7775d) [fix][broker] PIP-399: Fix Metric Name for Delayed Queue (#23712)
* [f24b792](https://github.com/datastax/pulsar/commit/f24b792) [fix][broker] Fix possible mark delete NPE when batch index ack is enabled (#23833)
* [640bd52](https://github.com/datastax/pulsar/commit/640bd52) [fix] [broker] Fix acknowledgeCumulativeAsync block when ackReceipt is enabled (#23841)
* [2d3ca8d](https://github.com/datastax/pulsar/commit/2d3ca8d) [fix][misc] Honor dynamic log levels in log4j2.yaml (#23847)
* [5d7ce30](https://github.com/datastax/pulsar/commit/5d7ce30) [fix][broker] Remove blocking calls from internalGetPartitionedStats (#23832)
* [dcfbfe2](https://github.com/datastax/pulsar/commit/dcfbfe2) [fix][broker] Continue using the next provider for http authentication if one fails (#23842)

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version  | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|----------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.13   | cassandra-enhanced-pulsar-sink-1.6.13-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.2    | pulsar-io-cloud-storage-3.2.2.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.13 | pulsar-io-data-generator-3.1.4.13.nar         |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.13 | pulsar-io-elastic-search-3.1.4.13.nar         |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.13 | pulsar-io-http-3.1.4.13.nar                   |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.13 | pulsar-io-jdbc-clickhouse-3.1.4.13.nar        |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.13 | pulsar-io-jdbc-mariadb-3.1.4.13.nar           |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.13 | pulsar-io-jdbc-openmldb-3.1.4.13.nar          |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.13 | pulsar-io-jdbc-postgres-3.1.4.13.nar          |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.13 | pulsar-io-jdbc-sqlite-3.1.4.13.nar            |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.13 | pulsar-io-kafka-3.1.4.13.nar                  |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.13 | pulsar-io-kinesis-3.1.4.13.nar                |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.1.15   | pulsar-snowflake-connector-0.1.15.nar         |
| [lakehouse](https://github.com/streamnative/pulsar-io-lakehouse)         | Lakehouse Connector                                                                                          | 3.3.1.6  | pulsar-io-lakehouse-3.3.1.6.nar               |
| [lakehouse-cloud](https://github.com/streamnative/pulsar-io-lakehouse)   | Lakehouse Cloud Connector                                                                                    | 3.3.1.6  | pulsar-io-lakehouse-3.3.1.6-cloud.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version  | File                                     |
|--------------------------------------------------------------------------|--------------------------------------|----------|------------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.3.0    | pulsar-cassandra-source-2.3.0.nar        |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.13 | pulsar-io-data-generator-3.1.4.13.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.13 | pulsar-io-debezium-mongodb-3.1.4.13.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.13 | pulsar-io-debezium-mssql-3.1.4.13.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.13 | pulsar-io-debezium-mysql-3.1.4.13.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.13 | pulsar-io-debezium-oracle-3.1.4.13.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.13 | pulsar-io-debezium-postgres-3.1.4.13.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.13 | pulsar-io-kafka-3.1.4.13.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.13 | pulsar-io-kinesis-3.1.4.13.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.3  | pulsar-kafka-proxy-3.1.0.3.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version  | File                                      |
|----------------------------------------------------------------|----------------------------------------|----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.3  | pulsar-protocol-handler-kafka-3.1.0.3.nar |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.3.0   | pulsar-cassandra-admin-2.3.0-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 6.0.1   | pulsar-jms-admin-6.0.1-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 6.0.1   | pulsar-jms-6.0.1-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.2.0   | pulsar-ai-tools-3.2.0.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.2.0   | pulsar-transformations-3.2.0.nar |
</details>


### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls31_3.1/build.json) used for the build.

## Luna Streaming Distribution 3.1 4.12
This maintenance release of the DataStax Luna Streaming Distribution for 3.1 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

### Most notable commits


* [c390890](https://github.com/datastax/pulsar/commit/c390890) [improve][broker] Reduce unnecessary REPLICATED_SUBSCRIPTION_SNAPSHOT_REQUEST (#23839)  
* [dc3924d](https://github.com/datastax/pulsar/commit/dc3924d) [fix][client] Prevent retry topic and dead letter topic producer leaks when sending of message fails (#23824)  
* [0a87cd4](https://github.com/datastax/pulsar/commit/0a87cd4) [fix][test] Remove useless test code (#23823)  
* [7489004](https://github.com/datastax/pulsar/commit/7489004) [fix][broker] Remove failed OpAddEntry from pendingAddEntries (#23817)  
* [4d57ccd](https://github.com/datastax/pulsar/commit/4d57ccd) Flag renamed to isProducerFenced   
* [263ab46](https://github.com/datastax/pulsar/commit/263ab46) Improved API for function worker liveliness probe   
* [c9334f7](https://github.com/datastax/pulsar/commit/c9334f7) Renamed the API for function worker liveliness probe   
* [19b3d80](https://github.com/datastax/pulsar/commit/19b3d80) Renamed the API for function worker liveliness probe   
* [e17ae99](https://github.com/datastax/pulsar/commit/e17ae99) Updated the API for function worker readiness probe   
* [e6be5d6](https://github.com/datastax/pulsar/commit/e6be5d6) Added an API for function worker readiness probe   
* [0214ecd](https://github.com/datastax/pulsar/commit/0214ecd) [improve] Upgrade to Netty 4.1.116.Final and io_uring to 0.0.26.Final (#23813)  
* [e20c23d](https://github.com/datastax/pulsar/commit/e20c23d) [fix][admin] Fix exception thrown in getMessageId method (#23784)  
* [625af78](https://github.com/datastax/pulsar/commit/625af78) (#23666)  [fix][test]: Flaky-test: GetPartitionMetadataMultiBrokerTest.testCompatibilityDifferentBrokersForNonPersistentTopic 
[fix] [broker] Fix items in dispatcher.recentlyJoinedConsumers are out-of-order, which may cause a delivery stuck (#23802) [* 00d1e4e](https://github.com/datastax/pulsar/commit/00d1e4e)  
* [2f856db](https://github.com/datastax/pulsar/commit/2f856db) [fix][client][branch-3.0] Fix compatibility between kerberos and tls (#23801)  
* [b22764f](https://github.com/datastax/pulsar/commit/b22764f) Msg delivery is stuck due to items in the collection recentlyJoinedConsumers are out-of-order (#23795)  
* [4562079](https://github.com/datastax/pulsar/commit/4562079) [fix][broker] Skip to persist cursor info if it failed by cursor closed (#23615)  
* [3461070](https://github.com/datastax/pulsar/commit/3461070) [fix][client] Cannot access message data inside ProducerInterceptor#onSendAcknowledgement (#23791)  
* [3aeb922](https://github.com/datastax/pulsar/commit/3aeb922) [improve][log] Print ZK path if write to ZK fails due to data being too large to persist (#23652)  
* [0bf6a0d](https://github.com/datastax/pulsar/commit/0bf6a0d) [fix][client] Make DeadLetterPolicy & KeySharedPolicy serializable (#23718)  
* [bda60d9](https://github.com/datastax/pulsar/commit/bda60d9) [fix][broker] Continue using the next provider for authentication if one fails (#23797)  
* [89ce9a3](https://github.com/datastax/pulsar/commit/89ce9a3) Fix 'Make replicateSubscriptionState nullable' cherry-pick commit   
* [c261c83](https://github.com/datastax/pulsar/commit/c261c83) [fix][broker] Fix enableReplicatedSubscriptions (#23781)  
* [ecb3601](https://github.com/datastax/pulsar/commit/ecb3601) Fix cherry-pick err   
* [8d79588](https://github.com/datastax/pulsar/commit/8d79588) [improve][client] Make replicateSubscriptionState nullable (#23757)  
* [92e6f3c](https://github.com/datastax/pulsar/commit/92e6f3c) fix topic not found issue in ProxyAuthorizationWithoutImplicitPermissionOnSubscriptionTest   
* [6746cf1](https://github.com/datastax/pulsar/commit/6746cf1) [improve][admin] Opt-out of topic-existence check (#23709)  
* [e2f62de](https://github.com/datastax/pulsar/commit/e2f62de) [improve][admin] Check if the topic existed before the permission operations (#22742)  
* [f964d29](https://github.com/datastax/pulsar/commit/f964d29) [fix][admin] Fix can't delete tenant for v1 (#22550)  
* [d4ecfaf](https://github.com/datastax/pulsar/commit/d4ecfaf) [fix][ml] Topic load timeout due to ml data ledger future never finishes (#23772)  
* [32a8368](https://github.com/datastax/pulsar/commit/32a8368) [fix][admin] Fix exception loss in getMessageId method (#23766)  
* [3931435](https://github.com/datastax/pulsar/commit/3931435) [fix][client] Fix enableRetry for consumers using legacy topic naming where cluster name is included (#23753)  
* [f48227a](https://github.com/datastax/pulsar/commit/f48227a) [Fix][Client] Fix pending message not complete when closeAsync (#23761)  
* [807b2d7](https://github.com/datastax/pulsar/commit/807b2d7) [fix] [client] Fix memory leak when publishing encountered a corner case error (#23738)  
* [f985993](https://github.com/datastax/pulsar/commit/f985993) [fix][fn][branch-3.0] Fix pulsar-function-go compilation   
* [b3e9bf1](https://github.com/datastax/pulsar/commit/b3e9bf1) [fix][sec] Upgrade golang.org/x/crypto from 0.21.0 to 0.31.0 in pulsar-function-go (#23743)  
* [540beac](https://github.com/datastax/pulsar/commit/540beac) [improve][fn] Improve closing of producers in Pulsar Functions ProducerCache invalidation (#23734)  
[improve][fn] Improve implementation for maxPendingAsyncRequests async concurrency limit when return type is [* 981b3c9](https://github.com/datastax/pulsar/commit/981b3c9) CompletableFuture<Void> (#23708)  
* [c971c87](https://github.com/datastax/pulsar/commit/c971c87) [improve] Upgrade lombok to 1.18.36 (#23752)  
* [c943e4c](https://github.com/datastax/pulsar/commit/c943e4c) [fix][common] TopicName: Throw IllegalArgumentException if localName is whitespace only (#23691)  
* [8f32ad0](https://github.com/datastax/pulsar/commit/8f32ad0) [fix] [broker] fix NPE when calculating a topic's backlogQuota (#23720)  
* [41eb828](https://github.com/datastax/pulsar/commit/41eb828) [fix][sec] Upgrade async-http-client to 2.12.4 to address CVE-2024-53990 (#23732)  
* [a494df5](https://github.com/datastax/pulsar/commit/a494df5) [fix][doc] Refine ClientBuilder#memoryLimit and ConsumerBuilder#autoScaledReceiverQueueSizeEnabled javadoc (#23687)  
* [f3c98d0](https://github.com/datastax/pulsar/commit/f3c98d0) [fix][client] Fix wrong start message id when it's a chunked message id (#23713)  
* [9bbbc22](https://github.com/datastax/pulsar/commit/9bbbc22) [fix][sec] Mitigate CVE-2024-53990 by disabling AsyncHttpClient CookieStore (#23725)  
* [f48bce5](https://github.com/datastax/pulsar/commit/f48bce5) [fix] [broker] Fix config replicationStartAt does not work when set it to earliest (#23719)  
* [d5dfffb](https://github.com/datastax/pulsar/commit/d5dfffb) [fix][admin] Listen partitioned topic creation event (#23680)  
* [3e48d0c](https://github.com/datastax/pulsar/commit/3e48d0c) [fix][broker] Catch exception for entry payload interceptor processor (#23683)     
* [0eb3eba](https://github.com/datastax/pulsar/commit/0eb3eba) [fix][sec] Bump commons-io version to 2.18.0 (#23684)  
* [5106b7a](https://github.com/datastax/pulsar/commit/5106b7a) [improve][io] Bump io.lettuce:lettuce-core from 5.0.2.RELEASE to 6.5.1.RELEASE in /pulsar-io/redis (#23685)  
* [7401419](https://github.com/datastax/pulsar/commit/7401419) [fix] [broker] Add consumer name for subscription stats (#23671)  
* [2107bde](https://github.com/datastax/pulsar/commit/2107bde) [improve][build][branch-3.0] Upgrade docker-maven-plugin to 0.45.1   
* [4d3594d](https://github.com/datastax/pulsar/commit/4d3594d) [fix][sql][branch-3.0] Fix shading configuration for presto-pulsar   
* [890c880](https://github.com/datastax/pulsar/commit/890c880) [improve][client] Enhance error handling for non-exist subscription in consumer creation (#23254)  
* [3841aec](https://github.com/datastax/pulsar/commit/3841aec) [fix][client] Fix race-condition causing doReconsumeLater to hang when creating retryLetterProducer has failed (#23560)  
* [86be34a](https://github.com/datastax/pulsar/commit/86be34a) [improve][client] Reduce unshaded dependencies and shading warnings in shaded Java client modules (#23647)  
* [dae5063](https://github.com/datastax/pulsar/commit/dae5063) [fix][build] Fix error "Element encoding is not allowed here" in pom.xml (#23655)  
* [5109c99](https://github.com/datastax/pulsar/commit/5109c99) [fix][client] Fix deadlock of NegativeAcksTracker (#23651)  
* [fada0dc](https://github.com/datastax/pulsar/commit/fada0dc) [improve][broker] Decouple pulsar_storage_backlog_age_seconds metric with backlogQuota check (#23619)  
* [c41f783](https://github.com/datastax/pulsar/commit/c41f783) [improve][test] Reduce OneWayReplicatorUsingGlobalZKTest.testRemoveCluster execution time (#23633)  
* [db8b961](https://github.com/datastax/pulsar/commit/db8b961) [fix] [broker] Topics failed to delete after remove cluster from replicated clusters set and caused OOM (#23360)

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|---------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.13  | cassandra-enhanced-pulsar-sink-1.6.13-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.2   | pulsar-io-cloud-storage-3.2.2.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.12 | pulsar-io-data-generator-3.1.4.12.nar          |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.12 | pulsar-io-elastic-search-3.1.4.12.nar          |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.12 | pulsar-io-http-3.1.4.12.nar                    |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.12 | pulsar-io-jdbc-clickhouse-3.1.4.12.nar         |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.12 | pulsar-io-jdbc-mariadb-3.1.4.12.nar            |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.12 | pulsar-io-jdbc-openmldb-3.1.4.12.nar           |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.12 | pulsar-io-jdbc-postgres-3.1.4.12.nar           |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.12 | pulsar-io-jdbc-sqlite-3.1.4.12.nar             |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.12 | pulsar-io-kafka-3.1.4.12.nar                   |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.12 | pulsar-io-kinesis-3.1.4.12.nar                 |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.1.15  | pulsar-snowflake-connector-0.1.15.nar         |
| [lakehouse](https://github.com/streamnative/pulsar-io-lakehouse)         | Lakehouse Connector                                                                                          | 3.3.1.6 | pulsar-io-lakehouse-3.3.1.6.nar               |
| [lakehouse-cloud](https://github.com/streamnative/pulsar-io-lakehouse)   | Lakehouse Cloud Connector                                                                                    | 3.3.1.6 | pulsar-io-lakehouse-3.3.1.6-cloud.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version | File                                    |
|--------------------------------------------------------------------------|--------------------------------------|---------|-----------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.3.0   | pulsar-cassandra-source-2.3.0.nar       |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.12 | pulsar-io-data-generator-3.1.4.12.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.12 | pulsar-io-debezium-mongodb-3.1.4.12.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.12 | pulsar-io-debezium-mssql-3.1.4.12.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.12 | pulsar-io-debezium-mysql-3.1.4.12.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.12 | pulsar-io-debezium-oracle-3.1.4.12.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.12 | pulsar-io-debezium-postgres-3.1.4.12.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.12 | pulsar-io-kafka-3.1.4.12.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.12 | pulsar-io-kinesis-3.1.4.12.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.3  | pulsar-kafka-proxy-3.1.0.3.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version  | File                                      |
|----------------------------------------------------------------|----------------------------------------|----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.3  | pulsar-protocol-handler-kafka-3.1.0.3.nar |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.3.0   | pulsar-cassandra-admin-2.3.0-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 6.0.1   | pulsar-jms-admin-6.0.1-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 6.0.1   | pulsar-jms-6.0.1-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.2.0   | pulsar-ai-tools-3.2.0.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.2.0   | pulsar-transformations-3.2.0.nar |
</details>


### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls31_3.1/build.json) used for the build.

## Luna Streaming Distribution 3.1 4.11
This maintenance release of the DataStax Luna Streaming Distribution for 3.1 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

### Most notable commits

* [77bf9a0](https://github.com/datastax/pulsar/commit/77bf9a0) [improve][test] Increase java memory in mvn tests
* [89919b6](https://github.com/datastax/pulsar/commit/89919b6) [fix] Restored method as deprecated in AbstractMetadataStore (#21950)
* [896c27a](https://github.com/datastax/pulsar/commit/896c27a) [fix][client] Make protobuf-java dependency optional in java client libraries (#23632)
* [3294ec4](https://github.com/datastax/pulsar/commit/3294ec4) [improve] Use single buffer for metrics when noUnsafe use (#23612)
* [65effdf](https://github.com/datastax/pulsar/commit/65effdf) [fix][broker] fix null lookup result when brokers are starting (#23642)
* [c691742](https://github.com/datastax/pulsar/commit/c691742) [fix][client] Fixed an issue where a cert chain could not be used in TLS authentication (#23644)
* [89d241e](https://github.com/datastax/pulsar/commit/89d241e) [cleanup][build] skip generating pom.xml.versionsBackup (#23639)
* [4601478](https://github.com/datastax/pulsar/commit/4601478) [fix][client] Initializing client-authentication using configured auth params (#23610)
* [592b4b0](https://github.com/datastax/pulsar/commit/592b4b0) [fix][misc] Class conflict during jetcd-core-shaded shading process (#23641)
* [b19f676](https://github.com/datastax/pulsar/commit/b19f676) [fix][ws] Implement missing http header data functions in AuthenticationDataSubscription (#23638)
* [bd890c0](https://github.com/datastax/pulsar/commit/bd890c0) Revert "Revert "[improve][offload] Use filesystemURI as the storage path (#23591)""
* [7e58085](https://github.com/datastax/pulsar/commit/7e58085) [fix][test][branch-3.0] Fix PrecisTopicPublishRateThrottleTest that broke after #23589 changes
* [68d5c3b](https://github.com/datastax/pulsar/commit/68d5c3b) [improve][broker] Don't use forkjoin pool by default for deleting partitioned topics (#22598)
* [ef8f879](https://github.com/datastax/pulsar/commit/ef8f879) [improve][broker] Close TopicPoliciesService to allow Pulsar broker graceful shutdown (#22589)
* [ac9493c](https://github.com/datastax/pulsar/commit/ac9493c) [fix][broker] Continue closing even when executor is shut down (#22599)
* [d8577f1](https://github.com/datastax/pulsar/commit/d8577f1) [fix][client] fix incomingMessageSize and client memory usage is negative (#23624)
* [96f61bf](https://github.com/datastax/pulsar/commit/96f61bf) [fix][fn] ack messages for window function when its result is null (#23618)
* [c5dca5d](https://github.com/datastax/pulsar/commit/c5dca5d) [improve] Improve logic for enabling Netty leak detection (#23613)
* [14734cb](https://github.com/datastax/pulsar/commit/14734cb) [improve][ml] Avoid repetitive nested lock for isMessageDeleted in ManagedCursorImpl (#23609)
* [a10b0ee](https://github.com/datastax/pulsar/commit/a10b0ee) [improve][broker] PIP-392: Add configuration to enable consistent hashing to select active consumer for partitioned topic (#23584)
* [969b274](https://github.com/datastax/pulsar/commit/969b274) [fix][misc] Unable to connect an etcd metastore with recent releases due to jetc-core sharding problem (#23604)
* [5cdb297](https://github.com/datastax/pulsar/commit/5cdb297) [fix][broker] Fix failed TokenAuthenticatedProducerConsumerTest (#23602)
* [94f17a7](https://github.com/datastax/pulsar/commit/94f17a7) [fix][broker] Fix currently client retries until operation timeout if the topic does not exist (#23530)
* [08e1b62](https://github.com/datastax/pulsar/commit/08e1b62) Enabling DNS retryOnTimeout with TCP in DnsNameResolver (#23590)
* [5d11727](https://github.com/datastax/pulsar/commit/5d11727) [improve] [broker] replace HashMap with inner implementation ConcurrentLongLongPairHashMap in Negative Ack Tracker. (#23582)
* [ac6c19f](https://github.com/datastax/pulsar/commit/ac6c19f) [fix][sec] Upgrade to Netty 4.1.115.Final to address CVE-2024-47535 (#23596)
* [49d6d4d](https://github.com/datastax/pulsar/commit/49d6d4d) [fix][test][branch-3.0] Fix cherry-picking issue in 2f6c1a3 where Cleanup import was missing0f704e7](https://github.com/apache/pulsar/commit/0f704e7)
* [bd74b9d](https://github.com/datastax/pulsar/commit/bd74b9d) [fix][client] The partitionedProducer maxPendingMessages always is 0 (#23593)
* [c1398ef](https://github.com/datastax/pulsar/commit/c1398ef) [improve][broker] Support cleanup `replication cluster` and `allowed cluster` when cluster metadata teardown (#23561)
* [6024213](https://github.com/datastax/pulsar/commit/6024213) [improve][broker] Make cluster metadata teardown command support metadata config path (#23520)
* [442aa49](https://github.com/datastax/pulsar/commit/442aa49) [fix][sec] Upgrade Zookeeper to 3.9.3 to address CVE-2024-51504 (#23581)
* [9b38d72](https://github.com/datastax/pulsar/commit/9b38d72) [fix][broker] Broker is failing to create non-durable sub if topic is fenced (#23579)
* [7e221be](https://github.com/datastax/pulsar/commit/7e221be) [fix][client] fix the beforeConsume() method earlier hit with message listener (#23578)
* [92e11ec](https://github.com/datastax/pulsar/commit/92e11ec) [fix][test] Fix DeadLetterTopicTest.testDeadLetterTopicWithInitialSubscriptionAndMultiConsumers (#23552)
* [fcae9fc](https://github.com/datastax/pulsar/commit/fcae9fc) [fix][test] Fix SimpleProducerConsumerTest.testMultiTopicsConsumerImplPauseForManualSubscription (#23546)
* [97d5d9c](https://github.com/datastax/pulsar/commit/97d5d9c) [fix][test] Fix ExtensibleLoadManager integration test
* [fb47d9d](https://github.com/datastax/pulsar/commit/fb47d9d) [fix][broker] Allow broker deployment in heterogeneous hw config cluster without restricting nic speed detection (#21409)

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|---------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.13  | cassandra-enhanced-pulsar-sink-1.6.13-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.2   | pulsar-io-cloud-storage-3.2.2.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.11 | pulsar-io-data-generator-3.1.4.11.nar          |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.11 | pulsar-io-elastic-search-3.1.4.11.nar          |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.11 | pulsar-io-http-3.1.4.11.nar                    |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.11 | pulsar-io-jdbc-clickhouse-3.1.4.11.nar         |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.11 | pulsar-io-jdbc-mariadb-3.1.4.11.nar            |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.11 | pulsar-io-jdbc-openmldb-3.1.4.11.nar           |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.11 | pulsar-io-jdbc-postgres-3.1.4.11.nar           |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.11 | pulsar-io-jdbc-sqlite-3.1.4.11.nar             |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.11 | pulsar-io-kafka-3.1.4.11.nar                   |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.11 | pulsar-io-kinesis-3.1.4.11.nar                 |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.1.15  | pulsar-snowflake-connector-0.1.15.nar         |
| [lakehouse](https://github.com/streamnative/pulsar-io-lakehouse)         | Lakehouse Connector                                                                                          | 3.3.1.6 | pulsar-io-lakehouse-3.3.1.6.nar               |
| [lakehouse-cloud](https://github.com/streamnative/pulsar-io-lakehouse)   | Lakehouse Cloud Connector                                                                                    | 3.3.1.6 | pulsar-io-lakehouse-3.3.1.6-cloud.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version | File                                    |
|--------------------------------------------------------------------------|--------------------------------------|---------|-----------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.3.0   | pulsar-cassandra-source-2.3.0.nar       |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.11 | pulsar-io-data-generator-3.1.4.11.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.11 | pulsar-io-debezium-mongodb-3.1.4.11.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.11 | pulsar-io-debezium-mssql-3.1.4.11.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.11 | pulsar-io-debezium-mysql-3.1.4.11.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.11 | pulsar-io-debezium-oracle-3.1.4.11.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.11 | pulsar-io-debezium-postgres-3.1.4.11.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.11 | pulsar-io-kafka-3.1.4.11.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.11 | pulsar-io-kinesis-3.1.4.11.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.3  | pulsar-kafka-proxy-3.1.0.3.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version  | File                                      |
|----------------------------------------------------------------|----------------------------------------|----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.3  | pulsar-protocol-handler-kafka-3.1.0.3.nar |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.3.0   | pulsar-cassandra-admin-2.3.0-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 6.0.1   | pulsar-jms-admin-6.0.1-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 6.0.1   | pulsar-jms-6.0.1-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.2.0   | pulsar-ai-tools-3.2.0.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.2.0   | pulsar-transformations-3.2.0.nar |
</details>


### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls31_3.1/build.json) used for the build.

## Luna Streaming Distribution 3.1 4.10
This maintenance release of the DataStax Luna Streaming Distribution for 3.1 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

### Most notable commits

* [57c8bac](https://github.com/datastax/pulsar/commit/57c8bac) [improve][broker] Exclude system topics from namespace level publish and dispatch rate limiting (#23589)
* [7b0677b](https://github.com/datastax/pulsar/commit/7b0677b) [improve][admin] Print error log if handle http response fails (#23563)
* [5479513](https://github.com/datastax/pulsar/commit/5479513) [fix][broker] Fix ownership loss (#23515)
* [f1d68fe](https://github.com/datastax/pulsar/commit/f1d68fe) [fix] [admin] Fix lookup get a null result if uses proxy (#23556)
* [b3505cd](https://github.com/datastax/pulsar/commit/b3505cd) [improve][io] Support update subscription position for sink connector (#23538)
* [d5ab04b](https://github.com/datastax/pulsar/commit/d5ab04b) [fix][broker] Increase readBuffer size for bookkeeper.DLOutputStream (#23548)
* [068a1ad](https://github.com/datastax/pulsar/commit/068a1ad) [fix][standalone] correctly delete bookie registration znode (#23497)
* [594b925](https://github.com/datastax/pulsar/commit/594b925) [fix][client] Fix Reader.hasMessageAvailable return wrong value after seeking by timestamp with startMessageIdInclusive (#23502)
* [2142929](https://github.com/datastax/pulsar/commit/2142929) [fix] [broker] Fix race-condition causing repeated delete topic (#23522)
* [17a32fd](https://github.com/datastax/pulsar/commit/17a32fd) [fix][client] Fix producer/consumer stop to reconnect or Pub/Sub due to IO thread race-condition  (#23499)
* [315c4af](https://github.com/datastax/pulsar/commit/315c4af) [improve][test] Added message properties tests for batch and non-batch messages (#23473)
* [38ceaf8](https://github.com/datastax/pulsar/commit/38ceaf8) [fix][client] Prevent embedding protobuf-java class files in pulsar-client-admin and pulsar-client-all (#23468)
* [b1a89db](https://github.com/datastax/pulsar/commit/b1a89db) [improve][io] Upgrade Spring version to 6.1.13 in IO Connectors (#23459)
* [7882308](https://github.com/datastax/pulsar/commit/7882308) [improve][broker] Make cluster metadata init command support metadata config path (#23269)
* [02e8f69](https://github.com/datastax/pulsar/commit/02e8f69) [fix][client] Use dedicated executor for requests in BinaryProtoLookupService (#23378) (#23461) |  [7006381](https://github.com/apache/pulsar/commit/7006381) |
* [637014b](https://github.com/datastax/pulsar/commit/637014b) rename ManagedLedgerInterceptorImplTest and override LoadBalancerOverrideBrokerNicSpeedGbps configuration |   |
* [bb76bb0](https://github.com/datastax/pulsar/commit/bb76bb0) [improve][broker] Add log to track issue when `handleGetTopicsOfNamespace` (#23434)
* [ac15753](https://github.com/datastax/pulsar/commit/ac15753) [fix][test] Address flaky GetPartitionMetadataMultiBrokerTest (#23456)
* [216c421](https://github.com/datastax/pulsar/commit/216c421) [fix][client] Fix the javadoc for ConsumerBuilder.isAckReceiptEnabled (#23452)
* [7b4d59d](https://github.com/datastax/pulsar/commit/7b4d59d) [fix][build] Add basic support for vscode-java and Eclipse IDE (#23448)
* [b27cea0](https://github.com/datastax/pulsar/commit/b27cea0) [fix][test] Fix flaky test ManagedLedgerTest.testDeleteCurrentLedgerWhenItIsClosed (#23437)
* [a5cae64](https://github.com/datastax/pulsar/commit/a5cae64) [fix][test] Fix flaky GetPartitionMetadataMultiBrokerTest.testCompatibilityDifferentBrokersForNonPersistentTopic (#23259)
* [e5de505](https://github.com/datastax/pulsar/commit/e5de505) [fix][broker] normalize path (#23438)
* [ef685cf](https://github.com/datastax/pulsar/commit/ef685cf) [fix][broker] Avoid orphan ledgers in BucketDelayedDeliveryTracker (#22802)
* [946fc04](https://github.com/datastax/pulsar/commit/946fc04) [improve][client] Increase default Java client connectionMaxIdleSeconds to 60 seconds (#23430)
* [6643db7](https://github.com/datastax/pulsar/commit/6643db7) [improve][build] Update maven-wrapper (mvnw) to recent stable version 3.3.2 (#23410)
* [063f0ff](https://github.com/datastax/pulsar/commit/063f0ff) [improve][misc] Upgrade Jetty to 9.4.56.v20240826 (#23405)
* [6cb657c](https://github.com/datastax/pulsar/commit/6cb657c) [fix][ml] Managed ledger should recover after open ledger failed (#23368)
* [cc34e0e](https://github.com/datastax/pulsar/commit/cc34e0e) [fix][sql][branch-3.0] Fix long decimal compatibility in Trino 368. (#23419)
* [c298585](https://github.com/datastax/pulsar/commit/c298585) [fix][broker] Fix AvgShedder strategy check (#23156)
* [2e4669d](https://github.com/datastax/pulsar/commit/2e4669d) [improve][build] Require Java 17 for building Pulsar branch-3.0 (#22875)
* [bc6c264](https://github.com/datastax/pulsar/commit/bc6c264) [improve] Upgrade Pulsar Python client in docker image to 3.5.0 (#23377)
* [33d3132](https://github.com/datastax/pulsar/commit/33d3132) [fix][broker] Fix out-of-order issues with ConsistentHashingStickyKeyConsumerSelector (#23327)
* [cfa7fb8](https://github.com/datastax/pulsar/commit/cfa7fb8) [fix][broker] Cancel possible pending replay read in cancelPendingRead (#23384)
* [5db8c7f](https://github.com/datastax/pulsar/commit/5db8c7f) [fix][misc] Log Conscrypt security provider initialization warnings at debug level (#23364)
* [171f05b](https://github.com/datastax/pulsar/commit/171f05b) [fix] [log] Do not print error log if tenant/namespace does not exist when calling get topic metadata (#23291)

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|---------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.13  | cassandra-enhanced-pulsar-sink-1.6.13-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.2   | pulsar-io-cloud-storage-3.2.2.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.10 | pulsar-io-data-generator-3.1.4.10.nar          |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.10 | pulsar-io-elastic-search-3.1.4.10.nar          |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.10 | pulsar-io-http-3.1.4.10.nar                    |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.10 | pulsar-io-jdbc-clickhouse-3.1.4.10.nar         |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.10 | pulsar-io-jdbc-mariadb-3.1.4.10.nar            |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.10 | pulsar-io-jdbc-openmldb-3.1.4.10.nar           |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.10 | pulsar-io-jdbc-postgres-3.1.4.10.nar           |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.10 | pulsar-io-jdbc-sqlite-3.1.4.10.nar             |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.10 | pulsar-io-kafka-3.1.4.10.nar                   |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.10 | pulsar-io-kinesis-3.1.4.10.nar                 |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.1.15  | pulsar-snowflake-connector-0.1.15.nar         |
| [lakehouse](https://github.com/streamnative/pulsar-io-lakehouse)         | Lakehouse Connector                                                                                          | 3.3.1.6 | pulsar-io-lakehouse-3.3.1.6.nar               |
| [lakehouse-cloud](https://github.com/streamnative/pulsar-io-lakehouse)   | Lakehouse Cloud Connector                                                                                    | 3.3.1.6 | pulsar-io-lakehouse-3.3.1.6-cloud.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version | File                                    |
|--------------------------------------------------------------------------|--------------------------------------|---------|-----------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.3.0   | pulsar-cassandra-source-2.3.0.nar       |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.10 | pulsar-io-data-generator-3.1.4.10.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.10 | pulsar-io-debezium-mongodb-3.1.4.10.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.10 | pulsar-io-debezium-mssql-3.1.4.10.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.10 | pulsar-io-debezium-mysql-3.1.4.10.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.10 | pulsar-io-debezium-oracle-3.1.4.10.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.10 | pulsar-io-debezium-postgres-3.1.4.10.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.10 | pulsar-io-kafka-3.1.4.10.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.10 | pulsar-io-kinesis-3.1.4.10.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.3  | pulsar-kafka-proxy-3.1.0.3.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version  | File                                      |
|----------------------------------------------------------------|----------------------------------------|----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.3  | pulsar-protocol-handler-kafka-3.1.0.3.nar |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.3.0   | pulsar-cassandra-admin-2.3.0-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 6.0.1   | pulsar-jms-admin-6.0.1-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 6.0.1   | pulsar-jms-6.0.1-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.2.0   | pulsar-ai-tools-3.2.0.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.2.0   | pulsar-transformations-3.2.0.nar |
</details>


### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls31_3.1/build.json) used for the build.

## Luna Streaming Distribution 3.1 4.9
This maintenance release of the DataStax Luna Streaming Distribution for 3.1 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

### Most notable commits

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|---------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.13  | cassandra-enhanced-pulsar-sink-1.6.13-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.2   | pulsar-io-cloud-storage-3.2.2.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.9 | pulsar-io-data-generator-3.1.4.9.nar          |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.9 | pulsar-io-elastic-search-3.1.4.9.nar          |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.9 | pulsar-io-http-3.1.4.9.nar                    |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.9 | pulsar-io-jdbc-clickhouse-3.1.4.9.nar         |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.9 | pulsar-io-jdbc-mariadb-3.1.4.9.nar            |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.9 | pulsar-io-jdbc-openmldb-3.1.4.9.nar           |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.9 | pulsar-io-jdbc-postgres-3.1.4.9.nar           |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.9 | pulsar-io-jdbc-sqlite-3.1.4.9.nar             |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.9 | pulsar-io-kafka-3.1.4.9.nar                   |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.9 | pulsar-io-kinesis-3.1.4.9.nar                 |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.1.15  | pulsar-snowflake-connector-0.1.15.nar         |
| [lakehouse](https://github.com/streamnative/pulsar-io-lakehouse)         | Lakehouse Connector                                                                                          | 3.3.1.6 | pulsar-io-lakehouse-3.3.1.6.nar               |
| [lakehouse-cloud](https://github.com/streamnative/pulsar-io-lakehouse)   | Lakehouse Cloud Connector                                                                                    | 3.3.1.6 | pulsar-io-lakehouse-3.3.1.6-cloud.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version | File                                    |
|--------------------------------------------------------------------------|--------------------------------------|---------|-----------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.3.0   | pulsar-cassandra-source-2.3.0.nar       |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.9 | pulsar-io-data-generator-3.1.4.9.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.9 | pulsar-io-debezium-mongodb-3.1.4.9.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.9 | pulsar-io-debezium-mssql-3.1.4.9.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.9 | pulsar-io-debezium-mysql-3.1.4.9.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.9 | pulsar-io-debezium-oracle-3.1.4.9.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.9 | pulsar-io-debezium-postgres-3.1.4.9.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.9 | pulsar-io-kafka-3.1.4.9.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.9 | pulsar-io-kinesis-3.1.4.9.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.3  | pulsar-kafka-proxy-3.1.0.3.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version  | File                                      |
|----------------------------------------------------------------|----------------------------------------|----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.3  | pulsar-protocol-handler-kafka-3.1.0.3.nar |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.3.0   | pulsar-cassandra-admin-2.3.0-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 6.0.0   | pulsar-jms-admin-6.0.0-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 6.0.0   | pulsar-jms-6.0.0-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.2.0   | pulsar-ai-tools-3.2.0.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.2.0   | pulsar-transformations-3.2.0.nar |
</details>


### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls31_3.1/build.json) used for the build.

## Luna Streaming Distribution 3.1 4.8
This maintenance release of the DataStax Luna Streaming Distribution for 3.1 which includes important stability and security updates for Luna Streaming, as well as for the various connectors packaged alongside it, such as sinks, sources, functions, protocol extensions, proxy extensions, filters, and client extensions.

### Most notable commits

* [8ea3944](https://github.com/datastax/pulsar/commit/8ea3944) [fix][sec] Upgrade Avro to 1.11.4 to address CVE-2024-47561 (#23394)
* [2d95226](https://github.com/datastax/pulsar/commit/2d95226) [fix] Bump commons-io:commons-io from 2.8.0 to 2.14.0 (#23393)
* [58febad](https://github.com/datastax/pulsar/commit/58febad) [fix][sec][branch-3.0] Upgrade protobuf-java to 3.25.5 (#23356) (#23357)
* [4fa2584](https://github.com/datastax/pulsar/commit/4fa2584) Revert "[improve][broker] Reschedule reads with increasing backoff when no messages are dispatched (#23226)"
* [1d2de0b](https://github.com/datastax/pulsar/commit/1d2de0b) Revert "[fix][broker] Fix retry backoff for PersistentDispatcherMultipleConsumers (#23284)"
* [35d086e](https://github.com/datastax/pulsar/commit/35d086e) [fix][sec] Upgrade vertx to 4.5.10 to address CVE-2024-8391 (#23338)
* [818887d](https://github.com/datastax/pulsar/commit/818887d) [fix][build] Fix problem where git.commit.id.abbrev is missing in image tagging (#23337)
* [fc3d028](https://github.com/datastax/pulsar/commit/fc3d028) [fix][test] Fix flaky test LeaderElectionTest.revalidateLeaderWithinSameSession (#22383)

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|---------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.13  | cassandra-enhanced-pulsar-sink-1.6.13-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.2   | pulsar-io-cloud-storage-3.2.2.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.8 | pulsar-io-data-generator-3.1.4.8.nar          |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.8 | pulsar-io-elastic-search-3.1.4.8.nar          |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.8 | pulsar-io-http-3.1.4.8.nar                    |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.8 | pulsar-io-jdbc-clickhouse-3.1.4.8.nar         |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.8 | pulsar-io-jdbc-mariadb-3.1.4.8.nar            |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.8 | pulsar-io-jdbc-openmldb-3.1.4.8.nar           |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.8 | pulsar-io-jdbc-postgres-3.1.4.8.nar           |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.8 | pulsar-io-jdbc-sqlite-3.1.4.8.nar             |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.8 | pulsar-io-kafka-3.1.4.8.nar                   |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.8 | pulsar-io-kinesis-3.1.4.8.nar                 |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.1.15  | pulsar-snowflake-connector-0.1.15.nar         |
| [lakehouse](https://github.com/streamnative/pulsar-io-lakehouse)         | Lakehouse Connector                                                                                          | 3.3.1.6 | pulsar-io-lakehouse-3.3.1.6.nar               |
| [lakehouse-cloud](https://github.com/streamnative/pulsar-io-lakehouse)   | Lakehouse Cloud Connector                                                                                    | 3.3.1.6 | pulsar-io-lakehouse-3.3.1.6-cloud.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version | File                                    |
|--------------------------------------------------------------------------|--------------------------------------|---------|-----------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.3.0   | pulsar-cassandra-source-2.3.0.nar       |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.8 | pulsar-io-data-generator-3.1.4.8.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.8 | pulsar-io-debezium-mongodb-3.1.4.8.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.8 | pulsar-io-debezium-mssql-3.1.4.8.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.8 | pulsar-io-debezium-mysql-3.1.4.8.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.8 | pulsar-io-debezium-oracle-3.1.4.8.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.8 | pulsar-io-debezium-postgres-3.1.4.8.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.8 | pulsar-io-kafka-3.1.4.8.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.8 | pulsar-io-kinesis-3.1.4.8.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.3  | pulsar-kafka-proxy-3.1.0.3.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version  | File                                      |
|----------------------------------------------------------------|----------------------------------------|----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.3  | pulsar-protocol-handler-kafka-3.1.0.3.nar |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.3.0   | pulsar-cassandra-admin-2.3.0-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 5.0.4   | pulsar-jms-admin-5.0.4-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 5.0.4   | pulsar-jms-5.0.4-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.2.0   | pulsar-ai-tools-3.2.0.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.2.0   | pulsar-transformations-3.2.0.nar |
</details>


### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls31_3.1/build.json) used for the build.


## Luna Streaming Distribution 3.1 4.7
This is a maintenance release of the DataStax Luna Streaming Distribution for 3.1. This release contains all the commits included in the Apache Pulsar branch-3.0 till 20th September 2024 plus the changes specific to Luna Streaming & important security updates.

### Most notable commits

* [38f90bd](https://github.com/datastax/pulsar/commit/38f90bd) upgrade opensearch sink to client 2.16 and tests to use server 2.16.0
* [c8b4b5d](https://github.com/datastax/pulsar/commit/c8b4b5d) [fix][broker] Fix incomplete NAR file extraction which prevents broker from starting (#23274)
* [c9adb43](https://github.com/datastax/pulsar/commit/c9adb43) [fix][io] Upgrade mssql server docker tag in DebeziumMsSqlContainer (#23318)
* [ceab81b](https://github.com/datastax/pulsar/commit/ceab81b) [fix][broker][branch-3.0] Fail fast if the extensible load manager failed to start (#23297) (#23302)
* [2498da0](https://github.com/datastax/pulsar/commit/2498da0) [fix][sql][branch-3.0] Fix UUID convert failed for JSON schema (#23292) | * 4d6310c](https://github.com/apache/pulsar/commit/4d6310c)
* [fe27172](https://github.com/datastax/pulsar/commit/fe27172) Added updated-datastax-license-version.sh to update datastax jar licenses while releasing 3.1 automatically
* [1b37382](https://github.com/datastax/pulsar/commit/1b37382) Revert "Update actions/upload-artifact to v4"
* [8997b77](https://github.com/datastax/pulsar/commit/8997b77) Update actions/upload-artifact to v4

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|---------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.12  | cassandra-enhanced-pulsar-sink-1.6.12-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.0   | pulsar-io-cloud-storage-3.2.0.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.7 | pulsar-io-data-generator-3.1.4.7.nar          |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.7 | pulsar-io-elastic-search-3.1.4.7.nar          |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.7 | pulsar-io-http-3.1.4.7.nar                    |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.7 | pulsar-io-jdbc-clickhouse-3.1.4.7.nar         |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.7 | pulsar-io-jdbc-mariadb-3.1.4.7.nar            |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.7 | pulsar-io-jdbc-openmldb-3.1.4.7.nar           |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.7 | pulsar-io-jdbc-postgres-3.1.4.7.nar           |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.7 | pulsar-io-jdbc-sqlite-3.1.4.7.nar             |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.7 | pulsar-io-kafka-3.1.4.7.nar                   |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.7 | pulsar-io-kinesis-3.1.4.7.nar                 |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.1.14  | pulsar-snowflake-connector-0.1.14.nar         |
| [lakehouse](https://github.com/streamnative/pulsar-io-lakehouse) | Lakehouse Connector | 3.3.1.6   | pulsar-io-lakehouse-3.3.1.6.nar         |
| [lakehouse-cloud](https://github.com/streamnative/pulsar-io-lakehouse) | Lakehouse Cloud Connector | 3.3.1.6   | pulsar-io-lakehouse-3.3.1.6-cloud.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version | File                                    |
|--------------------------------------------------------------------------|--------------------------------------|---------|-----------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.2.9   | pulsar-cassandra-source-2.2.9.nar       |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.7 | pulsar-io-data-generator-3.1.4.7.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.7 | pulsar-io-debezium-mongodb-3.1.4.7.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.7 | pulsar-io-debezium-mssql-3.1.4.7.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.7 | pulsar-io-debezium-mysql-3.1.4.7.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.7 | pulsar-io-debezium-oracle-3.1.4.7.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.7 | pulsar-io-debezium-postgres-3.1.4.7.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.7 | pulsar-io-kafka-3.1.4.7.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.7 | pulsar-io-kinesis-3.1.4.7.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.1  | pulsar-kafka-proxy-3.1.0.1.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version   | File                                      |
|----------------------------------------------------------------|----------------------------------------|-----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0  | starlight-rabbitmq-2.10.1.0.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.1   | pulsar-protocol-handler-kafka-3.1.0.1.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0  | starlight-rabbitmq-2.10.1.0.nar           |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.2.5   | pulsar-cassandra-admin-2.2.5-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 5.0.4   | pulsar-jms-admin-5.0.4-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 5.0.4   | pulsar-jms-5.0.4-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.1.9   | pulsar-ai-tools-3.1.9.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.1.9   | pulsar-transformations-3.1.9.nar |
</details>


### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls31_3.1/build.json) used for the build.


### Builtin connectors

- cassandra-enhanced-pulsar-sink-1.6.11-nar.nar
- pulsar-cassandra-source-2.2.9.nar
- pulsar-io-cloud-storage-2.10.0.nar
- pulsar-io-debezium-mongodb-3.1.4.7.nar
- pulsar-io-jdbc-sqlite-3.1.4.7.nar
- pulsar-io-kinesis-3.1.4.7.nar
- pulsar-io-data-generator-3.1.4.7.nar
- pulsar-io-elastic-search-3.1.4.7.nar
- pulsar-io-jdbc-clickhouse-3.1.4.7.nar
- pulsar-io-debezium-oracle-3.1.4.7.nar
- pulsar-io-jdbc-openmldb-3.1.4.7.nar
- pulsar-io-jdbc-postgres-3.1.4.7.nar
- pulsar-io-debezium-mssql-3.1.4.7.nar
- pulsar-io-debezium-mysql-3.1.4.7.nar
- pulsar-io-jdbc-mariadb-3.1.4.7.nar
- pulsar-io-debezium-postgres-3.1.4.7.nar
- pulsar-io-http-3.1.4.7.nar
- pulsar-io-kafka-3.1.4.7.nar
- pulsar-snowflake-connector-0.1.13.nar
- pulsar-protocol-handler-kafka-3.1.0.1.nar
- starlight-rabbitmq-2.10.1.0.nar
- pulsar-kafka-proxy-3.1.0.1.nar
- pulsar-jms-3.1.0-nar.nar

## Luna Streaming Distribution 3.1 4.6
This is a maintenance release of the DataStax Luna Streaming Distribution for 3.1. This release contains all the commits included in the Apache Pulsar branch-3.0 till 12th September 2024 plus the changes specific to Luna Streaming & important security updates.

### Most notable commits

* [43249a0](https://github.com/datastax/pulsar/commit/43249a0) Add vi/vim to luna 31 images (#310)
* [b0c3ffb](https://github.com/datastax/pulsar/commit/b0c3ffb) [improve][broker] Part 2 of PIP-370: add metrics "pulsar_replication_disconnected_count" (#23213)
* [ada390b](https://github.com/datastax/pulsar/commit/ada390b) [improve][broker] Phase 1 of PIP-370 support disable create topics on remote cluster through replication  (#23169)
* [751aea3](https://github.com/datastax/pulsar/commit/751aea3) AS-4027: add string write function (#308)
* [7b7d335](https://github.com/datastax/pulsar/commit/7b7d335) [fix][log] Do not print warn log when concurrently publishing and switching ledgers (#23209)
* [8ad5249](https://github.com/datastax/pulsar/commit/8ad5249) [fix][client] the nullValue in msgMetadata should be true by default (#22372)
* [959f80b](https://github.com/datastax/pulsar/commit/959f80b) [improve][client] Don't print info logs for each schema loaded by client (#23206)
* [336d5d6](https://github.com/datastax/pulsar/commit/336d5d6) [improve][broker] Improve pulsar_topic_load_failed metric to record correct failed time (#23199)
* [c29f36a](https://github.com/datastax/pulsar/commit/c29f36a) [improve][broker] Optimize high CPU usage when consuming from topics with ongoing txn (#23189)
* [7047c2c](https://github.com/datastax/pulsar/commit/7047c2c) [fix] [broker] Topic can never be loaded up due to broker maintains a failed topic creation future (#23184)
* [8d7f750](https://github.com/datastax/pulsar/commit/8d7f750) [fix][broker] Skip reading entries from closed cursor. (#22751)
* [ae7a71c](https://github.com/datastax/pulsar/commit/ae7a71c) [improve] [broker] Optimize performance for checking max topics when the topic is a system topic (#23185)
*  [6c6f6bf](https://github.com/datastax/pulsar/commit/6c6f6bf) [improve][broker] Should notify bundle ownership listener onLoad event when ServiceUnitState start (ExtensibleLoadManagerImpl only)
* [69064c3](https://github.com/datastax/pulsar/commit/69064c3) [improve][broker] Support customized shadow managed ledger implementation (#23179)
* [b463ba4](https://github.com/datastax/pulsar/commit/b463ba4) [fix][test] Fix flaky SubscriptionSeekTest.testSeekIsByReceive (#23170)
* [e3b9cdc](https://github.com/datastax/pulsar/commit/e3b9cdc) [feat] Add scripts for updating BK RocksDB ini files (#23178)
* [42e9157](https://github.com/datastax/pulsar/commit/42e9157) [fix][client] Copy orderingKey to retry letter topic and DLQ messages and fix bug in copying (#23182)
* [ef00bb2](https://github.com/datastax/pulsar/commit/ef00bb2) [fix] DLQ to handle bytes key properly (#23172)
* [bb6c14f](https://github.com/datastax/pulsar/commit/bb6c14f) [fix][broker] Fix shadow topics cannot be consumed when the entry is not cached (#23147)
* [c228b5d](https://github.com/datastax/pulsar/commit/c228b5d) [improve] [broker] Avoid subscription fenced error with consumer.seek whenever possible (#23163)
* [b8aa905](https://github.com/datastax/pulsar/commit/b8aa905) [fix][client] Create the retry producer async (#23157)
* [bdfc591](https://github.com/datastax/pulsar/commit/bdfc591) [fix][client] Fix for early hit `beforeConsume` for MultiTopicConsumer (#23141)
* [b04b905](https://github.com/datastax/pulsar/commit/b04b905) [improve][proxy] Reuse authentication instance in pulsar-proxy (#23113)
* [b46125e](https://github.com/datastax/pulsar/commit/b46125e) [improve] [client]Add new ServiceUrlProvider implementation: SameAuthParamsAutoClusterFailover (#23129)
* [68db449](https://github.com/datastax/pulsar/commit/68db449) [fix] [broker] Let Pending ack handler can retry to init when encounters a metadata store error (#23153)
* [b3d47d2](https://github.com/datastax/pulsar/commit/b3d47d2) [fix][broker] Fix 'Disabled replicated subscriptions controller' logic and logging (#23142)
* [e16a0e2](https://github.com/datastax/pulsar/commit/e16a0e2) [improve][broker] Explicitly close LB internal topics when playing a follower (ExtensibleLoadManagerImpl only) (#23144)
* [6cfacf2](https://github.com/datastax/pulsar/commit/6cfacf2) [fix] [broker] Fix compatibility issues for PIP-344 (#23136)
* [62fbcc9](https://github.com/datastax/pulsar/commit/62fbcc9) [improve][client] Add maxConnectionsPerHost and connectionMaxIdleSeconds to PulsarAdminBuilder (#22541)
* [5149aef](https://github.com/datastax/pulsar/commit/5149aef) [improve][misc] Upgrade jersey to 2.41 (#22290)
* [2455b1e](https://github.com/datastax/pulsar/commit/2455b1e) [fix][broker] Fix the bug that elected leader thinks it's a follower (#23138)
* [fcb4809](https://github.com/datastax/pulsar/commit/fcb4809) [improve][fn] Add support for overriding additionalJavaRuntimeArguments with PF_additionalJavaRuntimeArguments env (#23130)
* [be739ab](https://github.com/datastax/pulsar/commit/be739ab) [fix][client] Fix timeout handling in Pulsar Admin client (#23128)
* [9eca32d](https://github.com/datastax/pulsar/commit/9eca32d) [fix][fn] Make python install dependencies from requirements.txt (#20174)
* [13b6669](https://github.com/datastax/pulsar/commit/13b6669) [improve][misc] Optimize TLS performance by omitting extra buffer copies (#23115)
* [fcd02df](https://github.com/datastax/pulsar/commit/fcd02df) [improve][broker] Reduce the CPU pressure from the transaction buffer in rolling restarts (#23062)
* [ef1eacc](https://github.com/datastax/pulsar/commit/ef1eacc) [improve][broker] Support to specify auth-plugin, auth-parameters and tls-enable arguments when init cluster metadata (#23087) (#23126)
* [f598675](https://github.com/datastax/pulsar/commit/f598675) [improve][misc] Improve AES-GCM cipher performance (#23122)
* [26e63e1](https://github.com/datastax/pulsar/commit/26e63e1) [fix][broker] Handle the case when `getOwnedServiceUnits` fails gracefully (#23119)
* [156ce19](https://github.com/datastax/pulsar/commit/156ce19) [fix][broker]A failed consumer/producer future in ServerCnx can never be removed (#23123)
* [d2a8e86](https://github.com/datastax/pulsar/commit/d2a8e86) [fix][broker] Fix authenticate order in AuthenticationProviderList (#23111)
* [415f283](https://github.com/datastax/pulsar/commit/415f283) [fix][broker] type cast on exceptions in exceptionally can lead to lost calls (#23117)
* [b0a40f4](https://github.com/datastax/pulsar/commit/b0a40f4) [fix][broker] fix exception may hidden and result in stuck when topic loading (#23102)
* [85150dc](https://github.com/datastax/pulsar/commit/85150dc) [fix] [broker] fix replicated namespaces filter in filterAndUnloadMatchedNamespaceAsync (#23100)
* [e322642](https://github.com/datastax/pulsar/commit/e322642) [improve][broker]Reuse method getAvailableBrokersAsync (#23099)
* [5631b66](https://github.com/datastax/pulsar/commit/5631b66) [fix][client] TransactionCoordinatorClient support retry (#23081)

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|---------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.12  | cassandra-enhanced-pulsar-sink-1.6.12-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.0   | pulsar-io-cloud-storage-3.2.0.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.6 | pulsar-io-data-generator-3.1.4.6.nar          |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.6 | pulsar-io-elastic-search-3.1.4.6.nar          |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.6 | pulsar-io-http-3.1.4.6.nar                    |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.6 | pulsar-io-jdbc-clickhouse-3.1.4.6.nar         |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.6 | pulsar-io-jdbc-mariadb-3.1.4.6.nar            |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.6 | pulsar-io-jdbc-openmldb-3.1.4.6.nar           |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.6 | pulsar-io-jdbc-postgres-3.1.4.6.nar           |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.6 | pulsar-io-jdbc-sqlite-3.1.4.6.nar             |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.6 | pulsar-io-kafka-3.1.4.6.nar                   |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.6 | pulsar-io-kinesis-3.1.4.6.nar                 |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.1.14  | pulsar-snowflake-connector-0.1.14.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version | File                                    |
|--------------------------------------------------------------------------|--------------------------------------|---------|-----------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.2.9   | pulsar-cassandra-source-2.2.9.nar       |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.6 | pulsar-io-data-generator-3.1.4.6.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.6 | pulsar-io-debezium-mongodb-3.1.4.6.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.6 | pulsar-io-debezium-mssql-3.1.4.6.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.6 | pulsar-io-debezium-mysql-3.1.4.6.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.6 | pulsar-io-debezium-oracle-3.1.4.6.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.6 | pulsar-io-debezium-postgres-3.1.4.6.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.6 | pulsar-io-kafka-3.1.4.6.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.6 | pulsar-io-kinesis-3.1.4.6.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.1  | pulsar-kafka-proxy-3.1.0.1.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version   | File                                      |
|----------------------------------------------------------------|----------------------------------------|-----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0  | starlight-rabbitmq-2.10.1.0.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.1   | pulsar-protocol-handler-kafka-3.1.0.1.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0  | starlight-rabbitmq-2.10.1.0.nar           |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.2.5   | pulsar-cassandra-admin-2.2.5-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 5.0.4   | pulsar-jms-admin-5.0.4-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 5.0.4   | pulsar-jms-5.0.4-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.1.9   | pulsar-ai-tools-3.1.9.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.1.9   | pulsar-transformations-3.1.9.nar |
</details>


### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls31_3.1/build.json) used for the build.


### Builtin connectors

- cassandra-enhanced-pulsar-sink-1.6.11-nar.nar
- pulsar-cassandra-source-2.2.9.nar
- pulsar-io-cloud-storage-2.10.0.nar
- pulsar-io-debezium-mongodb-3.1.4.6.nar
- pulsar-io-jdbc-sqlite-3.1.4.6.nar
- pulsar-io-kinesis-3.1.4.6.nar
- pulsar-io-data-generator-3.1.4.6.nar
- pulsar-io-elastic-search-3.1.4.6.nar
- pulsar-io-jdbc-clickhouse-3.1.4.6.nar
- pulsar-io-debezium-oracle-3.1.4.6.nar
- pulsar-io-jdbc-openmldb-3.1.4.6.nar
- pulsar-io-jdbc-postgres-3.1.4.6.nar
- pulsar-io-debezium-mssql-3.1.4.6.nar
- pulsar-io-debezium-mysql-3.1.4.6.nar
- pulsar-io-jdbc-mariadb-3.1.4.6.nar
- pulsar-io-debezium-postgres-3.1.4.6.nar
- pulsar-io-http-3.1.4.6.nar
- pulsar-io-kafka-3.1.4.6.nar
- pulsar-snowflake-connector-0.1.13.nar
- pulsar-protocol-handler-kafka-3.1.0.1.nar
- starlight-rabbitmq-2.10.1.0.nar
- pulsar-kafka-proxy-3.1.0.1.nar
- pulsar-jms-3.1.0-nar.nar

## Luna Streaming Distribution 3.1 4.5
This is a maintenance release of the DataStax Luna Streaming Distribution for 3.1. This release contains all the commits included in the Apache Pulsar branch-3.0 till 26th August 2024 plus the changes specific to Luna Streaming & important security updates.

### Most notable commits

* [43249a0](https://github.com/datastax/pulsar/commit/43249a0) Add vi/vim to luna 31 images (#310)
* [b0c3ffb](https://github.com/datastax/pulsar/commit/b0c3ffb) [improve][broker] Part 2 of PIP-370: add metrics "pulsar_replication_disconnected_count" (#23213)
* [ada390b](https://github.com/datastax/pulsar/commit/ada390b) [improve][broker] Phase 1 of PIP-370 support disable create topics on remote cluster through replication  (#23169)
* [751aea3](https://github.com/datastax/pulsar/commit/751aea3) AS-4027: add string write function (#308)
* [7b7d335](https://github.com/datastax/pulsar/commit/7b7d335) [fix][log] Do not print warn log when concurrently publishing and switching ledgers (#23209)
* [8ad5249](https://github.com/datastax/pulsar/commit/8ad5249) [fix][client] the nullValue in msgMetadata should be true by default (#22372)
* [959f80b](https://github.com/datastax/pulsar/commit/959f80b) [improve][client] Don't print info logs for each schema loaded by client (#23206)
* [336d5d6](https://github.com/datastax/pulsar/commit/336d5d6) [improve][broker] Improve pulsar_topic_load_failed metric to record correct failed time (#23199)
* [c29f36a](https://github.com/datastax/pulsar/commit/c29f36a) [improve][broker] Optimize high CPU usage when consuming from topics with ongoing txn (#23189)
* [7047c2c](https://github.com/datastax/pulsar/commit/7047c2c) [fix] [broker] Topic can never be loaded up due to broker maintains a failed topic creation future (#23184)
* [8d7f750](https://github.com/datastax/pulsar/commit/8d7f750) [fix][broker] Skip reading entries from closed cursor. (#22751)
* [ae7a71c](https://github.com/datastax/pulsar/commit/ae7a71c) [improve] [broker] Optimize performance for checking max topics when the topic is a system topic (#23185)
*  [6c6f6bf](https://github.com/datastax/pulsar/commit/6c6f6bf) [improve][broker] Should notify bundle ownership listener onLoad event when ServiceUnitState start (ExtensibleLoadManagerImpl only)
* [69064c3](https://github.com/datastax/pulsar/commit/69064c3) [improve][broker] Support customized shadow managed ledger implementation (#23179)
* [b463ba4](https://github.com/datastax/pulsar/commit/b463ba4) [fix][test] Fix flaky SubscriptionSeekTest.testSeekIsByReceive (#23170)
* [e3b9cdc](https://github.com/datastax/pulsar/commit/e3b9cdc) [feat] Add scripts for updating BK RocksDB ini files (#23178)
* [42e9157](https://github.com/datastax/pulsar/commit/42e9157) [fix][client] Copy orderingKey to retry letter topic and DLQ messages and fix bug in copying (#23182)
* [ef00bb2](https://github.com/datastax/pulsar/commit/ef00bb2) [fix] DLQ to handle bytes key properly (#23172)
* [bb6c14f](https://github.com/datastax/pulsar/commit/bb6c14f) [fix][broker] Fix shadow topics cannot be consumed when the entry is not cached (#23147)
* [c228b5d](https://github.com/datastax/pulsar/commit/c228b5d) [improve] [broker] Avoid subscription fenced error with consumer.seek whenever possible (#23163)
* [b8aa905](https://github.com/datastax/pulsar/commit/b8aa905) [fix][client] Create the retry producer async (#23157)
* [bdfc591](https://github.com/datastax/pulsar/commit/bdfc591) [fix][client] Fix for early hit `beforeConsume` for MultiTopicConsumer (#23141)
* [b04b905](https://github.com/datastax/pulsar/commit/b04b905) [improve][proxy] Reuse authentication instance in pulsar-proxy (#23113)
* [b46125e](https://github.com/datastax/pulsar/commit/b46125e) [improve] [client]Add new ServiceUrlProvider implementation: SameAuthParamsAutoClusterFailover (#23129)
* [68db449](https://github.com/datastax/pulsar/commit/68db449) [fix] [broker] Let Pending ack handler can retry to init when encounters a metadata store error (#23153)
* [b3d47d2](https://github.com/datastax/pulsar/commit/b3d47d2) [fix][broker] Fix 'Disabled replicated subscriptions controller' logic and logging (#23142)
* [e16a0e2](https://github.com/datastax/pulsar/commit/e16a0e2) [improve][broker] Explicitly close LB internal topics when playing a follower (ExtensibleLoadManagerImpl only) (#23144)
* [6cfacf2](https://github.com/datastax/pulsar/commit/6cfacf2) [fix] [broker] Fix compatibility issues for PIP-344 (#23136)
* [62fbcc9](https://github.com/datastax/pulsar/commit/62fbcc9) [improve][client] Add maxConnectionsPerHost and connectionMaxIdleSeconds to PulsarAdminBuilder (#22541)
* [5149aef](https://github.com/datastax/pulsar/commit/5149aef) [improve][misc] Upgrade jersey to 2.41 (#22290)
* [2455b1e](https://github.com/datastax/pulsar/commit/2455b1e) [fix][broker] Fix the bug that elected leader thinks it's a follower (#23138)
* [fcb4809](https://github.com/datastax/pulsar/commit/fcb4809) [improve][fn] Add support for overriding additionalJavaRuntimeArguments with PF_additionalJavaRuntimeArguments env (#23130)
* [be739ab](https://github.com/datastax/pulsar/commit/be739ab) [fix][client] Fix timeout handling in Pulsar Admin client (#23128)
* [9eca32d](https://github.com/datastax/pulsar/commit/9eca32d) [fix][fn] Make python install dependencies from requirements.txt (#20174)
* [13b6669](https://github.com/datastax/pulsar/commit/13b6669) [improve][misc] Optimize TLS performance by omitting extra buffer copies (#23115)
* [fcd02df](https://github.com/datastax/pulsar/commit/fcd02df) [improve][broker] Reduce the CPU pressure from the transaction buffer in rolling restarts (#23062)
* [ef1eacc](https://github.com/datastax/pulsar/commit/ef1eacc) [improve][broker] Support to specify auth-plugin, auth-parameters and tls-enable arguments when init cluster metadata (#23087) (#23126)
* [f598675](https://github.com/datastax/pulsar/commit/f598675) [improve][misc] Improve AES-GCM cipher performance (#23122)
* [26e63e1](https://github.com/datastax/pulsar/commit/26e63e1) [fix][broker] Handle the case when `getOwnedServiceUnits` fails gracefully (#23119)
* [156ce19](https://github.com/datastax/pulsar/commit/156ce19) [fix][broker]A failed consumer/producer future in ServerCnx can never be removed (#23123)
* [d2a8e86](https://github.com/datastax/pulsar/commit/d2a8e86) [fix][broker] Fix authenticate order in AuthenticationProviderList (#23111)
* [415f283](https://github.com/datastax/pulsar/commit/415f283) [fix][broker] type cast on exceptions in exceptionally can lead to lost calls (#23117)
* [b0a40f4](https://github.com/datastax/pulsar/commit/b0a40f4) [fix][broker] fix exception may hidden and result in stuck when topic loading (#23102)
* [85150dc](https://github.com/datastax/pulsar/commit/85150dc) [fix] [broker] fix replicated namespaces filter in filterAndUnloadMatchedNamespaceAsync (#23100)
* [e322642](https://github.com/datastax/pulsar/commit/e322642) [improve][broker]Reuse method getAvailableBrokersAsync (#23099)
* [5631b66](https://github.com/datastax/pulsar/commit/5631b66) [fix][client] TransactionCoordinatorClient support retry (#23081)

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|---------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.11  | cassandra-enhanced-pulsar-sink-1.6.11-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.0   | pulsar-io-cloud-storage-3.2.0.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.5 | pulsar-io-data-generator-3.1.4.5.nar          |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.5 | pulsar-io-elastic-search-3.1.4.5.nar          |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.5 | pulsar-io-http-3.1.4.5.nar                    |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.5 | pulsar-io-jdbc-clickhouse-3.1.4.5.nar         |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.5 | pulsar-io-jdbc-mariadb-3.1.4.5.nar            |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.5 | pulsar-io-jdbc-openmldb-3.1.4.5.nar           |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.5 | pulsar-io-jdbc-postgres-3.1.4.5.nar           |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.5 | pulsar-io-jdbc-sqlite-3.1.4.5.nar             |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.5 | pulsar-io-kafka-3.1.4.5.nar                   |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.5 | pulsar-io-kinesis-3.1.4.5.nar                 |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.1.14  | pulsar-snowflake-connector-0.1.14.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version | File                                    |
|--------------------------------------------------------------------------|--------------------------------------|---------|-----------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.2.9   | pulsar-cassandra-source-2.2.9.nar       |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.5 | pulsar-io-data-generator-3.1.4.5.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.5 | pulsar-io-debezium-mongodb-3.1.4.5.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.5 | pulsar-io-debezium-mssql-3.1.4.5.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.5 | pulsar-io-debezium-mysql-3.1.4.5.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.5 | pulsar-io-debezium-oracle-3.1.4.5.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.5 | pulsar-io-debezium-postgres-3.1.4.5.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.5 | pulsar-io-kafka-3.1.4.5.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.5 | pulsar-io-kinesis-3.1.4.5.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.1  | pulsar-kafka-proxy-3.1.0.1.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version   | File                                      |
|----------------------------------------------------------------|----------------------------------------|-----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0  | starlight-rabbitmq-2.10.1.0.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.1   | pulsar-protocol-handler-kafka-3.1.0.1.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0  | starlight-rabbitmq-2.10.1.0.nar           |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.2.5   | pulsar-cassandra-admin-2.2.5-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 5.0.4   | pulsar-jms-admin-5.0.4-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 5.0.4   | pulsar-jms-5.0.4-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.1.9   | pulsar-ai-tools-3.1.9.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.1.9   | pulsar-transformations-3.1.9.nar |
</details>


### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls31_3.1/build.json) used for the build.


### Builtin connectors

- cassandra-enhanced-pulsar-sink-1.6.11-nar.nar
- pulsar-cassandra-source-2.2.9.nar
- pulsar-io-cloud-storage-2.10.0.nar
- pulsar-io-debezium-mongodb-3.1.4.5.nar
- pulsar-io-jdbc-sqlite-3.1.4.5.nar
- pulsar-io-kinesis-3.1.4.5.nar
- pulsar-io-data-generator-3.1.4.5.nar
- pulsar-io-elastic-search-3.1.4.5.nar
- pulsar-io-jdbc-clickhouse-3.1.4.5.nar
- pulsar-io-debezium-oracle-3.1.4.5.nar
- pulsar-io-jdbc-openmldb-3.1.4.5.nar
- pulsar-io-jdbc-postgres-3.1.4.5.nar
- pulsar-io-debezium-mssql-3.1.4.5.nar
- pulsar-io-debezium-mysql-3.1.4.5.nar
- pulsar-io-jdbc-mariadb-3.1.4.5.nar
- pulsar-io-debezium-postgres-3.1.4.5.nar
- pulsar-io-http-3.1.4.5.nar
- pulsar-io-kafka-3.1.4.5.nar
- pulsar-snowflake-connector-0.1.13.nar
- pulsar-protocol-handler-kafka-3.1.0.1.nar
- starlight-rabbitmq-2.10.1.0.nar
- pulsar-kafka-proxy-3.1.0.1.nar
- pulsar-jms-3.1.0-nar.nar

## Luna Streaming Distribution 3.1 4.4
This is a maintenance release of the DataStax Luna Streaming Distribution for 3.1. This release contains all the commits included in the Apache Pulsar branch-3.0 till 30th June 2024 plus the changes specific to Luna Streaming & important security updates.

### Most notable commits

* [f5eebae](https://github.com/datastax/pulsar/commit/f5eebae) [improve][broker] Optimize the performance of individual acknowledgments (#23072)
* [148077c](https://github.com/datastax/pulsar/commit/148077c) [fix] [broker] Internal reader of __change_events can not started after metadata store session rebuilt (#23018)
* [de5ccbd](https://github.com/datastax/pulsar/commit/de5ccbd) [improve][ci] Switch to use DEVELOCITY_ACCESS_KEY from GRADLE_ENTERPRISE_ACCESS_KEY (#23090)
* [453d964](https://github.com/datastax/pulsar/commit/453d964) [improve] [broker] Check max producers/consumers limitation first before other ops to save resources (#23074)
* [f5da2bf](https://github.com/datastax/pulsar/commit/f5da2bf) [fix] [broker] Remove blocking calls from Subscription.getStats (#23088)
* [c2fda68](https://github.com/datastax/pulsar/commit/c2fda68) [fix][client] Fix negative acknowledgement by messageId (#23060)
* [4b715b6](https://github.com/datastax/pulsar/commit/4b715b6) [fix][broker] Handle BucketDelayedDeliveryTracker recover failed (#22735)
* [8124284](https://github.com/datastax/pulsar/commit/8124284) [improve][broker] GetPartitionMetadata fail also can produce messages (#23050)
* [86d4ea0](https://github.com/datastax/pulsar/commit/86d4ea0) [fix][broker][branch-3.0] Do not try to clean owned bundles from inactive source brokers (ExtensibleLoadManagerImpl only) (#23064)
* [40a797c](https://github.com/datastax/pulsar/commit/40a797c) [improve] [broker] high CPU usage caused by list topics under namespace (#23049)
* [1897068](https://github.com/apache/pulsar/commit/1897068) fix code style 
* [082dfb5](https://github.com/datastax/pulsar/commit/082dfb5) [improve] [broker] Improve CPU resources usege of TopicName Cache (#23052)
* [235f7c5](https://github.com/datastax/pulsar/commit/235f7c5) [improve][broker][branch-3.0] PIP-364: Introduce a new load balance algorithm AvgShedder (#23053)
* [fdd9747](https://github.com/apache/pulsar/commit/fdd9747) fix code style introduce by #22983
* [326271a](https://github.com/datastax/pulsar/commit/326271a) [fix][broker] Replication stuck when partitions count between two clusters is not the same (#22983)
* [4c58701](https://github.com/datastax/pulsar/commit/4c58701) Reverted changes for oracle
* [4788375](https://github.com/datastax/pulsar/commit/4788375) Debezium upgrade to 2.6.1.Final
* [f6f2db2](https://github.com/datastax/pulsar/commit/f6f2db2) [fix][broker] Fix stuck when enable topic level replication and build remote admin fails (#23028)
* [182b704](https://github.com/datastax/pulsar/commit/182b704) [fix][admin] Fix half deletion when attempt to topic with a incorrect API (#23002)
* [f74d3df](https://github.com/datastax/pulsar/commit/f74d3df) [fix][broker] Fix geo-replication admin client url (#22584)
* [3d9d7e6](https://github.com/datastax/pulsar/commit/3d9d7e6) [fix][broker]Fix lookupService.getTopicsUnderNamespace can not work with a quote pattern (#23014)
* [044840a](https://github.com/datastax/pulsar/commit/044840a) [fix][client] Fix pattern consumer create crash if a part of partitions of a topic have been deleted (#22854)
* [c917de3](https://github.com/datastax/pulsar/commit/c917de3) [fix][misc] Remove RoaringBitmap dependency from pulsar-common (#23008)
* [b488f1f](https://github.com/datastax/pulsar/commit/b488f1f) [improve][broker] Use RoaringBitmap in tracking individual acks to reduce memory usage (#23006)
* [1560edb](https://github.com/datastax/pulsar/commit/1560edb) [fix][broker] Fix MessageDeduplication replay timeout cause topic loading stuck (#23004)
* [1db5939](https://github.com/datastax/pulsar/commit/1db5939) [fix] Make operations on `individualDeletedMessages` in lock scope (#22966)
* [65c8b23](https://github.com/datastax/pulsar/commit/65c8b23) [fix][broker] Can't connecte to non-persist topic when enable broker client tls (#22991)
* [2a0af99](https://github.com/datastax/pulsar/commit/2a0af99) [fix][broker] Fix broker OOM when upload a large package. (#22989)
* [538f68e](https://github.com/datastax/pulsar/commit/538f68e) [improve][broker] Improve exception for topic does not have schema to check (#22974)
* [b36266c](https://github.com/datastax/pulsar/commit/b36266c) [improve][build] Upgrade dependency-check-maven-plugin to 10.0.2 (#23012)
* [c34d444](https://github.com/datastax/pulsar/commit/c34d444) [fix][broker] PulsarStandalone started with error if --stream-storage-port is not 4181 (#22993)
* [8708d5f](https://github.com/datastax/pulsar/commit/8708d5f) [fix][ci] Fix OWASP Dependency Check download by using NVD API key (#22999)

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|---------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.11  | cassandra-enhanced-pulsar-sink-1.6.11-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.0   | pulsar-io-cloud-storage-3.2.0.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.4 | pulsar-io-data-generator-3.1.4.4.nar          |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.4 | pulsar-io-elastic-search-3.1.4.4.nar          |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.4 | pulsar-io-http-3.1.4.4.nar                    |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.4 | pulsar-io-jdbc-clickhouse-3.1.4.4.nar         |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.4 | pulsar-io-jdbc-mariadb-3.1.4.4.nar            |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.4 | pulsar-io-jdbc-openmldb-3.1.4.4.nar           |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.4 | pulsar-io-jdbc-postgres-3.1.4.4.nar           |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.4 | pulsar-io-jdbc-sqlite-3.1.4.4.nar             |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.4 | pulsar-io-kafka-3.1.4.4.nar                   |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.4 | pulsar-io-kinesis-3.1.4.4.nar                 |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.1.14  | pulsar-snowflake-connector-0.1.14.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version | File                                    |
|--------------------------------------------------------------------------|--------------------------------------|---------|-----------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.2.9   | pulsar-cassandra-source-2.2.9.nar       |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.4 | pulsar-io-data-generator-3.1.4.4.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.4 | pulsar-io-debezium-mongodb-3.1.4.4.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.4 | pulsar-io-debezium-mssql-3.1.4.4.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.4 | pulsar-io-debezium-mysql-3.1.4.4.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.4 | pulsar-io-debezium-oracle-3.1.4.4.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.4 | pulsar-io-debezium-postgres-3.1.4.4.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.4 | pulsar-io-kafka-3.1.4.4.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.4 | pulsar-io-kinesis-3.1.4.4.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.1  | pulsar-kafka-proxy-3.1.0.1.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version   | File                                      |
|----------------------------------------------------------------|----------------------------------------|-----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0  | starlight-rabbitmq-2.10.1.0.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.1   | pulsar-protocol-handler-kafka-3.1.0.1.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0  | starlight-rabbitmq-2.10.1.0.nar           |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.2.5   | pulsar-cassandra-admin-2.2.5-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 5.0.4   | pulsar-jms-admin-5.0.4-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 5.0.4   | pulsar-jms-5.0.4-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.1.9   | pulsar-ai-tools-3.1.9.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.1.9   | pulsar-transformations-3.1.9.nar |
</details>


### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls31_3.1/build.json) used for the build.


### Builtin connectors

- cassandra-enhanced-pulsar-sink-1.6.11-nar.nar
- pulsar-cassandra-source-2.2.9.nar
- pulsar-io-cloud-storage-2.10.0.nar
- pulsar-io-debezium-mongodb-3.1.4.4.nar
- pulsar-io-jdbc-sqlite-3.1.4.4.nar
- pulsar-io-kinesis-3.1.4.4.nar
- pulsar-io-data-generator-3.1.4.4.nar
- pulsar-io-elastic-search-3.1.4.4.nar
- pulsar-io-jdbc-clickhouse-3.1.4.4.nar
- pulsar-io-debezium-oracle-3.1.4.4.nar
- pulsar-io-jdbc-openmldb-3.1.4.4.nar
- pulsar-io-jdbc-postgres-3.1.4.4.nar
- pulsar-io-debezium-mssql-3.1.4.4.nar
- pulsar-io-debezium-mysql-3.1.4.4.nar
- pulsar-io-jdbc-mariadb-3.1.4.4.nar
- pulsar-io-debezium-postgres-3.1.4.4.nar
- pulsar-io-http-3.1.4.4.nar
- pulsar-io-kafka-3.1.4.4.nar
- pulsar-snowflake-connector-0.1.13.nar
- pulsar-protocol-handler-kafka-3.1.0.1.nar
- starlight-rabbitmq-2.10.1.0.nar
- pulsar-kafka-proxy-3.1.0.1.nar
- pulsar-jms-3.1.0-nar.nar

## Luna Streaming Distribution 3.1 4.3
This is a maintenance release of the DataStax Luna Streaming Distribution for 3.1. This release contains all the commits included in the Apache Pulsar branch-3.0 till 30th June 2024 plus the changes specific to Luna Streaming & important security updates.

### Most notable commits

* [b453330](https://github.com/datastax/pulsar/commit/b453330) [fix][ci] Fix jacoco code coverage report aggregation (#22964)
* [fe09af2](https://github.com/datastax/pulsar/commit/fe09af2) [cleanup][misc] Remove classifier from netty-transport-native-unix-common dependency (#22951)
* [8ced787](https://github.com/datastax/pulsar/commit/8ced787) [improve][misc] Upgrade to Netty 4.1.111.Final and switch to use grpc-netty-shaded (#22892)
* [3d16cf7](https://github.com/datastax/pulsar/commit/3d16cf7) [feat][broker][branch-3.0] PIP-321 Introduce allowed-cluster at the namespace level (#22378) (#22960)
* [1a44c3d](https://github.com/datastax/pulsar/commit/1a44c3d) [improve] [broker] PIP-356 Support Geo-Replication starts at earliest position (#22856)
* [6e7943f](https://github.com/datastax/pulsar/commit/6e7943f) |[fix][broker] Fix updatePartitionedTopic when replication at ns level and topic policy is set (#22971)
* [64682a7](https://github.com/datastax/pulsar/commit/64682a7) [fix][broker] Support lookup options for extensible load manager (#22487)
* [fb72821](https://github.com/datastax/pulsar/commit/fb72821) [fix][broker] Check the broker is available for the SLA monitor bundle when the ExtensibleLoadManager is enabled (#22485)
* [b691da9](https://github.com/datastax/pulsar/commit/b691da9) [fix][broker] Ensure that PulsarService is ready for serving incoming requests (#22977)
* [eeb084f](https://github.com/datastax/pulsar/commit/eeb084f) [fix][broker] Update init and shutdown time and other minor logic (ExtensibleLoadManagerImpl only) (#22930)
* [cd5b194](https://github.com/datastax/pulsar/commit/cd5b194) [fix][broker] Asynchronously return brokerRegistry.lookupAsync when checking if broker is active(ExtensibleLoadManagerImpl only) (#22899)
* [d26f20d](https://github.com/datastax/pulsar/commit/d26f20d) [fix][broker] Fix NPE after publishing a tombstone to the service unit channel (#22859)
* [93b5fcf](https://github.com/datastax/pulsar/commit/93b5fcf) [fix][broker] Immediately tombstone Deleted and Free state bundles (#22743)
* [2049c72](https://github.com/datastax/pulsar/commit/2049c72) [fix][broker] Fix Replicated Topic unload bug when ExtensibleLoadManager is enabled (#22496)
* [3f48e5f](https://github.com/datastax/pulsar/commit/3f48e5f) [fix][client] Fix orphan consumer when reconnection and closing are concurrency executing (#22958)
* [2331017](https://github.com/datastax/pulsar/commit/2331017) [improve][misc] Replace rename-netty-native-libs.sh script with renaming with maven-shade-plugin (#22957)
* [245b197](https://github.com/datastax/pulsar/commit/245b197) Revert "[improve][broker] Optimize `ConcurrentOpenLongPairRangeSet` by RoaringBitmap (#22908)"
* [c404e19](https://github.com/datastax/pulsar/commit/c404e19) [improve] [broker] make system topic distribute evenly. (#22953)
* [659896e](https://github.com/datastax/pulsar/commit/659896e) [fix][misc] Rename netty native libraries in pulsar-client-admin-shaded (#22954)
* [717db84](https://github.com/datastax/pulsar/commit/717db84) [improve][fn] Make producer cache bounded and expiring in Functions/Connectors (#22945)
* [0f4c208](https://github.com/datastax/pulsar/commit/0f4c208) [improve][misc] Replace rename-netty-native-libs.sh script with renaming with maven-shade-plugin (#22957)
* [c4ab0b8](https://github.com/datastax/pulsar/commit/c4ab0b8) [fix][misc] Rename netty native libraries in pulsar-client-admin-shaded (#22954)
* [d8ddba4](https://github.com/datastax/pulsar/commit/d8ddba4) [fix][ci] Replace removed macos-11 with macos-latest in GitHub Actions (#22965)
* [59028a6](https://github.com/datastax/pulsar/commit/59028a6) [improve][misc][branch-3.2] Upgrade to Bookkeeper 4.16.6 (#22963)
* [f11db32](https://github.com/datastax/pulsar/commit/f11db32) [improve][broker] Optimize `ConcurrentOpenLongPairRangeSet` by RoaringBitmap (#22908)
* [8edc5ab](https://github.com/datastax/pulsar/commit/8edc5ab) [fix][broker] Check the markDeletePosition and calculate the backlog (#22947)
* [7d13506](https://github.com/datastax/pulsar/commit/7d13506) [fix][fn] Support compression type and crypto config for all producers in Functions and Connectors (#22950)
* [1610af1](https://github.com/datastax/pulsar/commit/1610af1) [fix] [broker] broker log a full thread dump when a deadlock is detected in healthcheck every time (#22916)
* [1dc870c](https://github.com/datastax/pulsar/commit/1dc870c) [fix] [client] Fix resource leak in Pulsar Client since HttpLookupService doesn't get closed (#22858)
* [4fc7561](https://github.com/datastax/pulsar/commit/4fc7561) [fix][test] Fix TableViewBuilderImplTest NPE and infinite loop (#22924)
* [01a2e20](https://github.com/datastax/pulsar/commit/01a2e20) [fix][fn] Enable optimized Netty direct byte buffer support for Pulsar Function runtimes (#22910)
* [94f9ec3](https://github.com/datastax/pulsar/commit/94f9ec3) [fix] [broker] Messages lost on the remote cluster when using topic level replication (#22890)
* [2c987c8](https://github.com/datastax/pulsar/commit/2c987c8) [fix][test] Fix thread leaks in Managed Ledger tests and remove duplicate shutdown code (#21426)
* [1ba6b3a](https://github.com/datastax/pulsar/commit/1ba6b3a) [fix][proxy] Add missing parameter in newPartitionMetadataRequest call
* [db274ec](https://github.com/datastax/pulsar/commit/db274ec) [fix][client] fix producer/consumer perform lookup for migrated topic (#21356)
* [b9c9930](https://github.com/datastax/pulsar/commit/b9c9930) [fix] [broker] response not-found error if topic does not exist when calling getPartitionedTopicMetadata (#22838)
* [87013b4](https://github.com/datastax/pulsar/commit/87013b4) [improve] [client] PIP-344 support feature flag supportsGetPartitionedMetadataWithoutAutoCreation (#22773)
* [a4094fa](https://github.com/datastax/pulsar/commit/a4094fa) [fix] [client] PIP-344 Do not create partitioned metadata when calling pulsarClient.getPartitionsForTopic(topicName) (#22206)
* [1d80bd3](https://github.com/datastax/pulsar/commit/1d80bd3) fix: cannot find symbol from cherry-pick 73b50e
* [7e7e2af](https://github.com/datastax/pulsar/commit/7e7e2af) [fix][broker] Fix topic status for oldestBacklogMessageAgeSeconds continuously increases even when there is no backlog. (#22907)
* [ee21988](https://github.com/datastax/pulsar/commit/ee21988) [fix][cli] Fix the pulsar-daemon parameter passthrough syntax (#22905)
* [f7ee78d](https://github.com/datastax/pulsar/commit/f7ee78d) [fix][broker][branch-3.0] The topic might reference a closed ledger (#22860) (#22900)
* [8ba2f71](https://github.com/datastax/pulsar/commit/8ba2f71) [improve][broker] Include runtime dependencies in server distribution (#22001)
* [0aa3d43](https://github.com/datastax/pulsar/commit/0aa3d43) [improve][broker] Optimize PersistentTopic.getLastDispatchablePosition (#22707)
* [48c2b7d](https://github.com/datastax/pulsar/commit/48c2b7d) [fix][misc] Topic name from persistence name should decode local name (#22879)
* [78a8e30](https://github.com/datastax/pulsar/commit/78a8e30) [improve] Upgrade IPAddress to 5.5.0 (#22886)
* [cf96763](https://github.com/datastax/pulsar/commit/cf96763) [fix][cli] Fix Pulsar standalone "--wipe-data" (#22885)
* [338f52d](https://github.com/datastax/pulsar/commit/338f52d) [fix][cli] Fix Pulsar standalone shutdown - bkCluster wasn't closed (#22868)
* [ed9e77a](https://github.com/datastax/pulsar/commit/ed9e77a) [fix] Remove blocking calls from BookieRackAffinityMapping (#22846)
* [aa39152](https://github.com/datastax/pulsar/commit/aa39152) [improve][misc] Include native epoll library for Netty for arm64 (#22319)
* [35876cc](https://github.com/datastax/pulsar/commit/35876cc) [improve][broker] Include runtime dependencies in server distribution (#22001)
* [0704fae](https://github.com/datastax/pulsar/commit/0704fae) [improve][ci] Migrate from Gradle Enterprise to Develocity (#22880)

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|---------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.11  | cassandra-enhanced-pulsar-sink-1.6.11-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 3.2.0   | pulsar-io-cloud-storage-3.2.0.nar             |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.3 | pulsar-io-data-generator-3.1.4.3.nar          |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.3 | pulsar-io-elastic-search-3.1.4.3.nar          |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.3 | pulsar-io-http-3.1.4.3.nar                    |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.3 | pulsar-io-jdbc-clickhouse-3.1.4.3.nar         |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.3 | pulsar-io-jdbc-mariadb-3.1.4.3.nar            |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.3 | pulsar-io-jdbc-openmldb-3.1.4.3.nar           |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.3 | pulsar-io-jdbc-postgres-3.1.4.3.nar           |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.3 | pulsar-io-jdbc-sqlite-3.1.4.3.nar             |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.3 | pulsar-io-kafka-3.1.4.3.nar                   |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.3 | pulsar-io-kinesis-3.1.4.3.nar                 |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.1.14  | pulsar-snowflake-connector-0.1.14.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version | File                                    |
|--------------------------------------------------------------------------|--------------------------------------|---------|-----------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.2.9   | pulsar-cassandra-source-2.2.9.nar       |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.3 | pulsar-io-data-generator-3.1.4.3.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.3 | pulsar-io-debezium-mongodb-3.1.4.3.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.3 | pulsar-io-debezium-mssql-3.1.4.3.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.3 | pulsar-io-debezium-mysql-3.1.4.3.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.3 | pulsar-io-debezium-oracle-3.1.4.3.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.3 | pulsar-io-debezium-postgres-3.1.4.3.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.3 | pulsar-io-kafka-3.1.4.3.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.3 | pulsar-io-kinesis-3.1.4.3.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.0.1  | pulsar-kafka-proxy-3.1.0.1.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version   | File                                      |
|----------------------------------------------------------------|----------------------------------------|-----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0  | starlight-rabbitmq-2.10.1.0.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.0.1   | pulsar-protocol-handler-kafka-3.1.0.1.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0  | starlight-rabbitmq-2.10.1.0.nar           |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.2.5   | pulsar-cassandra-admin-2.2.5-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 5.0.4   | pulsar-jms-admin-5.0.4-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 5.0.4   | pulsar-jms-5.0.4-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.1.9   | pulsar-ai-tools-3.1.9.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.1.9   | pulsar-transformations-3.1.9.nar |
</details>


### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls31_3.1/build.json) used for the build.


### Builtin connectors

- cassandra-enhanced-pulsar-sink-1.6.11-nar.nar
- pulsar-cassandra-source-2.2.9.nar
- pulsar-io-cloud-storage-2.10.0.nar
- pulsar-io-debezium-mongodb-3.1.4.3.nar
- pulsar-io-jdbc-sqlite-3.1.4.3.nar
- pulsar-io-kinesis-3.1.4.3.nar
- pulsar-io-data-generator-3.1.4.3.nar
- pulsar-io-elastic-search-3.1.4.3.nar
- pulsar-io-jdbc-clickhouse-3.1.4.3.nar
- pulsar-io-debezium-oracle-3.1.4.3.nar
- pulsar-io-jdbc-openmldb-3.1.4.3.nar
- pulsar-io-jdbc-postgres-3.1.4.3.nar
- pulsar-io-debezium-mssql-3.1.4.3.nar
- pulsar-io-debezium-mysql-3.1.4.3.nar
- pulsar-io-jdbc-mariadb-3.1.4.3.nar
- pulsar-io-debezium-postgres-3.1.4.3.nar
- pulsar-io-http-3.1.4.3.nar
- pulsar-io-kafka-3.1.4.3.nar
- pulsar-snowflake-connector-0.1.13.nar
- pulsar-protocol-handler-kafka-3.1.0.1.nar
- starlight-rabbitmq-2.10.1.0.nar
- pulsar-kafka-proxy-3.1.0.1.nar
- pulsar-jms-3.1.0-nar.nar

## Luna Streaming Distribution 3.1 4.2
This is a maintenance release of the DataStax Luna Streaming Distribution for 3.1. This release contains all the commits included in the Apache Pulsar branch-3.0 till 7th June 2024 plus the changes specific to Luna Streaming & important security updates.

### Most notable commits

* [22a0603](https://github.com/datastax/pulsar/commit/22a0603) [improve] Upgrade Jetcd to 0.7.7 and VertX to 4.5.8 (#22835) 
* [2c34c2c](https://github.com/datastax/pulsar/commit/2c34c2c) [improve] [client] improve the class GetTopicsResult (#22766) 
* [90bd00d](https://github.com/datastax/pulsar/commit/90bd00d) [fix][broker] Fix cursor should use latest ledger config (#22644)  
* [ec6af44](https://github.com/datastax/pulsar/commit/ec6af44) [cleanup][ml] ManagedCursor clean up. (#22246) 
* [4b6e6b5](https://github.com/datastax/pulsar/commit/4b6e6b5) [fix] Bump io.airlift:aircompressor from 0.20 to 0.27 (#22819) 
* [7b426c6](https://github.com/datastax/pulsar/commit/7b426c6) [fix][sec] Upgrade Bouncycastle libraries to address CVEs (#22826) 
* [12971bc](https://github.com/datastax/pulsar/commit/12971bc) [improve][ml] RangeCache refactoring follow-up: use StampedLock instead of synchronized (#22818) 
* [040465d](https://github.com/datastax/pulsar/commit/040465d) [improve][ml] RangeCache refactoring: test race conditions and prevent endless loops (#22814) 
* [6812af7](https://github.com/datastax/pulsar/commit/6812af7) [fix][ml] Fix race conditions in RangeCache (#22789) 
* [0ee3687](https://github.com/datastax/pulsar/commit/0ee3687) [fix][meta] Check if metadata store is closed in RocksdbMetadataStore (#22852) 
* [8f59cfb](https://github.com/datastax/pulsar/commit/8f59cfb) [improve][build] Support git worktree working directory while building docker images (#22851) 
* [232cde3](https://github.com/datastax/pulsar/commit/232cde3) [improve][broker] Remove ClassLoaderSwitcher to avoid objects allocations and consistent the codestyle (#22796) 
* [49902fe](https://github.com/datastax/pulsar/commit/49902fe) [improve][broker] Clear thread local BrokerEntryMetadata instance before reuse (#22752) 
* [bf9cdeb](https://github.com/datastax/pulsar/commit/bf9cdeb) [fix][broker] EntryFilters fix NoClassDefFoundError due to closed classloader (#22767) 
* [0f86864](https://github.com/datastax/pulsar/commit/0f86864) [improve][broker] avoid creating new objects when intercepting (#22790) 
* [b2ccc5f](https://github.com/datastax/pulsar/commit/b2ccc5f) [improve][cli][branch-3.0] PIP-353: Improve transaction message visibility for peek-message (#22788) 
* [f0c5776](https://github.com/datastax/pulsar/commit/f0c5776) [fix] [broker] fix topic partitions was expanded even if disabled topic level replication (#22769) 
* [0ddcd49](https://github.com/datastax/pulsar/commit/0ddcd49) [fix][admin] Clearly define REST API on Open API (#22783) 
* [80fd482](https://github.com/datastax/pulsar/commit/80fd482) [fix][admin] Clearly define REST API on Open API for Topics (#22782) 
* [37f16db](https://github.com/datastax/pulsar/commit/37f16db) [fix][admin] Clearly define REST API on Open API for Namesaces@v2 (#22775) 
* [3d57b6e](https://github.com/datastax/pulsar/commit/3d57b6e) [fix][admin][part-1]Clearly define REST API on Open API (#22774) 
* [1baa094](https://github.com/datastax/pulsar/commit/1baa094) [fix] [ml] Add entry fail due to race condition about add entry failed/timeout and switch ledger (#22221) 
* [8027d5c](https://github.com/datastax/pulsar/commit/8027d5c) [fix][ml]: subscription props could be lost in case of missing ledger during recovery (#22637) 
* [323013a](https://github.com/datastax/pulsar/commit/323013a) [fix] [broker] fix deadlock when disable topic level Geo-Replication (#22738) 
* [6b7e727](https://github.com/datastax/pulsar/commit/6b7e727) [improve] [test] Add a test to guarantee the TNX topics will not be replicated (#22721) 
* [f54d72d](https://github.com/datastax/pulsar/commit/f54d72d) [improve][broker] checkTopicExists supports checking partitioned topic without index (#21701) 
* [d611a3d](https://github.com/datastax/pulsar/commit/d611a3d) [feat][broker] Implementation of PIP-323: Complete Backlog Quota Telemetry (#21816) (#22740) | 
* [97a6c45](https://github.com/datastax/pulsar/commit/97a6c45) [fix][offload] Break the fillbuffer loop when met EOF (#22722) 
* [f52b0f5](https://github.com/datastax/pulsar/commit/f52b0f5) [fix][schema] Error checking schema compatibility on a schema-less topic via REST API (#22720) 
* [7e6d2c8](https://github.com/datastax/pulsar/commit/7e6d2c8) [improve] [broker] [break change] Do not create partitioned DLQ/Retry topic automatically (#22705) 
* [421188e](https://github.com/datastax/pulsar/commit/421188e) [fix][broker] Make ExtensibleLoadManagerImpl.getOwnedServiceUnits async (#22727) 

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|---------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.11  | cassandra-enhanced-pulsar-sink-1.6.11-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 2.10.0  | pulsar-io-cloud-storage-2.10.0.nar            |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.2| pulsar-io-data-generator-3.1.4.2.nar          |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.2 | pulsar-io-elastic-search-3.1.4.2.nar          |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.2 | pulsar-io-http-3.1.4.2.nar                    |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.2 | pulsar-io-jdbc-clickhouse-3.1.4.2.nar         |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.2 | pulsar-io-jdbc-mariadb-3.1.4.2.nar            |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.2 | pulsar-io-jdbc-openmldb-3.1.4.2.nar           |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.2 | pulsar-io-jdbc-postgres-3.1.4.2.nar           |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.2 | pulsar-io-jdbc-sqlite-3.1.4.2.nar             |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.2 | pulsar-io-kafka-3.1.4.2.nar                   |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.2 | pulsar-io-kinesis-3.1.4.2.nar                 |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.1.13  | pulsar-snowflake-connector-0.1.13.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version | File                                    |
|--------------------------------------------------------------------------|--------------------------------------|---------|-----------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.2.9   | pulsar-cassandra-source-2.2.9.nar       |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.2 | pulsar-io-data-generator-3.1.4.2.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.2 | pulsar-io-debezium-mongodb-3.1.4.2.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.2 | pulsar-io-debezium-mssql-3.1.4.2.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.2 | pulsar-io-debezium-mysql-3.1.4.2.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.2 | pulsar-io-debezium-oracle-3.1.4.2.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.2 | pulsar-io-debezium-postgres-3.1.4.2.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.2 | pulsar-io-kafka-3.1.4.2.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.2 | pulsar-io-kinesis-3.1.4.2.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.4.2  | pulsar-kafka-proxy-3.1.4.2.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version  | File                                      |
|----------------------------------------------------------------|----------------------------------------|----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.4.2  | pulsar-protocol-handler-kafka-3.1.4.2.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar           |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.2.5   | pulsar-cassandra-admin-2.2.5-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 3.1.0   | pulsar-jms-admin-3.1.0-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 3.1.0   | pulsar-jms-3.1.0-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.1.7   | pulsar-ai-tools-3.1.7.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.1.1   | pulsar-transformations-3.1.1.nar |
</details>


### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls31_3.1/build.json) used for the build.


### Builtin connectors

- cassandra-enhanced-pulsar-sink-1.6.11-nar.nar
- pulsar-cassandra-source-2.2.9.nar
- pulsar-io-cloud-storage-2.10.0.nar
- pulsar-io-debezium-mongodb-3.1.4.2.nar
- pulsar-io-jdbc-sqlite-3.1.4.2.nar
- pulsar-io-kinesis-3.1.4.2.nar
- pulsar-io-data-generator-3.1.4.2.nar
- pulsar-io-elastic-search-3.1.4.2.nar
- pulsar-io-jdbc-clickhouse-3.1.4.2.nar
- pulsar-io-debezium-oracle-3.1.4.2.nar
- pulsar-io-jdbc-openmldb-3.1.4.2.nar
- pulsar-io-jdbc-postgres-3.1.4.2.nar
- pulsar-io-debezium-mssql-3.1.4.2.nar
- pulsar-io-debezium-mysql-3.1.4.2.nar
- pulsar-io-jdbc-mariadb-3.1.4.2.nar
- pulsar-io-debezium-postgres-3.1.4.2.nar
- pulsar-io-http-3.1.4.2.nar
- pulsar-io-kafka-3.1.4.2.nar
- pulsar-snowflake-connector-0.1.13.nar
- pulsar-protocol-handler-kafka-3.1.4.2.nar
- starlight-rabbitmq-2.10.1.0.nar
- pulsar-kafka-proxy-3.1.4.2.nar
- pulsar-jms-3.1.0-nar.nar

## Luna Streaming Distribution 3.1 4.1
This is a maintenance release of the DataStax Luna Streaming Distribution for 3.1. This release contains all the commits included in the Apache Pulsar branch-3.0 till 15th May 2024 plus the changes specific to Luna Streaming & important security updates.

### Most notable commits

* [4fa1c21](https://github.com/datastax/pulsar/commit/4fa1c21) [improve][ci][branch-3.0] Upgrade actions in pulsar-ci and pulsar-ci-flaky, port owasp cache change
* [53f0b91](https://github.com/datastax/pulsar/commit/53f0b91) [fix][test] Fix NPE in BookKeeperClusterTestCase tearDown (#22493)
* [99c2a9d](https://github.com/datastax/pulsar/commit/99c2a9d) [fix][broker] fix replicated subscriptions for transactional messages (#22452)
* [7042b52](https://github.com/datastax/pulsar/commit/7042b52) [fix] [broker] rename to changeMaxReadPositionCount (#22656)
* [1a02229](https://github.com/datastax/pulsar/commit/1a02229) [fix][sec] Upgrade postgresql version to avoid CVE-2024-1597 (#22635)
* [0a02cd9](https://github.com/datastax/pulsar/commit/0a02cd9) [fix][client] Fix ReaderBuilder doest not give illegalArgument on connection failure retry (#22639)
* [79f8e29](https://github.com/datastax/pulsar/commit/79f8e29) [fix][broker] Fix ProducerBusy issue due to incorrect userCreatedProducerCount on non-persistent topic (#22685)
* [c07b665](https://github.com/datastax/pulsar/commit/c07b665) [fix][broker] avoid offload system topic (#22497)
* [df29a6c](https://github.com/datastax/pulsar/commit/df29a6c) [improve][ws] Add memory limit configuration for Pulsar client used in Websocket proxy (#22666)
* [b69857d](https://github.com/datastax/pulsar/commit/b69857d) [fix][broker] Disable system topic message deduplication (#22582)
* [45b86eb](https://github.com/datastax/pulsar/commit/45b86eb) [fix] Fix Reader can be stuck from transaction aborted messages. (#22610)
* [fc7e6d7](https://github.com/datastax/pulsar/commit/fc7e6d7) [fix][test] Clear MockedPulsarServiceBaseTest fields to prevent test runtime memory leak (#22659)
* [a62730f](https://github.com/datastax/pulsar/commit/a62730f) [fix][storage] ReadonlyManagedLedger initialization does not fill in the properties (#22630)
* [703bdc5](https://github.com/datastax/pulsar/commit/703bdc5) [fix][sec] Upgrade elasticsearch-java version to avoid CVE-2023-4043 (#22640)
* [c37f354](https://github.com/datastax/pulsar/commit/c37f354) [fix] [client] Fix Consumer should return configured batch receive max messages (#22619)
* [dd9db88](https://github.com/datastax/pulsar/commit/dd9db88) [fix][sec] Upgrade aws-sdk.version to avoid CVE-2024-21634 (#22633)
* [87c4df3](https://github.com/datastax/pulsar/commit/87c4df3) [fix][fn]make sure the classloader for ContextImpl is `functionClassLoader` in different runtimes (#22501)
* [d9dc63c](https://github.com/datastax/pulsar/commit/d9dc63c) [fix][broker] Avoid being stuck when closing the broker with extensible load manager (#22573)
* [d6500ee](https://github.com/datastax/pulsar/commit/d6500ee) [fix][io] Fix es index creation (#22654) (#22701)
* [eede7fc](https://github.com/datastax/pulsar/commit/eede7fc) [improve] [log] Print source client addr when enabled haProxyProtocolEnabled (#22686)
* [cf92979](https://github.com/datastax/pulsar/commit/cf92979) [fix][broker] usedLocallySinceLastReport should always be reset (#22672)
* [790ac4e](https://github.com/datastax/pulsar/commit/790ac4e) [improve] Retry re-validating ResourceLock with backoff after errors (#22617)
* [0ac03da](https://github.com/datastax/pulsar/commit/0ac03da) [fix] [broker] Fix configurationMetadataSyncEventTopic is marked supporting dynamic setting, but not implemented  (#22684)
* [9669b4c](https://github.com/datastax/pulsar/commit/9669b4c) [fix][broker] Fix typos lister -> listener (#21068)
* [2a96f95](https://github.com/datastax/pulsar/commit/2a96f95) [improve][offload] Replace usage of shaded class in OffsetsCache (#22683)
* [3ed7f4c](https://github.com/datastax/pulsar/commit/3ed7f4c) [fix][offload] Fix OOM in tiered storage, caused by unbounded offsets cache (#22679)
* [fcf0183](https://github.com/datastax/pulsar/commit/fcf0183) [fix] [broker] Fix nothing changed after removing dynamic configs (#22673)
* [e3ac347](https://github.com/datastax/pulsar/commit/e3ac347) [fix] [test] Fix flaky test ReplicatorTest (#22594)
* [45de62a](https://github.com/datastax/pulsar/commit/45de62a) [fix][broker] One topic can be closed multiple times concurrently (#17524)
* [90036e1](https://github.com/datastax/pulsar/commit/90036e1) [fix] [broker] Part-2: Replicator can not created successfully due to an orphan replicator in the previous topic owner (#21948)
* [81fbc82](https://github.com/datastax/pulsar/commit/81fbc82) [improve] [broker] Create partitioned topics automatically when enable topic level replication (#22537)
* [ad55f97](https://github.com/datastax/pulsar/commit/ad55f97) [fix] [broker] Part-1: Replicator can not created successfully due to an orphan replicator in the previous topic owner (#21946)
* [43f4b41](https://github.com/datastax/pulsar/commit/43f4b41) [fix] [ml] Mark delete stuck due to switching cursor ledger fails (#22662)
* [da6212a](https://github.com/datastax/pulsar/commit/da6212a) [fix] [broker] Fix metrics pulsar_topic_load_failed_count is 0 when load non-persistent topic fails and fix the flaky test testBrokerStatsTopicLoadFailed (#22580)
* [32aff55](https://github.com/datastax/pulsar/commit/32aff55) [fix][test] Fix the flaky tests of ManagedLedgerImplUtilsTest (#22611)
* [275090a](https://github.com/datastax/pulsar/commit/275090a) [fix][broker] Reader stuck after call hasMessageAvailable when enable replicateSubscriptionState (#22572)
* [07b40ee](https://github.com/datastax/pulsar/commit/07b40ee) [fix][test] Clear fields in test cleanup to reduce memory consumption (#22583)
* [010a3f9](https://github.com/datastax/pulsar/commit/010a3f9) [fix][test] Fix resource leak in TransactionCoordinatorClientTest (#21380)
* [484f611](https://github.com/datastax/pulsar/commit/484f611) [fix][admin] Fix namespace admin api exception response (#22587)
* [09679d3](https://github.com/datastax/pulsar/commit/09679d3) [improve][sec] Align some namespace level policy authorisation check (#21640)
* [f2081cf](https://github.com/datastax/pulsar/commit/f2081cf) [fix][io] CompressionEnabled didn't work on elasticsearch sink (#22565)
* [72d2891](https://github.com/datastax/pulsar/commit/72d2891) [fix][test] Flaky-test: ManagedLedgerTest.testTimestampOnWorkingLedger (#22600)
* [c9586ae](https://github.com/datastax/pulsar/commit/c9586ae) [improve][broker] Propagate cause exception in TopicBusyException when applicable (#22596)
* [d1e3cce](https://github.com/datastax/pulsar/commit/d1e3cce) [improve][meta] Log a warning when ZK batch fails with connectionloss (#22566)
* [567aa99](https://github.com/datastax/pulsar/commit/567aa99) [fix][broker] Fix BufferOverflowException and EOFException bugs in /metrics gzip compression (#22576)
* [5bf373d](https://github.com/datastax/pulsar/commit/5bf373d) [improve][broker]Ensure namespace deletion doesn't fail (#259)
* [75b2db9](https://github.com/datastax/pulsar/commit/75b2db9) [improve][storage] Periodically rollover Cursor ledgers (#257)

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name                                                                     | Description                                                                                                  | Version | File                                          |
|--------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------|---------|-----------------------------------------------|
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink)            | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.11  | cassandra-enhanced-pulsar-sink-1.6.11-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage                                                                               | 2.10.0  | pulsar-io-cloud-storage-2.10.0.nar            |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source                                                                                   | 3.1.4.1 | pulsar-io-data-generator-3.1.4.1.nar          |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors)           | Writes data into Elastic Search                                                                              | 3.1.4.1 | pulsar-io-elastic-search-3.1.4.1.nar          |
| [http](https://pulsar.apache.org/docs/io-connectors)                     | Writes data to an HTTP server (Webhook)                                                                      | 3.1.4.1 | pulsar-io-http-3.1.4.1.nar                    |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors)          | JDBC sink for ClickHouse                                                                                     | 3.1.4.1 | pulsar-io-jdbc-clickhouse-3.1.4.1.nar         |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors)             | JDBC sink for MariaDB                                                                                        | 3.1.4.1 | pulsar-io-jdbc-mariadb-3.1.4.1.nar            |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for OpenMLDB                                                                                       | 3.1.4.1 | pulsar-io-jdbc-openmldb-3.1.4.1.nar           |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors)            | JDBC sink for PostgreSQL                                                                                     | 3.1.4.1 | pulsar-io-jdbc-postgres-3.1.4.1.nar           |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors)              | JDBC sink for SQLite                                                                                         | 3.1.4.1 | pulsar-io-jdbc-sqlite-3.1.4.1.nar             |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector                                                                              | 3.1.4.1 | pulsar-io-kafka-3.1.4.1.nar                   |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                                                                                           | 3.1.4.1 | pulsar-io-kinesis-3.1.4.1.nar                 |
| [snowflake](https://github.com/datastax/snowflake-connector)             | Snowflake Connector                                                                                          | 0.1.13  | pulsar-snowflake-connector-0.1.13.nar         |
</details>
<details><summary>Sources</summary>

| Name                                                                     | Description                          | Version | File                                    |
|--------------------------------------------------------------------------|--------------------------------------|---------|-----------------------------------------|
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra             | 2.2.9   | pulsar-cassandra-source-2.2.9.nar       |
| [data-generator](https://pulsar.apache.org/docs/io-connectors)           | Test data generator source           | 3.1.4.1 | pulsar-io-data-generator-3.1.4.1.nar    |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors)         | Debezium MongoDb Source              | 3.1.4.1 | pulsar-io-debezium-mongodb-3.1.4.1.nar  |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors)           | Debezium Microsoft SQL Server Source | 3.1.4.1 | pulsar-io-debezium-mssql-3.1.4.1.nar    |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors)           | Debezium MySql Source                | 3.1.4.1 | pulsar-io-debezium-mysql-3.1.4.1.nar    |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors)          | Debezium Oracle Source               | 3.1.4.1 | pulsar-io-debezium-oracle-3.1.4.1.nar   |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors)        | Debezium Postgres Source             | 3.1.4.1 | pulsar-io-debezium-postgres-3.1.4.1.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors)                    | Kafka source and sink connector      | 3.1.4.1 | pulsar-io-kafka-3.1.4.1.nar             |
| [kinesis](https://pulsar.apache.org/docs/io-connectors)                  | Kinesis connectors                   | 3.1.4.1 | pulsar-io-kinesis-3.1.4.1.nar           |
</details>
<details><summary>Proxy extensions</summary>

| Name                                                           | Description                            | Version  | File                            |
|----------------------------------------------------------------|----------------------------------------|----------|---------------------------------|
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Proxy Extension                  | 3.1.4.1  | pulsar-kafka-proxy-3.1.4.1.nar  |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name                                                           | Description                            | Version  | File                                      |
|----------------------------------------------------------------|----------------------------------------|----------|-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka)       | Kafka Protocol Handler                 | 3.1.4.1  | pulsar-protocol-handler-kafka-3.1.4.1.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar           |
</details>
<details><summary>CLI extensions</summary>

| Name                                                          | Description                                      | Version | File                                 |
|---------------------------------------------------------------|--------------------------------------------------|---------|--------------------------------------|
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands     | 2.2.5   | pulsar-cassandra-admin-2.2.5-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors)           | Starlight for JMS - Pulsar Admin Custom Commands | 3.1.0   | pulsar-jms-admin-3.1.0-nar.nar       |
</details>
<details><summary>Filters</summary>

| Name                                                | Description                                         | Version | File                     |
|-----------------------------------------------------|-----------------------------------------------------|---------|--------------------------|
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 3.1.0   | pulsar-jms-3.1.0-nar.nar |
</details>
<details><summary>Functions</summary>

| Name                                                       | Description             | Version | File                             |
|------------------------------------------------------------|-------------------------|---------|----------------------------------|
| [ai-tools](https://pulsar.apache.org/docs/io-connectors)   | Generative AI tools     | 3.1.7   | pulsar-ai-tools-3.1.7.nar        |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.1.1   | pulsar-transformations-3.1.1.nar |
</details>


### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls31_3.1/build.json) used for the build.


### Builtin connectors

- cassandra-enhanced-pulsar-sink-1.6.11-nar.nar
- pulsar-cassandra-source-2.2.9.nar
- pulsar-io-cloud-storage-2.10.0.nar
- pulsar-io-debezium-mongodb-3.1.4.1.nar
- pulsar-io-jdbc-sqlite-3.1.4.1.nar
- pulsar-io-kinesis-3.1.4.1.nar
- pulsar-io-data-generator-3.1.4.1.nar
- pulsar-io-elastic-search-3.1.4.1.nar
- pulsar-io-jdbc-clickhouse-3.1.4.1.nar
- pulsar-io-debezium-oracle-3.1.4.1.nar
- pulsar-io-jdbc-openmldb-3.1.4.1.nar
- pulsar-io-jdbc-postgres-3.1.4.1.nar
- pulsar-io-debezium-mssql-3.1.4.1.nar
- pulsar-io-debezium-mysql-3.1.4.1.nar
- pulsar-io-jdbc-mariadb-3.1.4.1.nar
- pulsar-io-debezium-postgres-3.1.4.1.nar
- pulsar-io-http-3.1.4.1.nar
- pulsar-io-kafka-3.1.4.1.nar
- pulsar-snowflake-connector-0.1.13.nar
- pulsar-protocol-handler-kafka-3.1.4.1.nar
- starlight-rabbitmq-2.10.1.0.nar
- pulsar-kafka-proxy-3.1.4.1.nar
- pulsar-jms-3.1.0-nar.nar

## Luna Streaming Distribution 3.1 4.0
This is a maintenance release of the DataStax Luna Streaming Distribution for 3.1. This release contains all the commits included in the Apache Pulsar branch-3.0 till 23 April 2024 plus the changes specific to Luna Streaming & important security updates.

### Most notable commits

* [6b7aa50bdda](https://github.com/datastax/pulsar/commit/6b7aa50bdda) [fix][test][branch-3.0] Fix test PersistentTopicsTest.testUpdatePartitionedTopic
* [2f451301e26](https://github.com/datastax/pulsar/commit/2f451301e26) Revert "[fix][test][branch-3.0] Fix broken ManagedLedgerTest.testGetNumberOfEntriesInStorage"
* [b7c5eaf94fc](https://github.com/datastax/pulsar/commit/b7c5eaf94fc) [fix][offload] Increase file upload limit from 2048MiB to 4096MiB for GCP/GCS offloading (#22554)
* [fd8329d93f1](https://github.com/datastax/pulsar/commit/fd8329d93f1) [fix][ml] Fix NPE of getValidPositionAfterSkippedEntries when recovering a terminated managed ledger (#22552)
* [287e456b0c1](https://github.com/datastax/pulsar/commit/287e456b0c1) [improve][broker] Support X-Forwarded-For and HA Proxy Protocol for resolving original client IP of http/https requests (#22524)
* [0904a475d47](https://github.com/datastax/pulsar/commit/0904a475d47) [fix][broker] Fix broken topic policy implementation compatibility with old pulsar version (#22535)
* [973fdceb34b](https://github.com/datastax/pulsar/commit/973fdceb34b) [fix][broker] Fix typos in Consumer class (#22532)
* [a207029aedb](https://github.com/datastax/pulsar/commit/a207029aedb) [improve][test] Move ShadowManagedLedgerImplTest to flaky tests (#22526)
* [58029496b2b](https://github.com/datastax/pulsar/commit/58029496b2b) [improve][broker] Repeat the handleMetadataChanges callback when configurationMetadataStore equals localMetadataStore (#22519)
* [00c2fbb4597](https://github.com/datastax/pulsar/commit/00c2fbb4597) [improve][broker] Add topic name to emitted error messages. (#22506)
* [d2b3eb7351f](https://github.com/datastax/pulsar/commit/d2b3eb7351f) [improve] Make the config `metricsBufferResponse` description more effective (#22490)
* [19c7f8e86e0](https://github.com/datastax/pulsar/commit/19c7f8e86e0) [fix][test] SchemaMap in AutoConsumeSchema has been reused (#22500)
* [ef4deb13abf](https://github.com/datastax/pulsar/commit/ef4deb13abf) [fix][broker] Fix message drop record in producer stat (#22458)
* [fcf433d7d01](https://github.com/datastax/pulsar/commit/fcf433d7d01) [fix][broker] Update topic partition failed when config maxNumPartitionsPerPartitionedTopic<0 (#22397)
* [b195ef00a7b](https://github.com/datastax/pulsar/commit/b195ef00a7b) [improve][build] Upgrade Lombok to 1.18.32 for Java 22 support (#22425)
* [b336996a926](https://github.com/datastax/pulsar/commit/b336996a926) Fix [improve] [proxy] Not close the socket if lookup failed caused by too many requests (apache#21216)
* [b7e0a19a6bc](https://github.com/datastax/pulsar/commit/b7e0a19a6bc) [improve][broker] backlog quota exceed limit log replaced with `debug` (#22475)
* [b356f1be1f3](https://github.com/datastax/pulsar/commit/b356f1be1f3) [improve][offload] Apply autoSkipNonRecoverableData configuration to tiered storage (#22531)
* [f87ef7487dd](https://github.com/datastax/pulsar/commit/f87ef7487dd) [fix][broker] Fix NPE causing dispatching to stop when using Key_Shared mode and allowOutOfOrderDelivery=true (#22533)
* [3008d35a079](https://github.com/datastax/pulsar/commit/3008d35a079) [improve][build] Upgrade OWASP Dependency check version to 9.1.0 (#22530)
* [984d3c06748](https://github.com/datastax/pulsar/commit/984d3c06748) [fix][broker] Fix a deadlock in SystemTopicBasedTopicPoliciesService during NamespaceEventsSystemTopicFactory init (#22528)
* [f8d509852cd](https://github.com/datastax/pulsar/commit/f8d509852cd) [improve][broker] Optimize gzip compression for /metrics endpoint by sharing/caching compressed result (#22521)
* [c87fa4ea1c4](https://github.com/datastax/pulsar/commit/c87fa4ea1c4) [fix][io] Kafka Source connector maybe stuck (#22511)
* [f3740572aaa](https://github.com/datastax/pulsar/commit/f3740572aaa) [fix][sec] Upgrade Bouncycastle to 1.78 (#22509)
* [ce3b816b691](https://github.com/datastax/pulsar/commit/ce3b816b691) [fix][test] Flaky-test: testMessageExpiryWithTimestampNonRecoverableException and testIncorrectClientClock (#22489)
* [7d1d0bb61a5](https://github.com/datastax/pulsar/commit/7d1d0bb61a5) [fix][broker] Create new ledger after the current ledger is closed (#22034)
* [0b001837598](https://github.com/datastax/pulsar/commit/0b001837598) [fix][broker] Optimize /metrics, fix unbounded request queue issue and fix race conditions in metricsBufferResponse mode (#22494)
* [961ecce291d](https://github.com/datastax/pulsar/commit/961ecce291d) [improve][broker] Improve Gzip compression, allow excluding specific paths or disabling it (#22370)
* [7f05b6e1f3e](https://github.com/datastax/pulsar/commit/7f05b6e1f3e) [improve][test] Replace usage of curl in Java test and fix stream leaks (#22463)
* [ba98afe1225](https://github.com/datastax/pulsar/commit/ba98afe1225) [improve] [broker] Servlet support response compression (#21667)
* [ca62ee3aba1](https://github.com/datastax/pulsar/commit/ca62ee3aba1) [fix] [broker] Prevent long deduplication cursor backlog so that topic loading wouldn't timeout (#22479)
* [d1b4588de82](https://github.com/datastax/pulsar/commit/d1b4588de82) [fix][txn]Handle exceptions in the transaction pending ack init (#21274)
* [aae0f48cb7e](https://github.com/datastax/pulsar/commit/aae0f48cb7e) [improve][misc] Upgrade to Bookkeeper 4.16.5 (#22484)
* [6d1bd3a82a0](https://github.com/datastax/pulsar/commit/6d1bd3a82a0) Remove unused fields `msgSize`
* [457257c9846](https://github.com/datastax/pulsar/commit/457257c9846) [fix][client] Fix client side memory leak when call MessageImpl.create and fix imprecise client-side metrics: pendingMessagesUpDownCounter, pendingBytesUpDownCounter, latencyHistogram (#22393)
* [cedc250faa7](https://github.com/datastax/pulsar/commit/cedc250faa7) [fix][ml] No rollover inactive ledgers when metadata service invalid (#22284)
* [fd4c9c6c8ec](https://github.com/datastax/pulsar/commit/fd4c9c6c8ec) [improve][io]: Add validation for JDBC sink not supporting primitive schema (#22376)
* [a5b9be343c8](https://github.com/datastax/pulsar/commit/a5b9be343c8) [admin][broker] Fix force delete subscription not working (#22423)
* [8f3e1fd6759](https://github.com/datastax/pulsar/commit/8f3e1fd6759) [fix][broker] Fix consumer stops receiving messages when with large backlogs processing (#22454)
* [8e2bd551915](https://github.com/datastax/pulsar/commit/8e2bd551915) [fix][misc] Rename all shaded Netty native libraries (#22415)
* [2e1c0c78fe2](https://github.com/datastax/pulsar/commit/2e1c0c78fe2) [fix][broker] Support OIDC providers with JWK without alg field set in keys (#22421)
* [3eb5c2d8f49](https://github.com/datastax/pulsar/commit/3eb5c2d8f49) [improve] [broker] Avoid repeated Read-and-discard when using Key_Shared mode (#22245)
* [ddf77be02eb](https://github.com/datastax/pulsar/commit/ddf77be02eb) [improve][test][branch-3.0] Improve ManagedLedgerTest.testGetNumberOfEntriesInStorage
* [6b37ac6ab94](https://github.com/datastax/pulsar/commit/6b37ac6ab94) [improve][misc] Pin Netty version in pulsar-io/alluxio (#21728)
* [9c1a8f28345](https://github.com/datastax/pulsar/commit/9c1a8f28345) [fix][build] Upgrade alluxio version to 2.9.3 to fix CVE-2023-38889 (#21715)
* [ec47aa7972c](https://github.com/datastax/pulsar/commit/ec47aa7972c) [fix][test] Fix flaky test BrokerServiceAutoSubscriptionCreationTest (#22190)
* [8035e668cbb](https://github.com/datastax/pulsar/commit/8035e668cbb) [fix][test][branch-3.0] Fix broken ManagedLedgerTest.testGetNumberOfEntriesInStorage
* [fcb759c6ae5](https://github.com/datastax/pulsar/commit/fcb759c6ae5) [improve][misc] Remove the call to sun InetAddressCachePolicy (#22329)
* [95c06755fa6](https://github.com/datastax/pulsar/commit/95c06755fa6) [fix][broker] Check cursor state before adding it to the `waitingCursors` (#22191)
* [6916dfade17](https://github.com/datastax/pulsar/commit/6916dfade17) [fix][client] Fix wrong results of hasMessageAvailable and readNext after seeking by timestamp (#22363)
* [60d8ecc481f](https://github.com/datastax/pulsar/commit/60d8ecc481f) [fix][broker] Avoid execute prepareInitPoliciesCacheAsync if namespace is deleted (#22268)
* [e9e57ded38c](https://github.com/datastax/pulsar/commit/e9e57ded38c) [fix][broker] Fix wrong double-checked locking for readOnActiveConsumerTask in dispatcher (#22279)
* [51f7cf5bcd1](https://github.com/datastax/pulsar/commit/51f7cf5bcd1) [fix][client] fix Reader.hasMessageAvailable might return true after seeking to latest (#22201)
* [4fcaec3cd63](https://github.com/datastax/pulsar/commit/4fcaec3cd63) [improve][client] Add backoff for `seek` (#20963)
* [781423d7d2c](https://github.com/datastax/pulsar/commit/781423d7d2c) [fix][misc] Make ConcurrentBitSet thread safe (#22361)
* [db1005dbbb6](https://github.com/datastax/pulsar/commit/db1005dbbb6) [fix][broker] Avoid expired unclosed ledgers when checking expired messages by ledger closure time (#22335)
* [b54b249a6bb](https://github.com/datastax/pulsar/commit/b54b249a6bb) [fix][test] Fix flaky RGUsageMTAggrWaitForAllMsgsTest (#22252)
* [3233fd29733](https://github.com/datastax/pulsar/commit/3233fd29733) [fix][client] Consumer lost message ack due to race condition in acknowledge with batch message (#22353)
* [00477abf668](https://github.com/datastax/pulsar/commit/00477abf668) [fix][test] Fix flaky ManagedLedgerErrorsTest.recoverAfterZnodeVersionError (#22368)
* [afd46d22838](https://github.com/datastax/pulsar/commit/afd46d22838) [fix] [test] Fix flaky test ManagedLedgerTest.testGetNumberOfEntriesInStorage (#22344)
* [b46b0c365dd](https://github.com/datastax/pulsar/commit/b46b0c365dd) [fix][ml]Expose ledger timestamp  (#22338)
* [d67d44df59f](https://github.com/datastax/pulsar/commit/d67d44df59f) [fix][client]Fixed getting an incorrect `maxMessageSize` value when accessing multiple clusters in the same process (#22306)
* [eb8fb8226d0](https://github.com/datastax/pulsar/commit/eb8fb8226d0) [improve][admin] Fix the `createMissingPartitions` doesn't response correctly (#22311)
* [f1213831ce3](https://github.com/datastax/pulsar/commit/f1213831ce3) [fix][sec] Go Functions security updates (#21844)
* [b1eae3b2f38](https://github.com/datastax/pulsar/commit/b1eae3b2f38) [fix][sec] Bump google.golang.org/grpc from 1.38.0 to 1.56.3 in /pulsar-function-go (#21444)
* [29b83591a7f](https://github.com/datastax/pulsar/commit/29b83591a7f) [fix] [broker] fix mismatch between dispatcher.consumerList and dispatcher.consumerSet (#22283)
* [4764b4439a7](https://github.com/datastax/pulsar/commit/4764b4439a7) [fix] [broker] Close dispatchers stuck due to mismatch between dispatcher.consumerList and dispatcher.consumerSet (#22270)
* [66959be7541](https://github.com/datastax/pulsar/commit/66959be7541) [fix] [client] Unclear error message when creating a consumer with two same topics (#22255)
* [53c09015291](https://github.com/datastax/pulsar/commit/53c09015291) [improve][broker] Add missing configuration keys for caching catch-up reads (#22295)
* [874847b35b8](https://github.com/datastax/pulsar/commit/874847b35b8) [improve][broker] Add createTopicIfDoesNotExist option to RawReader constructor (#22264)
* [ba9ac4c97d4](https://github.com/datastax/pulsar/commit/ba9ac4c97d4) Fix the tests with same namespace name (#22240)
* [153413750b0](https://github.com/datastax/pulsar/commit/153413750b0) Check the validity of config before start websocket service (#22231)
* [ac10a3c2a0a](https://github.com/datastax/pulsar/commit/ac10a3c2a0a) [fix][client] GenericProtobufNativeSchema not implement getNativeSchema method. (#22204)
* [9edef69d353](https://github.com/datastax/pulsar/commit/9edef69d353) [improve][broker] Change log level to reduce duplicated logs (#22147)
* [1c6206b6347](https://github.com/datastax/pulsar/commit/1c6206b6347) [improve][fn][branch-3.0] Add missing "exception" argument to some `log.error` (#22140) (#22213)
* [fcb76f781ac](https://github.com/datastax/pulsar/commit/fcb76f781ac) [improve][admin][branch-3.0] Expose the offload threshold in seconds to the admin (#22169)
* [98aa8078cf0](https://github.com/datastax/pulsar/commit/98aa8078cf0) [fix][broker] Fix String wrong format (#21829)
* [0381bc4ad7f](https://github.com/datastax/pulsar/commit/0381bc4ad7f) [fix] [broker] [branch-3.0] Fast fix infinite HTTP call createSubscriptions caused by wrong topicName (#21997)
* [9231e727c78](https://github.com/datastax/pulsar/commit/9231e727c78) [fix] [build] Remove test testNoOrphanTopicIfInitFailed (#21569)
* [7857ffb3290](https://github.com/datastax/pulsar/commit/7857ffb3290) [fix] [broker] Make the new exclusive consumer instead the inactive one faster (#21183)
* [e55318c1e30](https://github.com/datastax/pulsar/commit/e55318c1e30) [fix] [ml] fix wrong msg backlog of non-durable cursor after trim ledgers (#21250)
* [ed12a345c98](https://github.com/datastax/pulsar/commit/ed12a345c98) [fix] [ml] Reader can set read-pos to a deleted ledger (#21248)
* [5ceb05663eb](https://github.com/datastax/pulsar/commit/5ceb05663eb) [fix] [client] fix reader.hasMessageAvailable return false when incoming queue is not empty (#21259)
* [0c95498009f](https://github.com/datastax/pulsar/commit/0c95498009f) [improve] [broker] Print warn log if ssl handshake error & print ledger id when switch ledger (#21201)
* [c691c75f859](https://github.com/datastax/pulsar/commit/c691c75f859) [improve] [proxy] Not close the socket if lookup failed caused by too many requests (#21216)
* [7dfa2000bee](https://github.com/datastax/pulsar/commit/7dfa2000bee) [improve] [broker] improve read entry error log for troubleshooting (#21169)
* [8ddc0763571](https://github.com/datastax/pulsar/commit/8ddc0763571) [improve] [broker] Improve cache handling for partitioned topic metadata when doing lookup (#21063)
* [63f9385da41](https://github.com/datastax/pulsar/commit/63f9385da41) [fix] [broker] Producer is blocked on creation because backlog exceeded on topic, when dedup is enabled and no producer is there (#20951)
* [1ccb17ac8e6](https://github.com/datastax/pulsar/commit/1ccb17ac8e6) Revert "[fix][broker] Fix get topic policies as null during clean cache (#20763)"
* [23f6213b525](https://github.com/datastax/pulsar/commit/23f6213b525) [fix] [bk] Correctct the bookie info after ZK client is reconnected (#21035)
* [5b9dff35f6c](https://github.com/datastax/pulsar/commit/5b9dff35f6c) [fix] [ml] fix discontinuous ledger deletion (#20898)
* [7352c8f92ed](https://github.com/datastax/pulsar/commit/7352c8f92ed) [fix][io][branch-3.0] Not restart instance when kafka source poll exception. (#20818)
* [a64286773c3](https://github.com/datastax/pulsar/commit/a64286773c3) Revert Add listener interface for namespace service #20406
* [cbfb1301b39](https://github.com/datastax/pulsar/commit/cbfb1301b39) Revert "[fix][broker] Fix NPE when reset Replicator's cursor by position. (#20597)"
* [f64edd39532](https://github.com/datastax/pulsar/commit/f64edd39532) [fix][broker] Fix OpReadEntry.skipCondition NPE issue (#22367)
* [5ae9877d9f4](https://github.com/datastax/pulsar/commit/5ae9877d9f4) [feat]PIP 167: Make it Configurable to Require Subscription Permission for Consumer (#246)


### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name | Description | Version | File |
| ---- | ----------- | ------- | ---- |
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink) | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.11 | cassandra-enhanced-pulsar-sink-1.6.11-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage | 2.10.0 | pulsar-io-cloud-storage-2.10.0.nar |
| [data-generator](https://pulsar.apache.org/docs/io-connectors) | Test data generator source | 3.1.4.0 | pulsar-io-data-generator-3.1.4.0.nar |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors) | Writes data into Elastic Search | 3.1.4.0 | pulsar-io-elastic-search-3.1.4.0.nar |
| [http](https://pulsar.apache.org/docs/io-connectors) | Writes data to an HTTP server (Webhook) | 3.1.4.0 | pulsar-io-http-3.1.4.0.nar |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for ClickHouse | 3.1.4.0 | pulsar-io-jdbc-clickhouse-3.1.4.0.nar |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for MariaDB | 3.1.4.0 | pulsar-io-jdbc-mariadb-3.1.4.0.nar |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for OpenMLDB | 3.1.4.0 | pulsar-io-jdbc-openmldb-3.1.4.0.nar |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for PostgreSQL | 3.1.4.0 | pulsar-io-jdbc-postgres-3.1.4.0.nar |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for SQLite | 3.1.4.0 | pulsar-io-jdbc-sqlite-3.1.4.0.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors) | Kafka source and sink connector | 3.1.4.0 | pulsar-io-kafka-3.1.4.0.nar |
| [kinesis](https://pulsar.apache.org/docs/io-connectors) | Kinesis connectors | 3.1.4.0 | pulsar-io-kinesis-3.1.4.0.nar |
| [snowflake](https://github.com/datastax/snowflake-connector) | Snowflake Connector | 0.1.13 | pulsar-snowflake-connector-0.1.13.nar |
</details>
<details><summary>Sources</summary>

| Name | Description | Version | File |
| ---- | ----------- | ------- | ---- |
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra | 2.2.9 | pulsar-cassandra-source-2.2.9.nar |
| [data-generator](https://pulsar.apache.org/docs/io-connectors) | Test data generator source | 3.1.4.0 | pulsar-io-data-generator-3.1.4.0.nar |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors) | Debezium MongoDb Source | 3.1.4.0 | pulsar-io-debezium-mongodb-3.1.4.0.nar |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors) | Debezium Microsoft SQL Server Source | 3.1.4.0 | pulsar-io-debezium-mssql-3.1.4.0.nar |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors) | Debezium MySql Source | 3.1.4.0 | pulsar-io-debezium-mysql-3.1.4.0.nar |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors) | Debezium Oracle Source | 3.1.4.0 | pulsar-io-debezium-oracle-3.1.4.0.nar |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors) | Debezium Postgres Source | 3.1.4.0 | pulsar-io-debezium-postgres-3.1.4.0.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors) | Kafka source and sink connector | 3.1.4.0 | pulsar-io-kafka-3.1.4.0.nar |
| [kinesis](https://pulsar.apache.org/docs/io-connectors) | Kinesis connectors | 3.1.4.0 | pulsar-io-kinesis-3.1.4.0.nar |
</details>
<details><summary>Proxy extensions</summary>

| Name | Description | Version | File |
| ---- | ----------- | ------- | ---- |
| [kafka](https://github.com/datastax/starlight-for-kafka) | Kafka Proxy Extension | 3.1.4.0 | pulsar-kafka-proxy-3.1.4.0.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name | Description | Version | File |
| ---- | ----------- | ------- | ---- |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
| [kafka](https://github.com/datastax/starlight-for-kafka) | Kafka Protocol Handler | 3.1.4.0 | pulsar-protocol-handler-kafka-3.1.4.0.nar |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
</details>
<details><summary>CLI extensions</summary>

| Name | Description | Version | File |
| ---- | ----------- | ------- | ---- |
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands | 2.2.5 | pulsar-cassandra-admin-2.2.5-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - Pulsar Admin Custom Commands | 3.1.0 | pulsar-jms-admin-3.1.0-nar.nar |
</details>
<details><summary>Filters</summary>

| Name | Description | Version | File |
| ---- | ----------- | ------- | ---- |
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 3.1.0 | pulsar-jms-3.1.0-nar.nar |
</details>
<details><summary>Functions</summary>

| Name | Description | Version | File |
| ---- | ----------- | ------- | ---- |
| [ai-tools](https://pulsar.apache.org/docs/io-connectors) | Generative AI tools | 3.1.7   | pulsar-ai-tools-3.1.7.nar |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.1.1   | pulsar-transformations-3.1.1.nar |
</details>


### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls31_3.1/build.json) used for the build.


### Builtin connectors

- cassandra-enhanced-pulsar-sink-1.6.11-nar.nar
- pulsar-cassandra-source-2.2.9.nar
- pulsar-io-cloud-storage-2.10.0.nar
- pulsar-io-debezium-mongodb-3.1.4.0.nar
- pulsar-io-jdbc-sqlite-3.1.4.0.nar
- pulsar-io-kinesis-3.1.4.0.nar
- pulsar-io-data-generator-3.1.4.0.nar
- pulsar-io-elastic-search-3.1.4.0.nar
- pulsar-io-jdbc-clickhouse-3.1.4.0.nar
- pulsar-io-debezium-oracle-3.1.4.0.nar
- pulsar-io-jdbc-openmldb-3.1.4.0.nar
- pulsar-io-jdbc-postgres-3.1.4.0.nar
- pulsar-io-debezium-mssql-3.1.4.0.nar
- pulsar-io-debezium-mysql-3.1.4.0.nar
- pulsar-io-jdbc-mariadb-3.1.4.0.nar
- pulsar-io-debezium-postgres-3.1.4.0.nar
- pulsar-io-http-3.1.4.0.nar
- pulsar-io-kafka-3.1.4.0.nar
- pulsar-snowflake-connector-0.1.13.nar
- pulsar-protocol-handler-kafka-3.1.4.0.nar
- starlight-rabbitmq-2.10.1.0.nar
- pulsar-kafka-proxy-3.1.4.0.nar
- pulsar-jms-3.1.0-nar.nar


## Luna Streaming Distribution 3.1 3.1
This is a maintenance release containing important stability and security updates.

### Most notable commits

* [5b82329](https://github.com/datastax/pulsar/commit/5b82329) [improve][misc] Specify valid home dir for the default user in the Ubuntu based docker image (#22446)
* [a20af42](https://github.com/datastax/pulsar/commit/a20af42) [fix][build] Fix building docker images without setting UBUNTU_MIRROR
* [4e10b22](https://github.com/datastax/pulsar/commit/4e10b22) [fix][broker][admin] Fix cannot update properties on NonDurable subscription. (#22411)
* [d18f429](https://github.com/datastax/pulsar/commit/d18f429) [improve][test] Move most flaky tests to flaky group (#22433)
* [7ab68ca](https://github.com/datastax/pulsar/commit/7ab68ca) [improve][misc] Upgrade to Netty 4.1.108 and tcnative 2.0.65 (#22369)
* [d0373e2](https://github.com/datastax/pulsar/commit/d0373e2) [fix][broker] Update TransferShedder underloaded broker check to consider max loaded broker's msgThroughputEMA and update IsExtensibleLoadBalancerImpl check (#22321) (#22417)
* [08fcc87](https://github.com/datastax/pulsar/commit/08fcc87) [fix][broker] upgrade jclouds 2.5.0 -> 2.6.0 (#22220)
* [cca9630](https://github.com/datastax/pulsar/commit/cca9630) [fix][broker] Fix invalid condition in logging exceptions (#22412)
* [95a75a8](https://github.com/datastax/pulsar/commit/95a75a8) [fix][broker] Skip topic.close during unloading if the topic future fails with ownership check, and fix isBundleOwnedByAnyBroker to use ns.checkOwnershipPresentAsync for ExtensibleLoadBalancer (#22379) (#22406)
* [b080c7f](https://github.com/datastax/pulsar/commit/b080c7f) [fix][build] Fix networkaddress.cache.negative.ttl config (#22400)
* [2ac546c](https://github.com/datastax/pulsar/commit/2ac546c) [improve][broker] Don't log brokerClientAuthenticationParameters and bookkeeperClientAuthenticationParameters by default (#22395)
* [5f68f51](https://github.com/datastax/pulsar/commit/5f68f51)  [fix][broker] Fix issue of field 'topic' is not set when handle GetSchema request (#22377)
* [6cd168b](https://github.com/datastax/pulsar/commit/6cd168b) [fix][broker] Fix ResourceGroups loading (#21781)
* [0a5100f](https://github.com/datastax/pulsar/commit/0a5100f) [fix][broker] Fix ResourceGroup report local usage (#22340)
* [b1c4de9](https://github.com/datastax/pulsar/commit/b1c4de9) [fix][ci][branch-3.1] Increase Maven's heap size from 1024m to 1500m as it is in master
* [248efe9](https://github.com/datastax/pulsar/commit/248efe9) [improve][misc] Upgrade checkstyle to 10.14.2 (#22291)
* [c78f70f](https://github.com/datastax/pulsar/commit/c78f70f) [fix] Upgrade jose4j to 0.9.4 (#22273)
* [28404f3](https://github.com/datastax/pulsar/commit/28404f3) [fix][sec] Upgrade Zookeeper to 3.9.2 to address CVE-2024-23944 (#22275)
* [c401aa2](https://github.com/datastax/pulsar/commit/c401aa2) [fix][ci] Tolerate mount option change failing in CI (#22241)
* [53b02df](https://github.com/datastax/pulsar/commit/53b02df) [fix][sec]  Revert "[fix][sec] Add a check for the input time value (apache#22023)"  (#22243)
* [039b8aa](https://github.com/datastax/pulsar/commit/039b8aa) [improve][broker] Consistently add fine-grain authorization to REST API (#22202)
* [a7742d2](https://github.com/datastax/pulsar/commit/a7742d2) [fix][broker][branch-3.1] Fix broker not starting when both transactions and the Extensible Load Manager are enabled (#22194)
* [07609e6](https://github.com/datastax/pulsar/commit/07609e6) [improve][broker] Add fine-grain authorization to ns/topic management endpoints (#22305)

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name | Description | Version | File |
| ---- | ----------- | ------- | ---- |
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink) | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.11 | cassandra-enhanced-pulsar-sink-1.6.11-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage | 2.10.0 | pulsar-io-cloud-storage-2.10.0.nar |
| [data-generator](https://pulsar.apache.org/docs/io-connectors) | Test data generator source | 3.1.3.1 | pulsar-io-data-generator-3.1.3.1.nar |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors) | Writes data into Elastic Search | 3.1.3.1 | pulsar-io-elastic-search-3.1.3.1.nar |
| [http](https://pulsar.apache.org/docs/io-connectors) | Writes data to an HTTP server (Webhook) | 3.1.3.1 | pulsar-io-http-3.1.3.1.nar |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for ClickHouse | 3.1.3.1 | pulsar-io-jdbc-clickhouse-3.1.3.1.nar |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for MariaDB | 3.1.3.1 | pulsar-io-jdbc-mariadb-3.1.3.1.nar |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for OpenMLDB | 3.1.3.1 | pulsar-io-jdbc-openmldb-3.1.3.1.nar |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for PostgreSQL | 3.1.3.1 | pulsar-io-jdbc-postgres-3.1.3.1.nar |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for SQLite | 3.1.3.1 | pulsar-io-jdbc-sqlite-3.1.3.1.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors) | Kafka source and sink connector | 3.1.3.1 | pulsar-io-kafka-3.1.3.1.nar |
| [kinesis](https://pulsar.apache.org/docs/io-connectors) | Kinesis connectors | 3.1.3.1 | pulsar-io-kinesis-3.1.3.1.nar |
| [snowflake](https://github.com/datastax/snowflake-connector) | Snowflake Connector | 0.1.13 | pulsar-snowflake-connector-0.1.13.nar |
</details>
<details><summary>Sources</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- |
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra | 2.2.9 | pulsar-cassandra-source-2.2.9.nar |
| [data-generator](https://pulsar.apache.org/docs/io-connectors) | Test data generator source | 3.1.3.1 | pulsar-io-data-generator-3.1.3.1.nar |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors) | Debezium MongoDb Source | 3.1.3.1 | pulsar-io-debezium-mongodb-3.1.3.1.nar |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors) | Debezium Microsoft SQL Server Source | 3.1.3.1 | pulsar-io-debezium-mssql-3.1.3.1.nar |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors) | Debezium MySql Source | 3.1.3.1 | pulsar-io-debezium-mysql-3.1.3.1.nar |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors) | Debezium Oracle Source | 3.1.3.1 | pulsar-io-debezium-oracle-3.1.3.1.nar |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors) | Debezium Postgres Source | 3.1.3.1 | pulsar-io-debezium-postgres-3.1.3.1.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors) | Kafka source and sink connector | 3.1.3.1 | pulsar-io-kafka-3.1.3.1.nar |
| [kinesis](https://pulsar.apache.org/docs/io-connectors) | Kinesis connectors | 3.1.3.1 | pulsar-io-kinesis-3.1.3.1.nar |
</details>
<details><summary>Proxy extensions</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
| [kafka](https://github.com/datastax/starlight-for-kafka) | Kafka Proxy Extension | 3.1.0.1 | pulsar-kafka-proxy-3.1.0.1.nar |
</details>
<details><summary>Protocol handlers</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- |
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Protocol Handler | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
| [kafka](https://github.com/datastax/starlight-for-kafka) | Kafka Protocol Handler | 3.1.0.1 | pulsar-protocol-handler-kafka-3.1.0.1.nar |
</details>
<details><summary>CLI extensions</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- |
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands | 2.2.5 | pulsar-cassandra-admin-2.2.5-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - Pulsar Admin Custom Commands | 3.1.0 | pulsar-jms-admin-3.1.0-nar.nar |
</details>
<details><summary>Filters</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- |
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 3.1.0 | pulsar-jms-3.1.0-nar.nar |
</details>
<details><summary>Functions</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- |
| [ai-tools](https://pulsar.apache.org/docs/io-connectors) | Generative AI tools | 3.1.7 | pulsar-ai-tools-3.1.7.nar |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.1.1 | pulsar-transformations-3.1.1.nar |
</details>

### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls31_3.1/build.json) used for the build.


### Builtin connectors

- cassandra-enhanced-pulsar-sink-1.6.11-nar.nar
- pulsar-cassandra-source-2.2.9.nar
- pulsar-io-cloud-storage-2.10.0.nar
- pulsar-io-debezium-mongodb-3.1.3.1.nar
- pulsar-io-jdbc-sqlite-3.1.3.1.nar
- pulsar-io-kinesis-3.1.3.1.nar
- pulsar-io-data-generator-3.1.3.1.nar
- pulsar-io-elastic-search-3.1.3.1.nar
- pulsar-io-jdbc-clickhouse-3.1.3.1.nar
- pulsar-io-debezium-oracle-3.1.3.1.nar
- pulsar-io-jdbc-openmldb-3.1.3.1.nar
- pulsar-io-jdbc-postgres-3.1.3.1.nar
- pulsar-io-debezium-mssql-3.1.3.1.nar
- pulsar-io-debezium-mysql-3.1.3.1.nar
- pulsar-io-jdbc-mariadb-3.1.3.1.nar
- pulsar-io-debezium-postgres-3.1.3.1.nar
- pulsar-io-http-3.1.3.1.nar
- pulsar-io-kafka-3.1.3.1.nar
- pulsar-snowflake-connector-0.1.13.nar
- pulsar-protocol-handler-kafka-3.1.0.1.nar
- starlight-rabbitmq-2.10.1.0.nar
- pulsar-kafka-proxy-3.1.0.1.nar
- pulsar-jms-3.1.0-nar.nar


## Luna Streaming Distribution 3.1 3.0
This is the initial release of the DataStax Luna Streaming Distribution for 3.1. This release contains all the commits included in the Apache Pulsar v3.1.3 release plus the following changes specific to Luna Streaming:

### `lunastreaming-all` distribution
<details><summary>Sinks</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- |
| [cassandra-enhanced](https://github.com/datastax/pulsar-sink) | A DataStax Pulsar Sink to load records from Pulsar topics to Apache Cassandra(R) or DataStax Enterprise(DSE) | 1.6.11 | cassandra-enhanced-pulsar-sink-1.6.11-nar.nar |
| [cloud-storage](https://github.com/streamnative/pulsar-io-cloud-storage) | Writes data into cloud storage | 2.10.0 | pulsar-io-cloud-storage-2.10.0.nar |
| [data-generator](https://pulsar.apache.org/docs/io-connectors) | Test data generator source | 3.1.3.0 | pulsar-io-data-generator-3.1.3.0.nar |
| [elastic_search](https://pulsar.apache.org/docs/io-connectors) | Writes data into Elastic Search | 3.1.3.0 | pulsar-io-elastic-search-3.1.3.0.nar |
| [http](https://pulsar.apache.org/docs/io-connectors) | Writes data to an HTTP server (Webhook) | 3.1.3.0 | pulsar-io-http-3.1.3.0.nar |
| [jdbc-clickhouse](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for ClickHouse | 3.1.3.0 | pulsar-io-jdbc-clickhouse-3.1.3.0.nar |
| [jdbc-mariadb](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for MariaDB | 3.1.3.0 | pulsar-io-jdbc-mariadb-3.1.3.0.nar |
| [jdbc-openmldb](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for OpenMLDB | 3.1.3.0 | pulsar-io-jdbc-openmldb-3.1.3.0.nar |
| [jdbc-postgres](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for PostgreSQL | 3.1.3.0 | pulsar-io-jdbc-postgres-3.1.3.0.nar |
| [jdbc-sqlite](https://pulsar.apache.org/docs/io-connectors) | JDBC sink for SQLite | 3.1.3.0 | pulsar-io-jdbc-sqlite-3.1.3.0.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors) | Kafka source and sink connector | 3.1.3.0 | pulsar-io-kafka-3.1.3.0.nar |
| [kinesis](https://pulsar.apache.org/docs/io-connectors) | Kinesis connectors | 3.1.3.0 | pulsar-io-kinesis-3.1.3.0.nar |
| [snowflake](https://github.com/datastax/snowflake-connector) | Snowflake Connector | 0.1.13 | pulsar-snowflake-connector-0.1.13.nar |
</details>
<details><summary>Sources</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- |
| [cassandra-source](https://github.com/datastax/cdc-for-apache-cassandra) | Read data from Cassandra | 2.2.9 | pulsar-cassandra-source-2.2.9.nar |
| [data-generator](https://pulsar.apache.org/docs/io-connectors) | Test data generator source | 3.1.3.0 | pulsar-io-data-generator-3.1.3.0.nar |
| [debezium-mongodb](https://pulsar.apache.org/docs/io-connectors) | Debezium MongoDb Source | 3.1.3.0 | pulsar-io-debezium-mongodb-3.1.3.0.nar |
| [debezium-mssql](https://pulsar.apache.org/docs/io-connectors) | Debezium Microsoft SQL Server Source | 3.1.3.0 | pulsar-io-debezium-mssql-3.1.3.0.nar |
| [debezium-mysql](https://pulsar.apache.org/docs/io-connectors) | Debezium MySql Source | 3.1.3.0 | pulsar-io-debezium-mysql-3.1.3.0.nar |
| [debezium-oracle](https://pulsar.apache.org/docs/io-connectors) | Debezium Oracle Source | 3.1.3.0 | pulsar-io-debezium-oracle-3.1.3.0.nar |
| [debezium-postgres](https://pulsar.apache.org/docs/io-connectors) | Debezium Postgres Source | 3.1.3.0 | pulsar-io-debezium-postgres-3.1.3.0.nar |
| [kafka](https://pulsar.apache.org/docs/io-connectors) | Kafka source and sink connector | 3.1.3.0 | pulsar-io-kafka-3.1.3.0.nar |
| [kinesis](https://pulsar.apache.org/docs/io-connectors) | Kinesis connectors | 3.1.3.0 | pulsar-io-kinesis-3.1.3.0.nar |
</details>
<details><summary>Proxy extensions</summary>

| Name | Description | Version | File                            | 
| ---- | ----------- | ------- |---------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Proxy Extension | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar |
| [kafka](https://github.com/datastax/starlight-for-kafka) | Kafka Proxy Extension | 3.1.3.0 | pulsar-kafka-proxy-3.1.0.1.nar  |
</details>
<details><summary>Protocol handlers</summary>

| Name | Description | Version | File                                      | 
| ---- | ----------- | ------- |-------------------------------------------|
| [rabbitmq](https://github.com/datastax/starlight-for-rabbitmq) | Starlight for RabbitMQ Protocol Handler | 2.10.1.0 | starlight-rabbitmq-2.10.1.0.nar           |
| [kafka](https://github.com/datastax/starlight-for-kafka) | Kafka Protocol Handler | 3.1.3.0 | pulsar-protocol-handler-kafka-3.1.0.1.nar |
</details>
<details><summary>CLI extensions</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- |
| [cassandra-cdc](https://pulsar.apache.org/docs/io-connectors) | Cassandra CDC - Pulsar Admin Custom Commands | 2.2.5 | pulsar-cassandra-admin-2.2.5-nar.nar |
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - Pulsar Admin Custom Commands | 3.1.0 | pulsar-jms-admin-3.1.0-nar.nar |
</details>
<details><summary>Filters</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- |
| [jms](https://pulsar.apache.org/docs/io-connectors) | Starlight for JMS - support for server side filters | 3.1.0 | pulsar-jms-3.1.0-nar.nar |
</details>
<details><summary>Functions</summary>

| Name | Description | Version | File | 
| ---- | ----------- | ------- | ---- |
| [ai-tools](https://pulsar.apache.org/docs/io-connectors) | Generative AI tools | 3.1.7 | pulsar-ai-tools-3.1.7.nar |
| [transforms](https://pulsar.apache.org/docs/io-connectors) | Transformation function | 3.1.1 | pulsar-transformations-3.1.1.nar |
</details>

### Environment (Connectors, Protocol Handlers, Proxy Extensions, extra libraries)
See the [environment variables](https://github.com/riptano/pulsar-distro/blob/ls31_3.0/build.json) used for the build.


### Builtin connectors

- cassandra-enhanced-pulsar-sink-1.6.11-nar.nar
- pulsar-cassandra-source-2.2.9.nar
- pulsar-io-cloud-storage-2.10.0.nar
- pulsar-io-debezium-mongodb-3.1.3.0.nar
- pulsar-io-jdbc-sqlite-3.1.3.0.nar
- pulsar-io-kinesis-3.1.3.0.nar
- pulsar-io-data-generator-3.1.3.0.nar
- pulsar-io-elastic-search-3.1.3.0.nar
- pulsar-io-jdbc-clickhouse-3.1.3.0.nar
- pulsar-io-debezium-oracle-3.1.3.0.nar
- pulsar-io-jdbc-openmldb-3.1.3.0.nar
- pulsar-io-jdbc-postgres-3.1.3.0.nar
- pulsar-io-debezium-mssql-3.1.3.0.nar
- pulsar-io-debezium-mysql-3.1.3.0.nar
- pulsar-io-jdbc-mariadb-3.1.3.0.nar
- pulsar-io-debezium-postgres-3.1.3.0.nar
- pulsar-io-http-3.1.3.0.nar
- pulsar-io-kafka-3.1.3.0.nar
- pulsar-snowflake-connector-0.1.13.nar
- pulsar-protocol-handler-kafka-3.1.0.1.nar
- starlight-rabbitmq-2.10.1.0.nar
- pulsar-kafka-proxy-3.1.0.1.nar
- pulsar-jms-3.1.0-nar.nar

## Migrating from Luna Streaming 2.10
- Upgrade is fully supported for all the components (connectors included).
- Pulsar-SQL: If you're upgrading Pulsar SQL from 2.11 or earlier, you should copy config files from conf/presto to trino/conf. If you're downgrading Pulsar SQL to 2.11 or earlier from newer versions, do the vice-versa.
- Downgrade is not supported for Bookies, rest all components support downgrade. 
  - Description -
    - Pulsar 3.1 uses RocksDB 7.x which writes in a format that is not compatible with RocksDB 6.x which is used by LunaStreaming 2.10 via Bookkeeper 4.14.
  - References - 
    - Issue - [[Bug] Downgrade issue #22051 - apache/pulsar · GitHub](https://github.com/apache/pulsar/issues/22051)
    - PR - [Make RrocksDB checksum type configurable #3793](https://github.com/apache/bookkeeper/pull/3793)
- Prometheus client version has been changed from 0.5.0 to 0.16.0. Metric type UNTYPED is renamed to UNKNOWN.
  The metrics have been renamed because OpenMetrics's counter name needs a _total suffix.
  E.g `pulsar_expired_token_count` changed to `pulsar_expired_token_total`.
  - References -
  - PR - [Bump prometheus client version from 0.5.0 to 0.15.0](https://github.com/apache/pulsar/pull/13785)
  - PR - [Rename Pulsar txn metrics to specify OpenMetrics](https://github.com/apache/pulsar/pull/16581)
  - PR - [Rename Pulsar schema metrics to specify OpenMetrics](https://github.com/apache/pulsar/pull/16610)
  - PR - [Rename Pulsar lb metrics to specify OpenMetrics](https://github.com/apache/pulsar/pull/16611)
  - PR - [Bump prometheus client version from 0.15.0 to 0.16.0](https://github.com/apache/pulsar/pull/16591)