Dear hakkers,
Apache Kafka 2.4.0 final was released on Dec 15th. Alpakka Kafka 2.0.0-RC1 references this released artifact which includes improvements for async flow control we use in the Kafka Consumer (KAFKA-7548).
We will include more details about the 2.0.0 performance improvements in upcoming blog posts timed with the final release.
Other Noteworthy Things
- Bug fix to filter messages of revoked partitions in partitioned sources. This will reduce the number of duplicate messages that are handled during a rebalance using partitioned sources.
- Stage ID traceability. Log lines now include unique IDs to differentiate multiple Alpakka Kafka sources, flows, and sinks. Useful when using partitioned sources or when multiple Alpakka Kafka streams are running concurrently.
Before the final release we may also be able to upgrade several other Kafka community dependencies as they release their 2.4.0 support (embedded-kafka, Confluent Platform docker images in our testkit support for testcontainers).
Cheers,
the Alpakka team