fs2-kafka v3.6.0-RC1

This pre-release is done mainly to test changes around KafkaProducer fail-fast but also includes the bump of Scala versions.

What's Changed

• Update sbt-typelevel, sbt-typelevel-site to 0.7.0 in series/3.x by @scala-steward in #1320
• Update kafka-avro-serializer to 7.6.1 in series/3.x by @scala-steward in #1319
• Update scala-library to 2.13.14 in series/3.x by @scala-steward in #1324
• Update sbt-typelevel, sbt-typelevel-site to 0.7.1 in series/3.x by @scala-steward in #1327
• Update sbt to 1.10.0 in series/3.x by @scala-steward in #1326
• Update discipline-scalatest to 2.3.0 in series/3.x by @scala-steward in #1329
• Update testcontainers-scala-kafka, ... to 0.41.4 in series/3.x by @scala-steward in #1331
• Update scalafmt-core to 3.8.2 in series/3.x by @scala-steward in #1332
• Update sbt to 1.10.1 in series/3.x by @scala-steward in #1335
• Update kafka-clients to 3.7.1 in series/3.x by @scala-steward in #1334
• Update vulcan to 1.11.0 in series/3.x by @scala-steward in #1333
• Update kafka-avro-serializer to 7.6.2 in series/3.x by @scala-steward in #1336
• Update kafka-clients to 3.8.0 in series/3.x by @scala-steward in #1337
• Update scalafmt-core to 3.8.3 in series/3.x by @scala-steward in #1338
• Update sbt-typelevel, sbt-typelevel-site to 0.7.2 in series/3.x by @scala-steward in #1339
• Update fs2-core to 3.11.0 in series/3.x by @scala-steward in #1345
• Update kafka-avro-serializer to 7.7.0 in series/3.x by @scala-steward in #1342
• Update sbt-typelevel, sbt-typelevel-site to 0.7.3 in series/3.x by @scala-steward in #1347
• Update scala3-library to 3.3.4 in series/3.x by @scala-steward in #1350
• Update scala-library to 2.13.15 in series/3.x by @scala-steward in #1349
• Update sbt to 1.10.2 in series/3.x by @scala-steward in #1351
• Update kafka-avro-serializer to 7.7.1 in series/3.x by @scala-steward in #1348
• KafkaProducer.produce fails fast by @rodrigo-molina in #1340
• Fix compilation after #1340 merge by @aartigao in #1353
• Update scala-library to 2.12.20 in series/3.x by @scala-steward in #1346

New Contributors

• @rodrigo-molina made their first contribution in #1340

Full Changelog: v3.5.1...v3.6.0-RC1

fs2-kafka v3.5.1

Important Notice: Producer performance regression fixed ⚠️

Changes introduced in #1126 cause a significant performance drop in Producer (you can find more details with some nice graphs in #1321).

Users are encouraged to use v3.5.1 and avoid v3.5.0 for this reason.

Many thanks to @atnoya for noticing and seeking the root cause 🎉 (and mention to @abestel for confirming he was experiencing the same issues).

What's Changed

• Update tlBaseVersion to match latest tag by @aartigao in #1323
• Revert #1126 as it's causing a performance regression by @atnoya in #1322

New Contributors

• @atnoya made their first contribution in #1322

Full Changelog: v3.5.0...v3.5.1

fs2-kafka v3.5.0

Important Notice: Memory leak found 🐛

A leak in the fetch loop caused by a misuse of the CE Fiber API has been found and fixed (more info in #1318). Of course, all users are encouraged to upgrade ⬆️

All credits to @abestel who took the time to investigate the root cause a propose a fix for it! 🙇🏽 🥇 Awesome contribution! 🎉

Depending on the usage, the leak advances slowly or faster. As an example, here's the graph of one of our services for the last 12h in Staging (with the SNAPSHOT that includes #1318) and Prod (with v3.4.0) (both envs share exactly the same load) 👇🏽

Staging

Prod

Relevant Changes

• Fix CallbackStack.Node leak by @abestel in #1318

Other Changes

• Update tlBaseVersion to match latest tag by @aartigao in #1313
• Update fs2-core to 3.10.0 in series/3.x by @scala-steward in #1314
• Update sbt-buildinfo to 0.12.0 in series/3.x by @scala-steward in #1315
• Retry RebalanceInProgressException in CommitRecovery.Default by @aartigao in #1312
• Change Blocking to use Sync#interruptible, not blocking by @bastewart in #1126
• Update scalafmt-core to 3.8.1 in series/3.x by @scala-steward in #1317
• Update fs2-core to 3.10.2 in series/3.x by @scala-steward in #1316

Full Changelog: v3.4.0...v3.5.0

fs2-kafka v3.4.0

This release contains mostly version bumps for the library dependencies, but some of them are important enough to create a minor version 👇🏽

Relevant changes

• Latest Scala libs for 2.12, 2.13 and 3.3
• Latest Kafka Clients 3.7.x lineage (updated from 3.6.x in previous versions)
• Latest Kafka Avro Serializer 7.6.x lineage (updated from 7.5.x in previous versions)

What's Changed

• Add aartigao to developers list by @aartigao in #1298
• Plugin dependencies under sbt-typelevel umbrella by @aartigao in #1297
• Update testcontainers-scala-kafka, ... to 0.41.3 in series/3.x by @scala-steward in #1299
• Update kafka-avro-serializer to 7.6.0 in series/3.x by @scala-steward in #1300
• Update scalafmt-core to 3.8.0 in series/3.x by @scala-steward in #1301
• Update sbt-typelevel, sbt-typelevel-site to 0.6.6 in series/3.x by @scala-steward in #1302
• Improve NotSubscribedException message by @aartigao in #1303
• Update sbt-typelevel, sbt-typelevel-site to 0.6.7 in series/3.x by @scala-steward in #1311
• Update kind-projector to 0.13.3 in series/3.x by @scala-steward in #1310
• Update kafka-clients to 3.7.0 in series/3.x by @scala-steward in #1304
• Update sbt to 1.9.9 in series/3.x by @scala-steward in #1308
• Update cats-effect, cats-effect-laws, ... to 3.5.4 in series/3.x by @scala-steward in #1309
• Update scala-library to 2.12.19 in series/3.x by @scala-steward in #1305
• Update scala-library to 2.13.13 in series/3.x by @scala-steward in #1306
• Update scala3-library to 3.3.3 in series/3.x by @scala-steward in #1307

Full Changelog: v3.3.1...v3.4.0

fs2-kafka v3.3.1

Important Notice: Binary Incompatibilities ⚠️

This release fixes v3.3.0 by bringing back the binary incompatible changes.

Users are encouraged to use v3.3.1 and avoid v3.3.0 for this reason.

What's Changed

• Revert "Remove deprecated methods (#1268)" by @aartigao in #1296

Full Changelog: v3.3.0...v3.3.1

fs2-kafka v3.3.0

This is the fifth stable fs2-kafka release to be based on the 3.x series of the Apache Kafka client library. It is available for Scala 2.12, 2.13, and 3.3; all users are encouraged to upgrade.

Thanks for the effort of the new contributors @cwholmes and @L7R7 🎉 We hope to see more nice contributions in the future! 💪🏽 🙌🏽

Important Notice: Binary Incompatibilities ⚠️

This release introduced binary incompatibilities in #1268. Users are encouraged to use v.3.3.1 instead 🙏🏽

Relevant Changes

• Support consumer offsets for times and list topics by @cwholmes
• Add chunk-based consumer API by @L7R7

What's Changed

• Use Stream.iterable instead of Stream.emits by @aartigao in #1266
• Scalafmt update and Scala 3 syntax (-Xsource:3) by @aartigao in #1267
• Fix typos by @aartigao in #1269
• Update sbt to 1.9.7 in series/3.x by @scala-steward in #1271
• Update sbt-mdoc to 2.4.0 in series/3.x by @scala-steward in #1272
• Remove deprecated methods by @aartigao in #1268
• Update sbt-typelevel to 0.6.1 in series/3.x by @scala-steward in #1273
• Fix flaky KafkaConsumer#assignmentStream tests by @aartigao in #1274
• Update fs2-core to 3.9.3 in series/3.x by @scala-steward in #1275
• Update kafka-avro-serializer to 7.5.2 in series/3.x by @scala-steward in #1276
• Update sbt-mdoc to 2.5.1 in series/3.x by @scala-steward in #1277
• Revert "Update sbt-mdoc to 2.5.1 in series/3.x" by @aartigao in #1284
• Update scalafmt-core to 3.7.17 in series/3.x by @scala-steward in #1278
• Update logback-classic to 1.3.14 in series/3.x by @scala-steward in #1282
• Update sbt-typelevel to 0.6.3 in series/3.x by @scala-steward in #1283
• Update sbt-typelevel to 0.6.5 in series/3.x by @scala-steward in #1291
• Update vulcan to 1.10.1 in series/3.x by @scala-steward in #1286
• Update kafka-avro-serializer to 7.5.3 in series/3.x by @scala-steward in #1287
• Update kafka-clients to 3.6.1 in series/3.x by @scala-steward in #1288
• Update sbt to 1.9.8 in series/3.x by @scala-steward in #1289
• Support consumer offsets for times and list topics by @cwholmes in #1285
• Update cats-effect, cats-effect-laws, ... to 3.5.3 in series/3.x by @scala-steward in #1295
• Update fs2-core to 3.9.4 in series/3.x by @scala-steward in #1294
• Add chunk-based consumer API by @L7R7 in #1281

New Contributors

• @cwholmes made their first contribution in #1285
• @L7R7 made their first contribution in #1281

Full Changelog: v3.2.0...v3.3.0

fs2-kafka v3.2.0

This is the fourth stable fs2-kafka release to be based on the 3.x series of the Apache Kafka client library. It is available for Scala 2.12, 2.13, and 3.3; all users are encouraged to upgrade.

Relevant Changes

• Latest Scala libs for 2.12 and 2.13
• Latest Kafka Clients 3.6.x lineage (updated from 3.5.x in previous versions)
• MUnit Vulcan integration improvements by @keirlawson

What's Changed

• Update sbt-header to 5.10.0 in series/3.x by @scala-steward in #1258
• Update scala-library to 2.13.12 in series/3.x by @scala-steward in #1260
• Update scala-library to 2.12.18 in series/3.x by @scala-steward in #1259
• Expose creation of compat checker by @keirlawson in #988
• Fix CI build issues by @aartigao in #1261
• Update sbt-typelevel to 0.5.4 in series/3.x by @scala-steward in #1265
• Update sbt-mdoc to 2.3.8 in series/3.x by @scala-steward in #1264
• Update kafka-avro-serializer to 7.5.1 in series/3.x by @scala-steward in #1262
• Add compatiblity assertions with clues by @keirlawson in #990
• Update kafka-clients to 3.6.0 in series/3.x by @scala-steward in #1263

Full Changelog: v3.1.0...v3.2.0

fs2-kafka v3.1.0

This is the third stable fs2-kafka release to be based on the 3.x series of the Apache Kafka client library. It is available for Scala 2.12, 2.13, and 3.3; all users are encouraged to upgrade.

Development of the 2.x series is now discontinued. All new pull requests should target the 3.x branch.

This release bumps all third party dependencies to latest effective version (targeting JDK 8 as the base), fixes some transitive vulnerabilities and consolidates the build for Cats Effect 3.5.x and fs2 3.9.x.

Thanks everyone involved in the release and congrats to first-time contributors! 🥳 We hope to see more of your nice PRs in the near future! 💪🏽

What's Changed

• Remove VerifiableProperties issue workaround by @peter-hazell in #1231
• Update sbt to 1.8.3 in series/3.x by @scala-steward in #1204
• Update sbt-mima-plugin to 1.1.3 in series/3.x by @scala-steward in #1229
• Update kafka-clients to 3.4.1 in series/3.x by @scala-steward in #1214
• Update kafka-avro-serializer to 7.3.4 in series/3.x by @scala-steward in #1225
• SBT 1.9.x by @aartigao in #1245
• Bump CE and fs2 to the latest version by @aartigao in #1246
• Retire FakeFiber by @biochimia in #1238
• Mark series/2.x as EOL by @aartigao in #1248
• Update sbt-typelevel to 0.5.3 in series/3.x by @aartigao in #1247
• Updated transaction docs by @DanyYanev in #1201
• Make instantiation of CommitTimeoutException lazy. by @optician in #1150
• Added docs for graceful shutdown for cats-effect 3 by @LMnet in #1009
• Update kafka-avro-serializer to 7.4.0 in series/3.x by @scala-steward in #1203
• scala-steward (3.x series): reenable ignored 2.x series dependencies by @aartigao in #1249
• Bump third party deps by @aartigao in #1250
• Prepare release 3.1.0 by @aartigao in #1251
• Fix docs publishing by @aartigao in #1252

New Contributors

• @peter-hazell made their first contribution in #1231
• @aartigao made their first contribution in #1245
• @DanyYanev made their first contribution in #1201
• @optician made their first contribution in #1150

Full Changelog: v3.0.1...v3.1.0

fs2-kafka v3.0.1

This release makes some internal changes in preparation for changes to cancelation semantics forthcoming in cats-effect 3.5.0; it also updates some dependencies.

What's Changed

• Revert "Change to publish on series branches" by @bplommer in #1176
• Update sbt-mima-plugin to 1.1.2 in series/3.x by @scala-steward in #1184
• Post-3.0 release build updates by @bplommer in #1188
• Update sbt-typelevel to 0.4.20 in series/3.x by @scala-steward in #1192
• Update tlBaseVersion by @bplommer in #1197
• Preparatory changes for new CE cancelation semantics by @bplommer in #1187
• Update cats-effect, cats-effect-laws, ... to 3.4.9 in series/2.x by @scala-steward in #1195
• Update testcontainers-scala-kafka, ... to 0.40.15 in series/2.x by @scala-steward in #1194
• Update sbt-mima-plugin to 1.1.2 in series/2.x by @scala-steward in #1189
• Update logback-classic to 1.3.7 in series/2.x by @scala-steward in #1193
• Update scalafmt-core to 2.2.2 in series/2.x by @scala-steward in #1191
• Update kafka-avro-serializer to 6.2.10 in series/2.x by @scala-steward in #1190
• Update sbt-typelevel to 0.4.20 in series/2.x by @scala-steward in #1196
• Merge 2.x into 3.x by @bplommer in #1198

Full Changelog: v3.0.0...v3.0.1

fs2-kafka v2.6.1

This release makes some internal changes in preparation for changes to cancelation semantics forthcoming in cats-effect 3.5.0; it also updates some dependencies.

What's Changed

• Update tlBaseVersion by @bplommer in #1197
• Preparatory changes for new CE cancelation semantics by @bplommer in #1187
• Update cats-effect, cats-effect-laws, ... to 3.4.9 in series/2.x by @scala-steward in #1195
• Update testcontainers-scala-kafka, ... to 0.40.15 in series/2.x by @scala-steward in #1194
• Update sbt-mima-plugin to 1.1.2 in series/2.x by @scala-steward in #1189
• Update logback-classic to 1.3.7 in series/2.x by @scala-steward in #1193
• Update scalafmt-core to 2.2.2 in series/2.x by @scala-steward in #1191
• Update kafka-avro-serializer to 6.2.10 in series/2.x by @scala-steward in #1190
• Update sbt-typelevel to 0.4.20 in series/2.x by @scala-steward in #1196

Full Changelog: v2.6.0...v2.6.1