fs2-kafka v0.19.0

Changes

• Add KafkaProducer#producePassthrough for only keeping the passthrough after producing. (#74)
• Change KafkaConsumer#stream to be an alias for partitionedStream.parJoinUnbounded. (#78)
  • This also removes ConsumerSettings#fetchTimeout as it is now unused.
• Change to improve type inference of ProducerMessage. (#74, #76)
  • To support better type inference, a custom fs2.kafka.ProducerRecord has been added.
  • If you were using the Java ProducerRecord, change to fs2.kafka.ProducerRecord.
• Change to replace Sinks with Pipes, and usage of Stream#to with Stream#through. (#73)
• Remove ProducerMessage#single, multiple, and passthrough. (#74)
  • They have been replaced with ProducerMessage#apply and ProducerMessage#one.
  • If you were previously using single in isolation, then you can now use one.
  • For all other cases, you can now use ProducerMessage#apply instead.
• Rename KafkaProducer#produceBatched to produce. (#74)
• Remove the previous KafkaProducer#produce.
  • For previous behavior, flatten the result from produce. (#74)

Miscellaneous

• Change to include current year in license notices. (#72)

Released on 2019-01-18.

fs2-kafka v0.18.1

Additions

• Add withDeliveryTimeout to ProducerSettings. (#70)

Updates

• Update Kafka to 2.1.0. (#70)

Documentation

• Update mdoc to 1.1.0. (#71)

Released on 2019-01-01.

fs2-kafka v0.18.0

Additions

• Add support for default ExecutionContext for KafkaConsumers. (#60)
  If you've been using the consumerExecutionContextResource context,
  or consumerExecutionContextStream, then not providing a context
  when creating ConsumerSettings now yield the same result.
• Add KafkaConsumer#subscribeTo for subscribing to topics with varargs. (#62)
• Add KafkaConsumer#seek for setting starting offsets. Thanks @danielkarch. (#64)

Changes

• Change KafkaConsumer#subscribe to work for any Reducible. (#62)
• Change KafkaConsumer#subscribe to return F[Unit] instead of Stream[F, Unit]. (#62)
• Change KafkaConsumer requests to be attempted and errors returned directly. (#66)
• Change to use internal singleton for KafkaConsumer poll requests. (#69)

Fixes

• Fix toString for custom exceptions. (#61)
• Fix to always create new instances of NotSubscribedException. (#65)
• Fix KafkaConsumer requests to check consumer has not shutdown. (#66)
• Fix Show[ProducerRecord[K, V]] when partition is null. (#68)

Documentation

• Change to simplify the 'quick example' in the documentation. (#63)

Miscellaneous

• Change OVO Energy Ltd to OVO Energy Limited in license texts. (#67)

Released on 2018-12-16.

fs2-kafka v0.17.3

Additions

• Add beginningOffsets and endOffsets to KafkaConsumer. (#59)
• Add withRequestTimeout and withDefaultApiTimeout to ConsumerSettings. (#59)

Released on 2018-12-10.

fs2-kafka v0.17.2

Additions

• Add initial KafkaAdminClient. (#53)

Fixes

• Change to start Producer#close in a Fiber. (#52)

Updates

• Update fs2 to 1.0.2. (#48)

Documentation

• Update mdoc to 0.7.1. (#51)
• Add initial project website. (#54, #55, #56, #57, #58)

Miscellaneous

• Change to check all binary-compatible releases. (#49)

Released on 2018-12-10.

fs2-kafka v0.17.1

Additions

• Add ProducerMessage functions for partial type application. (#47)

Released on 2018-12-04.

fs2-kafka v0.17.0

Additions

• Add support for subscribing to topics with Regex patterns. (#29)
• Add support for committing record metadata along with offsets. (#28)
• Add CommittableOffsetBatch#updated(CommittableOffsetBatch). (#27)
• Add ProducerSettings#withLinger and withRequestTimeout. (#35)
• Add support for overriding Consumer and Producer creation. (#17)
• Add support for setting number of ExecutionContext threads. (#45)

Changes

• Change to make KafkaConsumer and KafkaProducer sealed. (#33)
• Change to move KafkaConsumerActor to internal package. (#32)
• Change to improve performance of offset batching. (#20)
• Change to improve performance of KafkaConsumerActor. (#18, #21, #22)
• Change behaviour of KafkaConsumer#partitionedStream to parallelPartitionedStream. (#19)
  The parallelPartitionedStream function on KafkaConsumer has therefore been removed. (#30)
• Change to alternative encoding of ProducerMessage and ProducerResult. (#38, #26)
• Change to use AnyVal for Resource and Stream builders. (#31)
• Change internal private definitions to private[this]. (#37)

Fixes

• Fix to propagate KafkaConsumerActor errors to Streams. (#36)

Updates

• Update fs2 to 1.0.1. (#46)
• Update cats-effect to 1.1.0. (#44)
• Update kafka-client to 2.0.1. (#34)
• Update sbt to 1.2.7. (#43)

Documentation

• Add documentation for most of the public API. (#23, #24, #40)

Miscellaneous

• Library is now published on Maven Central instead of on Bintray. (#42)

Released on 2018-12-03.

fs2-kafka v0.16.4

Changes

• Fix StackOverflowError by explicitly creating new Maps. (#16)

Released on 2018-11-14.

fs2-kafka v0.16.3

Changes

• Add parallelPartitionedStream for parallel processing per partition. (#13)
• Add batch commit sinks for when offsets are wrapped in Option. (#12)
• Fix StackOverflowError by explicitly creating new Sets. (#15)

Released on 2018-11-13.

fs2-kafka v0.16.2

Changes

• Add support for offset commit recovery. By default, only RetriableCommitFailedException are retried with a jittered exponential backoff for 10 attempts, switching to fixed rate retries for up to 5 attempts (see CommitRecovery#Default for more details). If you want to keep the previous behaviour (no retries), use the following on ConsumerSettings. (#9)

consumerSettings
  .withCommitRecovery(CommitRecovery.None)

• Fix KafkaConsumer#fiber instance to work as expected. Most notably, join and cancel should work as expected, with join no longer possibly becoming non-terminating after calling cancel. This also means that streams should be interrupted as expected. See KafkaConsumer#fiber for more details. (#11)

Miscellaneous

• Change to run doc instead of packageDoc in validate. (#10)

Released on 2018-11-05.