DBZ-8563 Add support for setting BatcherBuilder in Pulsar Producer

[iamseki]

The issue described in Jira ticket has evolved into a feature request that this PR addresses.

In summary, to enable batching and improve the throughput of Pulsar's KeyShared subscription, the producer must be configured with BatcherBuilder.KEY_BASED, as pointed out in the official Pulsar documentation:

• https://pulsar.apache.org/docs/next/concepts-messaging/#batching-for-key_shared-subscriptions

This PR introduces the ability to configure the BatcherBuilder for the Debezium Pulsar producer. For example, you can now configure it as follows:

# Sink Pulsar configuration
debezium.sink.type=pulsar
debezium.sink.pulsar.client.serviceUrl=pulsar://localhost:6650

# Sink Pulsar Producer configuration
debezium.sink.pulsar.producer.producerName=debezium_test_pulsar_batching
# New configuration for Pulsar sink
debezium.sink.pulsar.producer.batcherBuilder=KEY_BASED
...

[iamseki]

I noticed that the same test that fails in CI also fails locally but works after I update to the latest version of Debezium Core. It seems to be fixed. Can we rerun the CI?

[jpechane]

@iamseki Applied, thanks! Could you please a send PR to the main repo with docs update?
Test failure is unrelated.

[iamseki]

@jpechane I’ve opened a PR to update the documentation:

• DBZ-8563: Update documentation to specify the batcherBuilder for Pulsar producers debezium#6096