Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement an AsyncBatcher for Apache Kafka #26

Open
hussein-awala opened this issue Feb 28, 2024 · 0 comments
Open

Implement an AsyncBatcher for Apache Kafka #26

hussein-awala opened this issue Feb 28, 2024 · 0 comments
Labels
good first issue Good for newcomers
Milestone

Comments

@hussein-awala
Copy link
Owner

Producing Kafka messages in batches helps optimize network utilization and improve overall throughput.

aiokafka is the most used package to interact with Kafka asynchronously from Python, this package doesn't support an implicit batching mechanism. Instead, the user can create the batches explicitly and send them to Kafka.

Here is an example of how to produce messages in batches using aiokafka, which would be great to support in our package.

@hussein-awala hussein-awala added the good first issue Good for newcomers label Feb 28, 2024
@hussein-awala hussein-awala added this to the 0.3.0 milestone Feb 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

1 participant