Skip to content

Commit

Permalink
Update consumer config
Browse files Browse the repository at this point in the history
  • Loading branch information
fede1024 committed Feb 21, 2018
1 parent 6459d3f commit c04d8ce
Show file tree
Hide file tree
Showing 5 changed files with 34 additions and 10 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ Core(TM) i7-4712HQ CPU @ 2.30GHz:
→ cargo install
[...]
→ kafka-benchmark producer config/base_producer_benchmark.yaml msg_bursts_base
→ kafka-benchmark producer config/base_producer.yaml msg_bursts_base
Scenario: msg_bursts_base, repeat 5 times, 10s pause after each
* Produced 20000000 messages (190.735 MB) in 5.045 seconds using 6 threads
3964321 messages/s
Expand All @@ -44,7 +44,7 @@ Scenario: msg_bursts_base, repeat 5 times, 10s pause after each
37.874 MB/s
Average: 3964950 messages/s, 37.813 MB/s
→ kafka-benchmark produce config/base_producer_benchmark.yaml 1KB_bursts
→ kafka-benchmark produce config/base_producer.yaml 1KB_bursts
Scenario: 1KB_bursts, repeat 3 times, 20s pause after each
* Produced 200000 messages (1.863 GB) in 2.800 seconds using 6 threads
71429 messages/s
Expand Down
15 changes: 7 additions & 8 deletions consumer_benchmark_config.yaml → config/base_consumer.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -12,15 +12,14 @@ default:
session.timeout.ms: 6000

scenarios:
10B_full_topic:
10B_100MB:
topic: benchmark_topic_10B
message_limit: -1
message_limit: 10485760

1KB_one_million:
consumer_type: BaseConsumer
1KB_1GB:
topic: benchmark_topic_1KB
message_limit: 1000000
message_limit: 1048576

one_million_stream:
consumer_type: StreamConsumer
message_limit: 1000000
10KB_1GB:
topic: benchmark_topic_10KB
message_limit: 104858
File renamed without changes.
File renamed without changes.
25 changes: 25 additions & 0 deletions config/stream_consumer.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
---
default:
repeat_times: 1
repeat_pause: 0
consumer_type: StreamConsumer
topic: test_topic1
consumer_config:
bootstrap.servers: localhost:9092
group.id: 'benchmark_consumer_group'
auto.offset.reset: smallest
enable.auto.commit: false
session.timeout.ms: 6000

scenarios:
10B_100MB:
topic: benchmark_topic_10B
message_limit: 10485760

1KB_1GB:
topic: benchmark_topic_1KB
message_limit: 1048576

10KB_1GB:
topic: benchmark_topic_10KB
message_limit: 104858

0 comments on commit c04d8ce

Please sign in to comment.