You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have a single producer sending messages of max size 10MB to a single topic having a single partition. I have been hitting the Internal Queue full error a couple of times. I was looking into Kafka documentation on linger.ms, batch.size and also queue.buffering.max.messages. I see that I can increase the value of queue.buffering.max.messages from the default one (100000). I would like to know if there is any performance impact if I increase it ? And what factors should I consider before increasing it ? Is there any recommended value ?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I have a single producer sending messages of max size 10MB to a single topic having a single partition. I have been hitting the Internal Queue full error a couple of times. I was looking into Kafka documentation on
linger.ms
,batch.size
and alsoqueue.buffering.max.messages
. I see that I can increase the value ofqueue.buffering.max.messages
from the default one (100000). I would like to know if there is any performance impact if I increase it ? And what factors should I consider before increasing it ? Is there any recommended value ?Beta Was this translation helpful? Give feedback.
All reactions