Replies: 1 comment
-
By the way, I am indirectly using librdkafka through php-rdkafka-ffi in case that matters. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I am confused about
max.poll.interval.ms
andmax.poll.records
especially since we cannot set latter in librdkafka.Let's say
max.poll.interval.ms
is set to the default 5 minutes and I have a consumer that takes 1 minute to process a single message. Given the default formax.poll.records
is 500, does that mean I will always run into trouble (= rebalancing) every 5 messages consumed?While reading the documentation, I assumed the first poll will fetch 500 messages and put them into an internal queue. Then I process the first message, 1 minute since the poll that retrieved 500 messages passes, then the second message, 2 minutes pass, third message, 3 minutes pass, fourth message, 4 minutes pass, fifth message, 5 minutes pass, BOOM, there hasn't been a poll for
max.poll.interval.ms
since all of the messages processed so far have been supplied from the internal queue.Now I read in #3234 that
max.poll.interval.ms
isn't related to the poll from the broker, but the time between consuming two messages using high level consumer. Is that really so?Beta Was this translation helpful? Give feedback.
All reactions