You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm using amqpstorm 2.2.0 to consume messages from RabbitMQ.
I need a high rate of messages. With no_ack=false I increased the QOS value higher and higher to get better message rates. With ack I can reach up to 1.5k msg/s
Then I tried with no_ack=True and got the rates (4k/s) I needed. But the QUS value is ignored and it seems that amqpstorm reads all messages from RabbitMQ to its local queue.
The memory usage of my script raises until the system crasches ( this only happens if the rabbit queue is very big, after pausing the consumer for a few days).
Is there a way to limit the amount of used memory in amqpstorm basic.consume?
Chris
The text was updated successfully, but these errors were encountered:
This is indeed a side effect of the current implementation when using no-ack set to True. I'll look into implementing some sort of back pressure functionality that could be used to prevent excessive message buildup.
Hi
I'm using amqpstorm 2.2.0 to consume messages from RabbitMQ.
I need a high rate of messages. With no_ack=false I increased the QOS value higher and higher to get better message rates. With ack I can reach up to 1.5k msg/s
Then I tried with no_ack=True and got the rates (4k/s) I needed. But the QUS value is ignored and it seems that amqpstorm reads all messages from RabbitMQ to its local queue.
The memory usage of my script raises until the system crasches ( this only happens if the rabbit queue is very big, after pausing the consumer for a few days).
Is there a way to limit the amount of used memory in amqpstorm basic.consume?
Chris
The text was updated successfully, but these errors were encountered: