Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Using Empty option to clean 7 million tasks crash redis #845

Open
or-opus opened this issue Nov 10, 2024 · 1 comment
Open

Using Empty option to clean 7 million tasks crash redis #845

or-opus opened this issue Nov 10, 2024 · 1 comment

Comments

@or-opus
Copy link

or-opus commented Nov 10, 2024

Hi
We are using BullBoard with bullMq which is a life saver.

We paused a queue for couple of hours and during that time it got full with 7 million tasks (in paused), so we decided to clean those 7m so we wont have to process them.

Once clicking on Empty, our ElasticChace (AWS redis solution) instance got chocked,.all our services where not able to communicate with it, neither redis insight UI as it claims that a blocking script is running.

After 10 min it came back to life, after our entire data got.lost/deleted (assuming the EC instance was crashed)

Any idea what can cause that? Any scale limitations you are aware of?

Thx!

@felixmosh
Copy link
Owner

felixmosh commented Nov 11, 2024

Currently there is no limit of how many items to clean (it uses BullMQ directly, with max_safe_integer as the clean limit)
Meaning that there is no any logic on the bull-board side ...
I'm not aware of a scale limit of BullMQ itself, maybe you should ask there?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants