Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Hold minor compactions when tablets files exceed pause limit #5151

Open
keith-turner opened this issue Dec 7, 2024 · 0 comments
Open

Hold minor compactions when tablets files exceed pause limit #5151

keith-turner opened this issue Dec 7, 2024 · 0 comments
Labels
enhancement This issue describes a new feature, improvement, or optimization.
Milestone
4.0.0

Comments

@keith-turner
Copy link
Contributor

Is your feature request related to a problem? Please describe.

As part of the work on #5023 and #5104 a new property table.file.pause was added that causes bulk imports to pause when a tablets number of files exceeds this limit. Pausing was not implemented for minor compactions.

Describe the solution you'd like

When a tablets files exceeds the pause limit minor compactions will be held on the tablet server. This should cause back pressure for live writes when compactions are not keeping up.
@keith-turner keith-turner added the enhancement This issue describes a new feature, improvement, or optimization. label Dec 7, 2024
@keith-turner keith-turner added this to the 4.0.0 milestone Dec 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement This issue describes a new feature, improvement, or optimization.
Projects
None yet
Milestone
4.0.0
Development

No branches or pull requests
1 participant
@keith-turner