Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Double case pillows #6319

Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

Double case pillows #6319

wants to merge 2 commits into from

Conversation

gherceg
Copy link
Contributor

@gherceg gherceg commented Jun 13, 2024

Creating in case this is needed. Right now it is not.

Efforts to improve rate limiting and reduce the risk of unreasonable pillow lag are actively in progress, but in the meantime we remain susceptible to spikes in pillow lag. Apart from waiting out the increased load causing the backlog in pillows, our only other short term option is to increase the size of the pillow machine that handles processing case pillows so that we can increase the number of case pillow processes (we are currently memory bound on the r6a.4xlarge machine size).

This PR is only here in case it is absolutely needed.

Steps to rollout

  1. Merge this PR
  2. Follow instructions to update the instance type to r6a.8xlarge in AWS for pillow_b2000
  3. Run cchq --control production after-reboot pillow_b2000
  4. Run cchq --control production update-supervisor-confs --limit=pillowtop
Environments Affected

Production

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant