Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Investigate intermittent GET /matrix 504s during functional tests #415

Open
calvinnhieu opened this issue Oct 29, 2019 · 0 comments
Open

Investigate intermittent GET /matrix 504s during functional tests #415

calvinnhieu opened this issue Oct 29, 2019 · 0 comments
Assignees
@calvinnhieu

Comments

@calvinnhieu
Copy link
Collaborator

calvinnhieu commented Oct 29, 2019 •
edited
Loading

API Gateway metrics capture 5XX errors, the majority of which have been traced to be 504s with the exception of frequent 500s thrown in integration due to two hanging DSS ES subscriptions (now deleted and resolved). The remaining large spikes in 5XX errors can often be attributed to scheduled Redshift maintenance/upgrades in which the cluster is down for several minutes.

What remains unexplained are the remaining spikes that do not correlate to either of these events in which 504s are thrown on GET /matrix during functional tests causing intermittently failing GitLab builds in all environments. Determine the root cause of these errors.
@calvinnhieu calvinnhieu self-assigned this Oct 29, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@calvinnhieu calvinnhieu

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@calvinnhieu