Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Perf: Final load testing in k8s and Cloud #102

Closed
3 tasks
bmtcril opened this issue Jan 12, 2024 · 1 comment
Closed
3 tasks

Perf: Final load testing in k8s and Cloud #102

bmtcril opened this issue Jan 12, 2024 · 1 comment

Comments

@bmtcril
Copy link
Contributor

bmtcril commented Jan 12, 2024

Once we have a v1 release candidate, we should do a final benchmark / load test for K8s, a ClickHouse Cloud, and Altinity Cloud. This will allow us to have a baseline performance for regression testing and fix any last minute issues.

AC:

  • Tests have been run and documented on K8s
  • Tests have been run and documented on CH Cloud
  • Tests have been run and documented on Altinity

Testing methodolgy:

  • Gather a set of chart queries from Superset's "view sql" and store them off.
  • Using the xapi-db-load test tool, generate 1B rows in a fresh ClickHouse instance. Document how long it takes to generate.
  • Create a spreadsheet documenting performance as below

Superset

  • Approx load times for instructor dash with every permutation of filters
  • Approx load times for operator dash with every permutation of filters
  • Approx load times for each individual chart with every permutation of filters

ClickHouse queries

  • Run the saved reporting queries from above using the ClickHouse benchmark command line tool, store the resulting data for each query
@bmtcril
Copy link
Contributor Author

bmtcril commented May 31, 2024

This has been superseded by the many other performance tasks, closing it out

@bmtcril bmtcril closed this as completed May 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant