Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Make cargo bench part of CI to ensure we don’t accidentally introduce performance regressions #257

Conversation

dragoljub-duric
Copy link
Contributor

@dragoljub-duric dragoljub-duric commented Oct 4, 2023

Problem:
We are not checking if new PRs are introducing performance regressions.

Solution:

Add benchmark test to CI.

@dragoljub-duric dragoljub-duric marked this pull request as ready for review October 11, 2023 14:01
@dragoljub-duric dragoljub-duric requested a review from a team as a code owner October 11, 2023 14:01
Copy link
Collaborator

@ielashi ielashi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have a few comments that I'll add to the PR later today.

e2e-tests/benchmarking/benchmark.txt Outdated Show resolved Hide resolved
e2e-tests/benchmark.sh Outdated Show resolved Hide resolved
e2e-tests/benchmark.sh Outdated Show resolved Hide resolved
e2e-tests/benchmark.sh Outdated Show resolved Hide resolved
e2e-tests/benchmark.sh Outdated Show resolved Hide resolved
benchmarks/run-benchmark.sh Outdated Show resolved Hide resolved
benchmarks/run-benchmark.sh Outdated Show resolved Hide resolved
benchmarks/run-benchmark.sh Outdated Show resolved Hide resolved
benchmarks/run-benchmark.sh Outdated Show resolved Hide resolved
benchmarks/run-benchmark.sh Outdated Show resolved Hide resolved
benchmarks/run-benchmark.sh Outdated Show resolved Hide resolved
benchmarks/run-benchmark.sh Outdated Show resolved Hide resolved
@dragoljub-duric dragoljub-duric enabled auto-merge (squash) October 20, 2023 13:00
benchmarks/run-benchmark.sh Outdated Show resolved Hide resolved
benchmarks/run-benchmark.sh Outdated Show resolved Hide resolved
benchmarks/run-benchmark.sh Outdated Show resolved Hide resolved
benchmarks/run-benchmark.sh Outdated Show resolved Hide resolved
benchmarks/run-benchmark.sh Outdated Show resolved Hide resolved
.github/workflows/workflow.yml Outdated Show resolved Hide resolved
.github/workflows/workflow.yml Outdated Show resolved Hide resolved
benchmarks/run-benchmark.sh Outdated Show resolved Hide resolved
benchmarks/run-benchmark.sh Outdated Show resolved Hide resolved
benchmarks/run-benchmark.sh Outdated Show resolved Hide resolved
e2e-tests/benchmark.sh Outdated Show resolved Hide resolved
e2e-tests/benchmark.sh Outdated Show resolved Hide resolved
Copy link
Collaborator

@ielashi ielashi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

chmod +x drun
}

get_correct_drun_release() {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit:

Suggested change
get_correct_drun_release() {
maybe_download_drun() {

@dragoljub-duric dragoljub-duric merged commit dad22c1 into master Oct 26, 2023
22 checks passed
@dragoljub-duric dragoljub-duric deleted the EXC-1449-make-cargo-bench-part-of-ci-to-ensure-we-dont-accidentally-introduce-performance-regressions_2 branch October 26, 2023 08:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants