-
Notifications
You must be signed in to change notification settings - Fork 137
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Testing suite for builder #10
Comments
I was thinking we need these things:
the output should be something like:
ideally this is somehow standardized with the same inputs so that you can directly compare 2 versions of the code and say "hey, this version performed better than the other, which performs better than the main branch" |
Ruteri
added a commit
that referenced
this issue
Dec 21, 2022
Ruteri
added a commit
that referenced
this issue
Dec 21, 2022
Ruteri
added a commit
that referenced
this issue
Dec 21, 2022
avalonche
pushed a commit
that referenced
this issue
Feb 7, 2023
avalonche
pushed a commit
that referenced
this issue
Feb 7, 2023
avalonche
pushed a commit
that referenced
this issue
Mar 9, 2023
avalonche
pushed a commit
that referenced
this issue
Mar 9, 2023
avalonche
pushed a commit
that referenced
this issue
Mar 15, 2023
avalonche
pushed a commit
that referenced
this issue
Mar 15, 2023
avalonche
pushed a commit
that referenced
this issue
Mar 17, 2023
avalonche
pushed a commit
that referenced
this issue
Mar 17, 2023
avalonche
pushed a commit
that referenced
this issue
Mar 22, 2023
avalonche
pushed a commit
that referenced
this issue
Mar 22, 2023
avalonche
pushed a commit
that referenced
this issue
Jul 6, 2023
avalonche
pushed a commit
that referenced
this issue
Jul 6, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Rationale
To allow anyone to easily make changes to the builder, measure their impact, and ensure that they are safe.
Implementation
One way to approach this is to create a mass conflicting bundles at random and test merging against those. But thinking it through we might want a standardized dataset that allows for more precise measurement of performance (e.g. variance in the randomized generation of bundles doesn't affect performance)
The text was updated successfully, but these errors were encountered: