Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run TSS tests in parallel #1032

Open
HCastano opened this issue Aug 27, 2024 · 1 comment
Open

Run TSS tests in parallel #1032

HCastano opened this issue Aug 27, 2024 · 1 comment
Labels
Chore changes that do not relate to a fix or feature and don't modify src or test files (eg updating deps) DevOps Refactor

Comments

@HCastano
Copy link
Collaborator

We currently run all, or at least most, of the TSS tests serially. This is done to avoid
having different tests write conflicting state to the same DBs, and to ensure each test
is using a "clean" environment.

After some of the refactoring work in #1026 where a few tests were split out, the run
time of the testing CI step went from ~45 mins to ~60 mins. This is way too long to give
developers feedback about their PR, and it also consumes more minutes on our runners (and
thus incurs extra costs).

I'm proposing that we look into running these tests in parallel by setting up an
independent network for each test. To do this we'd need to ensure that non-conflicting
ports are used for each test, as well as different database locations (for both the
Substrate nodes and TSS servers).

While we might be able to do this with the test infrastrcuture we already have, I think
it's worthwhile to look into using a combination of zombienet and cargo-nextest.

@HCastano HCastano added Chore changes that do not relate to a fix or feature and don't modify src or test files (eg updating deps) DevOps Refactor labels Aug 27, 2024
@HCastano
Copy link
Collaborator Author

Related issue: #487 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Chore changes that do not relate to a fix or feature and don't modify src or test files (eg updating deps) DevOps Refactor
Projects
Status: 🏗 In progress
Development

No branches or pull requests

1 participant