Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration Tests don't run in robust manner #311

Open
nyuuyn opened this issue Feb 2, 2023 · 5 comments
Open

Integration Tests don't run in robust manner #311

nyuuyn opened this issue Feb 2, 2023 · 5 comments

Comments

@nyuuyn
Copy link
Contributor

nyuuyn commented Feb 2, 2023

Current Behavior:
Sometimes the tests fail and sometimes they don't, the behaviour is rather non-deteministic, since the tests are running in parallel now.
Maybe the github flows are sharing some state? See e.g. #309

@nyuuyn
Copy link
Contributor Author

nyuuyn commented Feb 2, 2023

@PhilWun @lharzenetter any insights ?

@lharzenetter
Copy link
Member

I don't now why this appears:
image

It seems like the test ran successfully but was canceled from the outside.

@nyuuyn
Copy link
Contributor Author

nyuuyn commented Feb 2, 2023

some test fails and cancels the others but @mar-be and I are looking into and don't find proper issues. The tests run fine locally and after a restart on github as well

@PhilWun
Copy link
Contributor

PhilWun commented Feb 2, 2023

According to actions/runner-images#1918 this can happen if the job uses too much memory or a timeout was triggered. The timeout for the tests is 80 minutes so that shouldn't be the issue, but I don't know how much memory is available for the jobs.

@nyuuyn
Copy link
Contributor Author

nyuuyn commented Feb 2, 2023

If we look into the logs of the runner/worker itself we see the following:
image

Maybe the network is a bit full and then everything goes FUBAR? Or github itself has an issue right now?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

No branches or pull requests

3 participants