-
Notifications
You must be signed in to change notification settings - Fork 139
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Avoid running functional tests for PRs whenever it makes sense #2839
Comments
/assign |
/kind enhancement |
/area prow |
Issues go stale after 90d of inactivity. If this issue is safe to close now please do so with /lifecycle stale |
/remove-lifecycle stale |
Issues go stale after 90d of inactivity. If this issue is safe to close now please do so with /lifecycle stale |
Stale issues rot after 30d of inactivity. If this issue is safe to close now please do so with /lifecycle rotten |
Rotten issues close after 30d of inactivity. /close |
@kubevirt-bot: Closing this issue. In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. |
/reopen |
@dhiller: Reopened this issue. In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. |
Short update: we are still investigating how to tackle this. @oshoval contributed the phased plugin recently, which enables us holding back on testing until the PR has reached merge queue state. We are still investigating how to find a proper solution wrt |
Great news! Thanks for the update and for pushing this subject forward! Can we abort functests for files with certain suffixes? e.g. .md, .txt, etc? |
Currently in Kubevirt, every PR needs to run and pass the complete test suite in order to merge.
However, for some PRs (e.g. non-code PRs) there's no value in running any functional tests at all, therefore CI resources are being wasted with no value whatsoever. As an example, a PR making someone an approver [1], which only requires changing a text file, should be tested. This leads to a waste of costly CI resources and should be avoided, which becomes even worse when tests are flakie and need to be re-tested for multiple times.
One possible approach to solving this is to trigger CI only if files under certain paths are being changed.
An even better situation would be to avoid running CI on more sophisticated scenarios, like changing a variable name, comments, file names, and other non-logical code refactoring.
[1] kubevirt/kubevirt#9900
The text was updated successfully, but these errors were encountered: