You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Given how long and costly benchmarking runs are, and how potentially costly a mistake is to start the benchmark again withouth having edited the robot script to skip test cases already run and/or addding --skip-all in the right place in the shebang while debugging report generation, skipping the execution of a test case should be the default policy whenever output data from a previous run already exists.
Only the user should decide when to go nuclear on previous data.
Implementation considerations
If the output folder for a given test case already exist, log a warning, skip, and move on to the next.
The text was updated successfully, but these errors were encountered:
glpuga
changed the title
--skip shiuld be the default behavior for shephers if data already exist from a previous run
--skip should be the default behavior for shepherd if data already exist from a previous run
Aug 16, 2024
glpuga
changed the title
--skip should be the default behavior for shepherd if data already exist from a previous run
Skip should be the default behavior for shepherd if data already exist from a previous run
Aug 16, 2024
Feature description
Given how long and costly benchmarking runs are, and how potentially costly a mistake is to start the benchmark again withouth having edited the robot script to skip test cases already run and/or addding --skip-all in the right place in the shebang while debugging report generation, skipping the execution of a test case should be the default policy whenever output data from a previous run already exists.
Only the user should decide when to go nuclear on previous data.
Implementation considerations
If the output folder for a given test case already exist, log a warning, skip, and move on to the next.
The text was updated successfully, but these errors were encountered: