Feat/mutation testing #8

ASuciuX · 2024-01-11T20:27:34Z

feature: mutation testing functional for PR differences in composite actions

needs initial output pushed into this branch before merging

…output-branch_name

- Updated message for unviable mutants, steps to solve it

…he PR

Based on the type of package it will include the corresponding arguments to be run with. Cases: - if >= 16 mutants on big packages => run big packages using 8 shards - else run big packages without shards - if >= 16 mutants on big packages and >= 120 mutants on small packages => run small packages using 4 shards - else if < 16 mutants on big packages and >= 80 mutants on small packages => run small packages using 4 shards - else run small packages without shards

Test/mutants pr differences

…ing them

Move Shells from Main Workflow to Composite Action

mutation-testing/check-packages-and-shards/action.yml

mutation-testing/output-pr-mutants/action.yml

mutation-testing/pr-differences/action.yml

mutation-testing/README.md

mutation-testing/check-packages-and-shards/README.md

mutation-testing/output-pr-mutants/action.yml

mutation-testing/pr-differences/action.yml

wileyj · 2024-01-12T01:19:41Z

one question i have here - is this workflow meant to run from any rust- based project, or only the stacks-core repo?
if it's only meant to run against stacks-core, i would advocate moving all the files under stacks-core (./stacks-core folder in the repo root).

functionally it looks good - just minor changes to align with standards from other workflows in this repo

ASuciuX · 2024-01-14T00:25:10Z

I've done the modifications on my repo (https://github.com/ASuciuX/actions/tree/test/move-shell-to-composite) in case there were more commits with fixes if the workflow fails. I've also removed the shell-scripts folder because the script was only called in one place, and with this, i've also removed the cloning of the actions repository in the composite.

one question i have here - is this workflow meant to run from any rust- based project, or only the stacks-core repo? if it's only meant to run against stacks-core, i would advocate moving all the files under stacks-core (./stacks-core folder in the repo root).

functionally it looks good - just minor changes to align with standards from other workflows in this repo

It was initially meant to only run on the stacks-core repo, but with the way it's structured right now, it can be run on any rust project. However, since only stackslib and stacks-node packages are considered big, it will run all the mutants as small - without --test-threads 1 argument or BITCOIND_TEST=1 and RUST_BACKTRACE=full env vars.

mutation-testing/pr-differences/action.yml

- update readme files - check exit codes - check that files exist before accessing them, otherwise exit - remove shell scripts folder since it was only used in 1 place - update actions versions used

wileyj

shipit

ASuciuX and others added 28 commits December 11, 2023 01:14

feat: add ci workflows

227c667

needs initial output pushed into this branch before merging

feat: upload artifact to fetch data easily & rename cache to mutants-…

33a3cbb

…output-branch_name

feat: docs readme mutations

ed270a1

feat: add retry to cache/artifact save in case of failure

f47472d

fix: regex matching for mutants v12.3

9c2ab75

feat: remove logger files, only keep filter-pr ones

bb9d337

- Updated message for unviable mutants, steps to solve it

feat: update readme to exclude logger paths

8b2b43d

feat: update actions checkout branch to point at the base branch of t…

f765dac

…he PR

feat: add env vars and test-threads for cargo test

1f1679e

feat: rename from filter-pr to pr-differences

e7b4a75

Merge pull request #4 from ASuciuX/test/mutants-filter-pr

9617c14

Test/mutants pr differences

feat: shorter step names, check files and commands before using them

b773b0f

feat: move the packages checking and output steps to composite

34438d1

feat: update output structure

8508292

feat: debug prints

105384e

feat: change 'echo' to 'cat'

18bc826

feat: check if file is empty, not the other way around

3b5a1b7

feat: update actions version, add comments, check files before access…

f4bde14

…ing them

feat: fix indentation

6ee34a9

feat: remove a check - perhaps it takes longer to move back

c422ffb

feat: add moving of the temp file to input file

f8097b3

feat: move the temp file to input file in script

d72903a

feat: fix typo in 'case'

946ec2f

feat: remove unnecessary check

427290c

feat: change artifact download version back to v3

75a257c

Merge branch 'feat/mutation-testing' into test/move-shell-to-composite

121448d

Merge pull request #7 from ASuciuX/test/move-shell-to-composite

babc08d

Move Shells from Main Workflow to Composite Action

ASuciuX requested a review from wileyj January 11, 2024 20:27

wileyj reviewed Jan 11, 2024

View reviewed changes

mutation-testing/check-packages-and-shards/action.yml Outdated Show resolved Hide resolved