SBFT'24 Competition - No mutation testing

[phi-go]

No description provided.

[phi-go]

@alan32liu could you try another coverage experiment with this branch?

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name sbft-standard-cov-01-17 --fuzzers libafl libfuzzer mystique pastis bandfuzz tunefuzz fox

[DonggeLiu]

Oh scratch my comment in the other PR.
Will run this now

@alan32liu could you try another coverage experiment with this branch?

[DonggeLiu]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name sbft-standard-cov-01-17 --fuzzers libafl libfuzzer mystique pastis bandfuzz tunefuzz fox

[DonggeLiu]

ops, did you forget to make the dummy change to trigger exp? : )
Unfortunately I don't have the permission to add it to your branch.

[DonggeLiu]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name sbft-standard-cov-01-17 --fuzzers libafl libfuzzer mystique pastis bandfuzz tunefuzz fox

[phi-go]

@alan32liu, done, it was in the sbft branch that I removed ...

It also seems that we do not have a report for pastis, so we could skip that fuzzer to save some time in the eval.

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name sbft-standard-cov-01-18 --fuzzers libafl libfuzzer mystique bandfuzz tunefuzz fox

[DonggeLiu]

Experiment sbft-standard-cov-01-17 data and results will be available later at:
The experiment data.
The experiment report.

[phi-go]

Ah you were faster, how long would you expect this experiment to take?

[DonggeLiu]

Ah you were faster, how long would you expect this experiment to take?

1-2 days?
I will need to re-run the command because the last one was somehow interrupted.

[DonggeLiu]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name sbft-standard-cov-01-18 --fuzzers libafl libfuzzer mystique bandfuzz tunefuzz fox

[phi-go]

Oh, in that case let's include pastis. Sorry for the back and forth.

[phi-go]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name sbft-standard-cov-01-18 --fuzzers libafl libfuzzer mystique pastis bandfuzz tunefuzz fox

[DonggeLiu]

Experiment sbft-standard-cov-01-18 data and results will be available later at:
The experiment data.
The experiment report.

[DonggeLiu]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name sbft-standard-cov-01-18-p --fuzzers libafl libfuzzer mystique pastis bandfuzz tunefuzz fox

[phi-go]

Thank you!

[DonggeLiu]

Experiment sbft-standard-cov-01-18-p data and results will be available later at:
The experiment data.
The experiment report.

[phi-go]

@alan32liu we had one final commit... Could you start the experiment again?
Also did something go wrong with the experiment, I don't see any build directories?

[DonggeLiu]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name sbft-standard-cov-01-19-p --fuzzers libafl libfuzzer mystique pastis bandfuzz tunefuzz fox

[phi-go]

@alan32liu can you post the link to the results of the experiment as well? 🙂

[DonggeLiu]

This is so strange: The experiment was not requested.

This also happened on the previous 2 exps.
Let me try again.

[DonggeLiu]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name sbft-standard-cov-01-20 --fuzzers libafl libfuzzer mystique pastis bandfuzz tunefuzz fox

[DonggeLiu]

Pretty sure it is working this time!

Experiment sbft-standard-cov-01-20 data and results will be available later at:
The experiment data.
The experiment report.
OR
The experiment report.