Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add an idempotency test #2229

Open
oharboe opened this issue Aug 9, 2024 · 0 comments
Open

Add an idempotency test #2229

oharboe opened this issue Aug 9, 2024 · 0 comments

Comments

@oharboe
Copy link
Collaborator

oharboe commented Aug 9, 2024

Description

Add this test to ORFS.

To do so, requires:

#!/bin/bash
#
# Run a smoketest with two builds and check for identical results
set -ue -o pipefail

cd "$(dirname "$0")/.."
. ../env.sh

make FLOW_VARIANT=a
# Pile on as many options as possible that should not affect the result
make SKIP_REPORT_TIMING=1 FLOW_VARIANT=b
diff -r results/nangate45/gcd/a/ results/nangate45/gcd/b/

Suggested Solution

Solve the non-idempotency problems and add a CI test which exercises all options that should have no effect on result in an A/B test.

Additional Context

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant