Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automated testing system #39

Open
mnlevy1981 opened this issue Jul 11, 2014 · 0 comments
Open

Automated testing system #39

mnlevy1981 opened this issue Jul 11, 2014 · 0 comments
Assignees

Comments

@mnlevy1981
Copy link
Contributor

Obviously some system is needed to ensure code on the master branch compiles and runs as expected... ideally with little or no human intervention.

Necessary Features:

  1. Build executable with all compilers available on machine, report build errors
  2. Run regression tests from reg_tests/ directory, report run errors
  3. Compare output to baseline output, report answer changes

Some discussion has taken place on the developer's mailing list:

  • Recommendation to avoid shell scripts as much as possible
  • Look into CMake / CTest?

Besides needing to create this testing infrastructure, I think we need to completely overhaul reg_tests/ so that it will play nice with the test system and be more amenable to introducing new regression tests.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant