Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sudden CFL violation failure in get_from_NOMADS_ics_FV3GFS_lbcs_FV3GFS test on Hera GNU #923

Closed
MichaelLueken opened this issue Oct 4, 2023 · 1 comment · Fixed by #921
Labels
bug Something isn't working

Comments

@MichaelLueken
Copy link
Collaborator

Expected behavior

The get_from_NOMADS_ics_FV3GFS_lbcs_FV3GFS WE2E test should successfully pass.

Current behavior

The get_from_NOMADS_ics_FV3GFS_lbcs_FV3GFS test is currently failing on Hera using GNU compilers with what appears to be a CFL violation:

FATAL from PE 7: compute_qs: saturation vapor pressure table overflow, nbad= 1

This is being seen in the Jenkins tests that have been run today, as well as manual tests of the HEAD of develop. Please note that I have not tried running this test using Intel compilers or on other machines as of this time.

Additionally, please note that the test successfully passed while run on the last PR that was merged, #898.

Machines affected

This failure has only been tested and seen on Hera using GNU compilers.

Steps To Reproduce

Run the get_from_NOMADS_ics_FV3GFS_lbcs_FV3GFS WE2E test on Hera using GNU-built executables.

@MichaelLueken
Copy link
Collaborator Author

MichaelLueken commented Oct 5, 2023

The date used in the failing run of get_from_NOMADS_ics_FV3GFS_lbcs_FV3GFS was 2023100200. Using this date and time for DATE_FIRST_CYCL and DATE_LAST_CYCL, along with changing DT_ATMOS to 60, allowed the test to pass:

----------------------------------------------------------------------------------------------------
Experiment name                                                  | Status    | Core hours used 
----------------------------------------------------------------------------------------------------
get_from_NOMADS_ics_FV3GFS_lbcs_FV3GFS                             COMPLETE              39.82
----------------------------------------------------------------------------------------------------
Total                                                              COMPLETE              39.82

The updating of DT_ATMOS to 60 has been made to PR #921, so this issue can be closed when that PR is merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
1 participant