[develop] Update the hashes of the UFS-WM and UFS_UTILS repositories #859

MichaelLueken · 2023-07-11T16:58:42Z

DESCRIPTION OF CHANGES:

Update the hash of the UFS-WM to 24c51d1 from July 5 and UFS_UTILS to ae483bd from June 26. Additionally, remove Cheyenne from the Jenkinsfile since EPIC no longer has usable allocation on that machine (all core-hours have been spent).

Type of change

Bug fix (non-breaking change which fixes an issue)
New feature (non-breaking change which adds functionality)
Breaking change (fix or feature that would cause existing functionality to not work as expected)
This change requires a documentation update

TESTS CONDUCTED:

ISSUE:

Fixes #855

CHECKLIST

My code follows the style guidelines in the Contributor's Guide
I have performed a self-review of my own code using the Code Reviewer's Guide
I have commented my code, particularly in hard-to-understand areas
My changes need updates to the documentation. I have made corresponding changes to the documentation
My changes do not require updates to the documentation (explain).
My changes generate no new warnings
New and existing tests pass with my changes
Any dependent changes have been merged and published

MichaelLueken · 2023-07-14T15:40:20Z

The Cheyenne Intel WE2E coverage tests were manually ran on Hera and all tests passed:

----------------------------------------------------------------------------------------------------
Experiment name                                                  | Status    | Core hours used 
----------------------------------------------------------------------------------------------------
custom_GFDLgrid__GFDLgrid_USE_NUM_CELLS_IN_FILENAMES_eq_FALSE      COMPLETE               7.54
grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16_plot     COMPLETE              29.39
grid_RRFS_CONUS_25km_ics_NAM_lbcs_NAM_suite_GFS_v16                COMPLETE              20.60
grid_RRFS_CONUScompact_13km_ics_HRRR_lbcs_RAP_suite_HRRR           COMPLETE              24.90
grid_RRFS_CONUScompact_25km_ics_HRRR_lbcs_RAP_suite_RRFS_v1beta    COMPLETE               8.57
grid_SUBCONUS_Ind_3km_ics_HRRR_lbcs_HRRR_suite_HRRR                COMPLETE              16.18
pregen_grid_orog_sfc_climo                                         COMPLETE               6.83
specify_template_filenames                                         COMPLETE               6.62
----------------------------------------------------------------------------------------------------
Total                                                              COMPLETE             120.63

The Cheyenne GNU WE2E coverage tests were manually ran on Hera and all tests passed:

----------------------------------------------------------------------------------------------------
Experiment name                                                  | Status    | Core hours used 
----------------------------------------------------------------------------------------------------
grid_CONUS_25km_GFDLgrid_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16      COMPLETE              20.13
grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_RRFS_v1beta      COMPLETE             232.84
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v17_p8_plot  COMPLETE              27.06
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_HRRR             COMPLETE              36.22
grid_RRFS_CONUScompact_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16   COMPLETE              23.00
grid_RRFS_NA_13km_ics_FV3GFS_lbcs_FV3GFS_suite_RAP                 COMPLETE             319.95
grid_SUBCONUS_Ind_3km_ics_NAM_lbcs_NAM_suite_GFS_v16               COMPLETE              51.55
specify_EXTRN_MDL_SYSBASEDIR_ICS_LBCS                              COMPLETE              10.10
----------------------------------------------------------------------------------------------------
Total                                                              COMPLETE             720.85

...ites_community/config.grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_2017_gfdlmp.yaml

…FS_2017_gfdlmp/_regional or changed CCPP suites for wflow_features WE2E tests. Remove Cheyenne from .cicd/Jenkinsfile since EPIC no longer has an allocation on that machine.

mkavulich

Thanks for addressing my comments, looks good to me.

Just a side question: will the Cheyenne coverage tests be run manually on another platform for the near future until we can get hours back for Cheyenne testing?

MichaelLueken · 2023-07-20T17:09:12Z

@mkavulich I will be manually running the Cheyenne coverage tests on Hera until EPIC can once again submit jobs on the machine.

DavidHuber-NOAA

Built and reran the fundamental tests on Hera. Everything looks good. Thanks @MichaelLueken!

MichaelLueken · 2023-08-11T14:44:23Z

Thanks for the reviews, @natalie-perlin and @DavidHuber-NOAA!

…(hfv3gfs is oversubscribed and tests are failing on the machine).

…ashes

MichaelLueken · 2023-08-14T20:58:51Z

The Cheyenne Intel tests were manually run on Hera and all tests passed:

----------------------------------------------------------------------------------------------------
Experiment name                                                  | Status    | Core hours used 
----------------------------------------------------------------------------------------------------
custom_GFDLgrid__GFDLgrid_USE_NUM_CELLS_IN_FILENAMES_eq_FALSE      COMPLETE               7.26
grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16_plot     COMPLETE              29.00
grid_RRFS_CONUS_25km_ics_NAM_lbcs_NAM_suite_GFS_v16                COMPLETE              19.11
grid_RRFS_CONUScompact_13km_ics_HRRR_lbcs_RAP_suite_HRRR           COMPLETE              25.54
grid_RRFS_CONUScompact_25km_ics_HRRR_lbcs_RAP_suite_RRFS_v1beta    COMPLETE               8.36
grid_SUBCONUS_Ind_3km_ics_HRRR_lbcs_HRRR_suite_HRRR                COMPLETE              16.18
pregen_grid_orog_sfc_climo                                         COMPLETE               7.04
specify_template_filenames                                         COMPLETE               6.95
----------------------------------------------------------------------------------------------------
Total                                                              COMPLETE             119.44

MichaelLueken · 2023-08-15T14:09:56Z

The Cheyenne GNU tests were manually run on Hera and all successfully passed:

----------------------------------------------------------------------------------------------------
Experiment name                                                  | Status    | Core hours used 
----------------------------------------------------------------------------------------------------
grid_CONUS_25km_GFDLgrid_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16      COMPLETE              20.43
grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_RRFS_v1beta      COMPLETE             230.37
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v17_p8_plot  COMPLETE              27.17
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_HRRR             COMPLETE              36.95
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_RAP              COMPLETE              81.45
grid_RRFS_CONUScompact_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16   COMPLETE              22.47
grid_RRFS_NA_13km_ics_FV3GFS_lbcs_FV3GFS_suite_RAP                 COMPLETE             316.26
grid_SUBCONUS_Ind_3km_ics_NAM_lbcs_NAM_suite_GFS_v16               COMPLETE              50.01
specify_EXTRN_MDL_SYSBASEDIR_ICS_LBCS                              COMPLETE              10.08
----------------------------------------------------------------------------------------------------
Total                                                              COMPLETE             795.19

The Gaea WE2E coverage tests were manually run and all successfully passed:

----------------------------------------------------------------------------------------------------
Experiment name                                                  | Status    | Core hours used 
----------------------------------------------------------------------------------------------------
community                                                          COMPLETE              24.94
grid_RRFS_CONUScompact_13km_ics_HRRR_lbcs_RAP_suite_RRFS_v1beta    COMPLETE              30.29
grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_RAP              COMPLETE              30.16
grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_HRRR             COMPLETE              34.15
grid_RRFS_CONUS_3km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15_thompson  COMPLETE             373.31
grid_RRFS_CONUScompact_25km_ics_HRRR_lbcs_HRRR_suite_HRRR          COMPLETE              33.61
grid_RRFS_CONUScompact_3km_ics_HRRR_lbcs_RAP_suite_RRFS_v1beta     COMPLETE             351.42
grid_SUBCONUS_Ind_3km_ics_RAP_lbcs_RAP_suite_RRFS_v1beta_plot      COMPLETE              10.61
nco_ensemble                                                       COMPLETE              81.91
nco_grid_RRFS_CONUS_3km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15_thom  COMPLETE             353.14
----------------------------------------------------------------------------------------------------
Total                                                              COMPLETE            1323.54

The Jet WE2E coverage tests were manually run and all successfully passed:

----------------------------------------------------------------------------------------------------
Experiment name                                                  | Status    | Core hours used 
----------------------------------------------------------------------------------------------------
community                                                          COMPLETE              17.69
custom_ESGgrid                                                     COMPLETE              16.81
custom_GFDLgrid                                                    COMPLETE               9.20
get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_nemsio_2021032018         COMPLETE               9.62
get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h     COMPLETE              75.81
get_from_HPSS_ics_RAP_lbcs_RAP                                     COMPLETE              18.34
grid_RRFS_AK_3km_ics_FV3GFS_lbcs_FV3GFS_suite_HRRR                 COMPLETE             238.07
grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16_plot     COMPLETE              38.26
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2        COMPLETE               7.95
grid_RRFS_CONUS_3km_ics_FV3GFS_lbcs_FV3GFS_suite_RRFS_v1beta       COMPLETE             554.01
nco_grid_RRFS_CONUScompact_25km_ics_HRRR_lbcs_RAP_suite_HRRR       COMPLETE              10.91
process_obs                                                        COMPLETE               0.26
----------------------------------------------------------------------------------------------------
Total                                                              COMPLETE             996.93

The Hera and Orion Jenkins tests successfully passed as well. Moving forward with merging this work now.

MichaelLueken changed the title ~~Update the hashes of the UFS-WM and UFS_UTILS repositories~~ [develop] Update the hashes of the UFS-WM and UFS_UTILS repositories Jul 11, 2023

mkavulich reviewed Jul 19, 2023

View reviewed changes

...ites_community/config.grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_2017_gfdlmp.yaml Show resolved Hide resolved

Update the UFS-WM and UFS_UTILS hashes to current HEAD. Removed FV3_G…

3eb4d42

…FS_2017_gfdlmp/_regional or changed CCPP suites for wflow_features WE2E tests. Remove Cheyenne from .cicd/Jenkinsfile since EPIC no longer has an allocation on that machine.

MichaelLueken force-pushed the feature/update-hashes branch from fc9c44d to 3eb4d42 Compare July 20, 2023 15:50

mkavulich approved these changes Jul 20, 2023

View reviewed changes

mkavulich mentioned this pull request Jul 28, 2023

[develop] Improvements for WE2E tests: script features, additional tests, remove unsupported domains #871

Merged

21 tasks

Merge branch 'ufs-community:develop' into feature/update-hashes

22fc623

natalie-perlin approved these changes Aug 10, 2023

View reviewed changes

MichaelLueken requested a review from DavidHuber-NOAA August 10, 2023 16:54

DavidHuber-NOAA approved these changes Aug 11, 2023

View reviewed changes

MichaelLueken added the run_we2e_coverage_tests Run the coverage set of SRW end-to-end tests label Aug 11, 2023

[develop] Update Jenkinsfile to point to new EPIC allocations on Jet …

281511a

…(hfv3gfs is oversubscribed and tests are failing on the machine).

MichaelLueken added the run_we2e_jenkins_coverage_tests SRW App automated CI testing with modified Jenkinsfile label Aug 11, 2023

natalie-perlin approved these changes Aug 11, 2023

View reviewed changes

MichaelLueken added 4 commits August 11, 2023 16:39

[develop] Update Jenkins scripts to treat jet-epic as jet

a62933e

[develop] Update srw_unittest.sh to use jet instead of jet-epic.

d9028f4

[develop] Update srw_unittest.sh to remove jet-epic.

d9986c1

[develop] Replace SRW_PLATFORM with platfrom in srw_ftest.

a621c31

MichaelLueken mentioned this pull request Aug 11, 2023

[develop] update Gaea modulefile #836

Merged

25 tasks

Merge remote-tracking branch 'upstream/develop' into feature/update-h…

5740fa4

…ashes

MichaelLueken merged commit d056a84 into ufs-community:develop Aug 15, 2023
3 checks passed

MichaelLueken deleted the feature/update-hashes branch August 15, 2023 14:12

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[develop] Update the hashes of the UFS-WM and UFS_UTILS repositories #859

[develop] Update the hashes of the UFS-WM and UFS_UTILS repositories #859

MichaelLueken commented Jul 11, 2023 •

edited

Loading

MichaelLueken commented Jul 14, 2023

mkavulich left a comment

MichaelLueken commented Jul 20, 2023

DavidHuber-NOAA left a comment

MichaelLueken commented Aug 11, 2023

MichaelLueken commented Aug 14, 2023

MichaelLueken commented Aug 15, 2023

[develop] Update the hashes of the UFS-WM and UFS_UTILS repositories #859

[develop] Update the hashes of the UFS-WM and UFS_UTILS repositories #859

Conversation

MichaelLueken commented Jul 11, 2023 • edited Loading

DESCRIPTION OF CHANGES:

Type of change

TESTS CONDUCTED:

ISSUE:

CHECKLIST

MichaelLueken commented Jul 14, 2023

mkavulich left a comment

Choose a reason for hiding this comment

MichaelLueken commented Jul 20, 2023

DavidHuber-NOAA left a comment

Choose a reason for hiding this comment

MichaelLueken commented Aug 11, 2023

MichaelLueken commented Aug 14, 2023

MichaelLueken commented Aug 15, 2023

MichaelLueken commented Jul 11, 2023 •

edited

Loading