Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added ff coupled wave case C48_S2SW for testing #1825

Conversation

TerrenceMcGuinness-NOAA
Copy link
Collaborator

@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA commented Aug 25, 2023

Description

Adding a yaml file C48_S2SW, C384_S2S to the case CI directory for testing.
Added C384_S2SW.pending for latter.

This will be part of the PR and weekly split of cases with weekly cases ran automatically once a week.

How Has This Been Tested?

  • Clone and Build tests on WCOSS Dell P3
  • Cycled test on Orion
  • Forecast-only test on Hera and Orion with CI framework

@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA changed the title adding ff case C384 couple wave yaml case for testing Testing ff coupled wave case C384W for testing Aug 25, 2023
@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA changed the title Testing ff coupled wave case C384W for testing Added ff coupled wave case C384W for testing Aug 25, 2023
@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA added CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera CI-Orion-Ready **CM use only** PR is ready for CI testing on Orion and removed CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera CI-Orion-Ready **CM use only** PR is ready for CI testing on Orion labels Aug 25, 2023
@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA added CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera CI-Orion-Ready **CM use only** PR is ready for CI testing on Orion labels Aug 25, 2023
@emcbot emcbot added CI-Orion-Building **Bot use only** CI testing is cloning/building on Orion CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera CI-Orion-Running **Bot use only** CI testing on Orion for this PR is in-progress and removed CI-Orion-Ready **CM use only** PR is ready for CI testing on Orion CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera CI-Orion-Building **Bot use only** CI testing is cloning/building on Orion labels Aug 25, 2023
@emcbot
Copy link

emcbot commented Aug 25, 2023

Automated global-workflow Testing Results:

Machine: Orion
Start: Fri Aug 25 18:04:19 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Fri Aug 25 18:06:35 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Fri Aug 25 18:32:21 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Aug 25 18:32:27 CDT 2023 for experiment C384_S2SW_6338ad45

@emcbot emcbot added CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress and removed CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera labels Aug 25, 2023
@emcbot
Copy link

emcbot commented Aug 25, 2023

Automated global-workflow Testing Results:

Machine: Hera
Start: Fri Aug 25 23:04:28 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Fri Aug 25 23:09:44 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Fri Aug 25 23:34:59 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Aug 25 23:35:10 UTC 2023 for experiment C384_S2SW_6338ad45

@JessicaMeixner-NOAA
Copy link
Contributor

Thanks @TerrenceMcGuinness-NOAA It's great to get waves included in the CI testing!

@TerrenceMcGuinness-NOAA
Copy link
Collaborator Author

TerrenceMcGuinness-NOAA commented Aug 26, 2023

Sure thing @JessicaMeixner-NOAA, Raul gave me the arguments for the run but I noticed that idate was wrong (idate=2021032312). Is there a SDATE you would prefer? I noticed on Orion /work/noaa/global/glopara/data/ICSDIR/prototype_ICs/GEFS-NoahMP-aerosols-p8c has a latest SDATE of 2018031500.

updated idate to one in the IC dir on Orion
@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA added CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera CI-Orion-Ready **CM use only** PR is ready for CI testing on Orion and removed CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress CI-Orion-Running **Bot use only** CI testing on Orion for this PR is in-progress labels Aug 26, 2023
@emcbot emcbot added CI-Orion-Building **Bot use only** CI testing is cloning/building on Orion and removed CI-Orion-Ready **CM use only** PR is ready for CI testing on Orion labels Aug 26, 2023
@emcbot emcbot added CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera and removed CI-Orion-Ready **CM use only** PR is ready for CI testing on Orion CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera labels Aug 28, 2023
@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA changed the title Added ff coupled wave case C384W for testing Added ff coupled wave case C48_S2SW for testing Aug 28, 2023
@emcbot emcbot added CI-Orion-Running **Bot use only** CI testing on Orion for this PR is in-progress and removed CI-Orion-Building **Bot use only** CI testing is cloning/building on Orion labels Aug 28, 2023
@emcbot
Copy link

emcbot commented Aug 28, 2023

Automated global-workflow Testing Results:

Machine: Orion
Start: Mon Aug 28 11:24:30 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Mon Aug 28 11:26:22 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Mon Aug 28 11:53:18 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 11:53:37 CDT 2023 for experiment C384_S2S_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 11:53:41 CDT 2023 for experiment C48_S2SA_gefs_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 11:53:44 CDT 2023 for experiment C48_S2SW_0dc65aff

@emcbot emcbot added CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress and removed CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera labels Aug 28, 2023
@emcbot
Copy link

emcbot commented Aug 28, 2023

Automated global-workflow Testing Results:

Machine: Hera
Start: Mon Aug 28 16:25:07 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Mon Aug 28 16:30:02 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Mon Aug 28 16:53:57 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 16:54:02 UTC 2023 for experiment C384_S2S_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 16:54:05 UTC 2023 for experiment C48_S2SA_gefs_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 16:54:07 UTC 2023 for experiment C48_S2SW_0dc65aff

@emcbot
Copy link

emcbot commented Aug 28, 2023

Automated global-workflow Testing Results:

Machine: Orion
Start: Mon Aug 28 11:24:30 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Mon Aug 28 11:26:22 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Mon Aug 28 11:53:18 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 11:53:37 CDT 2023 for experiment C384_S2S_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 11:53:41 CDT 2023 for experiment C48_S2SA_gefs_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 11:53:44 CDT 2023 for experiment C48_S2SW_0dc65aff
Experiment C48_S2SA_gefs_0dc65aff completed: *SUCCESS*
Experiment C48_S2SA_gefs_0dc65aff Completed at Mon Aug 28 12:26:08 CDT 2023
with 3 successfully completed jobs

@emcbot
Copy link

emcbot commented Aug 28, 2023

Automated global-workflow Testing Results:

Machine: Hera
Start: Mon Aug 28 16:25:07 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Mon Aug 28 16:30:02 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Mon Aug 28 16:53:57 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 16:54:02 UTC 2023 for experiment C384_S2S_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 16:54:05 UTC 2023 for experiment C48_S2SA_gefs_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 16:54:07 UTC 2023 for experiment C48_S2SW_0dc65aff
Experiment C48_S2SA_gefs_0dc65aff completed: *SUCCESS*
Experiment C48_S2SA_gefs_0dc65aff Completed at Mon Aug 28 17:30:25 UTC 2023
with 3 successfully completed jobs

@emcbot
Copy link

emcbot commented Aug 28, 2023

Automated global-workflow Testing Results:

Machine: Orion
Start: Mon Aug 28 11:24:30 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Mon Aug 28 11:26:22 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Mon Aug 28 11:53:18 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 11:53:37 CDT 2023 for experiment C384_S2S_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 11:53:41 CDT 2023 for experiment C48_S2SA_gefs_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 11:53:44 CDT 2023 for experiment C48_S2SW_0dc65aff
Experiment C48_S2SA_gefs_0dc65aff completed: *SUCCESS*
Experiment C48_S2SA_gefs_0dc65aff Completed at Mon Aug 28 12:26:08 CDT 2023
with 3 successfully completed jobs
Experiment C384_S2S_0dc65aff completed: *SUCCESS*
Experiment C384_S2S_0dc65aff Completed at Mon Aug 28 13:10:15 CDT 2023
with 18 successfully completed jobs

@emcbot
Copy link

emcbot commented Aug 28, 2023

Automated global-workflow Testing Results:

Machine: Orion
Start: Mon Aug 28 11:24:30 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Mon Aug 28 11:26:22 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Mon Aug 28 11:53:18 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 11:53:37 CDT 2023 for experiment C384_S2S_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 11:53:41 CDT 2023 for experiment C48_S2SA_gefs_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 11:53:44 CDT 2023 for experiment C48_S2SW_0dc65aff
Experiment C48_S2SA_gefs_0dc65aff completed: *SUCCESS*
Experiment C48_S2SA_gefs_0dc65aff Completed at Mon Aug 28 12:26:08 CDT 2023
with 3 successfully completed jobs
Experiment C384_S2S_0dc65aff completed: *SUCCESS*
Experiment C384_S2S_0dc65aff Completed at Mon Aug 28 13:10:15 CDT 2023
with 18 successfully completed jobs
Experiment C48_S2SW_0dc65aff completed: *SUCCESS*
Experiment C48_S2SW_0dc65aff Completed at Mon Aug 28 13:10:19 CDT 2023
with 21 successfully completed jobs

@emcbot emcbot added CI-Orion-Passed **Bot use only** CI testing on Orion for this PR has completed successfully and removed CI-Orion-Running **Bot use only** CI testing on Orion for this PR is in-progress labels Aug 28, 2023
@emcbot
Copy link

emcbot commented Aug 28, 2023

Automated global-workflow Testing Results:

Machine: Orion
Start: Mon Aug 28 11:24:30 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Mon Aug 28 11:26:22 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Mon Aug 28 11:53:18 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 11:53:37 CDT 2023 for experiment C384_S2S_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 11:53:41 CDT 2023 for experiment C48_S2SA_gefs_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 11:53:44 CDT 2023 for experiment C48_S2SW_0dc65aff
Experiment C48_S2SA_gefs_0dc65aff completed: *SUCCESS*
Experiment C48_S2SA_gefs_0dc65aff Completed at Mon Aug 28 12:26:08 CDT 2023
with 3 successfully completed jobs
Experiment C384_S2S_0dc65aff completed: *SUCCESS*
Experiment C384_S2S_0dc65aff Completed at Mon Aug 28 13:10:15 CDT 2023
with 18 successfully completed jobs
Experiment C48_S2SW_0dc65aff completed: *SUCCESS*
Experiment C48_S2SW_0dc65aff Completed at Mon Aug 28 13:10:19 CDT 2023
with 21 successfully completed jobs

@emcbot
Copy link

emcbot commented Aug 28, 2023

Automated global-workflow Testing Results:

Machine: Hera
Start: Mon Aug 28 16:25:07 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Mon Aug 28 16:30:02 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Mon Aug 28 16:53:57 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 16:54:02 UTC 2023 for experiment C384_S2S_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 16:54:05 UTC 2023 for experiment C48_S2SA_gefs_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 16:54:07 UTC 2023 for experiment C48_S2SW_0dc65aff
Experiment C48_S2SA_gefs_0dc65aff completed: *SUCCESS*
Experiment C48_S2SA_gefs_0dc65aff Completed at Mon Aug 28 17:30:25 UTC 2023
with 3 successfully completed jobs
Experiment C384_S2S_0dc65aff completed: *SUCCESS*
Experiment C384_S2S_0dc65aff Completed at Mon Aug 28 18:21:13 UTC 2023
with 18 successfully completed jobs

@emcbot
Copy link

emcbot commented Aug 28, 2023

Automated global-workflow Testing Results:

Machine: Hera
Start: Mon Aug 28 16:25:07 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Mon Aug 28 16:30:02 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Mon Aug 28 16:53:57 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 16:54:02 UTC 2023 for experiment C384_S2S_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 16:54:05 UTC 2023 for experiment C48_S2SA_gefs_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 16:54:07 UTC 2023 for experiment C48_S2SW_0dc65aff
Experiment C48_S2SA_gefs_0dc65aff completed: *SUCCESS*
Experiment C48_S2SA_gefs_0dc65aff Completed at Mon Aug 28 17:30:25 UTC 2023
with 3 successfully completed jobs
Experiment C384_S2S_0dc65aff completed: *SUCCESS*
Experiment C384_S2S_0dc65aff Completed at Mon Aug 28 18:21:13 UTC 2023
with 18 successfully completed jobs
Experiment C48_S2SW_0dc65aff completed: *SUCCESS*
Experiment C48_S2SW_0dc65aff Completed at Mon Aug 28 18:21:17 UTC 2023
with 21 successfully completed jobs

@emcbot emcbot added CI-Hera-Passed **Bot use only** CI testing on Hera for this PR has completed successfully and removed CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress labels Aug 28, 2023
@emcbot
Copy link

emcbot commented Aug 28, 2023

Automated global-workflow Testing Results:

Machine: Hera
Start: Mon Aug 28 16:25:07 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Mon Aug 28 16:30:02 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Mon Aug 28 16:53:57 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 16:54:02 UTC 2023 for experiment C384_S2S_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 16:54:05 UTC 2023 for experiment C48_S2SA_gefs_0dc65aff
Created experiment:            *SUCCESS*
Case setup: Completed at Mon Aug 28 16:54:07 UTC 2023 for experiment C48_S2SW_0dc65aff
Experiment C48_S2SA_gefs_0dc65aff completed: *SUCCESS*
Experiment C48_S2SA_gefs_0dc65aff Completed at Mon Aug 28 17:30:25 UTC 2023
with 3 successfully completed jobs
Experiment C384_S2S_0dc65aff completed: *SUCCESS*
Experiment C384_S2S_0dc65aff Completed at Mon Aug 28 18:21:13 UTC 2023
with 18 successfully completed jobs
Experiment C48_S2SW_0dc65aff completed: *SUCCESS*
Experiment C48_S2SW_0dc65aff Completed at Mon Aug 28 18:21:17 UTC 2023
with 21 successfully completed jobs

@NeilBarton-NOAA
Copy link
Contributor

@aerorahul @JessicaMeixner-NOAA I put some EP4a ICs are on hpss at

/NCEPDEV/emc-marine/1year/Neil.Barton/ICs_2021032400.tar

Note, these are not the typical ocean restarts because EP4 initializes the ocean from ORAS5.

@aerorahul
Copy link
Contributor

Thanks @NeilBarton-NOAA
This draft PR was just a quick way to find out if we can include C384-resolution type testing at a weekly cadence.
@TerrenceMcGuinness-NOAA will work on weekly testing in the next sprint and we will reach out to you all for ICs and configurations that you wish to be tested at a weekly basis. We hope the same configurations can be tested at a lower resolution on a per PR basis.

An issue on weekly testing is forthcoming.

@JessicaMeixner-NOAA
Copy link
Contributor

@TerrenceMcGuinness-NOAA @aerorahul until you upgrade to @NeilBarton-NOAA ICs, here's two cases that will run out of the box on hera. For orion you will have to move the IC created for the C384 case to the staged location. This file is:
/scratch1/NCEPDEV/climate/role.ufscpara/IC/GEFSwave20210528v2/2016070100/wav/glo_025/20160701.000000.restart.glo_025

I believe this becomes a yaml file /ci/cases/C48_S2SW.yaml as

experiment:
  type: gfs
  mode: forecast-only

arguments:
  pslot: ${pslot}
  app: S2SW
  resdet: 48
  comrot: ${RUNTESTS}/COMROT
  expdir: ${RUNTESTS}/EXPDIR
  idate: 2021032312
  edate: 2021032312
  yaml: ${HOMEgfs_PR}/ci/platforms/gfs_defaults_ci-updates.yaml

and a file /ci/cases/C384_S2SWA.yaml as

experiment:
  type: gfs
  mode: forecast-only

arguments:
  pslot: ${pslot}
  app: S2SWA
  resdet: 384
  comrot: ${RUNTESTS}/COMROT
  expdir: ${RUNTESTS}/EXPDIR
  idate: 2016070100
  edate: 2016070100
  yaml: ${HOMEgfs_PR}/ci/platforms/gfs_defaults_ci-updates.yaml

although I'm not sure about the yaml line.

Tests were completed on hera (not via ci) and output can be seen here:

G-w clone:(of develop): /scratch1/NCEPDEV/climate/Jessica.Meixner/gwtests/global-workflow
C48 output: /scratch1/NCEPDEV/climate/Jessica.Meixner/gwtests/s2swc48t02
C48 helper script which contains exp setup info: /scratch1/NCEPDEV/climate/Jessica.Meixner/gwtests/global-workflow/workflow/coupled_48.sh
C384 output: /scratch1/NCEPDEV/climate/Jessica.Meixner/gwtests/s2swaC384
C384 helper script which contains exp setup info: /scratch1/NCEPDEV/climate/Jessica.Meixner/gwtests/global-workflow/workflow/coupled_384.sh

Please let me know if you need any additional information from me.

@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA added the CI/CD Issue related to CI/CD label Sep 5, 2023
@JessicaMeixner-NOAA
Copy link
Contributor

@TerrenceMcGuinness-NOAA just wanted to check in to see if you needed further information from me or if things were working for you for both the C48 and C384 tests?

@JessicaMeixner-NOAA
Copy link
Contributor

@TerrenceMcGuinness-NOAA Will another PR with this capability be opened?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI/CD Issue related to CI/CD CI-Hera-Passed **Bot use only** CI testing on Hera for this PR has completed successfully CI-Orion-Passed **Bot use only** CI testing on Orion for this PR has completed successfully
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants