Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Testing 4 threads for GDAS eupd [DO NOT MERGE] #1911

Closed
wants to merge 4 commits into from

Conversation

emcbot
Copy link

@emcbot emcbot commented Oct 4, 2023

[DO NOT MERGE] Weekly CI Tests Wednesday Oct 04, 2023

@emcbot emcbot marked this pull request as draft October 4, 2023 22:06
@emcbot emcbot added CI/CD Issue related to CI/CD CI-Orion-Ready **CM use only** PR is ready for CI testing on Orion CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera CI-Orion-Building **Bot use only** CI testing is cloning/building on Orion CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera and removed CI-Orion-Ready **CM use only** PR is ready for CI testing on Orion CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera labels Oct 4, 2023
@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA changed the title [DO NOT MERGE] Weekly High Resolution CI Tests Wednesday Oct 04, 2023 [DO NOT MERGE] Weekly CI Tests Wednesday Oct 04, 2023 Oct 4, 2023
@emcbot emcbot added CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress and removed CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera labels Oct 4, 2023
@emcbot
Copy link
Author

emcbot commented Oct 4, 2023

Automated global-workflow Testing Results:

Machine: Hera
Start: Wed Oct  4 22:08:57 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Oct  4 22:13:23 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Wed Oct  4 22:38:08 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 22:38:12 UTC 2023 for experiment C384C192_hybatmda_c21e58bc
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 22:38:14 UTC 2023 for experiment C384_S2SWA_c21e58bc
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 22:38:17 UTC 2023 for experiment C384_atm3DVar_c21e58bc

@emcbot emcbot added CI-Orion-Running **Bot use only** CI testing on Orion for this PR is in-progress and removed CI-Orion-Building **Bot use only** CI testing is cloning/building on Orion labels Oct 4, 2023
@emcbot
Copy link
Author

emcbot commented Oct 4, 2023

Automated global-workflow Testing Results:

Machine: Orion
Start: Wed Oct  4 17:08:17 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Oct  4 17:10:18 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Wed Oct  4 17:38:54 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 17:39:01 CDT 2023 for experiment C384_atm3DVar_c21e58bc
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 17:39:04 CDT 2023 for experiment C384C192_hybatmda_c21e58bc
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 17:39:08 CDT 2023 for experiment C384_S2SWA_c21e58bc

@emcbot emcbot added CI-Orion-Failed **Bot use only** CI testing on Orion for this PR has failed and removed CI-Orion-Running **Bot use only** CI testing on Orion for this PR is in-progress labels Oct 5, 2023
@emcbot
Copy link
Author

emcbot commented Oct 5, 2023

Automated global-workflow Testing Results:

Machine: Orion
Start: Wed Oct  4 17:08:17 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Oct  4 17:10:18 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Wed Oct  4 17:38:54 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 17:39:01 CDT 2023 for experiment C384_atm3DVar_c21e58bc
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 17:39:04 CDT 2023 for experiment C384C192_hybatmda_c21e58bc
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 17:39:08 CDT 2023 for experiment C384_S2SWA_c21e58bc
Experiment C384C192_hybatmda_c21e58bc Terminated: *FAILED*
Experiment C384C192_hybatmda_c21e58bc Terminated with 1 tasks failed at Wed Oct  4 19:00:35 CDT 2023
Error logs:
/work2/noaa/stmp/GFS_CI_ROOT/PR/1911/RUNTESTS/COMROT/C384C192_hybatmda_c21e58bc/logs/2023040200/enkfgdaseupd.log

@emcbot
Copy link
Author

emcbot commented Oct 5, 2023

Automated global-workflow Testing Results:

Machine: Hera
Start: Wed Oct  4 22:08:57 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Oct  4 22:13:23 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Wed Oct  4 22:38:08 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 22:38:12 UTC 2023 for experiment C384C192_hybatmda_c21e58bc
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 22:38:14 UTC 2023 for experiment C384_S2SWA_c21e58bc
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 22:38:17 UTC 2023 for experiment C384_atm3DVar_c21e58bc
Experiment C384C192_hybatmda_c21e58bc completed: *SUCCESS*
Experiment C384C192_hybatmda_c21e58bc Completed at Thu Oct  5 01:18:09 UTC 2023
with 94 successfully completed jobs

@emcbot
Copy link
Author

emcbot commented Oct 5, 2023

Automated global-workflow Testing Results:

Machine: Hera
Start: Wed Oct  4 22:08:57 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Oct  4 22:13:23 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Wed Oct  4 22:38:08 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 22:38:12 UTC 2023 for experiment C384C192_hybatmda_c21e58bc
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 22:38:14 UTC 2023 for experiment C384_S2SWA_c21e58bc
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 22:38:17 UTC 2023 for experiment C384_atm3DVar_c21e58bc
Experiment C384C192_hybatmda_c21e58bc completed: *SUCCESS*
Experiment C384C192_hybatmda_c21e58bc Completed at Thu Oct  5 01:18:09 UTC 2023
with 94 successfully completed jobs
Experiment C384_S2SWA_c21e58bc completed: *SUCCESS*
Experiment C384_S2SWA_c21e58bc Completed at Thu Oct  5 02:36:10 UTC 2023
with 36 successfully completed jobs

@emcbot
Copy link
Author

emcbot commented Oct 5, 2023

Automated global-workflow Testing Results:

Machine: Hera
Start: Wed Oct  4 22:08:57 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Oct  4 22:13:23 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Wed Oct  4 22:38:08 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 22:38:12 UTC 2023 for experiment C384C192_hybatmda_c21e58bc
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 22:38:14 UTC 2023 for experiment C384_S2SWA_c21e58bc
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 22:38:17 UTC 2023 for experiment C384_atm3DVar_c21e58bc
Experiment C384C192_hybatmda_c21e58bc completed: *SUCCESS*
Experiment C384C192_hybatmda_c21e58bc Completed at Thu Oct  5 01:18:09 UTC 2023
with 94 successfully completed jobs
Experiment C384_S2SWA_c21e58bc completed: *SUCCESS*
Experiment C384_S2SWA_c21e58bc Completed at Thu Oct  5 02:36:10 UTC 2023
with 36 successfully completed jobs
Experiment C384_atm3DVar_c21e58bc completed: *SUCCESS*
Experiment C384_atm3DVar_c21e58bc Completed at Thu Oct  5 04:03:10 UTC 2023
with 55 successfully completed jobs

@emcbot emcbot added CI-Hera-Passed **Bot use only** CI testing on Hera for this PR has completed successfully and removed CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress labels Oct 5, 2023
@emcbot
Copy link
Author

emcbot commented Oct 5, 2023

Automated global-workflow Testing Results:

Machine: Hera
Start: Wed Oct  4 22:08:57 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Oct  4 22:13:23 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Wed Oct  4 22:38:08 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 22:38:12 UTC 2023 for experiment C384C192_hybatmda_c21e58bc
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 22:38:14 UTC 2023 for experiment C384_S2SWA_c21e58bc
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 22:38:17 UTC 2023 for experiment C384_atm3DVar_c21e58bc
Experiment C384C192_hybatmda_c21e58bc completed: *SUCCESS*
Experiment C384C192_hybatmda_c21e58bc Completed at Thu Oct  5 01:18:09 UTC 2023
with 94 successfully completed jobs
Experiment C384_S2SWA_c21e58bc completed: *SUCCESS*
Experiment C384_S2SWA_c21e58bc Completed at Thu Oct  5 02:36:10 UTC 2023
with 36 successfully completed jobs
Experiment C384_atm3DVar_c21e58bc completed: *SUCCESS*
Experiment C384_atm3DVar_c21e58bc Completed at Thu Oct  5 04:03:10 UTC 2023
with 55 successfully completed jobs

@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA added CI-Orion-Passed **Bot use only** CI testing on Orion for this PR has completed successfully and removed CI-Orion-Failed **Bot use only** CI testing on Orion for this PR has failed labels Oct 5, 2023
@emcbot
Copy link
Author

emcbot commented Oct 5, 2023

Automated global-workflow Testing Results:

Machine: Orion
Start: Wed Oct  4 17:08:17 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Oct  4 17:10:18 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Wed Oct  4 17:38:54 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 17:39:01 CDT 2023 for experiment C384_atm3DVar_c21e58bc
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 17:39:04 CDT 2023 for experiment C384C192_hybatmda_c21e58bc
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Oct  4 17:39:08 CDT 2023 for experiment C384_S2SWA_c21e58bc
Experiment C384C192_hybatmda_c21e58bc Terminated: *FAILED*
Experiment C384C192_hybatmda_c21e58bc Terminated with 1 tasks failed at Wed Oct  4 19:00:35 CDT 2023
Error logs:
/work2/noaa/stmp/GFS_CI_ROOT/PR/1911/RUNTESTS/COMROT/C384C192_hybatmda_c21e58bc/logs/2023040200/enkfgdaseupd.log

@emcbot emcbot added the CI-Orion-Building **Bot use only** CI testing is cloning/building on Orion label Oct 5, 2023
@emcbot
Copy link
Author

emcbot commented Oct 5, 2023

Automated global-workflow Testing Results:

Machine: Orion
Start: Thu Oct  5 14:56:59 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Thu Oct  5 14:59:59 CDT 2023

@emcbot emcbot closed this Oct 5, 2023
@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA removed the CI-Orion-Building **Bot use only** CI testing is cloning/building on Orion label Oct 5, 2023
@TerrenceMcGuinness-NOAA
Copy link
Collaborator

NOTE that I added "CI-Hera-Passed" here to test the check_ci.sh script for closing Weekly CI test PRs you can see that it did not really pass without the "fix" to GDAS eupd.

Removing test (only doing one)
trying 4 threads (2 failed 8 passed)
@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA added CI-Orion-Ready **CM use only** PR is ready for CI testing on Orion and removed CI-Hera-Passed **Bot use only** CI testing on Hera for this PR has completed successfully CI-Orion-Passed **Bot use only** CI testing on Orion for this PR has completed successfully labels Oct 13, 2023
@emcbot emcbot added CI-Orion-Building **Bot use only** CI testing is cloning/building on Orion and removed CI-Orion-Ready **CM use only** PR is ready for CI testing on Orion labels Oct 13, 2023
@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA changed the title [DO NOT MERGE] Weekly CI Tests Wednesday Oct 04, 2023 Testing 4 threads for GDAS eupd Oct 13, 2023
@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA changed the title Testing 4 threads for GDAS eupd Testing 4 threads for GDAS eupd [DO NOT MERGE] Oct 13, 2023
@emcbot emcbot added CI-Orion-Running **Bot use only** CI testing on Orion for this PR is in-progress and removed CI-Orion-Building **Bot use only** CI testing is cloning/building on Orion labels Oct 13, 2023
@emcbot
Copy link
Author

emcbot commented Oct 13, 2023

Automated global-workflow Testing Results:

Machine: Orion
Start: Fri Oct 13 09:44:21 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Fri Oct 13 09:46:25 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Fri Oct 13 10:15:15 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Oct 13 10:15:24 CDT 2023 for experiment C384C192_hybatmda_c1632a3f

@emcbot emcbot added CI-Orion-Failed **Bot use only** CI testing on Orion for this PR has failed and removed CI-Orion-Running **Bot use only** CI testing on Orion for this PR is in-progress labels Oct 13, 2023
@emcbot
Copy link
Author

emcbot commented Oct 13, 2023

Automated global-workflow Testing Results:

Machine: Orion
Start: Fri Oct 13 09:44:21 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Fri Oct 13 09:46:25 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Fri Oct 13 10:15:15 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Oct 13 10:15:24 CDT 2023 for experiment C384C192_hybatmda_c1632a3f
Experiment C384C192_hybatmda_c1632a3f Terminated: *FAILED*
Experiment C384C192_hybatmda_c1632a3f Terminated with 1 tasks failed at Fri Oct 13 11:20:35 CDT 2023
Error logs:
/work2/noaa/stmp/GFS_CI_ROOT/PR/1911/RUNTESTS/COMROT/C384C192_hybatmda_c1632a3f/logs/2023040200/enkfgdaseupd.log

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI/CD Issue related to CI/CD CI-Orion-Failed **Bot use only** CI testing on Orion for this PR has failed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants