Fix bufr sounding job #1834

KateFriedman-NOAA · 2023-09-01T13:32:52Z

Description

This PR gets the bufr sounding job working again by making two changes:

updating the logf filename within the relevant scripts to match the new naming convention that includes ".atm"
updating to a newer gfs-utils repo hash that includes a change to file length in the gfs_bufr code (resolves failure in testing), see Bufr file path length is insufficient to hold full path gfs-utils#21 & Extend max path length for bufr gfs-utils#22

Resolves #1832
Refs NOAA-EMC/gfs-utils#21

Type of change

Bug fix (fixes something broken)

Change characteristics

Is this a breaking change (a change in existing functionality)? NO
Does this change require a documentation update? NO

How has this been tested?

Low res cycled test on WCOSS2 with DO_BUFRSND="YES" set and the gfspostsnd job included in the cycle.
CI tests on Hera and Orion.

Checklist

Any dependent changes have been merged and published
My code follows the style guidelines of this project
I have performed a self-review of my own code
I have commented my code, particularly in hard-to-understand areas
My changes generate no new warnings
New and existing tests pass with my changes
I have made corresponding changes to the documentation if necessary

- Add missing "atm." to logf filenames in scripts for the bufr sounding job. Refs NOAA-EMC#1832

Refs NOAA-EMC#1832

emcbot · 2023-09-01T14:12:36Z

Automated global-workflow Testing Results:

Machine: Hera
Start: Fri Sep  1 13:44:24 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Fri Sep  1 13:48:59 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Fri Sep  1 14:12:17 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 14:12:21 UTC 2023 for experiment C48_ATM_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 14:12:24 UTC 2023 for experiment C48_S2S_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 14:12:27 UTC 2023 for experiment C48_S2SA_gefs_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 14:12:31 UTC 2023 for experiment C96C48_hybatmDA_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 14:12:34 UTC 2023 for experiment C96_atm3DVar_5a4e4de6

emcbot · 2023-09-01T14:20:22Z

Automated global-workflow Testing Results:

Machine: Orion
Start: Fri Sep  1 08:44:23 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Fri Sep  1 08:46:50 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Fri Sep  1 09:19:50 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:02 CDT 2023 for experiment C48_ATM_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:08 CDT 2023 for experiment C48_S2SA_gefs_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:13 CDT 2023 for experiment C48_S2S_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:16 CDT 2023 for experiment C96_atm3DVar_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:20 CDT 2023 for experiment C96C48_hybatmDA_5a4e4de6

emcbot · 2023-09-01T14:45:15Z

Automated global-workflow Testing Results:

Machine: Hera
Start: Fri Sep  1 13:44:24 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Fri Sep  1 13:48:59 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Fri Sep  1 14:12:17 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 14:12:21 UTC 2023 for experiment C48_ATM_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 14:12:24 UTC 2023 for experiment C48_S2S_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 14:12:27 UTC 2023 for experiment C48_S2SA_gefs_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 14:12:31 UTC 2023 for experiment C96C48_hybatmDA_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 14:12:34 UTC 2023 for experiment C96_atm3DVar_5a4e4de6
Experiment C48_S2SA_gefs_5a4e4de6 completed: *SUCCESS*
Experiment C48_S2SA_gefs_5a4e4de6 Completed at Fri Sep  1 14:45:14 UTC 2023
with 3 successfully completed jobs

emcbot · 2023-09-01T15:00:20Z

Automated global-workflow Testing Results:

Machine: Orion
Start: Fri Sep  1 08:44:23 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Fri Sep  1 08:46:50 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Fri Sep  1 09:19:50 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:02 CDT 2023 for experiment C48_ATM_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:08 CDT 2023 for experiment C48_S2SA_gefs_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:13 CDT 2023 for experiment C48_S2S_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:16 CDT 2023 for experiment C96_atm3DVar_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:20 CDT 2023 for experiment C96C48_hybatmDA_5a4e4de6
Experiment C48_S2S_5a4e4de6 completed: *SUCCESS*
Experiment C48_S2S_5a4e4de6 Completed at Fri Sep  1 10:00:20 CDT 2023
with 19 successfully completed jobs

emcbot · 2023-09-01T15:15:20Z

Automated global-workflow Testing Results:

Machine: Hera
Start: Fri Sep  1 13:44:24 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Fri Sep  1 13:48:59 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Fri Sep  1 14:12:17 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 14:12:21 UTC 2023 for experiment C48_ATM_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 14:12:24 UTC 2023 for experiment C48_S2S_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 14:12:27 UTC 2023 for experiment C48_S2SA_gefs_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 14:12:31 UTC 2023 for experiment C96C48_hybatmDA_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 14:12:34 UTC 2023 for experiment C96_atm3DVar_5a4e4de6
Experiment C48_S2SA_gefs_5a4e4de6 completed: *SUCCESS*
Experiment C48_S2SA_gefs_5a4e4de6 Completed at Fri Sep  1 14:45:14 UTC 2023
with 3 successfully completed jobs
Experiment C48_ATM_5a4e4de6 Terminated: *FAILED*
Experiment C48_ATM_5a4e4de6 Terminated with 1 tasks failed at Fri Sep  1 15:15:16 UTC 2023
Error logs:
/scratch1/NCEPDEV/global/Terry.McGuinness/GFS_CI_ROOT/PR/1834/RUNTESTS/COMROT/C48_ATM_5a4e4de6/logs/2021032312/gfspostsnd.log

KateFriedman-NOAA · 2023-09-01T15:22:46Z

Error in log (PR/1834/RUNTESTS/COMROT/C48_ATM_5a4e4de6/logs/2021032312/gfspostsnd.log) on Hera:

+ gfs_bufr.sh[83]: srun -l --export=ALL -n 40 /scratch1/NCEPDEV/global/Terry.McGuinness/GFS_CI_ROOT/PR/1834/global-workflow/exec/gfs_bufr.x
 0: forrtl: severe (66): output statement overflows record, unit -5, file Internal Formatted Write
 0: Image              PC                Routine            Line        Source
 0: gfs_bufr.x         000000000094B4AE  Unknown               Unknown  Unknown
 0: gfs_bufr.x         0000000000994EF1  Unknown               Unknown  Unknown
 0: gfs_bufr.x         0000000000406DF2  buff_                      31  buff.f
 0: gfs_bufr.x         0000000000408F35  MAIN__                    270  gfsbufr.f
 0: gfs_bufr.x         000000000040615E  Unknown               Unknown  Unknown
 0: libc-2.17.so       00002B80B6A18555  __libc_start_main     Unknown  Unknown
 0: gfs_bufr.x         0000000000406069  Unknown               Unknown  Unknown
srun: error: h3c39: task 0: Exited with exit code 66
srun: launch/slurm: _step_signal: Terminating StepId=48994302.9
+ gfs_bufr.sh[1]: postamble gfs_bufr.sh 1693581047 66

May need to run additional tests on Hera to investigate.

The issue with the log filename was at least resolved:

+ exgfs_atmos_postsnd.sh[74]: [[ ! -f /scratch1/NCEPDEV/global/Terry.McGuinness/GFS_CI_ROOT/PR/1834/RUNTESTS/COMROT/C48_ATM_5a4e4de6/gfs.20210323/12//model_data/atmos/history/gfs.t12z.atm.logf012.txt ]]
+ exgfs_atmos_postsnd.sh[78]: break
+ exgfs_atmos_postsnd.sh[88]: '[' 012 -gt 0 ']'
+ exgfs_atmos_postsnd.sh[89]: export FINT=3
+ exgfs_atmos_postsnd.sh[89]: FINT=3
+ exgfs_atmos_postsnd.sh[92]: /scratch1/NCEPDEV/global/Terry.McGuinness/GFS_CI_ROOT/PR/1834/global-workflow/ush/gfs_bufr.sh
Begin gfs_bufr.sh at Fri Sep  1 15:10:28 UTC 2023

emcbot · 2023-09-01T15:30:20Z

Automated global-workflow Testing Results:

Machine: Orion
Start: Fri Sep  1 08:44:23 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Fri Sep  1 08:46:50 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Fri Sep  1 09:19:50 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:02 CDT 2023 for experiment C48_ATM_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:08 CDT 2023 for experiment C48_S2SA_gefs_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:13 CDT 2023 for experiment C48_S2S_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:16 CDT 2023 for experiment C96_atm3DVar_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:20 CDT 2023 for experiment C96C48_hybatmDA_5a4e4de6
Experiment C48_S2S_5a4e4de6 completed: *SUCCESS*
Experiment C48_S2S_5a4e4de6 Completed at Fri Sep  1 10:00:20 CDT 2023
with 19 successfully completed jobs
Experiment C48_ATM_5a4e4de6 completed: *SUCCESS*
Experiment C48_ATM_5a4e4de6 Completed at Fri Sep  1 10:30:19 CDT 2023
with 49 successfully completed jobs

emcbot · 2023-09-01T15:36:08Z

Automated global-workflow Testing Results:

Machine: Orion
Start: Fri Sep  1 08:44:23 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Fri Sep  1 08:46:50 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Fri Sep  1 09:19:50 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:02 CDT 2023 for experiment C48_ATM_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:08 CDT 2023 for experiment C48_S2SA_gefs_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:13 CDT 2023 for experiment C48_S2S_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:16 CDT 2023 for experiment C96_atm3DVar_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:20 CDT 2023 for experiment C96C48_hybatmDA_5a4e4de6
Experiment C48_S2S_5a4e4de6 completed: *SUCCESS*
Experiment C48_S2S_5a4e4de6 Completed at Fri Sep  1 10:00:20 CDT 2023
with 19 successfully completed jobs
Experiment C48_ATM_5a4e4de6 completed: *SUCCESS*
Experiment C48_ATM_5a4e4de6 Completed at Fri Sep  1 10:30:19 CDT 2023
with 49 successfully completed jobs
Experiment C48_S2SA_gefs_5a4e4de6 completed: *SUCCESS*
Experiment C48_S2SA_gefs_5a4e4de6 Completed at Fri Sep  1 10:36:07 CDT 2023
with 3 successfully completed jobs

KateFriedman-NOAA · 2023-09-01T16:09:34Z

Error in log (PR/1834/RUNTESTS/COMROT/C48_ATM_5a4e4de6/logs/2021032312/gfspostsnd.log) on Hera:

+ gfs_bufr.sh[83]: srun -l --export=ALL -n 40 /scratch1/NCEPDEV/global/Terry.McGuinness/GFS_CI_ROOT/PR/1834/global-workflow/exec/gfs_bufr.x
 0: forrtl: severe (66): output statement overflows record, unit -5, file Internal Formatted Write
 0: Image              PC                Routine            Line        Source
 0: gfs_bufr.x         000000000094B4AE  Unknown               Unknown  Unknown
 0: gfs_bufr.x         0000000000994EF1  Unknown               Unknown  Unknown
 0: gfs_bufr.x         0000000000406DF2  buff_                      31  buff.f
 0: gfs_bufr.x         0000000000408F35  MAIN__                    270  gfsbufr.f
 0: gfs_bufr.x         000000000040615E  Unknown               Unknown  Unknown
 0: libc-2.17.so       00002B80B6A18555  __libc_start_main     Unknown  Unknown
 0: gfs_bufr.x         0000000000406069  Unknown               Unknown  Unknown
srun: error: h3c39: task 0: Exited with exit code 66
srun: launch/slurm: _step_signal: Terminating StepId=48994302.9
+ gfs_bufr.sh[1]: postamble gfs_bufr.sh 1693581047 66

@BoCui-NOAA would you be able to take a look at the gfs_bufr code error that happened in a small CI test on Hera? See error above and saved test here on Hera:

/scratch1/NCEPDEV/global/Kate.Friedman/expdir/CI_TEST_LOGS
see bottom of log: /scratch1/NCEPDEV/global/Kate.Friedman/expdir/CI_TEST_LOGS/COMROT/C48_ATM_5a4e4de6/logs/2021032312/gfspostsnd.log

The gfspostsnd (bufr sounding) job worked fine in other CI tests on Hera and Orion (including the same test configuration on Orion). Also, ran ok in a short C96C48 ATM-only cycled test on WCOSS2. Output from WCOSS2 test is here on Dogwood (ran on Cactus, copied logs to Dogwood):

/lfs/h2/emc/global/noscrub/kate.friedman/expdir/test96/
logs: /lfs/h2/emc/global/noscrub/kate.friedman/expdir/test96/COMROT_LOGS/2021122*/gfspostsnd

Thanks for any help you can provide for this code!

BoCui-NOAA · 2023-09-01T16:36:51Z

@KateFriedman-NOAA I will take a look the codes and test log files.

emcbot · 2023-09-01T17:46:11Z

Automated global-workflow Testing Results:

Machine: Orion
Start: Fri Sep  1 08:44:23 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Fri Sep  1 08:46:50 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Fri Sep  1 09:19:50 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:02 CDT 2023 for experiment C48_ATM_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:08 CDT 2023 for experiment C48_S2SA_gefs_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:13 CDT 2023 for experiment C48_S2S_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:16 CDT 2023 for experiment C96_atm3DVar_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:20 CDT 2023 for experiment C96C48_hybatmDA_5a4e4de6
Experiment C48_S2S_5a4e4de6 completed: *SUCCESS*
Experiment C48_S2S_5a4e4de6 Completed at Fri Sep  1 10:00:20 CDT 2023
with 19 successfully completed jobs
Experiment C48_ATM_5a4e4de6 completed: *SUCCESS*
Experiment C48_ATM_5a4e4de6 Completed at Fri Sep  1 10:30:19 CDT 2023
with 49 successfully completed jobs
Experiment C48_S2SA_gefs_5a4e4de6 completed: *SUCCESS*
Experiment C48_S2SA_gefs_5a4e4de6 Completed at Fri Sep  1 10:36:07 CDT 2023
with 3 successfully completed jobs
Experiment C96_atm3DVar_5a4e4de6 completed: *SUCCESS*
Experiment C96_atm3DVar_5a4e4de6 Completed at Fri Sep  1 12:46:10 CDT 2023
with 90 successfully completed jobs

emcbot · 2023-09-01T18:02:07Z

Automated global-workflow Testing Results:

Machine: Orion
Start: Fri Sep  1 08:44:23 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Fri Sep  1 08:46:50 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Fri Sep  1 09:19:50 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:02 CDT 2023 for experiment C48_ATM_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:08 CDT 2023 for experiment C48_S2SA_gefs_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:13 CDT 2023 for experiment C48_S2S_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:16 CDT 2023 for experiment C96_atm3DVar_5a4e4de6
Created experiment:            *SUCCESS*
Case setup: Completed at Fri Sep  1 09:20:20 CDT 2023 for experiment C96C48_hybatmDA_5a4e4de6
Experiment C48_S2S_5a4e4de6 completed: *SUCCESS*
Experiment C48_S2S_5a4e4de6 Completed at Fri Sep  1 10:00:20 CDT 2023
with 19 successfully completed jobs
Experiment C48_ATM_5a4e4de6 completed: *SUCCESS*
Experiment C48_ATM_5a4e4de6 Completed at Fri Sep  1 10:30:19 CDT 2023
with 49 successfully completed jobs
Experiment C48_S2SA_gefs_5a4e4de6 completed: *SUCCESS*
Experiment C48_S2SA_gefs_5a4e4de6 Completed at Fri Sep  1 10:36:07 CDT 2023
with 3 successfully completed jobs
Experiment C96_atm3DVar_5a4e4de6 completed: *SUCCESS*
Experiment C96_atm3DVar_5a4e4de6 Completed at Fri Sep  1 12:46:10 CDT 2023
with 90 successfully completed jobs
Experiment C96C48_hybatmDA_5a4e4de6 completed: *SUCCESS*
Experiment C96C48_hybatmDA_5a4e4de6 Completed at Fri Sep  1 13:02:07 CDT 2023
with 152 successfully completed jobs

emcbot · 2023-09-06T22:08:55Z

Automated global-workflow Testing Results:

Machine: Hera
Start: Wed Sep  6 21:41:12 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Sep  6 21:45:28 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Wed Sep  6 22:08:34 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:43 UTC 2023 for experiment C48_ATM_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:46 UTC 2023 for experiment C48_S2S_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:48 UTC 2023 for experiment C48_S2SA_gefs_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:51 UTC 2023 for experiment C96C48_hybatmDA_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:53 UTC 2023 for experiment C96_atm3DVar_ba960297

emcbot · 2023-09-06T22:36:08Z

Automated global-workflow Testing Results:

Machine: Orion
Start: Wed Sep  6 13:12:23 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Sep  6 13:14:28 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Wed Sep  6 13:45:09 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 13:45:18 CDT 2023 for experiment C48_ATM_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 13:45:21 CDT 2023 for experiment C48_S2SA_gefs_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 13:45:24 CDT 2023 for experiment C48_S2S_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 13:45:28 CDT 2023 for experiment C96_atm3DVar_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 13:45:31 CDT 2023 for experiment C96C48_hybatmDA_ba960297
Experiment C48_S2SA_gefs_ba960297 completed: *SUCCESS*
Experiment C48_S2SA_gefs_ba960297 Completed at Wed Sep  6 14:22:08 CDT 2023
with 3 successfully completed jobs
Experiment C48_S2S_ba960297 completed: *SUCCESS*
Experiment C48_S2S_ba960297 Completed at Wed Sep  6 15:06:13 CDT 2023
with 19 successfully completed jobs
Experiment C48_ATM_ba960297 completed: *SUCCESS*
Experiment C48_ATM_ba960297 Completed at Wed Sep  6 15:12:09 CDT 2023
with 49 successfully completed jobs
Experiment C96_atm3DVar_ba960297 completed: *SUCCESS*
Experiment C96_atm3DVar_ba960297 Completed at Wed Sep  6 17:36:07 CDT 2023
with 90 successfully completed jobs

emcbot · 2023-09-06T22:42:08Z

Automated global-workflow Testing Results:

Machine: Hera
Start: Wed Sep  6 21:41:12 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Sep  6 21:45:28 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Wed Sep  6 22:08:34 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:43 UTC 2023 for experiment C48_ATM_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:46 UTC 2023 for experiment C48_S2S_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:48 UTC 2023 for experiment C48_S2SA_gefs_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:51 UTC 2023 for experiment C96C48_hybatmDA_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:53 UTC 2023 for experiment C96_atm3DVar_ba960297
Experiment C48_S2SA_gefs_ba960297 completed: *SUCCESS*
Experiment C48_S2SA_gefs_ba960297 Completed at Wed Sep  6 22:42:08 UTC 2023
with 3 successfully completed jobs

emcbot · 2023-09-06T22:56:09Z

Automated global-workflow Testing Results:

Machine: Orion
Start: Wed Sep  6 13:12:23 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Sep  6 13:14:28 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Wed Sep  6 13:45:09 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 13:45:18 CDT 2023 for experiment C48_ATM_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 13:45:21 CDT 2023 for experiment C48_S2SA_gefs_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 13:45:24 CDT 2023 for experiment C48_S2S_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 13:45:28 CDT 2023 for experiment C96_atm3DVar_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 13:45:31 CDT 2023 for experiment C96C48_hybatmDA_ba960297
Experiment C48_S2SA_gefs_ba960297 completed: *SUCCESS*
Experiment C48_S2SA_gefs_ba960297 Completed at Wed Sep  6 14:22:08 CDT 2023
with 3 successfully completed jobs
Experiment C48_S2S_ba960297 completed: *SUCCESS*
Experiment C48_S2S_ba960297 Completed at Wed Sep  6 15:06:13 CDT 2023
with 19 successfully completed jobs
Experiment C48_ATM_ba960297 completed: *SUCCESS*
Experiment C48_ATM_ba960297 Completed at Wed Sep  6 15:12:09 CDT 2023
with 49 successfully completed jobs
Experiment C96_atm3DVar_ba960297 completed: *SUCCESS*
Experiment C96_atm3DVar_ba960297 Completed at Wed Sep  6 17:36:07 CDT 2023
with 90 successfully completed jobs
Experiment C96C48_hybatmDA_ba960297 completed: *SUCCESS*
Experiment C96C48_hybatmDA_ba960297 Completed at Wed Sep  6 17:56:09 CDT 2023
with 152 successfully completed jobs

emcbot · 2023-09-06T22:58:07Z

Automated global-workflow Testing Results:

Machine: Orion
Start: Wed Sep  6 13:12:23 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Sep  6 13:14:28 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Wed Sep  6 13:45:09 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 13:45:18 CDT 2023 for experiment C48_ATM_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 13:45:21 CDT 2023 for experiment C48_S2SA_gefs_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 13:45:24 CDT 2023 for experiment C48_S2S_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 13:45:28 CDT 2023 for experiment C96_atm3DVar_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 13:45:31 CDT 2023 for experiment C96C48_hybatmDA_ba960297
Experiment C48_S2SA_gefs_ba960297 completed: *SUCCESS*
Experiment C48_S2SA_gefs_ba960297 Completed at Wed Sep  6 14:22:08 CDT 2023
with 3 successfully completed jobs
Experiment C48_S2S_ba960297 completed: *SUCCESS*
Experiment C48_S2S_ba960297 Completed at Wed Sep  6 15:06:13 CDT 2023
with 19 successfully completed jobs
Experiment C48_ATM_ba960297 completed: *SUCCESS*
Experiment C48_ATM_ba960297 Completed at Wed Sep  6 15:12:09 CDT 2023
with 49 successfully completed jobs
Experiment C96_atm3DVar_ba960297 completed: *SUCCESS*
Experiment C96_atm3DVar_ba960297 Completed at Wed Sep  6 17:36:07 CDT 2023
with 90 successfully completed jobs
Experiment C96C48_hybatmDA_ba960297 completed: *SUCCESS*
Experiment C96C48_hybatmDA_ba960297 Completed at Wed Sep  6 17:56:09 CDT 2023
with 152 successfully completed jobs

emcbot · 2023-09-06T23:21:06Z

Automated global-workflow Testing Results:

Machine: Hera
Start: Wed Sep  6 21:41:12 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Sep  6 21:45:28 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Wed Sep  6 22:08:34 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:43 UTC 2023 for experiment C48_ATM_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:46 UTC 2023 for experiment C48_S2S_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:48 UTC 2023 for experiment C48_S2SA_gefs_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:51 UTC 2023 for experiment C96C48_hybatmDA_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:53 UTC 2023 for experiment C96_atm3DVar_ba960297
Experiment C48_S2SA_gefs_ba960297 completed: *SUCCESS*
Experiment C48_S2SA_gefs_ba960297 Completed at Wed Sep  6 22:42:08 UTC 2023
with 3 successfully completed jobs
Experiment C48_ATM_ba960297 completed: *SUCCESS*
Experiment C48_ATM_ba960297 Completed at Wed Sep  6 23:21:05 UTC 2023
with 49 successfully completed jobs

emcbot · 2023-09-06T23:27:15Z

Automated global-workflow Testing Results:

Machine: Hera
Start: Wed Sep  6 21:41:12 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Sep  6 21:45:28 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Wed Sep  6 22:08:34 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:43 UTC 2023 for experiment C48_ATM_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:46 UTC 2023 for experiment C48_S2S_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:48 UTC 2023 for experiment C48_S2SA_gefs_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:51 UTC 2023 for experiment C96C48_hybatmDA_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:53 UTC 2023 for experiment C96_atm3DVar_ba960297
Experiment C48_S2SA_gefs_ba960297 completed: *SUCCESS*
Experiment C48_S2SA_gefs_ba960297 Completed at Wed Sep  6 22:42:08 UTC 2023
with 3 successfully completed jobs
Experiment C48_ATM_ba960297 completed: *SUCCESS*
Experiment C48_ATM_ba960297 Completed at Wed Sep  6 23:21:05 UTC 2023
with 49 successfully completed jobs
Experiment C48_S2S_ba960297 completed: *SUCCESS*
Experiment C48_S2S_ba960297 Completed at Wed Sep  6 23:27:15 UTC 2023
with 19 successfully completed jobs

emcbot · 2023-09-07T01:57:10Z

Automated global-workflow Testing Results:

Machine: Hera
Start: Wed Sep  6 21:41:12 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Sep  6 21:45:28 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Wed Sep  6 22:08:34 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:43 UTC 2023 for experiment C48_ATM_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:46 UTC 2023 for experiment C48_S2S_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:48 UTC 2023 for experiment C48_S2SA_gefs_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:51 UTC 2023 for experiment C96C48_hybatmDA_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:53 UTC 2023 for experiment C96_atm3DVar_ba960297
Experiment C48_S2SA_gefs_ba960297 completed: *SUCCESS*
Experiment C48_S2SA_gefs_ba960297 Completed at Wed Sep  6 22:42:08 UTC 2023
with 3 successfully completed jobs
Experiment C48_ATM_ba960297 completed: *SUCCESS*
Experiment C48_ATM_ba960297 Completed at Wed Sep  6 23:21:05 UTC 2023
with 49 successfully completed jobs
Experiment C48_S2S_ba960297 completed: *SUCCESS*
Experiment C48_S2S_ba960297 Completed at Wed Sep  6 23:27:15 UTC 2023
with 19 successfully completed jobs
Experiment C96C48_hybatmDA_ba960297 completed: *SUCCESS*
Experiment C96C48_hybatmDA_ba960297 Completed at Thu Sep  7 01:57:10 UTC 2023
with 152 successfully completed jobs

emcbot · 2023-09-07T02:00:12Z

Automated global-workflow Testing Results:

Machine: Hera
Start: Wed Sep  6 21:41:12 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Sep  6 21:45:28 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Wed Sep  6 22:08:34 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:43 UTC 2023 for experiment C48_ATM_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:46 UTC 2023 for experiment C48_S2S_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:48 UTC 2023 for experiment C48_S2SA_gefs_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:51 UTC 2023 for experiment C96C48_hybatmDA_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:53 UTC 2023 for experiment C96_atm3DVar_ba960297
Experiment C48_S2SA_gefs_ba960297 completed: *SUCCESS*
Experiment C48_S2SA_gefs_ba960297 Completed at Wed Sep  6 22:42:08 UTC 2023
with 3 successfully completed jobs
Experiment C48_ATM_ba960297 completed: *SUCCESS*
Experiment C48_ATM_ba960297 Completed at Wed Sep  6 23:21:05 UTC 2023
with 49 successfully completed jobs
Experiment C48_S2S_ba960297 completed: *SUCCESS*
Experiment C48_S2S_ba960297 Completed at Wed Sep  6 23:27:15 UTC 2023
with 19 successfully completed jobs
Experiment C96C48_hybatmDA_ba960297 completed: *SUCCESS*
Experiment C96C48_hybatmDA_ba960297 Completed at Thu Sep  7 01:57:10 UTC 2023
with 152 successfully completed jobs
Experiment C96_atm3DVar_ba960297 completed: *SUCCESS*
Experiment C96_atm3DVar_ba960297 Completed at Thu Sep  7 02:00:11 UTC 2023
with 90 successfully completed jobs

emcbot · 2023-09-07T02:03:08Z

Automated global-workflow Testing Results:

Machine: Hera
Start: Wed Sep  6 21:41:12 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Wed Sep  6 21:45:28 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Wed Sep  6 22:08:34 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:43 UTC 2023 for experiment C48_ATM_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:46 UTC 2023 for experiment C48_S2S_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:48 UTC 2023 for experiment C48_S2SA_gefs_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:51 UTC 2023 for experiment C96C48_hybatmDA_ba960297
Created experiment:            *SUCCESS*
Case setup: Completed at Wed Sep  6 22:08:53 UTC 2023 for experiment C96_atm3DVar_ba960297
Experiment C48_S2SA_gefs_ba960297 completed: *SUCCESS*
Experiment C48_S2SA_gefs_ba960297 Completed at Wed Sep  6 22:42:08 UTC 2023
with 3 successfully completed jobs
Experiment C48_ATM_ba960297 completed: *SUCCESS*
Experiment C48_ATM_ba960297 Completed at Wed Sep  6 23:21:05 UTC 2023
with 49 successfully completed jobs
Experiment C48_S2S_ba960297 completed: *SUCCESS*
Experiment C48_S2S_ba960297 Completed at Wed Sep  6 23:27:15 UTC 2023
with 19 successfully completed jobs
Experiment C96C48_hybatmDA_ba960297 completed: *SUCCESS*
Experiment C96C48_hybatmDA_ba960297 Completed at Thu Sep  7 01:57:10 UTC 2023
with 152 successfully completed jobs
Experiment C96_atm3DVar_ba960297 completed: *SUCCESS*
Experiment C96_atm3DVar_ba960297 Completed at Thu Sep  7 02:00:11 UTC 2023
with 90 successfully completed jobs

KateFriedman-NOAA · 2023-09-07T13:41:09Z

Rerun CI tests on Hera and Orion have passed. Rerunning test on WCOSS2 to double check updated gfs_bufr code is all good.

Setting DO_BUFRSND back to it's default value of "NO" after completing CI tests. Refs NOAA-EMC#1832

BoCui-NOAA · 2023-09-07T14:35:31Z

Rerun CI tests on Hera and Orion have passed. Rerunning test on WCOSS2 to double check updated gfs_bufr code is all good.

@KateFriedman-NOAA Can you tell me the location of the re-run results on WCOSS2? Thanks!

KateFriedman-NOAA · 2023-09-07T15:22:54Z

@KateFriedman-NOAA Can you tell me the location of the re-run results on WCOSS2? Thanks!

@BoCui-NOAA see the following on Dogwood, it just finished running the gfspostsnd job:

expdir: /lfs/h2/emc/global/noscrub/kate.friedman/expdir/test96
output/logs: /lfs/h2/emc/ptmp/kate.friedman/comrot/test96
clone: /lfs/h2/emc/global/noscrub/kate.friedman/git/develop/workflow

BoCui-NOAA · 2023-09-07T15:45:45Z

@KateFriedman-NOAA Can you tell me the location of the re-run results on WCOSS2? Thanks!

@BoCui-NOAA see the following on Dogwood, it just finished running the gfspostsnd job:

expdir: /lfs/h2/emc/global/noscrub/kate.friedman/expdir/test96 output/logs: /lfs/h2/emc/ptmp/kate.friedman/comrot/test96 clone: /lfs/h2/emc/global/noscrub/kate.friedman/git/develop/workflow

@KateFriedman-NOAA
/lfs/h2/emc/ptmp/kate.friedman/comrot/test96/logs/2021122100/gfspostsnd.log

SENDDBN=NO in the above log file. Is it set only for the CI test? There is no files copied to /lfs/h2/emc/ptmp/kate.friedman/comrot/test96/gfs.20211221/00//products/atmos/wmo if SENDDBN=NO.

All the others look good to me. Thanks!

KateFriedman-NOAA · 2023-09-07T15:55:25Z

SENDDBN=NO in the above log file. Is it set only for the CI test? There is no files copied to /lfs/h2/emc/ptmp/kate.friedman/comrot/test96/gfs.20211221/00//products/atmos/wmo if SENDDBN=NO.

@BoCui-NOAA thanks for checking and mentioning this! SENDDBN was still set to its default value of "NO" in my test. I have set it to "YES" and rerun the job on WCOSS2. Please see the output in the wmo folder now:

kate.friedman@dlogin06:/lfs/h2/emc/ptmp/kate.friedman/comrot/test96> ll gfs.20211221/00/products/atmos/wmo/
total 52936
-rw-r--r-- 1 kate.friedman emc  8273734 Sep  7 15:52 gfs_collective1.postsnd_00
-rw-r--r-- 1 kate.friedman emc 10871630 Sep  7 15:52 gfs_collective2.postsnd_00
-rw-r--r-- 1 kate.friedman emc  6099408 Sep  7 15:52 gfs_collective3.postsnd_00
-rw-r--r-- 1 kate.friedman emc  8527876 Sep  7 15:52 gfs_collective4.postsnd_00
-rw-r--r-- 1 kate.friedman emc  6410026 Sep  7 15:52 gfs_collective5.postsnd_00
-rw-r--r-- 1 kate.friedman emc  4433366 Sep  7 15:52 gfs_collective6.postsnd_00
-rw-r--r-- 1 kate.friedman emc  1637804 Sep  7 15:51 gfs_collective7.postsnd_00
-rw-r--r-- 1 kate.friedman emc  4150986 Sep  7 15:52 gfs_collective8.postsnd_00
-rw-r--r-- 1 kate.friedman emc  3783892 Sep  7 15:52 gfs_collective9.postsnd_00

Also, here is the updated log: /lfs/h2/emc/ptmp/kate.friedman/comrot/test96/logs/2021122100/gfspostsnd.log

Do you recommend that when DO_BUFRSND="YES" is set (and the job is included in the suite) that SENDDBN="YES" is also automatically set?

All the others look good to me. Thanks!

Excellent, thanks!

BoCui-NOAA · 2023-09-07T16:35:40Z

kate.friedman@dlogin06:/lfs/h2/emc/ptmp/kate.friedman/comrot/test96> ll gfs.20211221/00/products/atmos/wmo/

The files in directory wmo look good. Thanks!

Do you recommend that when DO_BUFRSND="YES" is set (and the job is included in the suite) that SENDDBN="YES" is also automatically set?

Will SENDDBN="YES" affect other parts of the whole gfs testing? If not, it is ok for me to set DO_BUFRSND="YES" and then SENDDBN="YES".

Thanks!

KateFriedman-NOAA · 2023-09-07T16:58:03Z

The files in directory wmo look good. Thanks!

Great, thanks for checking and confirming!

Will SENDDBN="YES" affect other parts of the whole gfs testing?

Good point...other jobs do use that variable. I will leave SENDDBN="NO" by default for now and reevaluate later for the dev mode setting (it will be "YES" for ops).

KateFriedman-NOAA · 2023-09-07T17:00:22Z

Test on WCOSS2 was successful. This PR is ready for final approval and merging. @WalterKolczynski-NOAA please review/approve when able, thanks!

aerorahul

looks good.

addressed comments

KateFriedman-NOAA added 2 commits September 1, 2023 13:22

Update logf filenames for postsnd job scripts

21ce966

- Add missing "atm." to logf filenames in scripts for the bufr sounding job. Refs NOAA-EMC#1832

Merge branch 'NOAA-EMC:develop' into feature/downstream_fixes

1a087ba

KateFriedman-NOAA added the bug Something isn't working label Sep 1, 2023

KateFriedman-NOAA requested a review from WalterKolczynski-NOAA September 1, 2023 13:32

KateFriedman-NOAA self-assigned this Sep 1, 2023

Set DO_BUFRSND=YES for CI test

5a4e4de

Refs NOAA-EMC#1832

KateFriedman-NOAA added CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera CI-Orion-Ready **CM use only** PR is ready for CI testing on Orion labels Sep 1, 2023

emcbot added CI-Orion-Running **Bot use only** CI testing on Orion for this PR is in-progress and removed CI-Orion-Building **Bot use only** CI testing is cloning/building on Orion labels Sep 1, 2023

emcbot added CI-Hera-Failed **Bot use only** CI testing on Hera for this PR has failed and removed CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress labels Sep 1, 2023

emcbot added the CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress label Sep 6, 2023

emcbot added CI-Orion-Passed **Bot use only** CI testing on Orion for this PR has completed successfully and removed CI-Orion-Running **Bot use only** CI testing on Orion for this PR is in-progress labels Sep 6, 2023

emcbot added CI-Hera-Passed **Bot use only** CI testing on Hera for this PR has completed successfully and removed CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress labels Sep 7, 2023

Reverting DO_BUFRSND back to NO

139a549

Setting DO_BUFRSND back to it's default value of "NO" after completing CI tests. Refs NOAA-EMC#1832

KateFriedman-NOAA requested a review from WalterKolczynski-NOAA September 7, 2023 13:44

KateFriedman-NOAA changed the title ~~Fix bufr sounding job log filename~~ Fix bufr sounding job Sep 7, 2023

aerorahul approved these changes Sep 7, 2023

View reviewed changes

aerorahul merged commit 48e9a99 into NOAA-EMC:develop Sep 7, 2023
4 checks passed

KateFriedman-NOAA deleted the feature/downstream_fixes branch September 8, 2023 12:30

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fix bufr sounding job #1834

Fix bufr sounding job #1834

KateFriedman-NOAA commented Sep 1, 2023 •

edited

Loading

emcbot commented Sep 1, 2023

emcbot commented Sep 1, 2023

emcbot commented Sep 1, 2023

emcbot commented Sep 1, 2023

emcbot commented Sep 1, 2023

KateFriedman-NOAA commented Sep 1, 2023 •

edited

Loading

emcbot commented Sep 1, 2023

emcbot commented Sep 1, 2023

KateFriedman-NOAA commented Sep 1, 2023

BoCui-NOAA commented Sep 1, 2023

emcbot commented Sep 1, 2023

emcbot commented Sep 1, 2023

emcbot commented Sep 6, 2023

emcbot commented Sep 6, 2023

emcbot commented Sep 6, 2023

emcbot commented Sep 6, 2023

emcbot commented Sep 6, 2023

emcbot commented Sep 6, 2023

emcbot commented Sep 6, 2023

emcbot commented Sep 7, 2023

emcbot commented Sep 7, 2023

emcbot commented Sep 7, 2023

KateFriedman-NOAA commented Sep 7, 2023

BoCui-NOAA commented Sep 7, 2023

KateFriedman-NOAA commented Sep 7, 2023

BoCui-NOAA commented Sep 7, 2023

KateFriedman-NOAA commented Sep 7, 2023

BoCui-NOAA commented Sep 7, 2023

KateFriedman-NOAA commented Sep 7, 2023

KateFriedman-NOAA commented Sep 7, 2023

aerorahul left a comment

Fix bufr sounding job #1834

Fix bufr sounding job #1834

Conversation

KateFriedman-NOAA commented Sep 1, 2023 • edited Loading

Description

Type of change

Change characteristics

How has this been tested?

Checklist

emcbot commented Sep 1, 2023

emcbot commented Sep 1, 2023

emcbot commented Sep 1, 2023

emcbot commented Sep 1, 2023

emcbot commented Sep 1, 2023

KateFriedman-NOAA commented Sep 1, 2023 • edited Loading

emcbot commented Sep 1, 2023

emcbot commented Sep 1, 2023

KateFriedman-NOAA commented Sep 1, 2023

BoCui-NOAA commented Sep 1, 2023

emcbot commented Sep 1, 2023

emcbot commented Sep 1, 2023

emcbot commented Sep 6, 2023

emcbot commented Sep 6, 2023

emcbot commented Sep 6, 2023

emcbot commented Sep 6, 2023

emcbot commented Sep 6, 2023

emcbot commented Sep 6, 2023

emcbot commented Sep 6, 2023

emcbot commented Sep 7, 2023

emcbot commented Sep 7, 2023

emcbot commented Sep 7, 2023

KateFriedman-NOAA commented Sep 7, 2023

BoCui-NOAA commented Sep 7, 2023

KateFriedman-NOAA commented Sep 7, 2023

BoCui-NOAA commented Sep 7, 2023

KateFriedman-NOAA commented Sep 7, 2023

BoCui-NOAA commented Sep 7, 2023

KateFriedman-NOAA commented Sep 7, 2023

KateFriedman-NOAA commented Sep 7, 2023

aerorahul left a comment

Choose a reason for hiding this comment

KateFriedman-NOAA commented Sep 1, 2023 •

edited

Loading

KateFriedman-NOAA commented Sep 1, 2023 •

edited

Loading