Feature/gfs.v16.3.16 wdqms2 #2465
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
External package and serial enkf forecast updates
- Update on Dogwood implemented cgroups, which means memory limits are now enforced. - Exclusive jobs must now use "place=exclhost" insted of "place=excl". - Associated exclusive ecf script PBS statements are updated to exclhost. Refs: NOAA-EMC#399
Need to set exclhost for exclusive jobs on WCOSS2 now after cgroups was implemented. Matches updates to exclusive job ecf script PBS statements. Refs: NOAA-EMC#399
Will consider removing at later date. Refs: NOAA-EMC#399
…oss2 Update "excl" to "exclhost" for exclusive jobs on WCOSS2
- Update config.efcs to run EnKF forecast job with serial netcdf instead of parallel netcdf. Based on joint decision between NCO and EMC. - Update C384 config.fv3.nco.static block to set DELTIM=200 (NCO request). - Update C384 config.fv3.nco.static block to set WRITE_GROUP=2 to speed up serial EnKF forecast jobs to fit inside needed window in ops. Refs: NOAA-EMC#399
Sync feature/ops wcoss2 into dev_v16 (excl -> exclhost updates)
- Reviewed the various global-workflow utility code builds and added "-g" and/or "-traceback" flags if missing. - Added to only WCOSS2 makefiles/modulefiles for now for ops. Refs: NOAA-EMC#399, NOAA-EMC#791
Bo Cui updated gfs_bufr.sh to improve error handling Refs: NOAA-EMC#399, NOAA-EMC#790
- remove hyper=true in jgdas_atmos_analysis_calc.ecf - add export nth_echgres=$nth_echgres_gfs when CDUMP=gfs in config.analcalc; for correct thread setting at runtime - add export nth_echgres=4 to analcalc block in config.resources - add export nth_echgres_gfs=12 to analcalc block in config.resources Refs: NOAA-EMC#399
Hand-off tag to NCO is now EMC-v16.2.0.7 Refs: NOAA-EMC#399
…oss2 Final pre-production freeze updates for GFSv16.2.0 package on WCOSS2
wcoss2 cycled ecflow script with developer assigned path
Sync merge feature/ops-wcoss2 into dev_v16
- NCO updated the default path for HOMENHC and tested it in prod on WCOSS2 during NHC test Refs: NOAA-EMC#399
- Based on testing on Dogwood after some WCOSS2 updates some memory and resource adjustments were made by NCO. - Memory updates to the gempak, awips, and fbwnd job ecf scripts. - Resource adjustments to remedy oversubscription errors in the post and postsnd jobs. Refs: NOAA-EMC#399
The gfspostsnd job was oversubscribing CPUs on WCOSS2 after updates on Dogwood. Updating resources settings to get them matching and working. Refs: NOAA-EMC#399
- Add updated memory values for awips and gempak jobs into resource configs to match similar updates in ecf scripts Refs: NOAA-EMC#399
…oss2 WCOSS2 GFSv16.2.0 resource updates and NHC change
Sync feature/ops-wcoss2 into dev_v16
Sync merge dev_v16 updates into GFSv16.3.0 release branch
To support GFS V16.3 implementation, the UPP branch release/gfs_v16 was updated with the following changes: 1) aviation product upgrade 2) add continuous bucket precipitation product for wgne Tag and update details provided by Wen Meng. Refs: NOAA-EMC#744
Hardcode COMPONENT=atmos in config.anal. Co-authored-by: Rahul Mahajan <[email protected]>
Removed unnecessary export for the COMPONENT variable in drive_makeprepbufr.sh Refs: NOAA-EMC#802
Remove unneeded export for COMPONENT in ush_getdump.sh Refs: NOAA-EMC#802
…y updated for WCOSS2 (NOAA-EMC#839)
* updated checkout tag of gsi, build script and linking of executables in prep for v16.3 * remove version numbers from GSI monitoring packages * add option to PRUNE_4NCO when NCO builds the gsi
- Some files are not generated or existing during forecast-only mode and should not be included in archival. - Update jobs/rocoto/arch.sh and ush/hpssarch_gen.sh to check for MODE when defining and running some archives.
- In hpssarch_gen.sh add an if-block to check if cycled MODE for the pgb*anl files. Refs NOAA-EMC#1177
- Replaced tabs with spaces. Refs NOAA-EMC#1177
Fix bugs in forecast-only mode (GFSv16)
GFSv16.3.5 RFC 10388 - On WCOSS2, implement GFS v16.3.5 which updates the ‘global_satinfo.txt’ and ‘global_convinfo.txt’ GSI fix files. This change is needed to allow continued use of atmospheric motion vectors from the GOES-West satellite as GOES-18 replaces GOES-17 and to include the assimilation of VIIRS (Visible Infrared Imaging Radiometer Suite) radiances from S-NPP (Suomi National Polar-orbiting Partnership) and NOAA-20.
- NCO confirmed the `ecf/versions` folder and version files within are no longer needed. - All versions come from the `versions/` folder version files. Refs NOAA-EMC#1205
NCO confirmed the `ecf/versions` folder and version files within are no longer needed. All versions come from the `versions/` folder version files. Refs NOAA-EMC#1205
RFC 10562 - On WCOSS2, implement a modified GFS global analysis to remove the use of GMI (Global Precipitation Measurement Microwave Imager) data. The developer noticed an array overflow in the processing of GMI data on Hera which may lead to a SEGFAULT for the GSI (Grid-Point Statistical Interpolation). Removing this data usage will prevent a potential operational GSI crash. Refs NOAA-EMC#1278
…MC#1358) - Update the job dependencies for the gdasgldas and gdasfcst jobs to add a dependency on the gdasanal job being complete. - Also update the gfsfcst dependency to remove unneeded conditional. Refs NOAA-EMC#1320
…MC#1407) EUMETSAT switched Meteosat-10 for Meteosat-11 as the satellite performing full-Earth scans at 0degrees longitude on March 21 2023. EMC switched on the processing of Meteosat-10 winds in the GFS system to ensure continuity of data in the DA system. Implemented during the 2023032112 gfs cycle. - New GSI tag gfsda.v16.3.7 - Release notes for v16.3.7 (docs/Release_Notes.gfs.v16.3.7.md) - Change version=v16.3.7 and gfs_ver=v16.3.7 in versions/run.ver
Resolves NCO bugzilla NOAA-EMC#1208 within the GFSv16 package.
) ARFC to add debug flag to resolve wave post runtimes * The wave post jobs were running long in production. GDIT added the `ldebug` PBS statements to the wave post ecf scripts to resolve the issue. * Updates version to v16.3.8 Refs NOAA-EMC#1843
A temporary fix to allow the satingest changes to be implemented on August 29 without causing GSI to crash. Issue with the CRTM means that GSI will crash unless NOAA-21 radiances are switched off. Additional updates: * Mention gfs_bufr -check all bugzilla fix in release notes. Resolves NCO bugzilla NOAA-EMC#1208. * Fix tropcy build (NOAA-EMC#1815) Refs NOAA-EMC#1813
New CO2 fix files for 2024. Refs NOAA-EMC#1924
…OAA-EMC#2117) Enable the monitoring of NOAA-21 and GOES-18 radiances in the GFS GSI. Refs NOAA-EMC#1356
…EMC#2167) The fix files ‘global_satinfo.tx’t and ‘global_convinfo.txt’ are updated to begin actively assimilating NOAA-21 radiances into the GFS. Refs NOAA-EMC#2096
RFC 12134 - On WCOSS2, upgrade the GFS to v16.3.13. With this update, NCEP, in coordination with UKMO (UK Met Office), is updating the GFS to produce high resolution WAFS output and stop producing blended 1.25 deg WAFS files in order to meet a 2023 ICAO (International Civil Aviation Organization) milestone. Implemented on January 24 during 12z cycle. Refs NOAA-EMC#2013
* Add shared to place settings in ecf scripts. Jobs that are not exclusive on WCOSS2 now need to set shared when job is shared. * Update DMPDIR path on WCOSS2 to use new location: /lfs/h2/emc/dump/noscrub/dump Refs NOAA-EMC#2135
- Create skeleton release notes for WDQMS update in ops. - Update system version to tentative v16.3.14. Confirm later. Refs NOAA-EMC#2389
Add new scripts, configs, resource settings, and workflow manager configuration for the new WDQMS job. Refs NOAA-EMC#2389
…#2436) Remove the temporary `ldebug=true` setting in the ecf scripts for the wave post jobs in operations (GFSv16.3). Refs NOAA-EMC#2431
New operational version is v16.3.15 Refs NOAA-EMC#2389
…6.3.15 Refs NOAA-EMC#2389 * origin/dev/gfs.v16: GFSv16.3.14 - Remove ldebug flag from wave post ecf scripts (NOAA-EMC#2436)
Will include shared place setting in future GFS upgrade. Refs NOAA-EMC#2389
* Fix a typo in the `ecf` script identified by NCO/SPA. * Add a block for `SENDDBN` for the files that need to be alerted. A `TODO` remains for NCO SPA and Dataflow teams to identify the `SUB_TYPE` appropriate for this file. This is an action item for NCO. Refs NOAA-EMC#2389
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Type of change
Change characteristics
How has this been tested?
Checklist