Stat Analysis Implementation #7
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![github-advanced-security[bot]](https://avatars.githubusercontent.com/in/57789?s=60&v=4){kind=small}
|
Most updated commits add capability to untar, gunzip, grab obs space info, and read yamls that point to obs space yamls. The paths in the yaml will need to be updated correctly I am sure, but the code executes successfully in the g-w. |
This reverts commit 4dfbbb7.
…eature/anlstat-kd-2
# Description
This is a quick hotfix for small discrepancy in the Jenkins health check
launch script that runs in cron:
`gh -> "${GH}"`
# Type of change
- [x] Bug fix (fixes something broken)
- [ ] New feature (adds functionality)
- [ ] Maintenance (code refactor, clean-up, new CI test, etc.)
# Change characteristics
<!-- Choose YES or NO from each of the following and delete the other
-->
- Is this a breaking change (a change in existing functionality)? NO
- Does this change require a documentation update? NO
- Does this change require an update to any of the following submodules?
NO
# How is this tested
Ran in cron on Hercules and Orion
Co-authored-by: tmcguinness <[email protected]>
…hat need the path (NOAA-EMC#3013) # Description This PR is setting a shell environment variable **HOME_GFS** to point to the path **HOMEgfs** for systems that need to setup the runtime environment in their respective `.bashrc` files. For example: ``` # Added for Global Workflow if [ -n "${HOME_GFS}"]; then export MODULE_GWSETUP_PATH="${HOME_GFS}/modulefiles" module use "${MODULE_GWSETUP_PATH}" module load "module_gwsetup.gaea" fi ``` # Type of change - [x] Bug fix (fixes something broken) - [ ] New feature (adds functionality) - [x] Maintenance (code refactor, clean-up, new CI test, etc.) # Change characteristics <!-- Choose YES or NO from each of the following and delete the other --> - Is this a breaking change (a change in existing functionality)? NO - Does this change require a documentation update? NO - Does this change require an update to any of the following submodules? NO # How has this been tested? This PR itself will be ran on Gaea directly when `$HOMEgfs/workflow/gw_setup.sh` script for loading the runtime modules is operable on that system. # Checklist - [ ] Any dependent changes have been merged and published - [x] My code follows the style guidelines of this project - [x] I have performed a self-review of my own code - [x] I have commented my code, particularly in hard-to-understand areas - [ ] I have documented my code, including function, input, and output descriptions - [x] My changes generate no new warnings - [ ] New and existing tests pass with my changes - [ ] This change is covered by an existing CI test or a new one has been added - [ ] I have made corresponding changes to the system documentation if necessary
NCO has requested that each COM variable specify whether it is an input or an output. This completes that process for the global jgdas enkf ecen job. Refs NOAA-EMC#2451
) # Description<!-- This description will become the commit message for the PR. --> Simple bug fix to GitHub CI pipeline script for Parallel Works. Introduced a bug on its last update for setting the repo name in advance of running the GitHub CLI command for getting the repo owner and branch name of PRs. # Type of change - [x] Bug fix (fixes something broken) - [ ] New feature (adds functionality) - [ ] Maintenance (code refactor, clean-up, new CI test, etc.) # Change characteristics <!-- Choose YES or NO from each of the following and delete the other --> - Is this a breaking change (a change in existing functionality)? NO - Does this change require a documentation update? NO - Does this change require an update to any of the following submodules? # How has this been tested? Gets tested when update to default repo gets checked in. --------- Co-authored-by: Terry McGuinness <[email protected]>
…MC#3076) This Pr removes **pslot** dir (with hash) from local archive folder on CI case completion and also adds `cleanup_experiment` function in the BASH utilities to clean up after a CI case runs. This change consolidates cleanup actions and adds functionality to clean the local archive folders. Key changes: - Fixes bug for cleaning up the `RUNDIRS` directory before new experiments are run in the case the pipeline is being ran for a second time - Updated `$HOMEgfs/ci/scripts/check_ci.sh` to use the new `cleanup_experiment` function under the BASH CI system. - Added `cleanup_experiment `function in `$HOMEgfs/ci/scripts/utils/ci_utils.sh` to handle various cleanups including: - COMROOT/EXPDIR per case - ARCDIR and ATADIR directories for archive - STMP/RUNDIRS/${PSLOT} - Added get config var from EXPDIR utility [get_config_var.py](https://github.com/NOAA-EMC/global-workflow/pull/2961/files#diff-b780733ae1d45917730364e09a6c510e79d4cc8cffad6d9020c7961c53b987bc) for getting config values in BASH Resolves NOAA-EMC#2954 Resolves NOAA-EMC#3066
) This moves all machine-specific options to the workflow/hosts files from the config.* files. This also turns HPSS archiving on for WCOSS2 by default. This turns OFF UFS DA tests on WCOSS2. Resolves NOAA-EMC#2942 Resolves NOAA-EMC#3087 --------- Co-authored-by: Walter Kolczynski - NOAA <[email protected]> Co-authored-by: Rahul Mahajan <[email protected]>
|
Scripts are updated to successfully run as expected. JCB algorithms templates will need to be added in a separate PR. Need to test over a significant time. Example of output yaml created from running gdasanlstat job: |
Adds the ability to run C96mx100 with SFS options. Included in this PR is the ability to use the interpolated/coarse grained 1 degree MOM6 ICs. Staging the ATM and OCN perturbation files without using the +03 replay ICs. --------- Co-authored-by: Eric.Sinsky <[email protected]> Co-authored-by: Walter Kolczynski - NOAA <[email protected]> Co-authored-by: Rahul Mahajan <[email protected]>
NCO has requested that each COM variable specify whether it is an input or an output. This completes that process for the global jgdas enkf post job. Refs NOAA-EMC#2451
This commit turns on the tapering of atmospheric ensemble perturbations at the model top in the EnKF to reduce the upper layer ensemble spread. Resolves NOAA-EMC#3096 --------- Co-authored-by: Rahul Mahajan <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This is my second pass at adding the appropriate files needed to run a stat analysis job in the global-workflow.