Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Assign machine- and RUN-specific resources #2672

Merged
merged 59 commits into from
Jun 25, 2024
Merged
Show file tree
Hide file tree
Changes from 11 commits
Commits
Show all changes
59 commits
Select commit Hold shift + click to select a range
8f0185a
Add run-specific resource variables
DavidHuber-NOAA Jun 10, 2024
420edf8
Add machine-specific resource files
DavidHuber-NOAA Jun 10, 2024
8376ee6
Force npe_node_eobs to be set properly #2092
DavidHuber-NOAA Jun 10, 2024
aacecb0
Use run-specific variables
DavidHuber-NOAA Jun 10, 2024
cf0e397
Fix tabbing
DavidHuber-NOAA Jun 10, 2024
463c931
Make nth_anal independent of run
DavidHuber-NOAA Jun 10, 2024
a9ebe3b
Fix gdas FHMAX/OUT variable
DavidHuber-NOAA Jun 10, 2024
e5084f9
Correct enkf task variable name
DavidHuber-NOAA Jun 10, 2024
6bed0d1
Fixed shellcheck issues
DavidHuber-NOAA Jun 10, 2024
b716671
Fix more shellcheck issues
DavidHuber-NOAA Jun 10, 2024
e2e2421
Remove unused case
DavidHuber-NOAA Jun 10, 2024
7fd5f0e
Make additional fcst, efcs, anal variables RUN-specific
DavidHuber-NOAA Jun 11, 2024
ffec316
Strip enkf from RUN when reading config.anal
DavidHuber-NOAA Jun 11, 2024
b80814b
Add double quotes
DavidHuber-NOAA Jun 11, 2024
63b97dc
Fix fcst/efcs RUNs in variable declarations
DavidHuber-NOAA Jun 11, 2024
552ddda
Fix C768 analysis case in config.resources
DavidHuber-NOAA Jun 11, 2024
27cdab4
Corrected machine-specific resource config names
DavidHuber-NOAA Jun 12, 2024
12b880b
Add memory requirement for WCOSS2 prep job
DavidHuber-NOAA Jun 12, 2024
41134d5
Adjust epos and analcalc high res time limits/memory upward
DavidHuber-NOAA Jun 12, 2024
7271bfe
Increase memory for UPP @C384 on WCOSS2.
DavidHuber-NOAA Jun 13, 2024
4e28b2c
Make wtime for waveprep RUN-agnostic
DavidHuber-NOAA Jun 13, 2024
9166934
Declare runtime job resource variables based on RUN
DavidHuber-NOAA Jun 13, 2024
10a75b9
Clean up env files
DavidHuber-NOAA Jun 13, 2024
d9e2f32
Add {} around EXPDIR
DavidHuber-NOAA Jun 13, 2024
824c16f
Add double quotes to nth_
DavidHuber-NOAA Jun 13, 2024
b21f736
Fix resource tests
DavidHuber-NOAA Jun 13, 2024
e14a0e1
Merge remote-tracking branch 'emc/develop' into feature/machine_res
Jun 13, 2024
24946a6
Use -n instead of ! -z
DavidHuber-NOAA Jun 13, 2024
803add5
Declare one variable per line
DavidHuber-NOAA Jun 14, 2024
dae27f0
Use the environment bash for new config files
DavidHuber-NOAA Jun 14, 2024
3204824
Declare one variable per line; unset dynamic variables
DavidHuber-NOAA Jun 14, 2024
7c4e095
Add comment on sourcing machine resources file
DavidHuber-NOAA Jun 14, 2024
a80e008
Merge remote-tracking branch 'emc/develop' into feature/machine_res
DavidHuber-NOAA Jun 14, 2024
93248b3
Merge remote-tracking branch 'emc/develop' into feature/machine_res
DavidHuber-NOAA Jun 17, 2024
0286dd0
Rename mem/node variable, move to config.resources.
DavidHuber-NOAA Jun 17, 2024
238ae98
Ignore unused shellcheck warnings
DavidHuber-NOAA Jun 17, 2024
e5680e8
Apply suggestions from Walter's code review
DavidHuber-NOAA Jun 18, 2024
c499a96
Merge branch 'feature/machine_res' of github.com:DavidHuber-NOAA/glob…
DavidHuber-NOAA Jun 18, 2024
ac0778d
Increase memory requirement on S4 for ediag
DavidHuber-NOAA Jun 18, 2024
c5659e3
Adjusted available memory on kjet to what is accepted by the job sche…
InnocentSouopgui-NOAA Jun 19, 2024
0562ef0
Merge branch 'feature/machine_res' of github.com:DavidHuber-NOAA/glob…
DavidHuber-NOAA Jun 20, 2024
03496d5
Merge remote-tracking branch 'emc/develop' into feature/machine_res
DavidHuber-NOAA Jun 20, 2024
71704d3
Merge branch 'feature/machine_res' of github.com:InnocentSouopgui-NOA…
InnocentSouopgui-NOAA Jun 20, 2024
1caf612
Prevent OpenMP over-allocation of resources on S4
InnocentSouopgui-NOAA Jun 20, 2024
7cc2753
Add array length check for older bash versions.
DavidHuber-NOAA Jun 20, 2024
895d018
Recalculate analysis npe_node when redefining threads for machines
DavidHuber-NOAA Jun 20, 2024
b901c47
Correct rocoto version in hercules setup module.
DavidHuber-NOAA Jun 20, 2024
fdd0850
Only run analyses @ 8 threads at C768 on WCOSS2.
DavidHuber-NOAA Jun 20, 2024
7ba6006
Merge branch 'feature/machine_res' of https://github.com/DavidHuber-N…
InnocentSouopgui-NOAA Jun 20, 2024
859da0a
fix typo preventing a S4 to check array size
InnocentSouopgui-NOAA Jun 21, 2024
f34bdd6
High res wallclock/memory adjustments
DavidHuber-NOAA Jun 21, 2024
4b21dbc
Correct max mem requestable on WCOSS2
DavidHuber-NOAA Jun 21, 2024
88e7f50
Merge branch 'feature/machine_res' of https://github.com/DavidHuber-N…
InnocentSouopgui-NOAA Jun 21, 2024
11556d0
Merge pull request #13 from InnocentSouopgui-NOAA/feature/machine_res
DavidHuber-NOAA Jun 21, 2024
68063b0
Merge remote-tracking branch 'emc/develop' into feature/machine_res
DavidHuber-NOAA Jun 21, 2024
cb03a52
Merge branch 'feature/machine_res' of github.com:DavidHuber-noaa/glob…
DavidHuber-NOAA Jun 21, 2024
184d235
Fix atmensanlfv3inc resource declarations
DavidHuber-NOAA Jun 23, 2024
9917143
Remove reference to non-existent RUN-specific gempak variables
DavidHuber-NOAA Jun 24, 2024
fe85950
Merge branch 'develop' into feature/machine_res
DavidHuber-NOAA Jun 24, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions parm/config/gfs/config.anal
Original file line number Diff line number Diff line change
Expand Up @@ -19,11 +19,12 @@ if [[ "${CDUMP}" = "gfs" ]] ; then
export DIAG_TARBALL="YES"
fi

export npe_gsi=${npe_anal}

if [[ "${CDUMP}" == "gfs" ]] ; then
export npe_gsi=${npe_anal_gfs}
export nth_anal=${nth_anal_gfs}
elif [[ "${CDUMP}" == "gdas" ]]; then
export npe_gsi=${npe_anal_gdas}
export nth_anal=${nth_anal_gdas}
fi
WalterKolczynski-NOAA marked this conversation as resolved.
Show resolved Hide resolved

# Set parameters specific to L127
Expand Down
Loading
Loading