Missing mpmd.out for NOAA AWS CSP
#2003
Conversation
| mv mpmd.out "mpmd_${nset}.out" | ||
| # We are in a loop over downset, save output from mpmd into nset | ||
| # specific output; this if-block is necessary for the NOAA CSP AWS | ||
| # platform; AWS uses `mpiexec` (PBS) as it's parallel executable |
There was a problem hiding this comment.
WCOSS2 also uses PBS and is handled in the elif [[ "${launcher:-}" =~ ^mpiexec.* ]]; then # mpiexec block.
As seen, the output of each thread is piped to mpmd.${nm}.out
How is AWS executing MPMD and where does its output go?
The options above in AWSPW.env (mpmd_opt="--multi-prog --output=mpmd.%j.%t.out") appear to be SLURM options.
| @@ -16,7 +16,7 @@ step=$1 | |||
|
|
|||
| export npe_node_max=36 | |||
| export launcher="mpiexec.hydra" | |||
| export mpmd_opt="" | |||
| export mpmd_opt="--multi-prog --output=mpmd.%j.%t.out" | |||
There was a problem hiding this comment.
Are these the right options for mpiexec.hydra? They appear to be slurm options
There was a problem hiding this comment.
@rajdpanda Can you please address @aerorahul's questions?
There was a problem hiding this comment.
that's correct! they are options for srun but not for mpiexec.hydra. Forgot to mention this to Henry. It can be taken out
There was a problem hiding this comment.
@rajdpanda So, the only change required is to ush/fv3gfs_downstream_nems.sh?
Description
This PR addresses issue #2002. The
env/AWSPW.envfile has been updated with to now include the appropriatempmd.outdirectives. Further, theush/fv3gfs_downstream_nems.shhas been updated to allow PBS support. The PBS implementation may be considered a workaround for now and can be extended/modified if deemed necessary in the future.Resolves #2002
Type of change
Change characteristics
How has this been tested?
This was tested on NOAA CSP AWS. The CI will test for the RDHPCS platforms.
Checklist