Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Retire vrfy job #2080

Merged
merged 7 commits into from
Nov 18, 2023
Merged

Retire vrfy job #2080

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
748083d
Remove vrfy job script and config
KateFriedman-NOAA Nov 17, 2023
2f7dc3c
Remove reference to vrfy job in RTD
KateFriedman-NOAA Nov 17, 2023
53835c4
Remove reference to vrfy job in env files
KateFriedman-NOAA Nov 17, 2023
eff9011
Remove vrfy job from configs
KateFriedman-NOAA Nov 17, 2023
3a7c355
Remove vrfy from log list in hpssarch_gen.sh
KateFriedman-NOAA Nov 17, 2023
51b19f0
Remove vrfy job from rocoto workflow setup
KateFriedman-NOAA Nov 17, 2023
d329693
Merge branch 'NOAA-EMC:develop' into feature/retire_vrfy
KateFriedman-NOAA Nov 17, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
99 changes: 55 additions & 44 deletions docs/source/configure.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,47 +4,58 @@ Configure Run

The global-workflow configs contain switches that change how the system runs. Many defaults are set initially. Users wishing to run with different settings should adjust their $EXPDIR configs and then rerun the ``setup_xml.py`` script since some configuration settings/switches change the workflow/xml ("Adjusts XML" column value is "YES").

+----------------+------------------------------+---------------+-------------+---------------------------------------------------+
| Switch | What | Default | Adjusts XML | More Details |
+================+==============================+===============+=============+===================================================+
| APP | Model application | ATM | YES | See case block in config.base for options |
+----------------+------------------------------+---------------+-------------+---------------------------------------------------+
| DOIAU | Enable 4DIAU for control | YES | NO | Turned off for cold-start first half cycle |
| | with 3 increments | | | |
+----------------+------------------------------+---------------+-------------+---------------------------------------------------+
| DOHYBVAR | Run EnKF | YES | YES | Don't recommend turning off |
+----------------+------------------------------+---------------+-------------+---------------------------------------------------+
| DONST | Run NSST | YES | NO | If YES, turns on NSST in anal/fcst steps, and |
| | | | | turn off rtgsst |
+----------------+------------------------------+---------------+-------------+---------------------------------------------------+
| DO_AWIPS | Run jobs to produce AWIPS | NO | YES | downstream processing, ops only |
| | products | | | |
+----------------+------------------------------+---------------+-------------+---------------------------------------------------+
| DO_BUFRSND | Run job to produce BUFR | NO | YES | downstream processing |
| | sounding products | | | |
+----------------+------------------------------+---------------+-------------+---------------------------------------------------+
| DO_GEMPAK | Run job to produce GEMPAK | NO | YES | downstream processing, ops only |
| | products | | | |
+----------------+------------------------------+---------------+-------------+---------------------------------------------------+
| DO_VRFY | Run vrfy job | NO | YES | Whether to include vrfy job (GSI monitoring, |
| | | | | tracker, VSDB, fit2obs) |
+----------------+------------------------------+---------------+-------------+---------------------------------------------------+
| DO_METP | Run METplus jobs | YES | YES | One cycle spinup |
+----------------+------------------------------+---------------+-------------+---------------------------------------------------+
| EXP_WARM_START | Is experiment starting warm | .false. | NO | Impacts IAU settings for initial cycle. Can also |
| | (.true.) or cold (.false)? | | | be set when running ``setup_expt.py`` script with |
| | | | | the ``--start`` flag (e.g. ``--start warm``) |
+----------------+------------------------------+---------------+-------------+---------------------------------------------------+
| HPSSARCH | Archive to HPPS | NO | Possibly | Whether to save output to tarballs on HPPS |
+----------------+------------------------------+---------------+-------------+---------------------------------------------------+
| LOCALARCH | Archive to a local directory | NO | Possibly | Instead of archiving data to HPSS, archive to a |
| | | | | local directory, specified by ATARDIR. If |
| | | | | LOCALARCH=YES, then HPSSARCH must =NO. Changing |
| | | | | HPSSARCH from YES to NO will adjust the XML. |
+----------------+------------------------------+---------------+-------------+---------------------------------------------------+
| QUILTING | Use I/O quilting | .true. | NO | If .true. choose OUTPUT_GRID as cubed_sphere_grid |
| | | | | in netcdf or gaussian_grid |
+----------------+------------------------------+---------------+-------------+---------------------------------------------------+
| WRITE_DOPOST | Run inline post | .true. | NO | If .true. produces master post output in forecast |
| | | | | job |
+----------------+------------------------------+---------------+-------------+---------------------------------------------------+
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| Switch | What | Default | Adjusts XML | More Details |
+================+==================================+===============+=============+===================================================+
| APP | Model application | ATM | YES | See case block in config.base for options |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| DOIAU | Enable 4DIAU for control | YES | NO | Turned off for cold-start first half cycle |
| | with 3 increments | | | |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| DOHYBVAR | Run EnKF | YES | YES | Don't recommend turning off |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| DONST | Run NSST | YES | NO | If YES, turns on NSST in anal/fcst steps, and |
| | | | | turn off rtgsst |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| DO_AWIPS | Run jobs to produce AWIPS | NO | YES | downstream processing, ops only |
| | products | | | |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| DO_BUFRSND | Run job to produce BUFR | NO | YES | downstream processing |
| | sounding products | | | |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| DO_GEMPAK | Run job to produce GEMPAK | NO | YES | downstream processing, ops only |
| | products | | | |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| DO_FIT2OBS | Run FIT2OBS job | YES | YES | Whether to run the FIT2OBS job |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| DO_TRACKER | Run tracker job | YES | YES | Whether to run the tracker job |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| DO_GENESIS | Run genesis job | YES | YES | Whether to run the genesis job |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| DO_GENESIS_FSU | Run FSU genesis job | YES | YES | Whether to run the FSU genesis job |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| DO_VERFOZN | Run GSI monitor ozone job | YES | YES | Whether to run the GSI monitor ozone job |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| DO_VERFRAD | Run GSI monitor radiance job | YES | YES | Whether to run the GSI monitor radiance job |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| DO_VMINMON | Run GSI monitor minimization job | YES | YES | Whether to run the GSI monitor minimization job |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| DO_METP | Run METplus jobs | YES | YES | One cycle spinup |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| EXP_WARM_START | Is experiment starting warm | .false. | NO | Impacts IAU settings for initial cycle. Can also |
| | (.true.) or cold (.false)? | | | be set when running ``setup_expt.py`` script with |
| | | | | the ``--start`` flag (e.g. ``--start warm``) |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| HPSSARCH | Archive to HPPS | NO | Possibly | Whether to save output to tarballs on HPPS |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| LOCALARCH | Archive to a local directory | NO | Possibly | Instead of archiving data to HPSS, archive to a |
| | | | | local directory, specified by ATARDIR. If |
| | | | | LOCALARCH=YES, then HPSSARCH must =NO. Changing |
| | | | | HPSSARCH from YES to NO will adjust the XML. |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| QUILTING | Use I/O quilting | .true. | NO | If .true. choose OUTPUT_GRID as cubed_sphere_grid |
| | | | | in netcdf or gaussian_grid |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
| WRITE_DOPOST | Run inline post | .true. | NO | If .true. produces master post output in forecast |
| | | | | job |
+----------------+----------------------------------+---------------+-------------+---------------------------------------------------+
6 changes: 2 additions & 4 deletions docs/source/jobs.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,10 +18,10 @@ An experimental run is different from operations in the following ways:

* Addition steps in experimental mode:

- verification (vrfy)

- archive (arch)

- cleanup (cleanup)

Downstream jobs (e.g. awips, gempak, etc.) are not included in the diagram. Those jobs are not normally run in developmental tests.

=============================
Expand Down Expand Up @@ -71,8 +71,6 @@ Jobs in the GFS Configuration
+-------------------+-----------------------------------------------------------------------------------------------------------------------+
| postN | Runs the post processor. |
+-------------------+-----------------------------------------------------------------------------------------------------------------------+
| vrfy | Runs the verification tasks. |
+-------------------+-----------------------------------------------------------------------------------------------------------------------+
| waveinit | Runs wave initialization step. |
+-------------------+-----------------------------------------------------------------------------------------------------------------------+
| waveprep | Runs wave prep step. |
Expand Down
2 changes: 1 addition & 1 deletion env/AWSPW.env
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ if [[ $# -ne 1 ]]; then
echo "Must specify an input argument to set runtime environment variables!"
echo "argument can be any one of the following:"
echo "atmanlrun atmensanlrun aeroanlrun landanlrun"
echo "anal sfcanl fcst post vrfy metp"
echo "anal sfcanl fcst post metp"
echo "eobs eupd ecen efcs epos"
echo "postsnd awips gempak"
exit 1
Expand Down
2 changes: 1 addition & 1 deletion env/CONTAINER.env
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ if [[ $# -ne 1 ]]; then
echo "Must specify an input argument to set runtime environment variables!"
echo "argument can be any one of the following:"
echo "atmanlrun atmensanlrun aeroanlrun landanl"
echo "anal sfcanl fcst post vrfy metp"
echo "anal sfcanl fcst post metp"
echo "eobs eupd ecen efcs epos"
echo "postsnd awips gempak"
exit 1
Expand Down
2 changes: 1 addition & 1 deletion env/HERA.env
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ if [[ $# -ne 1 ]]; then
echo "Must specify an input argument to set runtime environment variables!"
echo "argument can be any one of the following:"
echo "atmanlrun atmensanlrun aeroanlrun landanl"
echo "anal sfcanl fcst post vrfy metp"
echo "anal sfcanl fcst post metp"
echo "eobs eupd ecen efcs epos"
echo "postsnd awips gempak"
exit 1
Expand Down
2 changes: 1 addition & 1 deletion env/JET.env
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ if [[ $# -ne 1 ]]; then
echo "Must specify an input argument to set runtime environment variables!"
echo "argument can be any one of the following:"
echo "atmanlrun atmensanlrun aeroanlrun landanl"
echo "anal sfcanl fcst post vrfy metp"
echo "anal sfcanl fcst post metp"
echo "eobs eupd ecen efcs epos"
echo "postsnd awips gempak"
exit 1
Expand Down
2 changes: 1 addition & 1 deletion env/ORION.env
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ if [[ $# -ne 1 ]]; then
echo "Must specify an input argument to set runtime environment variables!"
echo "argument can be any one of the following:"
echo "atmanlrun atmensanlrun aeroanlrun landanl"
echo "anal sfcanl fcst post vrfy metp"
echo "anal sfcanl fcst post metp"
echo "eobs eupd ecen efcs epos"
echo "postsnd awips gempak"
exit 1
Expand Down
2 changes: 1 addition & 1 deletion env/S4.env
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ if [[ $# -ne 1 ]]; then
echo "Must specify an input argument to set runtime environment variables!"
echo "argument can be any one of the following:"
echo "atmanlrun atmensanlrun aeroanlrun landanl"
echo "anal sfcanl fcst post vrfy metp"
echo "anal sfcanl fcst post metp"
echo "eobs eupd ecen efcs epos"
echo "postsnd awips gempak"
exit 1
Expand Down
2 changes: 1 addition & 1 deletion env/WCOSS2.env
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ if [[ $# -ne 1 ]]; then
echo "Must specify an input argument to set runtime environment variables!"
echo "argument can be any one of the following:"
echo "atmanlrun atmensanlrun aeroanlrun landanl"
echo "anal sfcanl fcst post vrfy metp"
echo "anal sfcanl fcst post metp"
echo "eobs eupd ecen esfc efcs epos"
echo "postsnd awips gempak"
exit 1
Expand Down
61 changes: 0 additions & 61 deletions jobs/rocoto/vrfy.sh
View file
Open in desktop

This file was deleted.

Loading