Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge ctsm5.1.dev169 into hillslope_hydrology #10

Closed
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
103 commits
Select commit Hold shift + click to select a range
a431310
initial commit
Aug 29, 2023
460fa67
add new function to public list
Aug 29, 2023
cf7a003
View factor fix
olyson Oct 10, 2023
1b3d377
Add comments
olyson Oct 10, 2023
6e15b4c
Automatically assign high priority items to project 25.
samsrabin Oct 19, 2023
804c281
Correct label.
samsrabin Oct 19, 2023
f9f38b6
initial refactoring from refactoring branch
TeaganKing Jan 10, 2024
4a8c499
a few more refactoring updates, formatting & testing
TeaganKing Jan 10, 2024
d3bffbe
included new tests for NeonSite class
TeaganKing Jan 11, 2024
88372f2
black/pylint
TeaganKing Jan 11, 2024
1c12818
mostly testing updates
TeaganKing Jan 12, 2024
2d2df94
rename arg_parse
TeaganKing Jan 16, 2024
a59c6e1
black arg_parse unit test
TeaganKing Jan 16, 2024
109e41c
Merge remote-tracking branch 'olyson/urbanBEMvf' into merge_tag_meier…
slevis-lmwg Jan 17, 2024
a5e8382
Answer-changing merge tag: turn Meier2022 on and bring in #2212
slevis-lmwg Jan 17, 2024
96466e8
Making Meier2022 the default for ctsm5.1
slevis-lmwg Jan 18, 2024
1ca0860
Add subr. setup_logic_roughness_methods to CLMBuildNamelist.pm
slevis-lmwg Jan 18, 2024
b3a05fa
Add clm51 namelist defaults for crop_residue_removal_frac and tillage…
slevis-lmwg Jan 18, 2024
7b14631
Add new expected failures to ExpectedTestFails.xml
slevis-lmwg Jan 19, 2024
ed88506
run_sys_tests: Check Python environment for FatesColdTwoStream tests.
samsrabin Jan 19, 2024
4f65f39
run_sys_tests: Check exact name of testmods.
samsrabin Jan 19, 2024
33be9f6
run_sys_tests: Handle tests without testmods.
samsrabin Jan 19, 2024
c5966a4
run_sys_tests: Changes to satisfy pylint.
samsrabin Jan 19, 2024
0dcd0a3
run_sys_tests: Reformatting with black.
samsrabin Jan 19, 2024
41e7db5
Added previous commit to .git-blame-ignore-revs.
samsrabin Jan 19, 2024
0244d13
Making sure tillage stays off when use_crop = .false.
slevis-lmwg Jan 19, 2024
9a54faf
Updated ChangeLog/ChangeSum
slevis-lmwg Jan 20, 2024
ff7c19d
Merge pull request #2323 from slevis-lmwg/merge_tag_meier_and_pr2212
slevis-lmwg Jan 20, 2024
975e628
Fix typo in comment.
samsrabin Jan 22, 2024
473a581
run_sys_tests: Functionize _get_testmod_list().
samsrabin Jan 22, 2024
039a243
Add 'unique' option to _get_testmod_list(), default True.
samsrabin Jan 22, 2024
a7dbc37
_get_testmod_list(): Only include strings with 'clm-'.
samsrabin Jan 22, 2024
8d7d88a
Add unit tests for _get_testmod_list().
samsrabin Jan 22, 2024
4ae9106
Add Izumi version of the aux_clm unit testing.
samsrabin Jan 22, 2024
8189178
Merge remote-tracking branch 'TeaganKing/new_refactoring' into bfb_me…
slevis-lmwg Jan 23, 2024
d327ec5
Merge remote-tracking branch 'adrifoster/interpMonthlyVeg_helper_func…
slevis-lmwg Jan 23, 2024
2d7beef
Merge remote-tracking branch 'samsrabin/check-pyenv-FatesColdTwoStrea…
slevis-lmwg Jan 23, 2024
2dfd59e
Merge remote-tracking branch 'samsrabin/funit-test-izumi' into bfb_me…
slevis-lmwg Jan 23, 2024
5fa6ecb
Merge remote-tracking branch 'escomp/auto-high-priority' into bfb_mer…
slevis-lmwg Jan 23, 2024
0295098
First drafts of ChangeLog/ChangeSum
slevis-lmwg Jan 24, 2024
8b262bd
Revert "Merge remote-tracking branch 'adrifoster/interpMonthlyVeg_hel…
slevis-lmwg Jan 24, 2024
6a27557
Updated ChangeLog/ChangeSum
slevis-lmwg Jan 25, 2024
a73a170
Merge pull request #2334 from slevis-lmwg/bfb_merge_tag_2315_et_al
slevis-lmwg Jan 25, 2024
ee7e6f6
Do not exit 'make all' if pylint fails.
samsrabin Jan 29, 2024
25f7d21
Fix pylint for ctsm_pylib_dependent_utils.py (except missing-module-d…
samsrabin Jan 29, 2024
7140337
Fix pylint for process_ggcmi_sdates.py.
samsrabin Jan 30, 2024
8347afc
Satisfy pylint for generate_gdds_functions.py.
samsrabin Jan 30, 2024
9c9b23f
Satisfy pylint for generate_gdds.py.
samsrabin Jan 30, 2024
73da27a
Remove unused function from cropcal_utils.py.
samsrabin Jan 31, 2024
ddd5e51
Rename a variable in generate_gdds.py.
samsrabin Jan 31, 2024
3b4ae70
Satisfy pylint for cropcal_module.py.
samsrabin Jan 31, 2024
4380ff7
Satisfy pylint for check_rxboth_run.py.
samsrabin Jan 31, 2024
8397f3c
Fix call of import_output() in check_rxboth_run.py.
samsrabin Jan 31, 2024
99bd601
Remove backticks from assign-to-project.yml
samsrabin Jan 31, 2024
4be7930
Satisfy pylint for test_sys_regrid_ggcmi_shdates.py.
samsrabin Jan 31, 2024
2a533ef
Satisfy pylint for test_unit_modify_singlept_site_neon.py.
samsrabin Jan 31, 2024
3cbe719
Satisfy pylint for test_unit_run_sys_tests.py.
samsrabin Jan 31, 2024
dbbe8c5
Satisfy pylint for test_unit_utils_import_coord.py.
samsrabin Jan 31, 2024
829da76
Remove a colon from assign-to-project.yml
samsrabin Feb 1, 2024
e611238
Merge pull request #2342 from ESCOMP/fix-auto-assign
samsrabin Feb 1, 2024
f87abd0
Satisfy pylint for modify_singlept_site_neon.py.
samsrabin Feb 1, 2024
1949f5c
Update parameter files to 240207 (delete _FillValue and history).
samsrabin Feb 7, 2024
9511108
Revert accidental changes re: ctsm_pylib
samsrabin Feb 7, 2024
dca964c
Update ChangeLog and ChangeSum.
samsrabin Feb 8, 2024
e4aa2bd
python/Makefile: Do not fail even if pylint isn't clean.
samsrabin Feb 8, 2024
8e3b3ba
python/Makefile: Call black before pylint in 'make all'.
samsrabin Feb 8, 2024
18e03ea
Satisfy pylint for ctsm_pylib_dependent_utils.py.
samsrabin Feb 8, 2024
4d7493a
Use c240207b parameter files.
samsrabin Feb 8, 2024
c030c23
Merge pull request #2350 from samsrabin/fix-paramfile-format
samsrabin Feb 8, 2024
c55dac6
Resolve pylint warnings about cropcal_module.py.
samsrabin Feb 8, 2024
34b3320
pylint: Allow variable names ax and im (common in matplotlib instruct…
samsrabin Feb 8, 2024
be18e3e
Satisfy pylint for cropcal_figs_module.py.
samsrabin Feb 8, 2024
5b3cad7
pylint: Resolve remaining wrong-import-position complaints.
samsrabin Feb 8, 2024
89c3dad
Post-pylint fixes to get RXCROPMATURITY working again.
samsrabin Feb 9, 2024
3e8b835
pylint: Resolve remaining invalid-name complaints.
samsrabin Feb 9, 2024
5fc5bf2
pylint: Resolve no-else-return and no-else-raise.
samsrabin Feb 9, 2024
cbff7d9
pylint: Resolve singleton-comparison.
samsrabin Feb 9, 2024
08ce929
pylint: Resolve bare-except.
samsrabin Feb 9, 2024
58b75f1
pylint: Resolve unused-import.
samsrabin Feb 9, 2024
3dae192
pylint: Add docstrings.
samsrabin Feb 9, 2024
538ab01
Move xr_flexsel to its own module; functionize bits of it.
samsrabin Feb 9, 2024
f7ad444
Resolve pylint for regrid_ggcmi_shdates.py.
samsrabin Feb 11, 2024
35df413
Move grid_one_variable() to its own module; functionize parts.
samsrabin Feb 11, 2024
81ac26e
Resolve most issues with import_ds().
samsrabin Feb 11, 2024
c2899bd
Move import_ds() to its own module.
samsrabin Feb 11, 2024
605bb3b
Satisfy pylint for cropcal_utils.py.
samsrabin Feb 11, 2024
3808b4b
Ignore raise-missing-from in xr_flexsel.py.
samsrabin Feb 11, 2024
a90049d
Remove unneeded '_CTSM_PYTHON =' bits.
samsrabin Feb 11, 2024
657cc5c
Fix imports in check_rxboth_run.py.
samsrabin Feb 11, 2024
e4b66a7
Merge pull request #2353 from samsrabin/make-all-linting-order
samsrabin Feb 13, 2024
e6873e3
Merge pull request #2354 from samsrabin/fix-pylint-2316
samsrabin Feb 13, 2024
b671ed7
FSURDATMODIFYCTSM test (aux_clm/clm_pymods) moved from cheyenne_intel…
samsrabin Feb 13, 2024
1200056
Merge pull request #2364 from samsrabin/fsurdatmodifyctsm-test-derecho
samsrabin Feb 14, 2024
efc4308
Merge tag 'ctsm5.1.dev167' into hillslope_hydrology-167
samsrabin Feb 15, 2024
7401dd9
Resolve issue #2366 and PR #2355
slevis-lmwg Feb 15, 2024
1c9ef97
Revert changes from #2355 due to error in FATES
slevis-lmwg Feb 15, 2024
06290f8
Hillslope tests now use v1.3 surface dataset.
samsrabin Feb 16, 2024
3ba613d
Updated ChangeLog/ChangeSum
slevis-lmwg Feb 16, 2024
e3e2e80
Merge pull request #2371 from slevis-lmwg/merge_tag_20240215
slevis-lmwg Feb 16, 2024
bf8a6bb
Merge tag 'ctsm5.1.dev168' into merge-b4bdev-20240222
samsrabin Feb 22, 2024
9b43482
Update ChangeLog and ChangeSum.
samsrabin Feb 22, 2024
4ba1501
Merge pull request #2382 from samsrabin/merge-b4bdev-20240222
samsrabin Feb 22, 2024
c2c3bf5
Merge tag 'ctsm5.1.dev169' into hillslope_hydrology-169
samsrabin Feb 25, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .git-blame-ignore-revs
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,7 @@ e4d38681df23ccca0ae29581a45f8362574e0630
025d5e7c2e80263717fb029101d65cbbf261c3c4
a9d96219902cf609636886c7073a84407f450d9a
d866510188d26d51bcd6d37239283db690af7e82
0dcd0a3c1abcaffe5529f8d79a6bc34734b195c7
# Ran SystemTests and python/ctsm through black python formatter
5364ad66eaceb55dde2d3d598fe4ce37ac83a93c
8056ae649c1b37f5e10aaaac79005d6e3a8b2380
Expand Down
23 changes: 23 additions & 0 deletions .github/workflows/assign-to-project.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
name: Auto Assign to Project(s)

on:
issues:
types: [opened, labeled]
pull_request:
types: [opened, labeled]
issue_comment:
types: [created]

jobs:
assign_high_priority:
runs-on: ubuntu-latest
name: Assign to High Priority project
steps:
- name: Assign issues and pull requests with priority-high label to project 25
uses: srggrs/[email protected]
if: |
contains(github.event.issue.labels.*.name, 'priority: high') ||
contains(github.event.pull_request.labels.*.name, 'priority: high')
with:
project: 'https://github.com/ESCOMP/CTSM/projects/25'
column_name: 'Needs triage'
30 changes: 27 additions & 3 deletions bld/CLMBuildNamelist.pm
Original file line number Diff line number Diff line change
Expand Up @@ -1571,6 +1571,7 @@ sub process_namelist_inline_logic {
setup_logic_irrigate($opts, $nl_flags, $definition, $defaults, $nl);
setup_logic_start_type($opts, $nl_flags, $nl);
setup_logic_decomp_performance($opts, $nl_flags, $definition, $defaults, $nl);
setup_logic_roughness_methods($opts, $nl_flags, $definition, $defaults, $nl, $physv);
setup_logic_snicar_methods($opts, $nl_flags, $definition, $defaults, $nl);
setup_logic_snow($opts, $nl_flags, $definition, $defaults, $nl);
setup_logic_glacier($opts, $nl_flags, $definition, $defaults, $nl, $envxml_ref);
Expand Down Expand Up @@ -1637,7 +1638,7 @@ sub process_namelist_inline_logic {
###############################
# namelist group: tillage #
###############################
setup_logic_tillage($opts, $nl_flags, $definition, $defaults, $nl);
setup_logic_tillage($opts, $nl_flags, $definition, $defaults, $nl, $physv);

###############################
# namelist group: ch4par_in #
Expand Down Expand Up @@ -2003,6 +2004,25 @@ sub setup_logic_decomp_performance {

#-------------------------------------------------------------------------------

sub setup_logic_roughness_methods {
my ($opts, $nl_flags, $definition, $defaults, $nl, $physv) = @_;

add_default($opts, $nl_flags->{'inputdata_rootdir'}, $definition, $defaults, $nl, 'z0param_method',
'phys'=>$nl_flags->{'phys'} );

my $var = remove_leading_and_trailing_quotes( $nl->get_value("z0param_method") );
if ( $var ne "Meier2022" && $var ne "ZengWang2007" ) {
$log->fatal_error("$var is incorrect entry for the namelist variable z0param_method; expected Meier2022 or ZengWang2007");
}
my $phys = $physv->as_string();
if ( $phys eq "clm4_5" || $phys eq "clm5_0" ) {
if ( $var eq "Meier2022" ) {
$log->fatal_error("z0param_method = $var and phys = $phys, but this method has been tested only with clm5_1 and later versions; to use with earlier versions, disable this error, and add Meier2022 parameters to the corresponding params file");
}
}
}
#-------------------------------------------------------------------------------

sub setup_logic_snicar_methods {
my ($opts, $nl_flags, $definition, $defaults, $nl) = @_;

Expand Down Expand Up @@ -2243,6 +2263,7 @@ sub setup_logic_crop_inparm {
'use_crop'=>$nl->get_value('use_crop') );

my $crop_residue_removal_frac = $nl->get_value('crop_residue_removal_frac');
add_default($opts, $nl_flags->{'inputdata_rootdir'}, $definition, $defaults, $nl, 'crop_residue_removal_frac' );
if ( $crop_residue_removal_frac < 0.0 or $crop_residue_removal_frac > 1.0 ) {
$log->fatal_error("crop_residue_removal_frac must be in range [0, 1]");
}
Expand All @@ -2255,10 +2276,13 @@ sub setup_logic_crop_inparm {
#-------------------------------------------------------------------------------

sub setup_logic_tillage {
my ($opts, $nl_flags, $definition, $defaults, $nl) = @_;
my ($opts, $nl_flags, $definition, $defaults, $nl, $physv) = @_;

add_default($opts, $nl_flags->{'inputdata_rootdir'}, $definition, $defaults, $nl, 'tillage_mode',
'use_crop'=>$nl_flags->{'use_crop'}, 'phys'=>$physv->as_string() );

my $tillage_mode = remove_leading_and_trailing_quotes( $nl->get_value( "tillage_mode" ) );
if ( $tillage_mode ne "off" && $tillage_mode ne "" && not &value_is_true($nl->get_value('use_crop')) ) {
if ( $tillage_mode ne "off" && $tillage_mode ne "" && not &value_is_true($nl_flags->{'use_crop'}) ) {
$log->fatal_error( "Tillage only works on crop columns, so use_crop must be true if tillage is enabled." );
}
}
Expand Down
10 changes: 7 additions & 3 deletions bld/namelist_files/namelist_defaults_ctsm.xml
Original file line number Diff line number Diff line change
Expand Up @@ -484,9 +484,9 @@ attributes from the config_cache.xml file (with keys converted to upper-case).
<!-- The default filenames are given relative to the root directory
for the CLM2 data in the CESM distribution -->
<!-- Plant function types (relative to {csmdata}) -->
<paramfile phys="clm5_1" >lnd/clm2/paramdata/ctsm51_params.c240105.nc</paramfile>
<paramfile phys="clm5_0" >lnd/clm2/paramdata/clm50_params.c240105.nc</paramfile>
<paramfile phys="clm4_5" >lnd/clm2/paramdata/clm45_params.c240105.nc</paramfile>
<paramfile phys="clm5_1" >lnd/clm2/paramdata/ctsm51_params.c240207b.nc</paramfile>
<paramfile phys="clm5_0" >lnd/clm2/paramdata/clm50_params.c240207b.nc</paramfile>
<paramfile phys="clm4_5" >lnd/clm2/paramdata/clm45_params.c240207b.nc</paramfile>

<!-- ================================================================== -->
<!-- FATES default parameter file -->
Expand All @@ -499,6 +499,7 @@ attributes from the config_cache.xml file (with keys converted to upper-case).
<!-- ================================================================== -->

<z0param_method>ZengWang2007</z0param_method>
<z0param_method phys="clm5_1">Meier2022</z0param_method>

<use_z0m_snowmelt z0param_method="Meier2022" >.true.</use_z0m_snowmelt>
<use_z0m_snowmelt >.false.</use_z0m_snowmelt>
Expand Down Expand Up @@ -554,6 +555,7 @@ attributes from the config_cache.xml file (with keys converted to upper-case).
<use_grainproduct use_crop=".true." phys="clm5_1" >.true.</use_grainproduct> <!-- 1-year grain product pool default to on for clm50 if crop is turned on -->

<crop_residue_removal_frac>0.d+0</crop_residue_removal_frac>
<crop_residue_removal_frac phys="clm5_1">0.5d00</crop_residue_removal_frac>

<!-- Crop model options -->
<baset_mapping use_crop=".true." phys="clm4_5" >constant</baset_mapping>
Expand Down Expand Up @@ -2825,6 +2827,8 @@ use_crop=".true.">lnd/clm2/surfdata_map/ctsm5.1.dev052/landuse.timeseries_mpasa1
<!-- ========================================= -->

<tillage_mode>off</tillage_mode>
<tillage_mode use_crop=".true." phys="clm5_1">low</tillage_mode>

<use_original_tillage_phases>.false.</use_original_tillage_phases>
<max_tillage_depth>0.26d00</max_tillage_depth>

Expand Down
21 changes: 21 additions & 0 deletions cime_config/testdefs/ExpectedTestFails.xml
Original file line number Diff line number Diff line change
Expand Up @@ -228,4 +228,25 @@
</phase>
</test>

<test name="ERS_D_Ld15.f45_f45_mg37.I2000Clm50FatesRs.derecho_intel.clm-FatesColdTwoStream">
<phase name="COMPARE_base_rest">
<status>FAIL</status>
<issue>#2325</issue>
</phase>
</test>

<test name="ERS_D_Ld15.f45_f45_mg37.I2000Clm50FatesRs.izumi_nag.clm-FatesColdTwoStream">
<phase name="COMPARE_base_rest">
<status>FAIL</status>
<issue>#2325</issue>
</phase>
</test>

<test name="ERS_D_Ld15.f45_f45_mg37.I2000Clm50FatesRs.derecho_gnu.clm-FatesColdTwoStreamNoCompFixedBioGeo">
<phase name="COMPARE_base_rest">
<status>FAIL</status>
<issue>#2325</issue>
</phase>
</test>

</expectedFails>
5 changes: 3 additions & 2 deletions cime_config/testdefs/testlist_clm.xml
Original file line number Diff line number Diff line change
Expand Up @@ -3308,8 +3308,8 @@

<test name="FSURDATMODIFYCTSM_D_Mmpi-serial_Ld1" grid="5x5_amazon" compset="I2000Clm50SpRs">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
<machine name="cheyenne" compiler="intel" category="clm_pymods"/>
<machine name="derecho" compiler="gnu" category="aux_clm"/>
<machine name="derecho" compiler="gnu" category="clm_pymods"/>
</machines>
<options>
<option name="wallclock">00:20:00</option>
Expand Down Expand Up @@ -3433,6 +3433,7 @@
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
<machine name="derecho" compiler="intel" category="aux_clm"/>
<machine name="izumi" compiler="intel" category="aux_clm"/>
</machines>
<options>
<option name="wallclock">00:30:00</option>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,6 @@ hillslope_transmissivity_method = 'LayerSum'
hillslope_pft_distribution_method = 'PftLowlandUpland'
hillslope_soil_profile_method = 'Uniform'

fsurdat = '$DIN_LOC_ROOT/lnd/clm2/testdata/surfdata_10x15_78pfts_simyr2000_synthetic_cosphill_1.2.nc'
fsurdat = '$DIN_LOC_ROOT/lnd/clm2/testdata/surfdata_10x15_78pfts_simyr2000_synthetic_cosphill_1.3.nc'

use_ssre = .false.
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
paramfile = '$DIN_LOC_ROOT/lnd/clm2/paramdata/ctsm51_ciso_cwd_hr_params.c240105.nc'
paramfile = '$DIN_LOC_ROOT/lnd/clm2/paramdata/ctsm51_ciso_cwd_hr_params.c240207b.nc'
hist_fincl1 = 'CWDC_HR','C13_CWDC_HR','C14_CWDC_HR','CWD_HR_L2','CWD_HR_L2_vr','CWD_HR_L3','CWD_HR_L3_vr'
Loading
Loading