Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Truth: For dtcenter/MET#2921 #2620

Closed
8 of 11 tasks
JohnHalleyGotway opened this issue Jun 25, 2024 · 1 comment
Closed
8 of 11 tasks

Update Truth: For dtcenter/MET#2921 #2620

JohnHalleyGotway opened this issue Jun 25, 2024 · 1 comment
Assignees
Labels
alert: NEED ACCOUNT KEY Need to assign an account key to this issue alert: NEED CYCLE ASSIGNMENT Need to assign to a release development cycle alert: NEED MORE DEFINITION Not yet actionable, additional definition required component: CI/CD Continuous integration and deployment issues priority: blocker Blocker requestor: METplus Team METplus Development Team type: update truth Update truth dataset
Milestone

Comments

@JohnHalleyGotway
Copy link
Collaborator

JohnHalleyGotway commented Jun 25, 2024

Describe Expected Changes

PR dtcenter/MET#2921 for issue dtcenter/MET#2841 modifies the definition of the range/azimuth grids used by the TC-RMW and TC-Diag tools. It makes the following changes:

  • Re-defines azimuths from being defined counterclockwise from due north to being define clockwise from due east.
  • Corrects the logic for deriving radial and tangential winds.

This will cause all TC-RMW and TC-Diag outputs based on the range/azimuth grid definitions to be modified. Specifically, we should see a phase shift in the data (i.e. shifting left by 25% due to the north to east change) as well as a reversal of values along the X-axis due to changing from counterclockwise to clockwise.

Define the Metadata

Title

  • Define the Title of this issue as Update Truth: For dtcenter/{REPO}#{PR_NUMBER} to indicate the repository and pull request that warranted this issue.

Assignee

Assign this issue to the author of the pull request that warranted this issue. Optionally assign anyone else who should review the differences in the output.

  • Select engineer(s) or no engineer required
  • Select scientist(s) or no scientist required

Milestone and Projects

  • Select Milestone as the next official version if updating truth data for the develop branch OR select next METplus-Wrappers-X.Y.Z bugfix version if updating truth data for a main_vX.Y branch.
  • If updating truth data for the develop branch, select the METplus-Wrappers-X.Y.Z Development project OR if updating truth for a main_vX.Y branch, select the Coordinated METplus-X.Y Support project

Update Truth Checklist

  • Review the GitHub Actions workflow that was triggered by the PR merge
    • If no differences were found, note this in a comment.
    • If all of the differences are expected, note this in a comment.
      Include any details of how the review was performed.
    • If unexpected differences are found, the following instructions can
      help uncover potential explanations. If none of these apply and the
      source of the differences cannot be determined, contact the
      METplus wrappers lead engineer (@georgemccabe) for assistance.
      • Search for other open issues that have the label type: update truth
        applied by clicking on the label on this issue. Coordinate with the
        author of these issues to ensure all diffs are properly reviewed.
      • Check if any additional GitHub Actions testing workflows have been
        triggered since the workflow that corresponds to this issue was run.
        Review the latest run to ensure that there are no diffs that are
        unrelated to this issue.
      • If the incorrect differences are caused by the changes from the
        issue that warranted this issue, consider reverting the PR and
        re-opening the issue.
    • Iterate until one of the above conditions apply.
  • Approve the update of the truth data
    • Contact the METplus wrappers lead engineer (@georgemccabe) or
      backup lead (@jprestop) to let them know that the truth data can
      be updated.
  • Update the truth data.
    This should be handled by a METplus wrappers engineer.
    See the instructions to update the truth data for more info.
  • Close this issue.
@JohnHalleyGotway JohnHalleyGotway added priority: blocker Blocker alert: NEED MORE DEFINITION Not yet actionable, additional definition required alert: NEED ACCOUNT KEY Need to assign an account key to this issue component: CI/CD Continuous integration and deployment issues alert: NEED CYCLE ASSIGNMENT Need to assign to a release development cycle requestor: METplus Team METplus Development Team type: update truth Update truth dataset labels Jun 25, 2024
@JohnHalleyGotway JohnHalleyGotway added this to the METplus-6.0.0 milestone Jun 25, 2024
@JohnHalleyGotway JohnHalleyGotway self-assigned this Jun 25, 2024
@JohnHalleyGotway JohnHalleyGotway moved this from 🔖 Ready to 🏗 In progress in METplus-Wrappers-6.0.0 Development Jun 25, 2024
@JohnHalleyGotway
Copy link
Collaborator Author

This review is based on this GHA testing workflow run that was triggered when PR dtcenter/MET#2921 was merged into develop.

I note the following:

  • 3 of the 56 use case groups failed.
  • Across those 3 use case groups, differences were flagged in a total of 4 NetCDF output files only:
Archive:  diff-use_cases_met_tool_wrapper_0-29_59-64.zip
  inflating: met_tool_wrapper/TCDiag/tc_diag/2023/sal032023_gfso_doper_2023062012_cyl_grid_parent_output.nc  
  inflating: met_tool_wrapper/TCDiag/tc_diag/2023/sal032023_gfso_doper_2023062012_cyl_grid_parent_truth.nc  
  inflating: met_tool_wrapper/TCDiag/tc_diag/2023/sal032023_gfso_doper_2023062012_diag_output.nc  
  inflating: met_tool_wrapper/TCDiag/tc_diag/2023/sal032023_gfso_doper_2023062012_diag_truth.nc  
Archive:  diff-use_cases_met_tool_wrapper_30-58.zip
  inflating: met_tool_wrapper/TCRMW/met_tool_wrapper/TCRMW/tc_rmw_aal142016_output.nc  
  inflating: met_tool_wrapper/TCRMW/met_tool_wrapper/TCRMW/tc_rmw_aal142016_truth.nc  
Archive:  diff-use_cases_tc_and_extra_tc_0-2.zip
  inflating: tc_and_extra_tc/TCRMW_fcstGFS_fcstOnly_gonzalo/model_applications/tc_and_extra_tc/TCRMW_gonzalo/tc_rmw_gonzal09l.2014101312_output.nc  
  inflating: tc_and_extra_tc/TCRMW_fcstGFS_fcstOnly_gonzalo/model_applications/tc_and_extra_tc/TCRMW_gonzalo/tc_rmw_gonzal09l.2014101312_truth.nc 

I used ncview to spot check the 4th file and see the differences are exactly as expected with the range/azimuth data shift to the right by 90 degrees (north to east) and then reversed (counterclockwise to clockwise):
Screen Shot 2024-06-25 at 12 11 40 PM

I also see the same pattern in the first diff file.

I'll also note that no differences were flagged in the TC-Diag .dat output file: met_tool_wrapper/TCDiag/tc_diag/2023/sal032023_gfso_doper_2023062012_diag.dat. This makes sense because the diagnostics are computed for each RANGE value and the modified azimuths should still produce the same average value for each range. However, the 850TANG, 850VORT, and 200DVRG diagnostics are reported as bad data in the output... and those are based on the derivation radial and tangential wind derivations. We should eventually have a TC-Diag use case that actually computes those diagnostic values from the radial/tangential winds (@jvigh and @KathrynNewman).

850TANG (10M/S)   9999  9999  9999
850VORT (/S)      9999  9999  9999
200DVRG (/S)      9999  9999  9999

@github-project-automation github-project-automation bot moved this from 🏗 In progress to ✅ Done in METplus-Wrappers-6.0.0 Development Jul 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
alert: NEED ACCOUNT KEY Need to assign an account key to this issue alert: NEED CYCLE ASSIGNMENT Need to assign to a release development cycle alert: NEED MORE DEFINITION Not yet actionable, additional definition required component: CI/CD Continuous integration and deployment issues priority: blocker Blocker requestor: METplus Team METplus Development Team type: update truth Update truth dataset
Projects
Status: 🏁 Done
Development

No branches or pull requests

2 participants