Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Handle text on lines in ECMWF BUFR templates #1234

Conversation

allanfrankwork
Copy link

@allanfrankwork allanfrankwork commented Sep 17, 2023

Description of Changes

Fixes line parsing for ECMWF BUFR templates.

I was parsing BUFR files and noticed that even the included ecmwf.D0000000000098013001.TXT file failed to be parsed due to comments after the three sections of numbers in some lines.

For the BUFR files I am parsing I'm using other templates which have the same problem - so I worked around that by cutting off the lines before handing them to tablelookup.csv and calling NetcdfFiles.openInMemory(filename)

However with this fix no such workaround is needed and since its also a problem for the file already in netcdf-java/bufr/src/main/resources/resources/bufrTables/local/ecmwf.D0000000000098013001.TXT I thought it would be good to include for all.

For unittest I tried including the file in netcdf-java/bufr/src/test/data but that makes the unittest fail - I suspect due missing bufr templates. If you have other ideas to try please let me know.

PR Checklist

  • Link to any issues that the PR addresses
  • Add labels
  • Open as a draft PR
    until ready for review
  • Make sure GitHub tests pass
  • Mark PR as "Ready for Review"

@CLAassistant
Copy link

CLAassistant commented Sep 17, 2023

CLA assistant check
All committers have signed the CLA.

@allanfrankwork allanfrankwork marked this pull request as draft September 18, 2023 21:27
@allanfrankwork
Copy link
Author

I have found some files that this still does not work on, setting PR to draft.

I'll update here when I know more.

@tdrwenski
Copy link
Contributor

Hi @allanfrankwork, are you still working on this PR?

@allanfrankwork
Copy link
Author

I am not.

IIRC, while trying to parse BUFR files from WIS2 I found a couple of different templates that were in slightly different format and the parsing function did not handle those variations.

I will close this PR.

Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants