Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

UCX warning messages filling log file #244

Assignees

Comments

@aidanheerdegen
Copy link
Contributor

Currently the access-om2.out stdout log file has a large number of lines (10425 for a 1 degree model, 278504 for a 0.1 degree model) like this:

[1628734843.363293] [gadi-cpu-clx-0929:1129006:0]          mpool.c:38   UCX  WARN  object 0x12334480 was not returned to mpool ucp_requests

These may be due to not waiting for non-blocking requests to return (open-mpi/ompi#6376), but in any case are only warnings, and can be ignored.

They can be suppressed by setting an environment variable: UCX_LOG_LEVEL=error

This should be done for all the configs by adding this to config.yaml

env:
    UCX_LOG_LEVEL: 'error'
@aekiss
Copy link
Contributor

aekiss commented Aug 20, 2021

should I do this or are you onto it?

@aidanheerdegen
Copy link
Contributor Author

Not currently doing it. Just flagged for it to be done.

Aside: I usually try and assign issues to me if I am working on them so as not to duplicate effort ... speaking of which ...

@aekiss aekiss self-assigned this Aug 20, 2021
aekiss added a commit to COSIMA/01deg_jra55_iaf that referenced this issue Aug 23, 2021
aekiss added a commit to COSIMA/01deg_jra55_ryf that referenced this issue Aug 23, 2021
aekiss added a commit to COSIMA/025deg_jra55_iaf that referenced this issue Aug 23, 2021
aekiss added a commit to COSIMA/025deg_jra55_ryf that referenced this issue Aug 23, 2021
aekiss added a commit to COSIMA/1deg_jra55_iaf that referenced this issue Aug 23, 2021
aekiss added a commit to COSIMA/1deg_jra55_ryf that referenced this issue Aug 23, 2021
@aekiss
Copy link
Contributor

aekiss commented Aug 23, 2021

@aidanheerdegen if these PRs look OK, feel free to merge

@aekiss
Copy link
Contributor

aekiss commented Aug 23, 2021

(sorry for barging in with this, I just realised I hadn't read your reply carefully)

@aidanheerdegen
Copy link
Contributor Author

No barging. I hadn't planned on doing it myself ...

@aidanheerdegen
Copy link
Contributor Author

Travis is being a pain. Will need to merge without CI, see #245.

Sorry, I realise I quoted error, but when I actually tested it I didn't use quotes. My apologies.

env:
  UCX_LOG_LEVEL: error

http://www.yamllint.com says it's ok and functionally the same. I have now tested with quotes and it also works fine.

@aekiss
Copy link
Contributor

aekiss commented Aug 23, 2021

no worries @aidanheerdegen - if the quotes are just a cosmetic issue I think we'll cope

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment