Add logger examples in eval script #59
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Ram81
requested changes
Sep 23, 2022
| @@ -62,6 +62,22 @@ If you are looking for a simple challenge configuration that you can replicate t | |||
|
|
|||
| 11. To update the challenge on EvalAI, make changes in the repository and push on `challenge` branch and wait for the build to complete. | |||
|
|
|||
| ### Printing and Logging in Evaluation Script | |||
There was a problem hiding this comment.
Change to Logging in Evaluation Script
Comment on lines
+9
to
+17
| eval_script_logger = logging.getLogger(name='eval_script') | ||
| eval_script_logger.setLevel(logging.DEBUG) | ||
|
|
||
| handler = logging.StreamHandler(sys.stdout) | ||
| handler.setLevel(logging.DEBUG) | ||
| formatter = logging.Formatter('%(asctime)s - %(name)s - %(levelname)s - %(message)s') | ||
| handler.setFormatter(formatter) | ||
| eval_script_logger.addHandler(handler) | ||
|
|
There was a problem hiding this comment.
can you create a new method called get_logger in this script and use that to get the logger here?
| ### Printing and Logging in Evaluation Script | ||
| `print` statements will show up on the console directly. | ||
| In order to get `logging` statements from the evaluation script, ensure that the logger has a `stdout` handler added. We redirect the output from `stdout` to the submission workers console. | ||
| An example logger can be created like so: |
There was a problem hiding this comment.
Change to Here's an example of setting up a logger:
| eval_script_logger.addHandler(handler) | ||
| ``` | ||
|
|
||
| Then, we can use this logger anywhere in the script and the corresponding level logs will show up in the output. |
There was a problem hiding this comment.
Chnage to Once set up, you can use the logger anywhere in the evaluation script to display logs on EvalAI manage tab.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR adds examples for logger in evaluation script and adds some suggestions in the README.