We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
attribute_annotate.py
Describe the bug
When running attribute_annotate.py, an error occurs in get_reward(). This is due to KeyError: 'exceeded'.
get_reward()
KeyError: 'exceeded'
Traceback (most recent call last): File "/opt/NeMo-Aligner/examples/nlp/data/steerlm/attribute_annotate.py", line 150, in <module> main(prepare_args()) File "/opt/NeMo-Aligner/examples/nlp/data/steerlm/attribute_annotate.py", line 96, in main _ = get_reward(["hello world!"], host=args.host, port=args.port, model_name=args.model_name) File "/opt/NeMo-Aligner/examples/nlp/data/steerlm/attribute_annotate.py", line 74, in get_reward all_exceeded += output_dict["exceeded"].tolist() KeyError: 'exceeded'
Steps/Code to reproduce bug Referring to the following https://docs.nvidia.com/nemo-framework/user-guide/latest/modelalignment/steerlm.html#step-4-generate-annotations
export MODEL="/workspace/models/Llama3-70B-SteerLM-RM" python /opt/NeMo-Aligner/examples/nlp/gpt/serve_reward_model.py \ rm_model_file=${MODEL} \ trainer.num_nodes=1 \ trainer.devices=8 \ ++model.tensor_model_parallel_size=4 \ ++model.pipeline_model_parallel_size=1 \ inference.inference_micro_batch_size=8 \ inference.port=1424 python /opt/NeMo-Aligner/examples/nlp/data/steerlm/attribute_annotate.py \ --input-file=data/oasst/train.jsonl \ --output-file=data/oasst/train_labeled.jsonl \ --port=1424
Expected behavior
There is no error if there is or is not an "exceeded" key in the inference output.
Environment overview (please complete the following information)
Environment details
If NVIDIA docker image is used you don't need to specify these. Otherwise, please provide:
Additional context
Add any other context about the problem here. Example: GPU model
The text was updated successfully, but these errors were encountered:
Fix NVIDIA#349
b906211
Signed-off-by: Atsunori Fujita <[email protected]>
5ecd1cb
dd9954b
No branches or pull requests
Describe the bug
When running
attribute_annotate.py
, an error occurs inget_reward()
. This is due toKeyError: 'exceeded'
.Steps/Code to reproduce bug
Referring to the following
https://docs.nvidia.com/nemo-framework/user-guide/latest/modelalignment/steerlm.html#step-4-generate-annotations
Expected behavior
There is no error if there is or is not an "exceeded" key in the inference output.
Environment overview (please complete the following information)
Environment details
If NVIDIA docker image is used you don't need to specify these.
Otherwise, please provide:
Additional context
Add any other context about the problem here.
Example: GPU model
The text was updated successfully, but these errors were encountered: