Skip to content

Commit

Permalink
fix: serve_reward_model.py no longer errors if pretrained GBS indivis…
Browse files Browse the repository at this point in the history
…ible by parallel state (#333)

Signed-off-by: Terry Kong <[email protected]>
  • Loading branch information
terrykong committed Oct 4, 2024
1 parent 962549c commit 50948a9
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions examples/nlp/gpt/conf/inference_rm.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -49,3 +49,7 @@ model:
regression:
merge_attributes: False # whether to merge attribute values into a scalar
attribute_weights: null # apply these weights to each attributes when merging them into a scalar

# NOTE: The user does not need to change the global batch size below
# GBS is overridden to 0 to disable checks for compatibility with the megatron-core parallel state
global_batch_size: 0

0 comments on commit 50948a9

Please sign in to comment.