Skip to content

Commit

Permalink
docs: fix KD doc rendering (#434)
Browse files Browse the repository at this point in the history
Signed-off-by: ashors1 <[email protected]>
  • Loading branch information
ashors1 authored Dec 6, 2024
1 parent 635f801 commit 9e515ce
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions docs/user-guide/knowledge-distillation.rst
Original file line number Diff line number Diff line change
Expand Up @@ -45,6 +45,7 @@ To start, we must first download both the pre-trained student and fine-tuned tea
#. Download the `Llama3-8B LLM model and tokenizer <https://huggingface.co/meta-llama/Meta-Llama-3-8B>`__ into the model's folder. You can use the Hugging Face CLI for this:

.. code-block:: bash
huggingface-cli download nvidia/nemotron-3-8b-chat-4k-sft --local-dir teacher_checkpoint
After these steps, you should have files ``2b_student.nemo`` and ``teacher_checkpoint/Nemotron-3-8B-Chat-4k-SFT.nemo`` to use in NeMo-Aligner.
Expand Down

0 comments on commit 9e515ce

Please sign in to comment.