[SUBMISSION] December 2024 - Module 1: Instruction tuning

[jasoriya]

December 2024 Student Submission

Module Completed

• Module 1: Instruction Tuning
• Module 2: Preference Alignment
• Module 3: Parameter-efficient Fine-tuning
• Module 4: Evaluation
• Module 5: Vision-language Models
• Module 6: Synthetic Datasets
• Module 7: Inference
• Module 8: Deployment

Changes Made

Describe what you've done in this PR:

1. What concepts did you learn?
2. What changes or additions did you make?
3. Any challenges you faced?

Notebooks Added/Modified

List any notebooks you've added or modified:

• Added new example in module_name/students/my_example.ipynb
• Modified existing notebook with additional examples
• Added documentation or comments

Checklist

• I have read the module materials
• My code runs without errors
• I have pushed models and datasets to the huggingface hub
• My PR is based on the december_2024 branch

Questions or Discussion Points

Add any questions you have or points you'd like to discuss:
1.
2.

Additional Notes

Any other information that might be helpful for reviewers:
I tried to see how a challenging task like chain of thought prompting could be fine-tuned on a small LLM. As can be seen in the example output in the notebook, the fine-tuned model tries to start the reasoning chain but starts hallucinating soon after.

[burtenshaw]

Any other information that might be helpful for reviewers:
I tried to see how a challenging task like chain of thought prompting could be fine-tuned on a small LLM. As can be seen in the example output in the notebook, the fine-tuned model tries to start the reasoning chain but starts hallucinating soon after.

This is really cool!

Start a thread on Discord if you want to discuss! https://discord.com/channels/879548962464493619/1313889336907010110

[burtenshaw]

Could you exchange a review with one of the other students's PRs? [SUBMISSION]

[jasoriya]

@burtenshaw I'd be glad to exchange a review. It seems that we don't have the permission to add ourselves as a reviewer. Would you be adding us as a reviewer?

[burtenshaw]

@burtenshaw I'd be glad to exchange a review. It seems that we don't have the permission to add ourselves as a reviewer. Would you be adding us as a reviewer?

Thanks. Just comment and mention me. Then I'll assign.

[bhautik-pithadiya]

@burtenshaw add me as a reviewer for this PR.

[burtenshaw]

@bhautik-pithadiya if you review, I'll merge.