Skip to content

Issues: philschmid/deep-learning-pytorch-huggingface

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

31 Open 10 Closed
31 Open 10 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Fine-tune-llm-in-2024-with-trl.ipynb for LLAMA3.2
#65 opened Oct 13, 2024 by anas-zafar
ValueError: Must flatten tensors with uniform dtype but got torch.bfloat16 and torch.float32
#61 opened Sep 12, 2024 by daje0601
OOM error in FSDP QLORA setup
#60 opened Sep 4, 2024 by ss8319
Regarding the OOM issues with fine-tuning Flan-T5-xl
#58 opened Jul 14, 2024 by Alsodream
Quantization question:
#56 opened Jun 21, 2024 by aptum11
Deprecation warnings.
#52 opened May 14, 2024 by hohoCode
Fine-tune-llm-in-2024-with-trl.ipynb not producing the outputs
#51 opened May 10, 2024 by scigeek72
Out of Memory: Cannot reproduce T5-XXL run on 8xA10G.
#49 opened Mar 22, 2024 by slai-natanijel
3
What's the use of "messages" in dpo step?
#48 opened Mar 11, 2024 by katopz
question about DeepSpeedPeftCallback
#47 opened Mar 5, 2024 by mickeysun0104
Re. fine-tune-llms-in-2024-with-trl.ipynb
#45 opened Mar 1, 2024 by andysingal
1
flash attention error on instruction tune llama-2 tutorial on Sagemaker notebook
#40 opened Oct 25, 2023 by matthewchung74
2
Precision Issue
#39 opened Sep 29, 2023 by zihaohe123
4
Falcon-180B "forward() got an unexpected keyword argument 'position_ids'"
#38 opened Sep 22, 2023 by aittalam
Does this work for Llama2 - Fine-tune Falcon 180B with DeepSpeed ZeRO, LoRA & Flash Attention?
#37 opened Sep 21, 2023 by ibicdev
11
Instruction tuning of LLama2 is significantly slower compared to documented 3 hours fine-tuning time on A10G.
#35 opened Sep 20, 2023 by mlscientist2
1
Compute metrics while using SFT trainer
#34 opened Sep 19, 2023 by shubhamagarwal92
1
LLama 2 Flash Attention Patch Not Working For 70B
#32 opened Sep 7, 2023 by mallorbc
6
Is the DataCollator necessary in peft-flan-t5-int8-summarization.ipynb ?
#29 opened Aug 15, 2023 by brooksbp
Llama patch for FlashAttention support fails with use_cache
#26 opened Aug 1, 2023 by qmdnls
2
How to create a json file for create_flan_t5_cnn_dataset.py
#25 opened Jul 31, 2023 by andysingal
1
gcc/cuda used for training
#24 opened Jul 26, 2023 by danyaljj
1
CPU offload when not using offload deepspeed config file
#19 opened Jun 15, 2023 by siddharthvaria
3
Error when training peft model example
#18 opened Jun 8, 2023 by Tachyon5
6
Does deepspeed partition the model to multi GPUs?
#15 opened Apr 26, 2023 by vikki7777
4
ProTip! Follow long discussions with comments:>50.