-
Notifications
You must be signed in to change notification settings - Fork 39
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Failed to Adapt to your own corpus via LoRA #123
Comments
Hi, thanks for raising this! This occurred when porting the research codebase into the library. To fix your issues:
Also, Hope this helps! |
@markus583 |
I see, does this happen when you run |
Yes, I got the above error when running wtpsplit/train/train_lora.py.
When executing the evaluation_loop function, an error will be reported, indicating that there is no |
Thanks for the detailed info! Really appreciate it. Currently I don't have access to a decent enough CUDA-powered device so I can't fully test this. But I pushed a version that should fix many of the mentioned issues. As for the specifics:
|
I see, thank you for your clear and detailed explanation. While looking through an older version of the research code, I realized that I used a custom version of the |
I just pushed the corresponding fixed and tested it on GPU, following the tutorial in the README. It works as expected now, so I will close this issue. If anything still comes up, feel free to comment here, I will re-open it. |
Hello, I tried to train a Lora using my own data, but the method in the "Adapt to your own corpus via LoRA" section in README.md was not successful, and there were problems including but not limited to the following:
Is there any way to fix this?
The text was updated successfully, but these errors were encountered: