New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] Any updates to errors due to Gradient Accumulation? #795

Open

2 tasks done

jackswl opened this issue Oct 17, 2024 · 1 comment

Open

2 tasks done

[BUG] Any updates to errors due to Gradient Accumulation? #795

jackswl opened this issue Oct 17, 2024 · 1 comment

Labels

bug stale

jackswl commented Oct 17, 2024

Prerequisites

I have read the documentation.
I have checked other issues for similar problems.

Backend

Local

Interface Used

CLI

CLI Command

UI Screenshots & Parameters

Error Logs

With the recent bug fix by Unsloth, wondering if AutoTrain will be updated for this? Thanks
https://www.reddit.com/r/LocalLLaMA/comments/1g4ego7/llm_training_bug_fixes_gradient_accumulation_was/

Additional Information

No response

jackswl added the bug label

github-actions bot commented Nov 16, 2024

This issue is stale because it has been open for 30 days with no activity.

github-actions bot added the stale label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment