New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Integration with huggingface #12

Open

arsalan993 opened this issue Dec 3, 2021 · 1 comment

arsalan993 commented Dec 3, 2021

If somehow we can integrate this with hugging face models while doing inference then its job is done for production-level deployments.

Owner

rentruewang commented Dec 5, 2021

Agreed. Will work on it when I have the time.

tlby mentioned this issue

Trainer batch size auto scaling huggingface/transformers#14200

Closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment