New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[tracking] Shortfin LLM Minor Features #446

Open

1 task

renxida opened this issue Nov 7, 2024 · 0 comments

Contributor

renxida commented Nov 7, 2024 •

edited

Loading

list of minor features in shortfin, to do while waiting for other things / for ramping up people coming in to shortfin

Stop generation on EOS tokens and respect max length specification from generation request
[ ]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment