Skip to content

Issues: InftyAI/llmaz

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

19 Open 6 Closed
19 Open 6 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Support SGLang as another backend needs-kind Indicates a PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#39 opened Jul 26, 2024 by kerthcet
1
Use rust instead of python when downloading model weights feature Categorizes issue or PR as related to a new feature. important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. needs-triage Indicates an issue or PR lacks a label and requires one.
#38 opened Jul 26, 2024 by kerthcet v0.1.0
@kerthcet
1
Support OpenAPI feature Categorizes issue or PR as related to a new feature. important-longterm Important over the long term, but may not be staffed and/or may need multiple releases to complete. needs-triage Indicates an issue or PR lacks a label and requires one.
#37 opened Jul 26, 2024 by kerthcet
1
Support OCI artifacts enhancement Categorizes issue or PR as related to a new feature with API changes. feature Categorizes issue or PR as related to a new feature. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#35 opened Jul 24, 2024 by kerthcet v0.1.0
1
Will sharing models via hostPath leading to security probelm needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one. question Further information is requested
#34 opened Jul 24, 2024 by kerthcet
1
Model should be namespaced needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one. question Further information is requested
#33 opened Jul 24, 2024 by kerthcet
1
Support Deployment for serving most models backlog Higher priority than priority/awaiting-more-evidence. needs-triage Indicates an issue or PR lacks a label and requires one. question Further information is requested
#32 opened Jul 24, 2024 by kerthcet
9
Support Adapters in model serving enhancement Categorizes issue or PR as related to a new feature with API changes. feature Categorizes issue or PR as related to a new feature. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#27 opened Jul 19, 2024 by kerthcet
1
Remove core folder cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt. important-longterm Important over the long term, but may not be staffed and/or may need multiple releases to complete. triage/accepted Indicates an issue or PR is ready to be actively worked on.
#24 opened Jul 17, 2024 by kerthcet
3
Support HA with LeaderElection feature Categorizes issue or PR as related to a new feature. help wanted Extra attention is needed needs-kind Indicates a PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#23 opened Jul 16, 2024 by kerthcet
1
Support Secret in Playground feature Categorizes issue or PR as related to a new feature. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#22 opened Jul 15, 2024 by kerthcet v0.1.0
1
Liveness & Readiness support feature Categorizes issue or PR as related to a new feature. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#21 opened Jul 15, 2024 by kerthcet v0.1.0
1
Support DataSource of docker image feature Categorizes issue or PR as related to a new feature. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#20 opened Jul 15, 2024 by kerthcet v0.1.0
2
Support DataSource of ModelScope feature Categorizes issue or PR as related to a new feature. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#19 opened Jul 15, 2024 by kerthcet v0.2.0
1
Add more testcases for webhooks cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt. good first issue Good for newcomers needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#17 opened Jul 15, 2024 by kerthcet
1
Support multi-host inference feature Categorizes issue or PR as related to a new feature. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#16 opened Jul 15, 2024 by kerthcet v0.2.0
1
Support MultiModelsClaims for speculative decoding and splitwise feature Categorizes issue or PR as related to a new feature. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#15 opened Jul 15, 2024 by kerthcet v0.2.0
2
Failed to pass through the labels to the lws Pods bug Categorizes issue or PR as related to a bug. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
#14 opened Jul 15, 2024 by kerthcet v0.1.0
2
Support autoscaling enhancement Categorizes issue or PR as related to a new feature with API changes. feature Categorizes issue or PR as related to a new feature. important-longterm Important over the long term, but may not be staffed and/or may need multiple releases to complete.
#3 opened Nov 23, 2023 by kerthcet
4
ProTip! What’s not been updated in a month: updated:<2024-06-26.