-
Notifications
You must be signed in to change notification settings - Fork 171
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adds LLM Rest API compatibility for Studio 2.0 API mode. #2083
Commits on Jan 17, 2024
-
(WIP): Studio2 app infra and SD API
UI/app structure and utility implementation. - Initializers for webui/API launch - Schedulers file for SD scheduling utilities - Additions to API-level utilities - Added embeddings module for LoRA, Lycoris, yada yada - Added image_processing module for resamplers, resize tools, transforms, and any image annotation (PNG metadata) - shared_cmd_opts module -- sorry, this is stable_args.py. It lives on. We still want to have some global control over the app exclusively from the command-line. At least we will be free from shark_args. - Moving around some utility pieces. - Try to make api+webui concurrency possible in index.py - SD UI -- this is just img2imgUI but hopefully a little better. - UI utilities for your nod logos and your gradio temps. Enable UI / bugfixes / tweaks
Configuration menu - View commit details
-
Copy full SHA for dbacc36 - Browse repository at this point
Copy the full SHA dbacc36View commit details -
Studio2/SD: Use more correct LoRA alpha calculation (#2034)
* Updates ProcessLoRA to use both embedded LoRA alpha, and lora_strength optional parameter (default 1.0) when applying LoRA weights. * Updates ProcessLoRA to cover more dim cases. * This bring ProcessLoRA into line with PR #2015 against Studio1
Configuration menu - View commit details
-
Copy full SHA for cdf2eb5 - Browse repository at this point
Copy the full SHA cdf2eb5View commit details -
Studio2: Remove duplications from api/utils.py (#2035)
* Remove duplicate os import * Remove duplicate parse_seed_input function Migrating to JSON requests in SD UI More UI and app flow improvements, logging, shared device cache Model loading Complete SD pipeline. Tweaks to VAE, pipeline states Pipeline tweaks, add cmd_opts parsing to sd api
Configuration menu - View commit details
-
Copy full SHA for 7a0017d - Browse repository at this point
Copy the full SHA 7a0017dView commit details -
Configuration menu - View commit details
-
Copy full SHA for a43c559 - Browse repository at this point
Copy the full SHA a43c559View commit details
Commits on Feb 2, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 019ba70 - Browse repository at this point
Copy the full SHA 019ba70View commit details -
Add StreamingLLM support to studio2 chat (#2060)
* Streaming LLM * Update precision and add gpu support * (studio2) Separate weights generation for quantization support * Adapt prompt changes to studio flow * Remove outdated flag from llm compile flags. * (studio2) use turbine vmfbRunner * tweaks to prompts * Update CPU path and llm api test. * Change device in test to cpu. * Fixes to runner, device names, vmfb mgmt * Use small test without external weights.
Configuration menu - View commit details
-
Copy full SHA for 2935166 - Browse repository at this point
Copy the full SHA 2935166View commit details -
HF-Reference LLM mode + Update test result to match latest Turbine. (#…
…2080) * HF-Reference LLM mode. * Fixup test to match current output from Turbine. * lint * Fix test error message + Only initialize HF torch model when used. * Remove redundant format_out change.
Configuration menu - View commit details
-
Copy full SHA for 934c352 - Browse repository at this point
Copy the full SHA 934c352View commit details
Commits on Feb 3, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 83a1446 - Browse repository at this point
Copy the full SHA 83a1446View commit details
Commits on Feb 5, 2024
-
Configuration menu - View commit details
-
Copy full SHA for c4f3526 - Browse repository at this point
Copy the full SHA c4f3526View commit details -
Configuration menu - View commit details
-
Copy full SHA for 198c42c - Browse repository at this point
Copy the full SHA 198c42cView commit details -
Configuration menu - View commit details
-
Copy full SHA for f009c8b - Browse repository at this point
Copy the full SHA f009c8bView commit details
Commits on Feb 7, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 1dba5dd - Browse repository at this point
Copy the full SHA 1dba5ddView commit details
Commits on Feb 12, 2024
-
Configuration menu - View commit details
-
Copy full SHA for b983cb3 - Browse repository at this point
Copy the full SHA b983cb3View commit details
Commits on Feb 19, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 32557ab - Browse repository at this point
Copy the full SHA 32557abView commit details
Commits on Apr 19, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 859624e - Browse repository at this point
Copy the full SHA 859624eView commit details