Skip to content

v2.0.0
Compare
Choose a tag to compare
@petermuller petermuller released this 10 Jun 17:32
· 309 commits to main since this release
v2.0.0
9dbd01d
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

What's Changed

The LISA v2.0.0 release boasts wider support for the OpenAI spec for users making queries directly against the LISA Serve endpoint. The following is a list of changes that we have introduced since v1.2.0

  • LiteLLM added as a model proxy in the REST API container. LiteLLM provides LISA's OpenAI API spec support
    • SageMaker Endpoint and Bedrock Foundation Model support added via LiteLLM configuration
  • Added support for vLLM containers in addition to the existing support for TGI and TEI containers
  • Chat UI updates to support LISA's OpenAI API support
  • Documentation updates
  • Added example Jupyter notebook showing the OpenAI compatibility with the LISA Serve endpoint
  • Deprecated v1 endpoints as they will be removed in a future release
Assets 2
Loading