Skip to content

b4164
Compare
Choose a tag to compare
@github-actions github-actions released this 25 Nov 16:58
b4164
9ca2e67
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode. 
server : add speculative decoding support (#10455)

* server : add speculative decoding support

ggml-ci

* server : add helper function slot.can_speculate()

ggml-ci
Assets 21
Loading