Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add mirostat_eta and mirostat_tau model parameters supported by Ollama / llama.cpp backend #3348

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

sealad886
Copy link
Contributor

@sealad886 sealad886 commented Dec 13, 2024

Description

Added new variables to relevant parts of the code to enable:

  • mirostatEta and mirostatTau can be configured in the appropriate spot in config.json
  • These variables are now sent to the _streamComplete and _streamChat functions (and any other data structure that extends BaseCompletionOptions and related accessor functions)
  • updated documentation

Fixes #3345

Checklist

  • The relevant docs, if any, have been updated or created

Screenshots

The schema options are validated and suggested appropriately:
Screenshot 2024-12-13 at 03 38 01

Testing

[ For new or modified features, provide step-by-step testing instructions to validate the intended behavior of the change. ]
[ For new UI features, ensure that the changes look good across viewport widths, light/dark theme, etc ]

Copy link

netlify bot commented Dec 13, 2024

Deploy Preview for continuedev ready!

Name Link
🔨 Latest commit fc8edcd
🔍 Latest deploy log https://app.netlify.com/sites/continuedev/deploys/675bac35fed42c0008431aef
😎 Deploy Preview https://deploy-preview-3348--continuedev.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add support for Ollama model parameters mirostat-eta and mirostat-tau
1 participant