-
Notifications
You must be signed in to change notification settings - Fork 22
Configuration Options Explained
fingerthief edited this page May 12, 2024
·
6 revisions
The settings dialog allows you to customize the behavior of our application to suit your needs. Below is a breakdown of each setting:
Settings values are saved automatically as soon as you click away from the edited value.
For more information on the available parameters, see the Open Router API documentation.
Setting | Description |
---|---|
Key | Enter your API key for the service you are using, if applicable. Some services do not require an API key for locally hosted API endpoints. |
Model Name | The name of the model you are using, if applicable. (e.g., meta-llama/llama-3-70b-instruct ) |
API Endpoint | The base URL of the API endpoint being used to interact with the model. (e.g., http://192.168.120.6:1234 for locally hosted or https://openrouter.ai/api for a different service) |
Temperature | Influences the variety in the model's responses. Lower values lead to more predictable and typical responses, while higher values encourage more diverse and less common responses. At 0, the model always gives the same response for a given input. |
Max Tokens | Set the maximum number of tokens to be generated by the AI model. A higher value will result in longer responses, but may also increase the risk of generating irrelevant or unnecessary text. |
Repetition Penalty | Helps to reduce the repetition of tokens from the input. A higher value makes the model less likely to repeat tokens, but too high a value can make the output less coherent (often with run-on sentences that lack small words). Token penalty scales based on original token's probability. |
Top P | Limits the model's choices to a percentage of likely tokens: only the top tokens whose probabilities add up to P. A lower value makes the model's responses more predictable, while the default setting allows for a full range of token choices. |
System Prompt | Allows the user to give the AI a prompt to adhere to if desired. |
Setting | Description |
---|---|
Key | Enter your OpenAI API key to enable GPT functionality. |
Slider Value | Adjust the tone of the GPT responses to be more serious or creative. Moving the slider to the left will result in more serious responses, while moving it to the right will result in more creative responses. |
Setting | Description |
---|---|
Image Count | Select the number of images to generate for each prompt. |
Image Resolution | Choose the resolution of the generated images. |
Setting | Description |
---|---|
Key | Enter your Claude API key to enable Claude functionality. |
Slider Value | Adjust the tone of the Claude responses to be more serious or creative. Moving the slider to the left will result in more serious responses, while moving it to the right will result in more creative responses. |