Skip to content

Commit

Permalink
Update docs
Browse files Browse the repository at this point in the history
  • Loading branch information
s-kostyaev committed Jun 2, 2024
1 parent ef2f43b commit 9bd2641
Showing 1 changed file with 12 additions and 10 deletions.
22 changes: 12 additions & 10 deletions README.org
Original file line number Diff line number Diff line change
Expand Up @@ -43,11 +43,12 @@ In that case you should customize ellama configuration like this:
;; could be llm-openai for example
(require 'llm-ollama)
(setopt ellama-provider
(make-llm-ollama
;; this model should be pulled to use it
;; value should be the same as you print in terminal during pull
:chat-model "mistral:7b-instruct-v0.2-q6_K"
:embedding-model "mistral:7b-instruct-v0.2-q6_K"))
(make-llm-ollama
;; this model should be pulled to use it
;; value should be the same as you print in terminal during pull
:chat-model "llama3:8b-instruct-q8_0"
:embedding-model "nomic-embed-text"
:default-chat-non-standard-params '(("num_ctx" . 8192))))
;; Predefined llm providers for interactive switching.
;; You shouldn't add ollama providers here - it can be selected interactively
;; without it. It is just example.
Expand All @@ -63,14 +64,15 @@ In that case you should customize ellama configuration like this:
:embedding-model "mixtral:8x7b-instruct-v0.1-q3_K_M-4k"))))
;; Naming new sessions with llm
(setopt ellama-naming-provider
(make-llm-ollama
:chat-model "mistral:7b-instruct-v0.2-q6_K"
:embedding-model "mistral:7b-instruct-v0.2-q6_K"))
(make-llm-ollama
:chat-model "llama3:8b-instruct-q8_0"
:embedding-model "nomic-embed-text"
:default-chat-non-standard-params '(("stop" . ("\n")))))
(setopt ellama-naming-scheme 'ellama-generate-name-by-llm)
;; Translation llm provider
(setopt ellama-translation-provider (make-llm-ollama
:chat-model "sskostyaev/openchat:8k"
:embedding-model "nomic-embed-text")))
:chat-model "phi3:14b-medium-128k-instruct-q6_K"
:embedding-model "nomic-embed-text")))
#+END_SRC

** Commands
Expand Down

0 comments on commit 9bd2641

Please sign in to comment.