Exposed Ollama on local network, still get connection errors

[ikidd]

I've added Environment="OLLAMA_HOST=0.0.0.0" to the ollama.service file, daemon-reload and restart. Changed config.toml to reflect the IP:Port of the Ollama host URL.

If I attach to the perplixica_backend container, install curl and run:

curl http://<IP_of_Ollama_Host>:11434/api/generate -d '{ "model": "llama3.2", "prompt": "Why is the sky blue?" }'

I get the appropriate response back from the ollama service.

But I still get errors in the docker log for Ollama connection from the backend container.

perplexica-backend_1 | error: Unhandled Rejection at: [object Promise], reason: TypeError [ERR_INVALID_URL]: Invalid URL

Perplexed.

[ItzCrazyKns]

What URL are you using for Ollama in the settings?

[ikidd]

http://10.10.251.50:11434 which is the host IP address. Hitting it with curl from within the container works as above.

[ItzCrazyKns]

http://10.10.251.50:11434 which is the host IP address. Hitting it with curl from within the container works as above.

What is your config.toml file? you can hide the keys.

[ikidd]

`❯ cat config.toml
[API_KEYS]

[API_ENDPOINTS]
OLLAMA = "http://10.10.251.50:11434"
SEARXNG = "http://localhost:32768"

[GENERAL]
PORT = 3001
SIMILARITY_MEASURE = "cosine"
KEEP_ALIVE = "5m"
`

[alexhegit]

I am trying to use docker with ollama as backend. But the web-ui seems has error ,

I confirm the ollama is working. I just follow the instruction to modify the config.toml for ollama as bellow,

[GENERAL]
PORT = 3001 # Port to run the server on
SIMILARITY_MEASURE = "cosine" # "cosine" or "dot"
KEEP_ALIVE = "5m" # How long to keep Ollama models loaded into memory. (Instead of using -1 use "-1m")

[API_KEYS]
OPENAI = "" # OpenAI API key - sk-1234567890abcdef1234567890abcdef
GROQ = "" # Groq API key - gsk_1234567890abcdef1234567890abcdef
ANTHROPIC = "" # Anthropic API key - sk-ant-1234567890abcdef1234567890abcdef
GEMINI = "" # Gemini API key - sk-1234567890abcdef1234567890abcdef

[API_ENDPOINTS]
SEARXNG = "http://localhost:32768" # SearxNG API URL
OLLAMA = "http://localhost:11434" # Ollama API URL - http://host.docker.internal:11434

[ItzCrazyKns]

Please follow: https://github.com/ItzCrazyKns/Perplexica?tab=readme-ov-file#ollama-connection-errors