Something went wrong. Please try again later.

[wangnanwy]

I want to use the glm-4 model, but it doesn't work. The following prompt appears:
""

[dartpain]

Hi I think I you case you have set api url to what looks like a openai compatable endpoint.
My suggestion would be:
Set LLLM_NAME=openai
Then inside application/llm/openai.py

self.client = OpenAI(
            api_key=api_key,
            base_url="http://open.bigmodel.cn/api/paas/v4", 
        )

Alse in your env variables set MODEL_NAME to glm-4

API_URL should point to docsgpt backend.
Configuration of LLM endpoint is separate

Hope this helps

[wangnanwy]

已经收到您的来件！！