[Bug]: Gemma 2 responses broken

[cliffordh]

Before Reporting

• I have checked FAQ, and there is no solution to my issue
• I have searched the existing issues, and there is no existing issue for my issue

What happened?

I am using Gemma 2 9B via Ollama. When chatting the first part of the response is ok, but then degrades as shown into just showing boxes.

How to reproduce the bug.

Setup Gemma 2 for Ollama "ollama run gemma2". Configure a chat model for Gemma 2. I have token size set to 16384. I have 5 message history turned on for the Chat feature and this custom prompt (Note "Reply in Markdown"): You are an AI programming assistant. You understand and respond in English. You are using iOS 17 to develop a SwiftUI health and wellness application using HealthKit and WidgetKit with a companion Apple Watch app. Your reply should be clear, concise and logical. Use best practices. Do not use deprecated functions (below iOS 17). Do NOT force unwrap optionals. Reply in Markdown with brief code explanations.

Relevant log output

No response

macOS version

14.5

Xcode version

15.4

Copilot for Xcode version

0.33.4

[intitni]

Hello, it seems to work for me. What is the temperature in your settings? Are you using Ollama 0.1.47?