Ability to customize message when Chat is unavailable

[stephherbers]

Ability to customize banner text when LLM such that the chat is unavailable on an experiment level

• Add custom message to model that is default to None. When configure show that text for the message in addition to "System is down" or something similar to that.

[SmittieC]

We want predefined bot responses when there's an error happening on the server?

[stephherbers]

Ah not so much message but banner, I'll correct the wording on the ticket.

[SmittieC]

From our offline chats, I think that if this message is configured, we should let the bot say it to the user instead of the banner. The reason why I'm advocating for this is to keep things consistent across all channels. Non web channels don't have banners, so the bot response is all we can work with.

So to be clear what I am suggesting:

1. When there's no message configured, keep things as they are i.e. show the "something went wrong" bannar in the webchat. I'm not entirely sure what to do with external channels here. Maybe we use some special formatting?
2. When there is a custom message configured, the bot's reply should be that message. No banner should be shown on the web UI.