You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Two special tokens are used to mark the beginning of user and assistant turns: <|prompter|> and <|assistant|>. Each turn ends with a <|endoftext|> token.
And I strongly believe this is the case for the llama version as well, because when I played around with it, it sometimes outputted those strings.
The text was updated successfully, but these errors were encountered:
I'm pretty sure the Open-Assistant models added in 17308a8 require different labels than the normal llama models.
I couldn't find anything on their llama huggingface repo, but in https://huggingface.co/OpenAssistant/stablelm-7b-sft-v7-epoch-3 I found this:
And I strongly believe this is the case for the llama version as well, because when I played around with it, it sometimes outputted those strings.
The text was updated successfully, but these errors were encountered: