4 ms·
I see you're using [INST] tokens. Please don't do this -- this model was not trained in this format or to be a chat model. Instead, it should be treated as a c
by rushingcreek 3y ago
I see you're using [INST] tokens. Please don't do this -- this model was not trained in this format or to be a chat model.
Instead, it should be treated as a completions model (like text-davinci-003) and no system prompt should be provided.
Just tell it what you want.