3 ms·
Often you'll find there's '-chat-' and '-instruct-' variants of an LLM available. Trying to chat to an INSTRUCT model will be disappointing, much as you descri
by Jedd 2y ago
Often you'll find there's '-chat-' and '-instruct-' variants of an LLM available.
Trying to chat to an INSTRUCT model will be disappointing, much as you describe.
- kaoD 2y agoThis was on their example LLaVA 1.5 7b q4 with all default parameters which does not specify chat or instruct... but after the first message it actually worked as expected so I guess it's RLHF'd for chat or chat+instruct. I don't know if it was some sort of error on the UI or what. Trying to interrogate it about the first message yielded no results. It just repeated back my question, verbatim, unlike the rest of the chat which was more or less chat-like :shrugh: