3 ms·
Dumb question: Are "non-instructed" versions of LLMs just raw, no-guardrail versions of the "instructed" versions that most end-users see? And why does Mixtral
by CharlesW 3y ago
Dumb question: Are "non-instructed" versions of LLMs just raw, no-guardrail versions of the "instructed" versions that most end-users see? And why does Mixtral need one, when OpenAI LLMs do not?
- hnuser123456 3y agohttps://platform.openai.com/docs/models/gpt-base https://platform.openai.com/docs/models/gpt-base https://platform.openai.com/docs/guides/text-generation/completions-api https://platform.openai.com/docs/guides/text-generation/comp...
- CharlesW 3y agoI appreciate the correction, thanks!
- kingsleyopara 3y agoLLM’s are first trained to predict the next most likely word (or token if you want to be accurate) from web crawls. These models are basically great at continuing unfinished text but can’t really be used for instructions e.g. Q&A or chatting - this is the “non-instructed” version. These models are then fine tuned for instructions using additional data from human interaction - these are the “instructed” versions which are what end users (e.g. ChatGPT, Gemini, etc.) see.
- CharlesW 3y agoVery helpful, thank you.