3 ms·
LLM’s are first trained to predict the next most likely word (or token if you want to be accurate) from web crawls. These models are basically great at continui
by kingsleyopara 3y ago
LLM’s are first trained to predict the next most likely word (or token if you want to be accurate) from web crawls. These models are basically great at continuing unfinished text but can’t really be used for instructions e.g. Q&A or chatting - this is the “non-instructed” version. These models are then fine tuned for instructions using additional data from human interaction - these are the “instructed” versions which are what end users (e.g. ChatGPT, Gemini, etc.) see.
- CharlesW 3y agoVery helpful, thank you.