2 ms·
There were bigger models than ChatGPT 3.5 before it was released and they didn't perform better. In fact, the hype isn't built around large parameters but in fa
by imtringued 4y ago
There were bigger models than ChatGPT 3.5 before it was released and they didn't perform better. In fact, the hype isn't built around large parameters but in fact on an interactive LLM architecture. ChatGPT and GPT do very different things but it is ChatGPT that gets the hype despite essentially having the same parameter count.
The parameter count thing appeals to people believing in linear scaling per parameter.
- EGreg 4y agoWhat do you mean by interactive LLM architecture?
- stormfather 4y agoI assume they mean trained on human feedback to understand human intent and answer questions, and then glued to a front end that lets us chat with it.