4 ms·
Am I missing something here ? At the end of the day, aren't ChatGPT, AlphaCode, etc still just finetuned LLMs, or has there been some significant changes to th
by HarHarVeryFunny 4y ago
Am I missing something here ?
At the end of the day, aren't ChatGPT, AlphaCode, etc still just finetuned LLMs, or has there been some significant changes to the architecture that give reason to expect the output to be anything more intelligent than LLM "predict next word" continuations ?
Of course GPT, Codex/Copilot, ChatGPT are all impressive, and have some unexpected emergent capabilities (this being the interesting thing about this "scale experiment"), but even with "think step by step" prompt hacks and finetuning, they're still just LLMs unless something (intelligence!) has been added so they can learn from their mistakes at runtime and test their predictions ("understanding") by interaction with the external world.
So, if these are still just LLMs, then why are people treating them as if their prompt answers might/should actually be correct as opposed to what might be expected from massive training set prediction - i.e. right a lot of the time, but catastrophically wrong a lot of the time too, with no insight as to which is which.
I saw a ChatGPT example the other day where it confidently explained how taking 90% of a number then adding 10% of that would get you back to the original. It sure doesn't appear if there's any intelligence there, even if it seems it's generating "correct" answers enough of the time that people want to ascribe intelligence to it. I'd trust advice from ChatGPT about as much as I'd trust advice from Eliza (a simplistic 1960's ChatBot that also managed to fool some people).
I'm not sure what it says that this type of "contextually correct bullshit" is being productized into things like OpenAI Codex. What next? Use it for medical advice too ? If I want untrustworthy suggestions I'd rather just Google for it where I can at least judge the source, as opposed to ChatGPT where you have no idea whether it's regurgitating stuff from NASA or 4chan.