3 ms·
It is hard for me to compare two black boxes. I agree that ChatGPT looks leaps and bounds better than Bard, but it’s hard for me to tell the power of the core t
by svaha1728 3y ago
It is hard for me to compare two black boxes. I agree that ChatGPT looks leaps and bounds better than Bard, but it’s hard for me to tell the power of the core transformer model ends and the heuristics and secondary models begin.
Knowing what those little components look like, for me, would help me evaluate which model is actually better. Right now it feels to me that the difference between the two comes down to more copyrighted materials in ChatGPT’s training set… and more sophisticated ways to hide that,
but that’s just my hunch.
“That fundamental formula has not really changed much for years,” says Jakub Pachocki, one of GPT-4’s developers. “But it’s still like building a spaceship, where you need to get all these little components right and make sure none of it breaks.”
https://www.technologyreview.com/2023/03/14/1069823/gpt-4-is-bigger-and-better-chatgpt-openai/amp/ https://www.technologyreview.com/2023/03/14/1069823/gpt-4-is...