3 ms·
> the gpt architecture is well known and has had a few independent implementations. We know it's real Wasn't the claim that all the secret sauce was in the mo
by josefx 5y ago
> the gpt architecture is well known and has had a few independent implementations. We know it's real
Wasn't the claim that all the secret sauce was in the model?
Also there are systems with a lab in a box style similar to Theranos they just didn't sell themselves as miracle machines capable of identifying everything from a drop of blood.
> But what you get from the API now is not generated or tweaked by humans.
From what I get from the other answers the API basically returns some random crap unless you fine tune some heat parameter. So it isn't surprising that it returns a different answer with every query. I don't know why this is done but I just hope nobody tries to use a system with random output for anything important without first putting it through a human filter.
- moconnor 5y agoNo, you do not get random crap from the GPT-3 API and you don’t have to tune the heat parameter, defaults are generally fine. You can get a unique formulation each time; this is generally seen as a feature rather than a bug, humans are typically the same (different words, same meaning). The big difference is that you can also get a different meaning / opinion each time - coupled with the human-like language this is disconcerting and unexpected for many people. GPT-3 is more understandable if you think of it as sampling an opinion from the internet rather than a coherent entity with its own opinions.