4 ms·
"3. OpenAI gets human-like responses by using the simple technique of... hiring humans to write the responses." It worked for Theranos. Almost. People wanted
by 1vuio0pswjnm7 5y ago
"3. OpenAI gets human-like responses by using the simple technique of... hiring humans to write the responses."
It worked for Theranos. Almost.
People wanted to believe in Elizabeth Holmes and what she symbolised. Similarly, people want to believe in "AI" and what it symbolises. For me, the question is why it seems more than ever people want to believe that longstanding, difficult problems are being solved without demanding proof. Perhaps it has always been this way.
The truth is that Siemens blood analyser works better than the Theranos one. The ruse was that if the results came from Theranos, people might attribute the work to Theranos, not Siemens. Meanwhile, Theranos used the Siemens analyser behind-the-scenes, as well as manipulations of test data to obscure the truth. The company had no intention to tell the public what it was doing to produce results, we only know what they were doing because of litigation and criminal prosecution.
"To be fair, OpenAI does state that "InstructGPT is then further fine-tuned on a dataset labeled by human labelers." But this still seems misleading to me. It's not just that the algorithm is fine-tuned on the dataset. It seems that these freelancers are being hired specifically to rewrite the output."
The comparison is not based on the question of exactly what OpenAI is doing behind-the-scenes, or whether its specific actions are comparable to Theranos or any other "tech" company example, the question is whether the origin of results is misleading, whether people are being deceived and whether the actor, here OpenAI, is aware that people are being deceived.
- deleted 5y ago[deleted]
- mardifoufs 5y agoAre you implying OpenAi is running most of it's API queries through humans? Like theranos did with it's tests? Because that's just ludicrous, the gpt architecture is well known and has had a few independent implementations. We know it's real, and even if this story was accurate, a few humans tuning the model is nothing unusual. But what you get from the API now is not generated or tweaked by humans. That only happens on the training data or when they are testing the model. (Edit: In this case they seem to be hard-coding some answers to prevent abusive/newsworthy outputs but again that is completely irrelevant to the performance of GPT itself. It's just a filter) The comparison to theranos makes no sense and it's becoming a lazy meme at this point.
- josefx 5y ago> the gpt architecture is well known and has had a few independent implementations. We know it's real Wasn't the claim that all the secret sauce was in the model? Also there are systems with a lab in a box style similar to Theranos they just didn't sell themselves as miracle machines capable of identifying everything from a drop of blood. > But what you get from the API now is not generated or tweaked by humans. From what I get from the other answers the API basically returns some random crap unless you fine tune some heat parameter. So it isn't surprising that it returns a different answer with every query. I don't know why this is done but I just hope nobody tries to use a system with random output for anything important without first putting it through a human filter.
- moconnor 5y agoNo, you do not get random crap from the GPT-3 API and you don’t have to tune the heat parameter, defaults are generally fine. You can get a unique formulation each time; this is generally seen as a feature rather than a bug, humans are typically the same (different words, same meaning). The big difference is that you can also get a different meaning / opinion each time - coupled with the human-like language this is disconcerting and unexpected for many people. GPT-3 is more understandable if you think of it as sampling an opinion from the internet rather than a coherent entity with its own opinions.