3 ms·
Guys all of this happened within a couple months. If you guys are confident about the entity as it is right now not taking over your job, what if I double the
by HervalFreire 4y ago
Guys all of this happened within a couple months.
If you guys are confident about the entity as it is right now not taking over your job, what if I double the accuracy of gpt output?
What if I double it again? Then again? And again? And again?
You guys realize this is what's coming right? This thing literally is a baby as of now.
- deelly 4y agoIs it true that GPT4 failure rate is .5 of GPT3?
- HervalFreire 4y agoI mean this is impossible to measure right? You'd have to compare all possible outputs of GPT3 with all possible outputs of GPT4. You can get away with a random sample. But there's a lot of bias in that sample and it's hard to control it. Out of the infinite possibilities there definitely exists sets of inputs and outputs where both GPT3 and GPT4 are always wrong. On the other side of the coin there are also sets where GPT4 is always right and GPT3 is always wrong and vice versa. Given that there's no methodology to control what is "random" in these sets it's hard to come up with a good metric. So the 0.5 thing is a bit of anecdotal number from the gut.