3 ms·
Awaiting the substack post that: - Can't reproduce the issue that this paywalled article links to - Finds that the methodology used to assess "accuracy" isn't
by phillipcarter 3y ago
Awaiting the substack post that:
- Can't reproduce the issue that this paywalled article links to
- Finds that the methodology used to assess "accuracy" isn't actually checking accuracy, but is checking for a specific output, and that output generally does still produce the right value, just in a different format
- Summarizes by saying that ChatGPT is neither the second coming of christ nor horribly inaccurate, just something in between
- NikolaNovak 3y agoIs it pay walled? I don't have any subscription and just came across it semi randomly. I've also linked to the underlying study In a comment if thay helps.
- phillipcarter 3y agoYeah, the article is paywalled unfortunately. Thanks for linking to the study.