2 ms·
Is .8 or .9 considered good enough accuracy for something as simple as this?
by topaz0 2y ago
Is .8 or .9 considered good enough accuracy for something as simple as this?
- edublancas 2y agoI'd say how much is good enough highly depends on your use case. For something that still has to be reviewed by a human, I think even .7 is great; if you're planning to automate processes end-to-end, I'd aim for higher than .95
- LunaSea 2y agoWell, when "simply" extracting the core text of an article is a task where most solutions (rule-based, visual, traditional classifiers and LLMs) rarely score above 0.8 in precision on datasets with a variety of websites and / or multilingual pages, I would consider that not too bad.
- moralestapia 2y agoYes, because the prompt is simple as well. Chain of thought or some similar strategies (I hate that they have their own name and like a paper and authors, lol) can help you push that 0.9 to a 0.95-0.99.
- kristianp 2y agoI found that strange. Normally 2 significant digits are used, e.g. 74%