2 ms·
https://epoch.ai/data-insights/llm-apis-accuracy-runtime-tradeoff https://epoch.ai/data-insights/llm-apis-accuracy-runtime-tra... It is easier to get from 0% a
by onlyrealcuzzo 1y ago
https://epoch.ai/data-insights/llm-apis-accuracy-runtime-tradeoff https://epoch.ai/data-insights/llm-apis-accuracy-runtime-tra...
It is easier to get from 0% accurate to 99% accurate, than it is to get from 99% accurate to 99.9% accurate.
This is like the classic 9s problem in SRE. Each nine is exponentially more difficult.
How easy do we really think it will be for an LLM to get 100% accurate at physics, when we don't even know what 100% right is, and it's theoretically possible it's not even physically possible?