3 ms·
Is there a graph somewhere that illustrates it?
by amelius 1y ago
Is there a graph somewhere that illustrates it?
- onlyrealcuzzo 1y agohttps://epoch.ai/data-insights/llm-apis-accuracy-runtime-tradeoff https://epoch.ai/data-insights/llm-apis-accuracy-runtime-tra... It is easier to get from 0% accurate to 99% accurate, than it is to get from 99% accurate to 99.9% accurate. This is like the classic 9s problem in SRE. Each nine is exponentially more difficult. How easy do we really think it will be for an LLM to get 100% accurate at physics, when we don't even know what 100% right is, and it's theoretically possible it's not even physically possible?