3 ms·
Has any enterprising hacker here yet graphed price vs "output" over time since 2023, taking "quality" into account? That's got to be a very tricky analysis giv
by i_think_so 5mo ago
Has any enterprising hacker here yet graphed price vs "output" over time since 2023, taking "quality" into account?
That's got to be a very tricky analysis given how subjective quality is. But I'm sure there are people trying to pin it down.
- helloplanets 5mo agoQuality would be performance against different given benchmarks, I assume? There's multiple open weight models you can run on a pretty standard computer at home, which match the quality of GPT 4. I guess that would also change the equation.
- coalhouse 5mo agoanything that compares proprietary models will be very miscalibrated and may not be indicative, there have been too many model changes in both chat and the api where model providers did not even say the word before it got too noticable
- lukewarm707 5mo agoartificial analysis has an intelligence benchmark