4 ms·
I think there's basically the benchmarks, and then "the benchmarks". The former is, like, actual stuff you can quantify and game. And the latter is the public r
by theahura 1y ago
I think there's basically the benchmarks, and then "the benchmarks". The former is, like, actual stuff you can quantify and game. And the latter is the public response. The former is a leading indicator but it's not always accurate, and the latter is what actually matters. I knew Gemini 2.5 was better than Claude 3.7 based on the Reddit reaction lol
- deleted 1y ago[deleted]
- niuzeta 1y agoJust out of curiosity, what were the reactions like from what you saw? I had the opposite take from Reddit, which proved to be incorrect. So I'm just curious how you read(more correctly than me) the reactions vis-a-vis Reddit.
- duxup 1y agoI keep meaning to try Gemini for coding but honestly they’ve all gotten reasonably good for my use cases that I don’t think I need to try a lot of new ones / new versions.
- triknomeister 1y agoAny industry that cannot depend on artificial benchmarks, and instead has to depends on user benchmarks is a labor intensive industry. If it turns out that LLMs in their current form do depend a lot on manual user benchmarks, then they will always require human workers. Kind of like how AI means actually Indians.