4 ms·
This model is breaking records on my benchmark of choice, which is 'the fraction of Hacker News comments that are positive.' Even people who avoid Google produc
by qnleigh 10mo ago
This model is breaking records on my benchmark of choice, which is 'the fraction of Hacker News comments that are positive.' Even people who avoid Google products on principle are impressed. Hardly anyone is arguing that ChatGPT is better in any respect (except brand recognition).
- ipsum2 10mo agoChatgpt 5.2 thinking is significantly better quality for most knowledge work, but it trades off in speed.
- Palmik 10mo agoNo offense, but that seems like a poor benchmark. These initial vibe checks are easily swayed by personal brand biases.
- awestroke 10mo agoThe brand bias is heavily against Google, not in Googles favor
- Palmik 10mo agoIn context of AI I'm mostly seeing anti-OpenAI pro-Google bias.
- clarkmoreno 10mo agoFacts. These HN threads are half astroturfing and paid shills. Near impossible to decifer authentic takes that are not actual colleagues or people IRL
- qnleigh 10mo agoFair. No benchmark is perfect. I do pay special attention to what the most negative comments say (which in this case are unusually positive). And people discussing performance on their own personal benchmarks.
- Simon321 10mo agoi don't know, chat gpt seems to hallucinate a lot less