3 ms·

I'm scratching my head a bit at this one. I already assume that the models are shifting underneath me. It's very frustrating that most non-developers just thin

by xrd 1y ago

I'm scratching my head a bit at this one. I already assume that the models are shifting underneath me. It's very frustrating that most non-developers just think you can ask an LLM a question and it will respond accurately each time. They are designed to make creative output and even if you dial down the temperature they still can hallucinate. Why not be explicit about the thinking budget instead of aliasing it to a number with a term like ultrathink? It's a cute word, and fun to know is managed on the client side, but isn't it again more imprecision to tools the are already suffering from that?

j_bum 1y ago
> shifting underneath me I love that language. This is something that’s constantly bothered me from the get go. Maybe I’m just wearing a tinfoil hat, but I swear I’ve noticed variations in behavior and performance within models across time. This has been super annoying to me. I always use the chat interfaces (mostly Claude atm), so I guess that just puts me at the whim of which sub-version of model Anthropic is serving for the day. Or again, maybe I’m just hallucinating.