Great summary of highlights. Don't agree with all, but I think it's a very sound attempt at a year in review summary >LLM prices crashed This one has me a lit

Great summary of highlights. Don't agree with all, but I think it's a very sound attempt at a year in review summary >LLM prices crashed This one has me a little spooked. The white knight on this front (DS) has both announced increases and has had staff poached. There is still Gemini free tier which is ofc basically impossible to beat (solid & functionally unlimited/free) but it's google so reluctant to trust. Seriously worried about seeing a regression on pricing in first half of 2025. Especially with the OAI $200 price anchoring. >“Agents” still haven’t really happened yet Think that's largely because it's a poorly defined concept and true "agent" implies some sort of pseudo-agi autonomy. This is a definition/expectation issue rather than technical in my mind >LLMs somehow got even harder to use I don't think that's 100%. An explosion of options is not equal to harder to use. And the guidance for noobs is still pretty much same as always (llama.cp or one of the common frontends like text-generation-webui). It's become harder to tell what is good, but not to get going. ---- One key theme I think is missing is just how hard it has become to tell what is "good" for the average user. There is so much benchmark shenanigans going on that it's just impossible to tell. I'm literally at the "I'm just going to build my own testing framework" stage. Not because I can do better technically (I can't)...but because I can gear it towards things I care about and I can be confident my DIY sample hasn't been gamed.