3 ms·
I speculate LLMs providers are serving smallers models dynamically to follow usage spikes, and need for computes to train new models. I did observed that mode
by Kuinox 9mo ago
I speculate LLMs providers are serving smallers models dynamically to follow usage spikes, and need for computes to train new models.
I did observed that models agents are becoming worse over time, especially before a new model is released.
- Cthulhu_ 9mo agoProbably a big factor, the biggest challenges AI companies have now is value vs cost vs revenue. There will be a big correction and many smaller parties collapsing or being subsumed as investor money dries out.
- Kuinox 9mo agoI think it's more a problem of GPU capacity than costs. Training takes a lot of resources, inference too.
- deleted 9mo ago[deleted]
- Workaccount2 9mo agoInternally everyone is compute constrained. No one will convince me that the models getting dumb, or especially them getting lazy, isn't because the servers are currently being inundated. However right now it looks like we will move to training specific hardware and inference specific hardware, which hopefully relives some of that tension.