3 ms·
It's mostly R&D though, not inference. If LLM's effectively become a commodity then they are screwed anyway.
by pqtyw 4mo ago
It's mostly R&D though, not inference. If LLM's effectively become a commodity then they are screwed anyway.
- swiftcoder 4mo agoAren’t the Chinese labs quickly turning them into a commodity? The open-weight models will have a steady race to the bottom on inference costs just by dint of competition between providers. They aren’t at the frontier yet, but they are rapidly eating the flash market.