4 ms·
Would expect LLM training/inference infra to become commoditized before LLMs do.
by frollogaston 5mo ago
Would expect LLM training/inference infra to become commoditized before LLMs do.
- bigyabai 5mo agoThere are multiple top-tier LLMs on the market right now. The competition is intense and the product differentiation is minuscule in many cases. Claude Code had a half-life of 1 or 2 months before getting sherlocked by the community. We don't really see this type of opportunism in the hardware space. Case in point, the TPU is a pretty big accomplishment that successfully competes for inference and stimulates the need for cheaper compute.