4 ms·

Or what if local models get good enough to threaten the server based product?

• otabdeveloper4 7mo ago
  They're good enough already. The moat is only a) post-training magic for the elusive UX "vibes" b) stickiness of the Claude UI's. The first part will be eventually (give it a couple years) solved by a LoRA marketplace. The second is not relevant because existing UI's are very sticky already and Claude won't be able to overcome decades of inertia anyways.
  • mock-possum 7mo ago
    That and the price of hardware
• edf13 7mo ago
  That is the biggest threat - and likely where things will end up eventually… it’s when that “eventually” is and what the server based providers can pivot to in that time.
• nosefurhairdo 7mo ago
  Seems unlikely. We're already seeing specialized hardware optimized for LLM performance (taalas, groq, cerebras), and simple economies of scale result in these sorts of products being a better value when rented from a server vs purchased/managed/upgraded for the typical the user. Frontier models will continue to be either exclusively available from servers or significantly more affordable from servers vs local alternatives for the foreseeable future.
• mikkupikku 7mo ago
  This will probably happen unless the industry conspires to roll back the availability of general computation so common people can only own computers with enough power to be glorified thin clients. The way this might look is good hardware never officially being banned, just priced too high for anybody to afford, and produced in small quantities to keep it that way while all production shifts to making massively expensive powerful hardware for corporate buyers.