3 ms·

How long do we think this "big company gates access to an impressive AI model" moment will last? I wonder if generative models will become such a commodity tha

• layer8 4y ago
  There will be moats around training data (Adobe probably has huge amounts of high-quality training data that isn’t available to the public), and around fine-tuning for specific fields. The more specialized the application, the less of a commodity it will be. And it remains to be seen how long it will take until there is an open-source model on the level of GPT-4. It may be harder than many expect, and the commercial offerings may be on yet another level by then.
  • Someone1234 4y ago
    Exactly, and the moats largely boil down to: "Why is there no Open Source replacing for Google Search?" Big AI's advantage is still being made. Every time a user hits "Feedback" they're fine-tuning this proprietary model. You can absolutely make an Open Source model with enough compute, but if it is only e.g. "95%" good relative to the paid one at "97%" or "98%" are you going to prioritize it? How many of you use Google because it is 2% better than Bing for example?
    • turnsout 4y ago
      If it's 95% as good and it can be rolled into every product at basically zero cost, then yeah, the paid version will die. There are plenty of proprietary technologies that are better than say Postgres, or JPEG, or JSON. And some businesses need that marginal edge. But if the open source option is free, standardized, has great tooling, and is 95% as good, that's a real problem for OpenAI and their peers.