3 ms·
In the long run, if this approach takes off, I don't see what OpenAI's role will be. They have no moat: all the training data is scraped from elsewhere, the mod
by kibwen 4y ago
In the long run, if this approach takes off, I don't see what OpenAI's role will be. They have no moat: all the training data is scraped from elsewhere, the models run on commodity hardware with ever-decreasing costs, and the output of an AI-powered confident-bullshitter is probabilistic enough that users wouldn't notice the underlying model being swapped out in favor of one developed in-house. Maybe if OpenAI were actually "open" somehow then they could at least argue the moral point of supporting OSS or whatever, but AFAICT the "open" part of their name appears to be merely baldfaced openwashing. I guess they're just hoping for an acquisition?
- frabcus 4y agoMy first guess is the human feedback used for training the Reinforcement Learning from Human Feedback (RLHF) network?
- d_watt 4y agoI feel like you could say the same thing about Twilio, or AWS, or Stripe. I think there's proven to constantly be a huge market for companies that do the dirty work that everyone knows they could do, but don't have the time or expertise to do. If they can stay ahead of the curve on having best in class api-ification of the underlying tech, even if they develop competitors with similar quality, they have the momentum of being the brand name now.