5 ms·

The moat between OpenAI and projects like this is access to expensive computing resources, an organizational mandate to invest in aforementioned compute, and fi

The moat between OpenAI and projects like this is access to expensive computing resources, an organizational mandate to invest in aforementioned compute, and finally, access to high quality training data. They were first to market so they’re only getting further ahead thanks to the invaluable real world usage data. I don’t think their moat ever had anything to do with innovative architecture. If anything, projects like this will widen the chasm since it’s easier for OpenAI to implement new architecture in their models than it is for an independent researcher to scale their ideas. If projects like this are seeds then the problem is that OpenAI owns all the land.

pffft8888 4y ago
That's a bit defeatest, don't you think? OpenAI is not the end all and be all, and projects like this will only inspire more challengers. OpenAI copying this architecture will delegitimize them as hardcore innovators, whom they're not. I see this is a credible challenge because it most certainly is.
- textninja 4y ago
  I agree, I sounded more defeatist than I intended. No doubt the moat is expansive, but it’s not impossible to cross. At least until the regulators get involved. [I did it again, didn’t I.]
  - d0mine 4y ago
    regulators exists so that big guys won't be worried that small guys will out innovate them. If somebody asks for regulation, they became too big to innovate themselves.
lallysingh 4y ago
I don't think so. OpenAI doesn't do anything but AI. You can't ask GPT to actually do anything for you but generate output. Siri, the crap it is, can actually do things for you. Alexa can do things for you. The real value of this system is as a control interface and OpenAI has nothing to control.
- fnordpiglet 4y ago
  But Microsoft does.
- flangola7 4y ago
  Did you see the plugins announcement?
  - lallysingh 4y ago
    Yeah (after my comment) but the big players will compete instead of doing plug-ins.

pffft8888 4y ago

That's a bit defeatest, don't you think? OpenAI is not the end all and be all, and projects like this will only inspire more challengers. OpenAI copying this architecture will delegitimize them as hardcore innovators, whom they're not. I see this is a credible challenge because it most certainly is.

textninja 4y ago
I agree, I sounded more defeatist than I intended. No doubt the moat is expansive, but it’s not impossible to cross. At least until the regulators get involved. [I did it again, didn’t I.]
- d0mine 4y ago
  regulators exists so that big guys won't be worried that small guys will out innovate them. If somebody asks for regulation, they became too big to innovate themselves.

lallysingh 4y ago

I don't think so. OpenAI doesn't do anything but AI. You can't ask GPT to actually do anything for you but generate output. Siri, the crap it is, can actually do things for you. Alexa can do things for you. The real value of this system is as a control interface and OpenAI has nothing to control.

fnordpiglet 4y ago
But Microsoft does.
flangola7 4y ago
Did you see the plugins announcement?
- lallysingh 4y ago
  Yeah (after my comment) but the big players will compete instead of doing plug-ins.