4 ms·
There are no moats in deep learning, everything changes so fast. They have the next iteration of GPT Sutskever helped to finalize. OpenAI lost it's future unle
by nabla9 2y ago
There are no moats in deep learning, everything changes so fast.
They have the next iteration of GPT Sutskever helped to finalize. OpenAI lost it's future unless they find new same caliber people.
- sk11001 2y ago> They have the next iteration of GPT Sutskever helped to finalize How do you know that they have the next GPT? How do you know what Sutskever contributed? (There was talk that the most valuable contributions came from the less well known researchers not from him)
- criddell 2y agoIsn't access to massive datasets and computation the moat? If you and your very talented friends wanted to build something like GPT-4, could you? It's going to get orders of magnitude less expensive, but for now, the capital requirements feel like a pretty deep moat.
- Gud 2y agoHow do you know massive datasets are required? Just because that’s how current LLMs operate, doesn’t mean it’s necessarily the only solution.
- datameta 2y agoThen the resources needed to discover an alternative to brute-forcing a large model are a huge barrier. I think academia and startups are currently better suited to optimize tinyml and edge ai hardware/compilers/frameworks etc.