3 ms·
What does the future of open-source large neural nets look like? My understanding is GPT-3 takes ~600GB of GPU memory to run inference. Does an open source mode
by pjfin123 6y ago
What does the future of open-source large neural nets look like? My understanding is GPT-3 takes ~600GB of GPU memory to run inference. Does an open source model just allow you a choice of a handful of cloud providers instead of one?
- aabhay 6y agoOpen source doesn’t mean that everyone will be rolling their own. It means that lots of players will start to offer endpoints with GPT-X, perhaps bundled with other services. It is good for the market.
- stellaathena 6y agoRight, this is why a cloud company is sponsoring the replication. They can’t sell GPT-3 as a service until they get a copy of it.