3 ms·
He's not wrong. Just like AAA game developers aren't releasing free games and $100b studios aren't releasing free movies. Developer tools all being open-source
by armchairhacker 4y ago
He's not wrong. Just like AAA game developers aren't releasing free games and $100b studios aren't releasing free movies. Developer tools all being open-source software is the exception not the rule.
And the reason developer tools are all open-source is because for many of them, if you don't open-source some other talented group will just develop and release their own version. There are many individuals - individuals - who in <1 year can make a half-decent IDE or version control or programming language or network utility etc. And yeah it won't be as good as IntelliJ or Git, but give it a few years and hundreds of contributors and it will be - look at Emacs, Git, Linux, Rust, SerenityOS, etc.
But an individual cannot train an AI that costs $1b+ and huge amounts of training data unless they're a billionaire. And until that changes, its only natural that those who can will keep at least some of the resulting model to themselves. My hope is that:
- A very large group of developers unite in LAION or possibly a different org. Unfortunately idk how effective this will be as $1b is more than many people's lifetime income.
- A nation's people vote their government to develop and release fully open AI. That would be amazing, and I'm sure a government has the resources, but I see an entire population cooperating on this as less likely than a very large but not necessarily majority group getting enough resources themselves.
- Something like Stable Diffusion, which makes individuals developing powerful AI possible. That's possibly the most likely scenario, but given how much information and compute these AI need to be "powerful", idk how feasible this is. Even SD needs a smaller corporation to release the weights
- TechBro8615 4y agoIt's not hard to imagine some decentralized GPU network akin to seti@home that could enable a community to train models on the scale of a big corporation, without any individual member of the community being a billionaire. Also, keep in mind it's in the best interest of the big companies to exaggerate the cost of the systems they use to train their models.
- pk-protect-ai 4y agoBLOOM petals
- fxtentacle 4y agoThe EU is planning to fund public LLMs. leam.ai
- imtringued 4y ago>Even SD needs a smaller corporation to release the weights There are dozens of models available for stable diffusion.
- GoblinSlayer 4y agoThen you make a small AI that gathers huge amounts of training data and trains another AI.