3 ms·
This interview covers a few different topics, like detecting flaws in the Venezuelan elections, to dangerous applications of AI, to monopolistic control of AI (
by blackeyeblitzar 2y ago
This interview covers a few different topics, like detecting flaws in the Venezuelan elections, to dangerous applications of AI, to monopolistic control of AI (towards the end of the interview).
Monopolistic control is clearly a problem, and all the barriers (money for GPUs, regulations that pull up the ladder, hoarding of user data, ability for big companies to copy smaller ones, etc) make this AI transition problematic unless we also come up with new easy to enforce antitrust regulations.
But I think an even bigger issue is that these monopolists are all closed source. Open source in AI means we should be able to reproduce their exact model. Everything from training data to censorship filters needs to be transparent. Otherwise we really have no idea how we might be getting manipulated through these systems, whether by the company providing the models or those who can regulate or pressure or otherwise control those companies.
- koolala 2y ago>Open source in AI means we should be able to reproduce their exact model. like: Use this specific RNG seed and train for 10 trillion cycles in this data to get X duplicate model?
- solveit 2y agoPracticality of reproducing training runs that cost tens of millions aside, it's hopeless. Determinism is hard enough with a single GPU, fixing a seed isn't going to be much help when training is distributed across hundreds of GPUs.