3 ms·
Interesting discussion! While I agree with Zuckerberg's vision, the comments raise valid concerns. The point about GPU accessibility and cost is crucial. Public
by msnkarthik 2y ago
Interesting discussion! While I agree with Zuckerberg's vision, the comments raise valid concerns.
The point about GPU accessibility and cost is crucial. Public clusters are great, but sustainable funding and equitable access are essential to avoid exacerbating existing inequalities.
I also resonate with the call for CUDA alternatives. Breaking the dependence on proprietary technology is key for a truly open AI ecosystem.
While existing research clusters offer some access, their scope and resources often pale in comparison to what companies like Meta are proposing.
We need a multi-pronged approach: open-sourcing models AND investing in accessible infrastructure, diverse hardware options, and sustainable funding models for a truly democratic AI future.
- fnordpiglet 2y agoI suspect we are still early in the optimization evolution. The weights are what matter. The ability to run them anywhere might come.
- troupo 2y agoThe training datasets and methodology are what matters. None of that is disclosed by anyone
- narrator 2y ago3nm chip fabs take years to build. You don't just go to AWS and spin one up. This is the very hard part about AI that breaks a lot of the usual tech assumptions. We have entered a world where suddenly there isn't enough compute, because it's just too damn hard to build capacity and that's different from the past 40 years.