3 ms·
Facebook has been building out one of the most powerful GPU clusters on the planet [1] for AI research, since at least 2021. This blog post in Jan of 2022 says
by carlsborg 4y ago
Facebook has been building out one of the most powerful GPU clusters on the planet [1] for AI research, since at least 2021. This blog post in Jan of 2022 says they were already doing NLP research on it "with the aim of one day training models with trillions of parameters.". Their 2017 cluster, had 22,000 NVIDIA V100s.
[1] https://ai.facebook.com/blog/ai-rsc/ https://ai.facebook.com/blog/ai-rsc/
- esotericimpl 4y ago[dead]
- steve_adams_86 4y agoI expect that they aren’t wasting these resources, either. The first useful machine learning models I ever used were from Facebook research. There were other options at the time, but what they created was accessible, fast, and had very usable outputs. I suspect there is still more useful work in the area happening there.
- int_19h 4y agoThe problem is that, given past Facebook/Meta reputation wrt privacy, who would trust their "AI cloud" if they monetize it like Microsoft is doing right now?