2 ms·
> Once you have everything trained (you might need a GPU or a cluster of GPUs to train it for several days/weeks/months), you can use it. It takes a whole team
by visarga 5y ago
> Once you have everything trained (you might need a GPU or a cluster of GPUs to train it for several days/weeks/months), you can use it.
It takes a whole team to replicate an advanced model. Take a look at our open source working groups: Eleuther, LAION, BigScience. They worked for months for one release and burned millions of dollars on GPU (gracefully donated by well meaning sponsors).
https://www.eleuther.ai/ https://www.eleuther.ai/
https://laion.ai/ https://laion.ai/
The BigScience group is massive:
https://bigscience.notion.site/10743770aae24ff3bdc1b938cf454bb8?v=92f51ef4650c4fc085cda88e23c8ebbb https://bigscience.notion.site/10743770aae24ff3bdc1b938cf454...
- shepardrtc 5y agoI didn't even know anything like those groups existed. That's very helpful. Thank you!