4 ms·
A PhD student I recently talked to was complaining how in academia they will never have the resources it takes to train models like GPT. And how now some academ
by karmakurtisaani 4y ago
A PhD student I recently talked to was complaining how in academia they will never have the resources it takes to train models like GPT. And how now some academics are only researching the input/outputs to these LLMs. Seems like it's pretty dire or at least uninspiring to all but very few at the moment.
- tayo42 4y agowhy is that? don't like those academic particle researchers get tons of money to build wild experiments to measure waves or collide particles? unless i get the funding part wrong? are those not academic projects?
- wardedVibe 4y agoUntil the government funding agencies are willing to do "big science" in computer science we're not going to get particle accelerator sized projects. It sort of happened in France, and bloom was the result. https://huggingface.co/bigscience/bloom https://huggingface.co/bigscience/bloom
- pixl97 4y agoThe issue here is speed. If it takes 10 years to get funding on particle physics, generally it doesn't matter "that much" because that part of the science scene moves pretty slowly. If it takes 10 years to build a billion dollar cluster for AI today, what the hell is the AI world going to look like in 10 years anyway? Building a cluster to study AI ethics might be meaningless because a terminator may be pointing its laser rifle at our head by then telling us to be good little human subjects because Microsoft and OpenAI decided to move fast and break things.
- WFHRenaissance 4y agoSo basic science will have to move to the private sector.
- bagels 4y agoThey should join Facebook or Google, get paid a ton, and do research there with the resources they need.