4 ms·
Datacenter GPUs have >1000gbps network connections between nodes, which is necessary to actually utilize GPUs with current training techniques. It's possible th
by why_only_15 4y ago
Datacenter GPUs have >1000gbps network connections between nodes, which is necessary to actually utilize GPUs with current training techniques. It's possible that a furthering of techniques used in GPT-JT[1] might make it feasible to use home computers, but even GPT-JT requires at least a 1gbps connection.
[1]: https://www.together.xyz/blog/releasing-v1-of-gpt-jt-powered-by-open-source-ai https://www.together.xyz/blog/releasing-v1-of-gpt-jt-powered...
- peterleiser 4y agoGood point. One criterion for whether a SETI@home approach is reasonable for a class of problems is if the total processing time exceeds the network download and upload time. In SETI@home classic the work units didn't take too much time to download compared to how long it took to process a work unit.