4 ms·

Don't these public clusters exist today, and have been around for decades at this point, with varying architectures? In the sense that you submit a proposal, it

Don't these public clusters exist today, and have been around for decades at this point, with varying architectures? In the sense that you submit a proposal, it gets approved, and then you get access for your research?

JumpCrisscross 2y ago
Not--to my knowledge--for the GPUs necessary to train cutting-edge LLMs.
- Maxious 2y ago
  All of the major cloud providers offer grants for public research https://www.amazon.science/research-awards https://www.amazon.science/research-awards https://edu.google.com/intl/ALL_us/programs/credits/research https://edu.google.com/intl/ALL_us/programs/credits/research https://www.microsoft.com/en-us/azure-academic-research/ https://www.microsoft.com/en-us/azure-academic-research/ NVIDIA offers discounts https://developer.nvidia.com/education-pricing https://developer.nvidia.com/education-pricing eg. for Australia, the National Computing Infrastructure allows researchers to reserve time on: - 160 nodes each containing four Nvidia V100 GPUs and two 24-core Intel Xeon Scalable 'Cascade Lake' processors. - 2 nodes of the NVIDIA DGX A100 system, with 8 A100 GPUs per node. https://nci.org.au/our-systems/hpc-systems https://nci.org.au/our-systems/hpc-systems
NewJazz 2y ago
This is the most recent iteration of a national platform. They have tons of GPUs (and CPUs, and flash storage) hooked up as a Kubernetes cluster, available for teaching and research. https://nationalresearchplatform.org/ https://nationalresearchplatform.org/
varelse 2y ago
[dead]