2 ms·
> Distributing a single model over thousands of tiny GPUs takes months of time from dozens of people with rare expertise. CG-1 eliminates this challenge. Settin
by mydriasis 3y ago
> Distributing a single model over thousands of tiny GPUs takes months of time from dozens of people with rare expertise. CG-1 eliminates this challenge. Setting up a generative AI model takes minutes, not months and can be done by a single person.
That's fascinating. Their website[0] says that their model support is 600 billion parameters. Is that enough, given how rapidly these models seem to be expanding? I'm not on the up-and-up with how vast they need to be.
[0] https://www.condorgalaxy.ai/ https://www.condorgalaxy.ai/
- cs-fan-101 3y ago[Cerebras employee here] Condor Galaxy 1 can support beyond 600 billion parameters. In standard config its 600B but it can scale to train upwards of 100T parameter models
- mydriasis 3y agoWow, that's a lot! Awesome info. Thank you!