3 ms·
Yeah getting around the no public cloud thing was really annoying. We had to build our own datacenter. On the plus side, it was drastically cheaper and now we
by gdiamos 3y ago
Yeah getting around the no public cloud thing was really annoying. We had to build our own datacenter.
On the plus side, it was drastically cheaper and now we can just slot in machines.
I would prefer that a tier 1 cloud made MI GPUs available though. It would make it so much more accessible.
- bitcoinmoney 3y agoAre you releasing your software stack to the public?
- gdiamos 3y agoIt's available now with an enterprise license, because we validate that it is running correctly on a system we help configure. We will open source pieces of it over time. Our strategy is open source functional core. Eventually we will have an open source dev environment that runs on a personal scale computer. We already have this for some configurations, but we don't do enough testing to ensure perf/functionality on many different systems. We are mainly bottlenecked by resources as a 12-person startup. We have released some open source SDKs here: https://github.com/orgs/lamini-ai https://github.com/orgs/lamini-ai This class has some training recipe code: https://www.deeplearning.ai/short-courses/finetuning-large-language-models/ https://www.deeplearning.ai/short-courses/finetuning-large-l... One thing I'd like to push back to open source is the scale out AMD SLURM support.