4 ms·

OK that sounds lovely. We are but a poor startup, but I am hoping we can afford to reach out to y'all soon. Maybe even share workflows/stuff that works for us.

OK that sounds lovely. We are but a poor startup, but I am hoping we can afford to reach out to y'all soon. Maybe even share workflows/stuff that works for us. If some ML (unsloth? lorax? sglang?) work on a Mi300 with a little tinkering, that would be spectacular.

latchkey 3y ago
Thanks! Again, partnerships over customers. If you're experienced and have the technical chops to make a MI300x sing, we want to work with you. Our model is that we are the capex/opex investor for businesses. As much as I love software, Hot Aisle is more of a hardware business. Running super high end large scale compute is an extreme challenge in itself. We are less interested in building the software side of things and want to foster those who can focus on that side. https://github.com/unslothai/unsloth/issues/160 https://github.com/unslothai/unsloth/issues/160 https://github.com/search?q=repo%3Apredibase%2Florax+rocm&type=code https://github.com/search?q=repo%3Apredibase%2Florax+rocm&ty... https://github.com/sgl-project/sglang/issues/157 https://github.com/sgl-project/sglang/issues/157 https://github.com/casper-hansen/AutoAWQ https://github.com/casper-hansen/AutoAWQ (supports rocm)