45 ms·
I’m not complaining. The clusters are great. The non-Slurm H100s are great. The Spark is more fun.
by enum 11mo ago
I’m not complaining. The clusters are great. The non-Slurm H100s are great. The Spark is more fun.
- latchkey 11mo agoWhat makes it more fun?
- enum 11mo agoI think that personal computing is more fun than time-shared computing. :) It's remarkable what can now be done on a whisper-quiet little box. I hope the Strix Halo's will be just as much fun, and they should be, so long as Flash Attention works.
- latchkey 11mo agoHaven't tried to compile it for SH, but did compile it for MI355x and it worked. LONG compile time though ninja sure helped. Fair, thanks for the answer. The bane of my existence... salloc: Granted job allocation 1978 salloc: Waiting for resource configuration
- moondev 11mo agoYou can't attach a monitor to a h100, it has no video out. Even ignoring GPU details spark is an awesome little quiet powerhouse arm64 workstation that is 100% Linux first
- latchkey 11mo agoAt least on our offerings (MI300x), we offer console and even iDrac bios access (bare metal) and it is all running Ubuntu.
- moondev 11mo agoSure what I mean is a physical monitor is more fun than a virtual console. Curious though how you offer idrac to customer, do you have another OOB BMC for the idrac? Or is this internal engineering context
- latchkey 11mo agoI really don't understand the difference. Either way, it is just a window into a computer. ¯\_(ツ)_/¯ We rent bare metal on-demand and our whole business is to be able to offer compute that you probably wouldn't be able to host in your house $, as if you own it yourself. So, we made it so that users can get access into the BMC and modify the box however they want. When they are done, we've automated the reset as well. Fully self-service. $ These boxes are very expensive, weigh 350lbs, sound like a jet engine and consume ~10kW.