2 ms·
Good for you. Do you know how to optimize the MTU of an Infiniband interconnect? Do you understand how to schedule multiple models being trained concurrently?
by alephnerd 2y ago
Good for you.
Do you know how to optimize the MTU of an Infiniband interconnect? Do you understand how to schedule multiple models being trained concurrently? Do you know why you cannot directly leverage bare metal compute within a Docker image?
This is important Infra knowledge you need to take full advantage of any model you are training on your own hardware. And this is why Deepseek was successful - they understood the ins-and-outs of systems programming and the H800 architecture to maximize the compute performance they needed to train their model.
- beardedwizard 2y agoWhat about Linux namespaces makes you think it's not running on bare metal? Maybe you are thinking of versions of docker that introduce a Linux hyper visor like macos?
- alephnerd 2y ago> What about Linux namespaces makes you think it's not running on bare metal Nothing! That's my point! I've met a number of "MLEs" who couldn't push back like that with my very basic "fizzbuzz" question