4 ms·
Congrats to the team on the launch! Personal story time: I met a couple of their engineers at an event a few months back. They mentioned they were building a d
by jumploops 1y ago
Congrats to the team on the launch!
Personal story time: I met a couple of their engineers at an event a few months back. They mentioned they were building a distributed training system for LLMs.
I asked them how they were building it and they mentioned Python. I said something along the lines of “not to be the typical internet commenter guy, but why aren’t you using something like Rust for the distributed system parts?”
They mumbled something about Python as the base for all current LLMs, and then kinda just walked away…
From their article:
> “Rust-based orchestrator and discovery service coordinate permissionless workers”
Glad to see that I wasn’t entirely off-base :)
- deleted 1y ago[deleted]
- Havoc 1y agoGiven the latencies at play python did probably make more sense though
- bwfan123 1y agoThe technical underpinning has nothing to do with the language. It is a different way of optimizing parameters called diloco. I agree though that python is an abomination for systems services componentry when there are languages like rust.