3 ms·
The most interesting thing I see is the productization of the diloco work done here [1]. If someone can make this scale, then we can say goodbye to expensive ba
by bwfan123 1y ago
The most interesting thing I see is the productization of the diloco work done here [1]. If someone can make this scale, then we can say goodbye to expensive backend networking and mainframe-like AI training machinery.
[1] https://arxiv.org/abs/2311.08105 https://arxiv.org/abs/2311.08105