4 ms·
Just got https://github.com/distantmagic/paddler https://github.com/distantmagic/paddler working across 2 machines on windows, for load balancing, This will be
by Jayakumark 2y ago
Just got https://github.com/distantmagic/paddler https://github.com/distantmagic/paddler working across 2 machines on windows, for load balancing, This will be next level and useful for Llama 400B to run across multiple machines. But looks like windows support is not there yet.