3 ms·
https://aihorde.net https://aihorde.net is something like an open-source load balancer with queuing for LLMs, too
by amiantos 2y ago
https://aihorde.net https://aihorde.net is something like an open-source load balancer with queuing for LLMs, too