3 ms·
The interesting thing here is being able to run llama inference in a distributed fashion across multiple computers.
by rahimnathwani 2y ago
The interesting thing here is being able to run llama inference in a distributed fashion across multiple computers.
- samstave 2y agoWhich begs the question; Where is the equiv of distributed GPU? (Seti@HOME) and just pipe to a tool which is globally ditributed R1 full, but slow... and let it reason in the open on deep and complex tasks