2 ms·
LLMs are already slow on one machine. Now you are going to add network calls to it?
by esafak 2mo ago
LLMs are already slow on one machine. Now you are going to add network calls to it?
- vforno 2mo agoActually, no, in this case it would be possible that if other peers in the network give up processing or space you would have a speed that you wouldn't have as a single computer.