4 ms·
The average computer is not realistically capable of running LLMs effectively (because VRAM or RAM does not fit the full model).
by alwayslikethis 4y ago
The average computer is not realistically capable of running LLMs effectively (because VRAM or RAM does not fit the full model).
- hanniabu 4y agoYou simply reward based on performance
- whoisjuan 4y ago“Run large language models like BLOOM-176B collaboratively — you load a small part of the model, then team up with people serving the other parts to run inference or fine-tuning.” According to this excerpt, a node in the network doesn’t need load the entire model. Only a part.