4 ms·
They can be connected to share ram and processing. Depending on the use case for known processes the LLM requirements are much, much, simpler and lower to make
by j45 1mo ago
They can be connected to share ram and processing.
Depending on the use case for known processes the LLM requirements are much, much, simpler and lower to make and keep it more predictable.
- AbsurdCensor 1mo agoI really haven't seen any 16gb Mac Mini cluster setups running large models at any appreciable speed for the reasons previously provided. Do you happen to have examples that folks are actually using?