4 ms·
Yes, running LLMs.
by HachiWari8 2y ago
Yes, running LLMs.
- enragedcacti 2y agoI know that higher bandwidth is good for LLMs but are there actual workstation use cases where the speed outweighs the context and parameter limits imposed by 16GB of total system ram? I don't follow it that closely but it just feels to me like quality >>> quantity for laptops or mini PCs where an APU would be relevant.