30 ms·
> 40k in consumer hardware is never going to compete with 40k of AI specialized GPUs/servers. For general purpose LLM probably yes. For something very domain-s
by menaerus 10mo ago
> 40k in consumer hardware is never going to compete with 40k of AI specialized GPUs/servers.
For general purpose LLM probably yes. For something very domain-specialized not necessarily.