3 ms·
how much speed increase do we get on CPU only configurations? has anyone tested it in such cases?
by ekianjo 3y ago
how much speed increase do we get on CPU only configurations? has anyone tested it in such cases?
- ComputerGuru 3y agoThis architecture is specifically aimed at optimizing GPU use.
- NavinF 3y agoCPU-only is impractical for most use cases and this will only become more true over time as models become larger. The mediocre perf/$ and perf/watt makes it not worth the effort
- hobobaggins 3y agoMight be worth it in a datacenter, especially if it's operating other servers alongside (perhaps I/O bound web serving or something); perf/$ does matter, definitely, but the state of the art is moving quickly (getting faster/more efficient) and optimizing some models for CPU is still relevant IMO.