3 ms·
Datacenter hardware can batch at large scale, probably over 90% more energy efficient per token than a MacBook.
by petu 2mo ago
Datacenter hardware can batch at large scale, probably over 90% more energy efficient per token than a MacBook.
loading thread…