3 ms·
The majority of inference actually does happen in cpu.
by halJordan 15d ago
The majority of inference actually does happen in cpu.
- why_only_15 12d agoThis is just wrong unless you're using some confusing definition. Notice that companies trying to do lots of inference aren't looking for CPUs, they're looking for GPUs/TPUs.