3 ms·

What if you're doing bulk inference? The efficiency and throughput of bs=1 s=1 is truly abysmal.

• saagarjha 2y ago
  People want to talk to their computer, not service requests for a thousand users.