3 ms·
$1/hr sounds suspiciously close to a price of one A100 80GB GPU. Maybe an 8x node assuming batching >= 8 users per node.
by tgrowazay 8mo ago
$1/hr sounds suspiciously close to a price of one A100 80GB GPU.
Maybe an 8x node assuming batching >= 8 users per node.