6 ms·
The data centers are for inference time serving, and as long as the GPUs go better, it shouldn't really matter. Token prices should go down 10-100x over the com
by verdverm 2mo ago
The data centers are for inference time serving, and as long as the GPUs go better, it shouldn't really matter. Token prices should go down 10-100x over the coming years, and then we will use more, because they have more capacity for the same hardware