4 ms·
This is correct, they are subsidized but it's the training cost that costs the most with a majority of people hitting cache for most queries for inference.
by brandensilva 3mo ago
This is correct, they are subsidized but it's the training cost that costs the most with a majority of people hitting cache for most queries for inference.