3 ms·
yeah boutique providers are dime and dozen they host the models on their own cloud machines and you just look at tokens/sec and price of tokens you'll have to
by yieldcrv 5mo ago
yeah boutique providers are dime and dozen
they host the models on their own cloud machines and you just look at tokens/sec and price of tokens
you'll have to evaluate their APIs independently but that doesn't tend to be the issue