8 ms·
Sorry I don't understand, you're saying the direct providers aren't the canonical source you'd recommend? If I was running these on my own machine or GPU would
by jc4p 4mo ago
Sorry I don't understand, you're saying the direct providers aren't the canonical source you'd recommend?
If I was running these on my own machine or GPU wouldn't the argument then be "Well you didn't use the real providers?"
For the record I started doing this approach because the Kimi team released this which was shocking to me: https://github.com/MoonshotAI/K2-Vendor-Verifier https://github.com/MoonshotAI/K2-Vendor-Verifier
- yieldcrv 4mo agoyeah boutique providers are dime and dozen they host the models on their own cloud machines and you just look at tokens/sec and price of tokens you'll have to evaluate their APIs independently but that doesn't tend to be the issue