2 ms·
With that model you need to ensure wrappers won't send requests with tons of tokens as you will be the one who ends up paying for gpu bandwidth... Meaning your
by jcq3 4y ago
With that model you need to ensure wrappers won't send requests with tons of tokens as you will be the one who ends up paying for gpu bandwidth... Meaning your spending is based on usage