19 ms·
this is a good one, so fun. congrats and good work! what's cost like rn with the lightweight model?
by rgbrgb 1y ago
this is a good one, so fun. congrats and good work!
what's cost like rn with the lightweight model?
- michaelstewart 1y agoThe lightweight model is incredibly cheap. Cost so far today $0.06. It within the same order of magnitude as the per-request cost of the write to cloudflare KV storage (which I'm using to cache the inference result).