3 ms·
I am not sure who is the intended customer for this service. The prompt and the model go hand in hand. If you randomly select the model the likelihood of getti
by _pdp_ 11mo ago
I am not sure who is the intended customer for this service.
The prompt and the model go hand in hand. If you randomly select the model the likelihood of getting something consistent is basically zero.
Also model pricing don't very that much. I have never heard of spot-instance equivalent for inference although that will be cool. The demand for GPU is so high right now that I think most datacenters are at 100% utilisation.
Btw landing page does not bring much confidence this is serious. Might want to change it to communicate better and also to be attractive to "developers" I guess.
- askvictor 11mo ago> Also model pricing don't very that much. I'm curious when AI pricing will couple with energy markets. Then the location of the datacentre will matter considerably
- franga2000 11mo agoDepends on what you're doing. Something like "read this text and extract all the phone numbers" or "write a 3-point summary of this email" will perform about the same on all good models.
- pants2 11mo agoThe equivalent of "Spot Instance" is basically the OpenAI Batch API
- h2o_wine 11mo agoIt's a tool not an SEO branded, shiny website. It's a utility. & model pricing varies considerably for now. This tool will be useless in another year or two.