6 ms·

10k+ GPUs for Inference Jobs (waitlist giveaway)

• bobjmiles 4y ago
  Salad just launched a waitlist for their new Inference API running atop distributed infrastructure, 10k's of GPUs available. The network is built from consumer nodes and comes at a fraction the cost of any other provider. - 6x inferences per dollar for Stable Diffusion (3090) - 4x inf/dollar for BERT (CPUs) $1k/$100 in credits available on the waitlist: salad.com/salad-inference-endpoints ----- Salad also has a fully managed container service in beta, accessible at portal.salad.com, but account verification is required to get a container quota >0 (you go through the full setup and then prompted for more info)
• boxerbk 4y ago
  Do you have an easy way to see the cost differential between this and public cloud alternatives?
  • bobjmiles 4y ago
    Only BERT (running on CPU only instances) and Stable Diffusion (on RTX3090) for now :) https://salad.com/salad-cloud/generative-ai https://salad.com/salad-cloud/generative-ai