3 ms·

Which while expensive is dirt cheap compared to a comparable NVidia or AMD system.

• blharr 9mo ago
  What speed are you getting at that level of hardware though?
• SchemaLoad 9mo ago
  It's still very expensive compared to using the hosted models which are currently massively subsidised. Have to wonder what the fair market price for these hosted models will be after the free money dries up.
  • cactusplant7374 9mo ago
    Inference is profitable. Maybe we hit a limit and we don't need as many expensive training runs in the future.
    • teaearlgraycold 9mo ago
      For sure Claude Code isn’t profitable
      • bdangubic 9mo ago
        Neither was Uber and … and …
        • plagiarist 9mo ago
          Businesses will desire me for my insomnia once Anthropics starts charging congestion pricing.
          • bdangubic 9mo ago
            that is coming for sure to replace the "500" errors
    • paxys 9mo ago
      Inference APIs are probably profitable, but I doubt the $20-$100 monthly plans are.
      • cactusplant7374 9mo ago
        I wouldn’t be so sure. Most users aren’t going to use up their quota every week.
  • whatsupdog 9mo ago
    I wonder if the "distributed AI computing" touted by some of the new crypto projects [0] works and is relatively cheaper. 0. https://www.daifi.ai/ https://www.daifi.ai/