4 ms·

Hetzner and Scaleway already do instances with GPUs so this kinda already exists

• hkt 1y ago
  In fact, does anybody want to hire a server with me? I suspect it'll work out cheaper than Claude max etc: a server from hetzner starts at £220ish: https://www.hetzner.com/dedicated-rootserver/matrix-gpu/ https://www.hetzner.com/dedicated-rootserver/matrix-gpu/ It might be fun to work out how to share, too. A whole new breed of shell hosting.
  • benterix 1y ago
    I have a couple of non-GPU servers with them and quite a few Heztner Cloud projects, but I never understood their GPU offering. They have just two (small) VRAM sizes and you pay per month, whereas the ones like Runpod have a large selection of whatever you need, and they are cheaper, and you can rent them for a shorter period like two weeks, no setup time. Am I missing something?
    • hoppp 1y ago
      There are use-case for smaller models that fit in 20gb VRAM, like in database sentiment analysis and such.
      • benterix 1y ago
        Sure, my point you can get these cheaper outside of Hetzner, so I don't really understand who are these for.