3 ms·

It would be really funny if Anthropic engs run open weight models locally when they need to fix Claude API issues :)

• throwup238 2mo ago
  Or just their own models locally, since 8x GPU pods fit under a desk (makes a nice foot heater too)
  • jaggederest 2mo ago
    It's been a while since I messed with serious hardware, what's the cooling noise level? I guess they have to be water cooled or the rack format 8u ones would be about 100db
    • 27183 2mo ago
      My 4x 15k rpm 1U fans I use to cool my twin AMD V620s make a horrible racket, especially how they resonate with the rest of the workstation's case fans. Similar in volume and annoyance to running an 8" circular saw. I can only imagine it would probably be as bad or worse than that.
      • jaggederest 2mo ago
        Yeah my experience in the past was that datacenter hardware (air cooled, at least, I've never dealt with water cooled) uses tiny fans at or about 15000RPM, so it matches basically what you're saying or worse. I always loved this video: https://www.youtube.com/watch?v=tDacjrSCeq4 https://www.youtube.com/watch?v=tDacjrSCeq4
        • 27183 2mo ago
          That was one of those fantastic early google videos/youtube things I probably watched 100 times. This was another from (roughly) that era: https://www.youtube.com/watch?v=ULSA5wktywI https://www.youtube.com/watch?v=ULSA5wktywI