3 ms·

Finally or unfortunately? We (customers, hackers) get further and further from owning hardware and running software on our terms.

RajT88 1y ago
In a few years when all these rack servers are outdated for AI workloads, there will be a glut in the market of cheap only-slightly-dated servers. My JellyFin setup in 5 years is going to be fucking awesome.
- ivanjermakov 1y ago
  Same, after getting into homelabbing, "post-lease" became my favorite word.
  - rbanffy 1y ago
    When this bubble bursts, we'll have a lot of number crunching capability being sold for peanuts.
    - bee_rider 1y ago
      Using these tiny floats for classic engineering workloads—if I were starting gradschool right now, that’s definitely what I’d look at. Mixed precision numerical algorithms are already a topic, but with the hardware glut there’ll definitely be room to push things. So it’s in a nice spot where there’s some scaffolding, but it isn’t totally done, and the hardware is probably going to make things possible.
      - rbanffy 1y ago
        > Using these tiny floats for classic engineering workloads I think that's the idea. Back in the stone age, I did that with Apple II floats (40-bits) because I was hitting quantization problems in a Mandelbrot explorer program I wrote. Wrapping my head around it in BASIC was hard. You can only go so far when your abstraction level is that low.
citizenpaul 1y ago
Looks like Jaron Lanier's predictions about servers being the new form of power are coming true. Companies are predictably moving to remove the power from the hands of their chattel. https://en.wikipedia.org/wiki/Who_Owns_the_Future%3F https://en.wikipedia.org/wiki/Who_Owns_the_Future%3F
rbanffy 1y ago
They are still selling desktops, laptops, and ordinary servers (and some quite extraordinary ones). It's just that their AI systems are selling like hot cakes. Which is more or less everyone's AI systems. The appetite for AI training and inference seems to be exploding. My best guess is that it'll be like the dot-com bubble, but this time we'll get cheap Nvidia DGX rack machines being sold by asset recovery services.

RajT88 1y ago

In a few years when all these rack servers are outdated for AI workloads, there will be a glut in the market of cheap only-slightly-dated servers. My JellyFin setup in 5 years is going to be fucking awesome.

ivanjermakov 1y ago
Same, after getting into homelabbing, "post-lease" became my favorite word.
- rbanffy 1y ago
  When this bubble bursts, we'll have a lot of number crunching capability being sold for peanuts.
  - bee_rider 1y ago
    Using these tiny floats for classic engineering workloads—if I were starting gradschool right now, that’s definitely what I’d look at. Mixed precision numerical algorithms are already a topic, but with the hardware glut there’ll definitely be room to push things. So it’s in a nice spot where there’s some scaffolding, but it isn’t totally done, and the hardware is probably going to make things possible.
    - rbanffy 1y ago
      > Using these tiny floats for classic engineering workloads I think that's the idea. Back in the stone age, I did that with Apple II floats (40-bits) because I was hitting quantization problems in a Mandelbrot explorer program I wrote. Wrapping my head around it in BASIC was hard. You can only go so far when your abstraction level is that low.

citizenpaul 1y ago

Looks like Jaron Lanier's predictions about servers being the new form of power are coming true. Companies are predictably moving to remove the power from the hands of their chattel. https://en.wikipedia.org/wiki/Who_Owns_the_Future%3F https://en.wikipedia.org/wiki/Who_Owns_the_Future%3F

rbanffy 1y ago

They are still selling desktops, laptops, and ordinary servers (and some quite extraordinary ones). It's just that their AI systems are selling like hot cakes. Which is more or less everyone's AI systems. The appetite for AI training and inference seems to be exploding. My best guess is that it'll be like the dot-com bubble, but this time we'll get cheap Nvidia DGX rack machines being sold by asset recovery services.