5 ms·

Also would possibly instantly void the value of trillions of pending AI datacenter capex GPU compute is not just for text inferencing. The video generation dem

• mirekrusin 1y ago
  It doesn't matter how much compute you have, you'll always be able to saturate it one way or another with ai and having more compute will forever be an advantage. If breakthrough in ai happens you'll get multiplied benefits, not loss.
  • ivape 1y ago
    The “AI is hype” can’t seem to wrap this idea around their little heads for some reason.
    • ithkuil 1y ago
      Jevons paradox https://en.wikipedia.org/wiki/Jevons_paradox https://en.wikipedia.org/wiki/Jevons_paradox
  • hansvm 1y ago
    That does depend on GPUs being more efficient than CPUs for those breakthroughs.
    • disgruntledphd2 1y ago
      For matrix multiplication that's probably true though.
      • hansvm 1y ago
        That depends on how fine-grained the matrix multiplication is (and if that's actually the core workload). Past a certain scale you can't get away with brute force (and Moore's law doesn't fix that insofar as orders of magnitude of difference will exist no matter where you are in that progression, allowing for qualitatively different capabilities between better algorithms and worse) examining every parameter every time, which could push the world to something where the branchy nature of CPUs and their better amenability to true random-access memory makes them win out.