3 ms·

Thank you for the breakdown. Bit of an emotional journey. "$500 in the future...? Oh, $30 million now, so that might be a while..."

• jamalaramala 2y ago
  It took 30 years for computers go from entire rooms to desktops, and another 30 years to go from desktops to our pockets. I don't know if we can extrapolate, but I can imagine AI inference on our desktops for $500 in a few years...
  • stefs 2y ago
    well, we can AI inference on our desktops for $500 today, just with smaller models and far slower.
    • ryao 2y ago
      There is no need to use smaller models. You can run the biggest models such as llama 3.1 405B on a fairly low end desktop today: https://github.com/lyogavin/airllm https://github.com/lyogavin/airllm However, it will be far slower as you said.
  • deleted 2y ago
    [deleted]