4 ms·

If you recall how it was just 4 years back. Since then more progress in AI than in previous 40. Which in turn better than prev 400. It's accelerating and unstop

• johnnyanmac 2y ago
  Idk if I'd call it "progress" at this point. There were a few big steps and then companies poured billions to shove it in our face. And from what I hear we hit a plateau with current approaches. I don't think AI is really following Moore's law here.
  • MoonGhost 2y ago
    > I hear we hit a plateau with current approaches Then we need new. The important last year step was distillation as mainstream. In my opinion. Now using old models to train new is normal or even necessary. That was done before, but it was sort of experimental. Creating targeted datasets is a very powerful thing. Now big models can be trained on quality data instead of internet random mix. This includes long thinking and tools use examples from the beginning and not as fine tuning. Another way of thinking is AI is steadily getting close to human level IQ. Not approximating, it will cross the line. This distance had reduced dramatically in last few years. Then it's singularity that everybody was talking about for so long. This year we already have google's robotic multimodal. It's closed, but likely will be reproduced. Significant step toward useful generic robots.
    • johnnyanmac 2y ago
      We do. But we're not in an innovation environment anymore. It's pump and churn what we're currently doing and hope we brute force "intelligence". Ironic situation. There's lots of promises out there but not much action nor real world appeal to this stuff. That's pretty much textbook gifting as of now.