4 ms·
> this is simply not true. and it's very clear if you look at continual learning, robotics, biology, etc. each has enough economic incentives to spend 1000x com
by littlestymaar 7mo ago
> this is simply not true. and it's very clear if you look at continual learning, robotics, biology, etc. each has enough economic incentives to spend 1000x compute if that led to much better results, but we just don't know how to do that
I'm (and so is the post itself) talking about LLMs in particular, and this is indeed true for LLM.
- sdpmas 7mo agocontinual learning is LLMs :) ultimately everything will be/already is data bottlenecked.