3 ms·
> The direction of travel is very clear And if we get 9 women we can produce a baby in a single month. There's no guarantee such progression will continue. In
by philipwhiuk 2y ago
> The direction of travel is very clear
And if we get 9 women we can produce a baby in a single month.
There's no guarantee such progression will continue. Indeed, there's much more evidence it is coming to a a halt.
- farseer 2y agoIts not even been 2 years, and you think things are coming to a halt?
- simianparrot 2y agoI know for a fact they are because rate _and_ quality of improvement is diminishing exponentially. I keep a close eye on this field as part of my job.
- 0points 2y agoYes. The models require training data and they already been fed the internet. More and more of the content generated since is LLM generated and useless as training data. The models get worse, not better by being fed their own output, and right now they are out of training data. This is why Reddit just went profitable, AI companies buy their text to train their models because it is at least somewhat human written. Of course, even reddit is crawling with LLM generated text, so yes. It is coming to a halt.
- CaptainFever 2y agoData is not the only factor. Architecture improvements, data filtering etc. matter too.
- Towaway69 2y agoIt might also be an example of 80/20 - we're just entering the 20% of features that take 80% of the time & effort. It might be possible but will shareholders/investors foot the bill for the 80% that they still have to pay.