4 ms·
Its not even been 2 years, and you think things are coming to a halt?
by farseer 2y ago
Its not even been 2 years, and you think things are coming to a halt?
- simianparrot 2y agoI know for a fact they are because rate _and_ quality of improvement is diminishing exponentially. I keep a close eye on this field as part of my job.
- 0points 2y agoYes. The models require training data and they already been fed the internet. More and more of the content generated since is LLM generated and useless as training data. The models get worse, not better by being fed their own output, and right now they are out of training data. This is why Reddit just went profitable, AI companies buy their text to train their models because it is at least somewhat human written. Of course, even reddit is crawling with LLM generated text, so yes. It is coming to a halt.
- CaptainFever 2y agoData is not the only factor. Architecture improvements, data filtering etc. matter too.