3 ms·
Just to play devils advocate: are we sure humans have demonstrated the ability to go beyond their training data? Like.. are we sure-sure about that?
by boxed 5mo ago
Just to play devils advocate: are we sure humans have demonstrated the ability to go beyond their training data? Like.. are we sure-sure about that?
- 1attice 5mo agoIdk, I mean, Shakespeare never read Shakespeare, so, I mean, unless aliens?
- boxed 5mo agoAI images are all unique and new.
- 1attice 5mo agoNot nearly as new as Shakespeare was when he single handedly reinvented English vocabulary, for example.
- boxed 5mo agoHe accidentally formalized spelling. You can't invent vocabulary when you're writing plays for a mass audience and want the audience to actually understand what is being said. That makes no sense.
- whatshisface 5mo agoI'm not asking for anything close enough to the boundary for questions like that to be difficult. There are some ML systems like AlphaGo that have crossed the line in specific domains. It's just that making self-play and online learning work for huge LLMs is highly non obvious. The idea is simply that the basic idea behind LLMs, that you're distilling the entropy out of the entire available world of text, is antithetical to creativity. Further developing on the theme of self-play, humans have the ability to sense what we want (intellectually) and reach for it communally over thousands of years. It's an innate quality, and if AI starts participating (contrast to giving people psychosis) we will all be able to tell.
- boxed 5mo ago> Further developing on the theme of self-play, humans have the ability to sense what we want (intellectually) and reach for it communally over thousands of years. It's an innate quality, and if AI starts participating (contrast to giving people psychosis) we will all be able to tell. Well.. that's not true is it. There are human cultures that haven't reached for anything for thousands of years even though they clearly saw what western culture was doing and that they were being left behind badly.
- suddenlybananas 5mo agoPlanes, trains, and automobiles are not natural features of the environment.
- boxed 5mo agoAnd all were invented piece by piece. Each human had to have updated training data to be able to handle the next tweak.
- rotis 5mo agoAre you suggesting intelligent design got us here?
- boxed 5mo agoThe exact opposite. Improvements are step by step and small.