3 ms·
Things are a bit more subtle and complicated than that. Using the logical conclusion of your mirror claim it does constitute that excessive toxicity can be gene
by godelski 3y ago
Things are a bit more subtle and complicated than that. Using the logical conclusion of your mirror claim it does constitute that excessive toxicity can be generated unintentionally. That this can even happen through simple cultural differences in understanding. As an example to this, many people think Chinese are being rude due to their directness and hashness but this can just simply be because a direct translation of the words is used rather than reframing into the cultural context. So in this respect intent is divorced from the produced effect. It also is reasonable that to study these effects you would wish to start by intentional provocation. Complexity and subtly comes later.
But the more complicated aspect is that of mode collapse. A good example of this is with Alpha Go's game against Lee Sedol. The game that Sedol won was weird. Alpha Go played in a very weird way, and a very bad way. This is due to the probabilistic nature and that it had likely wandered into a latent space that it had not seen before. Remember that it was mostly trained against good games and so can easily get confused in bad games (as Sedol also got confused due to its previous high performance and he thought it was playing some "5-D chess"). This compounds with the above aspect as now there exists a mechanism wherein such toxicity can arise through seemingly unprovoked means. We call these hallucinations btw.
Of course, this does mean there is good reason to study said toxicity. But we shouldn't conflate academic curiosity with theater. Are people uninformed and taking AI risk too far? Most certainty. But the same can be said about the hype of these tools too. Both are clearly detrimental to the progress of AI advancement. In this we probably should be a bit more measured in our quickness to respond and critiques. Tribalism doesn't belong here but people will encourage it.
- Loquebantur 3y agoThe danger of Ai doesn't stem from it being possibly exceptionally toxic or anything. The point is, LLMs are already in their present state convincing enough chatbots to fool a majority into believing them to be real people. If you can take enough of them to task on social media, you can influence public discourse. The slow boil cooks the frog. Having no place for free constructive open discussion, society is bound to not only stagnate but retardate. Parcellation into echo chambers only exacerbates the problem.
- red-iron-pine 3y ago> The danger of Ai doesn't stem from it being possibly exceptionally toxic or anything. The point is, LLMs are already in their present state convincing enough chatbots to fool a majority into believing them to be real people. I'd bet my hat that a non-trivial number of posts here on HN are, and have been, generated via GPT-3, and before ChatGPT became big. There are definite signs of astroturfing, and you can almost predict which threads are going to have it -- China, Tesla, some BTC discussions. They don't even need to be convincing, just present and in enough volume to drag down or derail discussions; "The Firehose of Falsehood" model.