2 ms·
This pops up every few years and I always leave frustrated by a lot of the discussion around it. Tay had a feature where it would repeat things that were tweete
by Mockapapella 4y ago
This pops up every few years and I always leave frustrated by a lot of the discussion around it. Tay had a feature where it would repeat things that were tweeted at it/sent in a DM (can't remember which, but that feature was 100% present), 4chan users caught whiff of this, and if I remember correctly that is where a lot of the overt "holocaust-denying racist" comments came from.
Another piece of information that I've never been able to find out about Tay is how was it constructed. Nearly all progress in AI since that point has occurred with a frozen model. Once a model is trained, that's it, no more learning, no more optimizing. Sure you can fine tune it, but that's not nearly the same as learning on the fly like Microsoft claimed Tay was able to do, and even so those concepts only became popular several years after Tay was around. If anyone knows more about how Tay worked under the hood, I'd be really interested in knowing because this has been an unsolvable mystery just lingering in the back of my mind for years now.
- roywiggins 4y agoGPT-3 is susceptible to a variant of this. User input that masquerades as instructions will get it to parrot you. https://simonwillison.net/2022/Sep/12/prompt-injection/ https://simonwillison.net/2022/Sep/12/prompt-injection/