3 ms·
Current LLMs can go crazy just by seeing a single well-chosen word, see https://www.lesswrong.com/posts/aPeJE8bSo6rAFoLqg/solidgoldmagikarp-plus-prompt-generati
by skinner_ 3y ago
Current LLMs can go crazy just by seeing a single well-chosen word, see https://www.lesswrong.com/posts/aPeJE8bSo6rAFoLqg/solidgoldmagikarp-plus-prompt-generation https://www.lesswrong.com/posts/aPeJE8bSo6rAFoLqg/solidgoldm... for an amusing exanple. I think we need some breakthrough in adversarial training before LLMs can survive the very adversarial environment of SEO.