4 ms·
This attack reminds me of that viral photo [0] of an LCD billboard on the back of a truck (ironically called "The Safety Truck") that played a video of the road
by chatmasta 3y ago
This attack reminds me of that viral photo [0] of an LCD billboard on the back of a truck (ironically called "The Safety Truck") that played a video of the road ahead of it. The criticism of it was that it could cause a self-driving AI to misinterpret the video as the actual road. Some people also suggested that a malicious actor could project a false image on the screen, such as a red stop sign or a pedestrian crossing the road, causing it to brake suddenly on the highway. So this prompt injection attack reminded me of that because it shows how an LLM AI might be similarly vulnerable to a malicious prompt "in the wild."
[0] https://news.samsung.com/global/the-safety-truck-could-revolutionize-road-safety https://news.samsung.com/global/the-safety-truck-could-revol...