12 ms·
he never said to steal the key, but hijack it - eg by prompt injecting in a different prompt, and using the output of that to serve their own app nobody seriou
by swyx 3y ago
he never said to steal the key, but hijack it - eg by prompt injecting in a different prompt, and using the output of that to serve their own app
nobody seriously does this at any appreciable scale, for rate limiting and reliability reasons, but it is an attack vector for sure and given enough time you could make a "botnet" that compromises a bunch of prompt injection exposed sites at once to serve your needs, but anyone smart enough to do that is probably getting millions in vc funding to build Yet Another LLM Ops Startup
- jasonjayr 3y agoWAAAAAAAAAAAY back in the day, a misconfigured, or brute-forced PBX could present a dialtone to an inbound caller, allowing calls to originate from the system. (Actually, this is probably easier with VOIP trunk credentials nowadays) Once discovered, this would quickly pivot and feed a redialer service and run up your phone bill something fierce. Till the next billing cycle, the system owner might be none the wiser! If there is money to be made selling something obtained for free, legally or illegally, it will be abused.