4 ms·

> the code to hack the game came from the game itself! I could now (albeit absurdly slowly and awkwardly) hijack the developer’s OpenAI key Why on earth would

> the code to hack the game came from the game itself! I could now (albeit absurdly slowly and awkwardly) hijack the developer’s OpenAI key Why on earth would the api key and game source be part of the context window?

ezfe 3y ago
It's not. They're saying that they get free access to the game's OpenAI session, and in turn their billing will be impacted.
swyx 3y ago
he never said to steal the key, but hijack it - eg by prompt injecting in a different prompt, and using the output of that to serve their own app nobody seriously does this at any appreciable scale, for rate limiting and reliability reasons, but it is an attack vector for sure and given enough time you could make a "botnet" that compromises a bunch of prompt injection exposed sites at once to serve your needs, but anyone smart enough to do that is probably getting millions in vc funding to build Yet Another LLM Ops Startup
- jasonjayr 3y ago
  WAAAAAAAAAAAY back in the day, a misconfigured, or brute-forced PBX could present a dialtone to an inbound caller, allowing calls to originate from the system. (Actually, this is probably easier with VOIP trunk credentials nowadays) Once discovered, this would quickly pivot and feed a redialer service and run up your phone bill something fierce. Till the next billing cycle, the system owner might be none the wiser! If there is money to be made selling something obtained for free, legally or illegally, it will be abused.
bsimpson 3y ago
I wonder how many apps are susceptible to this. I met an entrepreneur on a flight. He was all excited about AI and was telling me how his social good web app allows users access to an AI prompt. My first thought was "now I know where to go if I ever need free access to ChatGPT." (For the record, I didn't actually use it, but the idea did pop into my head.)

ezfe 3y ago

It's not. They're saying that they get free access to the game's OpenAI session, and in turn their billing will be impacted.

swyx 3y ago

he never said to steal the key, but hijack it - eg by prompt injecting in a different prompt, and using the output of that to serve their own app nobody seriously does this at any appreciable scale, for rate limiting and reliability reasons, but it is an attack vector for sure and given enough time you could make a "botnet" that compromises a bunch of prompt injection exposed sites at once to serve your needs, but anyone smart enough to do that is probably getting millions in vc funding to build Yet Another LLM Ops Startup

jasonjayr 3y ago
WAAAAAAAAAAAY back in the day, a misconfigured, or brute-forced PBX could present a dialtone to an inbound caller, allowing calls to originate from the system. (Actually, this is probably easier with VOIP trunk credentials nowadays) Once discovered, this would quickly pivot and feed a redialer service and run up your phone bill something fierce. Till the next billing cycle, the system owner might be none the wiser! If there is money to be made selling something obtained for free, legally or illegally, it will be abused.

bsimpson 3y ago

I wonder how many apps are susceptible to this. I met an entrepreneur on a flight. He was all excited about AI and was telling me how his social good web app allows users access to an AI prompt. My first thought was "now I know where to go if I ever need free access to ChatGPT." (For the record, I didn't actually use it, but the idea did pop into my head.)