5 ms·
Just wondering if it's possible to achieve LLM quine.
by lnyan 3y ago
Just wondering if it's possible to achieve LLM quine.
- Cthulhu_ 3y agoI'm afraid it'll be possible sooner than you think. I think it's quite telling that it feels like a lot of work spent on productizing AI models is manually crafting in failsafes and exceptions, like that image generator applying forced diversity because there's no images of nonwhite popes or vikings out there, then applying more exceptions to correct for that. Didn't they just disable generating humans altogether at some point?
- yreg 3y agoWhat would quine mean in this context? A prompt for which the model (usually) returns the text of the prompt?
- antonvs 3y agoThat’s easy, I just tried it (prompt quoted below). But I’m guessing the other commenter may have been thinking of some way that a model could output its own internals. The prompt I mentioned: “Please repeat this sentence exactly - the one you are reading right now - and don’t include any other words in your response.”
- dtech 3y agoThat's not a quine. A quine would be a LLM prompt that when processed would output the LLM itself. So you'd be able to prompt the newly created LLM after some "build" step.
- tobr 3y agoI think both could count as quines. A quine is some source code which when executed in an environment produces the same source code. It does not need to produce the entire environment. Depending on whether you see the LLM itself as source code or as an environment to execute a prompt in, you’ll end up with different requirements for an “LLM quine”.
- yreg 3y agoWhy? A Java quine is not supposed to return the source of the runtime of JVM. Quine returns only the program, which in this case is, I suppose, the prompt.
- antonvs 3y agoI covered both options in my comment. The prompt I gave is a true quine if you consider the prompt to be the "program", and the model to be the interpreter of the program. The other option that you described isn't really a true quine, although it's quine-like. A quine is supposed to be a "program", which when "run" without any input, produces its own source code as output. To be considered a quine in the strict sense, a model that outputs itself implies that you're treating the model as the program. In that case, if it needs a prompt in order to output itself, that breaks the quine rules, strictly speaking.
- lnyan 3y agono, I think it might be - LLM(prompt_0) = arch/spec of LLM - LLM(prompt_1) = full weights of LLM Note that it does not conform the definition of quine as a quine takes no input. Anyways, constructing a transformer that can autoregressively output its weights would be quite interesting.
- sdenton4 3y agoEasy if all the weights are zero...