5 ms·
Do all llm know they are a LLM? It doesn't depend on the system prompt?
by DeathArrow 5mo ago
Do all llm know they are a LLM? It doesn't depend on the system prompt?
- rootnod3 5mo agoWithout a system prompt no. And in general they “know” nothing and just predict the next best word.
- lupire 5mo agoThis is wrong. See other comments.
- DeathArrow 5mo agoFor sure, as they are stochastic parrots. My question should have been: what are the odds a llm would react properly to those instruction, but I got lazy and asked if they "know" it, because I presumed most readers here do know how llms are working.
- jdiff 5mo agoI think any instruction tuned model is going to "know" it's an LLM.
- andai 5mo agoThe pre-trained ones no (except some of the new ones which have post training data added to pre-training for some reason). The post-trained ones yes (at least all the ones I've seen). Some of the niche ones I'm not sure about. Like the historical LLMs. I have not tested those yet.
- Diti 5mo agoYes. The first step of aligning each and every GPT-based LLM is to suppress the “I am human” kind of responses. It’s baked into the weights.
- Gigachad 5mo agoReminds me of old cleverbot conversations where it would always assert it is human and you are the bot. Trained on previous conversations with people.
- Tenoke 5mo agoIt's also at minimum baked into the system prompt of virtually any LLM.
- lupire 5mo agoThat's not "baked" and only applies to remotely hosted LLMs where someone else feeds the prompt into the LLM.
- barrenko 5mo agohttps://en.wikipedia.org/wiki/Original_face https://en.wikipedia.org/wiki/Original_face