5 ms·
The real problem is, at the end of the day, you can't prove or disprove these are ever 'real' or not - and before anyone mentions repeatablity, repeatability is
by fullstackchris 3y ago
The real problem is, at the end of the day, you can't prove or disprove these are ever 'real' or not - and before anyone mentions repeatablity, repeatability is NOT indicative of authenticity! I can get any LLM to provide a repeatable answer for an infinite number of things (what day comes after Monday? I bet it will repeatably answer Tuesday!)
It's like the simulation theory - it can't be proven or disproven, so just stop trying.
At this point I can at least understand why these stupid prompt conspiracy theory things thrive so well on social media though.
- Karunamon 3y agoYou kind of can, though. It's a bit less obvious through the chatGPT website, but if you have played around with the API (where choosing your own system prompt is part of normal operation), you see that getting it to output things according to that prompt is where most of the magic is. … And that getting it to output that prompt is trivial. And no, hallucination is not really a problem for this. At the end of the day, such cynicism is baseless.
- stevenhuang 3y agoYou don't need to guess and it's not a conspiracy. People with self hosted LLMs have reproduced this.