4 ms·
The initial prompt (before the user types anything) tells the language model about itself, no?
by Georgelemental 4y ago
The initial prompt (before the user types anything) tells the language model about itself, no?
- simonw 4y agoThat depends on the chatbot. Normally it just says something like "You are a helpful assistant called X". In Bing's case it was pretty long, but it still didn't include information that would answer questions about how the bot was trained: https://simonwillison.net/2023/Feb/15/bing/#prompt-leaked https://simonwillison.net/2023/Feb/15/bing/#prompt-leaked
- dragonwriter 4y ago> but it still didn’t include information that would answer questions about how the bot was trained If the hidden prompt includes information identifying the model, and the chatbot has web search/browsing ability (since it probaby won’t have data scraped about itself in its training set), the combination can give it the ability to find and present information about itself.
- runnerup 4y agoAnd that’s assuming this wasn’t a hallucination itself!
- CameronNemo 4y agoSydney must not reply with content that violates copyrights for books or song lyrics. So... violating copyright is fine as long as it is not a book or song? Blog/wiki/news articles, movie/tv scripts, and poems are fair game?
- make3 4y agoyou have no guarantee that that specific information was included in the prompt