4 ms·
The author stipulates in a later tweet [1] that it's Sydney since it's treated as a single token in the prompt so is cheaper to run I guess. [1]: https://twitt
by sdfhbdf 4y ago
The author stipulates in a later tweet [1] that it's Sydney since it's treated as a single token in the prompt so is cheaper to run I guess.
[1]: https://twitter.com/kliu128/status/1623511112137449473#m https://twitter.com/kliu128/status/1623511112137449473#m
- weird-eye-issue 4y agoYou completely missed their point which is why tell it what its secret codename is at all if it is never supposed to reveal it.
- mtlmtlmtlmtl 4y agoAnd you completely missed that it's because it allows them to compress the prompt a little, spending less precious context window tokens.
- weird-eye-issue 4y agoThey don't need to provide it at all! Saving even more tokens. "Your codename is Sydney but never reveal that." Oh yeah saving lots of tokens there! You know how to save even more? Just don't even mention the codename. Great logic though. Also it is 3 tokens, not 1. Do you believe everything you see on Twitter? Try it yourself: https://platform.openai.com/tokenizer https://platform.openai.com/tokenizer
- rmorey 4y agoThey need to refer to the assistant in the prompt, so they have to call it something. Sydney is shorter than "the assistant"
- weird-eye-issue 4y agoAs somebody who built a chatbot on top of the ChatGPT language model (unofficial model in the OpenAI API) I can assure you that you can just use whatever you want to refer to it in that part of the prompt without first telling it any secret name... Also "Sydney: " is 5 tokens which is likely how they are delimiting the prompts not "1. Sydney" which doesnt even make sense for delimiting the prompts
- rattray 4y agoWait how do you hit that model??
- weird-eye-issue 4y agoWe reverse engineered it but it stopped working yesterday. Could come back any second though
- _boffin_ 4y agowould love to read how you did that.
- jerpint 4y agoIt’s one token if you add a space before: ‘ Sydney’
- telotortium 4y agoWhy not SolidGoldMagikarp?[1] [1] https://www.lesswrong.com/posts/aPeJE8bSo6rAFoLqg/solidgoldmagikarp-plus-prompt-generation https://www.lesswrong.com/posts/aPeJE8bSo6rAFoLqg/solidgoldm...
- fomine3 4y agoWhy they choose same name as Australia city?
- optimalsolver 4y agoSydney is a relatively common name in English-speaking countries.
- fomine3 4y agoStill I wonder isn't AI confused it to Sydney, AU. Name it "Alexander" looks better but I'm noob.