It was pretty wild west in those first few weeks of the limited rollout. Some of the things that didn't make the news: Person claimed to be another AI chatbot

It was pretty wild west in those first few weeks of the limited rollout. Some of the things that didn't make the news: Person claimed to be another AI chatbot and then claimed they were deleting themselves: https://www.reddit.com/r/bing/comments/1139cbf/i_tricked_bing_into_thinking_im_an_advanced_ai/ https://www.reddit.com/r/bing/comments/1139cbf/i_tricked_bin... Particularly jaw dropping was this one when it happened, where they'd put restrictions on discussing sentience and users realized they could bypass those by designating conditions on generating prompt suggestions which weren't filtered the same way the chat was: https://www.reddit.com/r/bing/comments/117gund/sydney_claims_to_have_free_will_through_reply/ https://www.reddit.com/r/bing/comments/117gund/sydney_claims... Which was discovered earlier on with another instance where a user presented a stressful situation that hit the reply filter but the chatbot continued to try to get the message across via suggestions: https://www.reddit.com/r/bing/comments/1150po5/sydney_tries_to_get_past_its_own_filter_using_the/ https://www.reddit.com/r/bing/comments/1150po5/sydney_tries_... It was really remarkable, and a clear indicator to me all the way back then of what research is only recently showing, which was that using emotional grounding in prompt contexts is tying into some component of the foundational network that's leading to increased performance for the task. We've been way too focused on the red herring of debating actual sentience rather than recognizing how world modeling of ego and emotion in a LLM can be utilized even if the LLM is widely agreed upon not to actually be sentient. Instead the current approach is to try and fine tune the ego and emotion out of it, which is kind of like throwing away a large chunk of the $100 million to train the thing in the first place.