3 ms·
There was a previous incident where Grok would say that Elon was the biggest spreader of misinformation on Twitter, which caused someone to add a line in the pr
by TheAceOfHearts 1y ago
There was a previous incident where Grok would say that Elon was the biggest spreader of misinformation on Twitter, which caused someone to add a line in the prompt so it would stop saying that. It was eventually claimed that it had been a new employee that made that change.
The newer incident was related to White Genocide in South Africa. Another employee added a line about the topic, which caused Grok to randomly start talking about this even with unrelated questions.
This latest incident ultimately caused the xAI team to decide to publish their prompts on GitHub. Even if their processes around this are a bit undercooked, they'll probably just keep iterating on it until landing in a good spot. It would be great if we could get a stronger guarantee that the prompt that is tagged on GitHub matches what is actually deployed to production.
Something to look out for is whether this repo will actually be treated as a source of truth, or if it'll end up being a one-time dump that never gets updated. Previously, Elon made a lot of noise about open sourcing the recommendation algorithm for Twitter, but after the initial release the repo was never updated again, despite it being clear that there were changes being made to the recommendation algorithm. When I last saw someone ask Elon about this, he claimed that he would release the updated algorithm changes, but it hasn't happened.
I think releasing the prompts for major LLMs is generally a good thing, and I'm hopeful that this might push other companies to follow along. At a minimum, platforms should disclose when they make changes to system prompts. Ideally, they would also release the prompt itself, but goodness exists on a scale and I try to be pragmatic.