I’ve seen the recent statement by someone at OpenAI but whatever weasel words they use, it did change. The modified cabbage-goat-lion problem [1] that GPT4 alw

I’ve seen the recent statement by someone at OpenAI but whatever weasel words they use, it did change. The modified cabbage-goat-lion problem [1] that GPT4 always failed to solve, it now gets it right. I’ve seen enough people run it in enough variations [2] before to know that it absolutely did change. Maybe they didn’t “change” as in train anything, but it’s definitely been RHLFed and it’s impacting the results. [1] https://news.ycombinator.com/item?id=35155467 https://news.ycombinator.com/item?id=35155467 [2] anecdata: dozens of people, hundreds of times total