It definitely doesn’t have a comprehensive real world model like a human, but there’s probably something extra besides just statistics: https://thegradient.pub

It definitely doesn’t have a comprehensive real world model like a human, but there’s probably something extra besides just statistics: https://thegradient.pub/othello/ https://thegradient.pub/othello/ > They suggest language models can develop world models for very simple concepts in their internal representations (layer-wise activations), such as color [9], direction [10], or track boolean states during synthetic tasks [11] But I don’t think there have been any probes like this for ChatGPT yet This is better evidence than the Twitter example but I bet it still wouldn’t be well received in that thread