I think the Othello paper is the go-to for proving that transformer networks do actually create internal models of the things they're trained on. https://thegr

I think the Othello paper is the go-to for proving that transformer networks do actually create internal models of the things they're trained on. https://thegradient.pub/othello/ https://thegradient.pub/othello/