Well its already "impossible" for most people to know how it works. Personally I know how the sausage is made but not well enough to code my own transformer (y

Well its already "impossible" for most people to know how it works. Personally I know how the sausage is made but not well enough to code my own transformer (yet). I think there is a dichotomy between those who see it as magic, and truly intelligent, and those who know how it works and know it isn't thinking at all. And at the same time a lot of engineers who are using it directly overestimate their own understanding of how these LLMs really work. Interesting times.