Nothing in that tweet is in any way related to anything I've said. It's certainly not about the distinction between how NNs are trained and how they work. The w

Nothing in that tweet is in any way related to anything I've said. It's certainly not about the distinction between how NNs are trained and how they work. The way NNs are trained is part (and obviously only part) of how they work. I'm well aware that LLMs are not simple. Remember when I said you'd need around two years of a college CS degree to understand it, and elsewhere where I said that it could be a college course? The area between "simple" and "beyond human understanding" is pretty large, though. Your description of "emergent capabilities" so far is pointing to a paper which says that putting larger data into a model produces different results, which is, you know, obvious. Calling those differences "emergent capabilities" is extraordinarily poor communication. What I mean when I say "emergent capabilities" is capabilities which aren't explained by the input data and program code, and you have yet to present a single one. Certainly nothing that could be called originality or preference, which were my two original examples of what ChatGPT doesn't have.