> (And is this an LLM trick or something else? Perhaps a combination of things? Is it AI, LLM, LMNOP, or some kid in a sweatshop overseas? I don't really know -

> (And is this an LLM trick or something else? Perhaps a combination of things? Is it AI, LLM, LMNOP, or some kid in a sweatshop overseas? I don't really know -- that distinction is also beyond my pay grade.) That's the thing: The hidden layers that process the text _MUST_ have some kind of language structure getting figured out. Otherwise none of the behaviors of ChatGPT make sense. Interpreting those layers and passing them to the user in some way should be the core focus IMO anyway. On the other hand: there's also the problem of brute force. If they paid 50,000 cheap "Mechanical Turks" to manually teach an AI that the "top left" of an image is pixel coordinates (0,0), that's... trickery. Its no longer intelligence. Its disconnected and not innate to the model anymore. The nature of the training set is what would determine how useful any of this actually is, and how well it generalizes to new tasks.