"reasoning" is a strong word. "Pattern extraction and application" is a better description of what is happening. In particular, LLMs fail miserably at tasks li

"reasoning" is a strong word. "Pattern extraction and application" is a better description of what is happening. In particular, LLMs fail miserably at tasks like "apply this simple pattern many times in succession" aka "for-loop", because they can't count in an abstract way, only on concrete contexts.