The criticism that autoregressive language models with billions of parameters don’t acquire basic logics (e.g., propositional, quantificational) is valid and, i

The criticism that autoregressive language models with billions of parameters don’t acquire basic logics (e.g., propositional, quantificational) is valid and, in my opinion, extremely interesting. Unfortunately, the subjectivity of their evaluation undermines that critique. The subjectivity is especially weird since these characteristics can be objectively evaluated (e.g., finding contradictions).