For me it is the opposite. I'm shocked by how simple transformer based models and how small the architectural differences are between the latest models. Almost

For me it is the opposite. I'm shocked by how simple transformer based models and how small the architectural differences are between the latest models. Almost nothing has changed since late 2023.