No company will land it building attention based transformers. They simply don't do what people say they do. They are very powerful and I love using claude code

No company will land it building attention based transformers. They simply don't do what people say they do. They are very powerful and I love using claude code every day at work. But they aren't going to become autonomous androids because they don't even respect what little we know about cognitive science. I think that what is more exciting across all of this work is that many of these models are a strong increment forward in predicting physical systems which means we can have more accurate and more complex control systems for manufacturing, transport, etc. You can use transformers to take a super computer scale weather model and run it on a desktop GPU. That is rather impressive imo.