I'm not sure if Transformers are necessarily the spark. My personal pet theory is that the absolute most important thing we need to crack is online self-modific

I'm not sure if Transformers are necessarily the spark. My personal pet theory is that the absolute most important thing we need to crack is online self-modification, i.e. letting the model alter its own structure and optimization as it is inferencing. I think getting that level of flexibility to be stable during training is extremely important. And wow, thanks, I'm glad you enjoyed the film! I had to learn a ton of new techniques to pull it off haha, but I'm quite satisfied with the result. I've got some pretty fun ideas for episode 2 already, too!