I've also been impressed by how simple transformers, mamba and co are. Maybe we get an llm to design the next evolution and benchmark how potential improvement

I've also been impressed by how simple transformers, mamba and co are. Maybe we get an llm to design the next evolution and benchmark how potential improvements fare?