There’s hacks and workarounds because billions of dollars have been poured into transformers by the biggest tech companies in the world. Your assumption that t

There’s hacks and workarounds because billions of dollars have been poured into transformers by the biggest tech companies in the world. Your assumption that the same effort could be given to MAMBA or RWKV isn’t necessarily true. I’m sure there’s research arms looking to see if they scale to the level OpenAI or Google have their transformers at now, but they’re still very much in their infancy. This all ignores the risk of them not panning out and the lost time not focusing some energy on transformers.