Btw, I also realise on rereading, both statements can be true at the same time. In the podcast as well, I was being very transparent that I am happily using tr

Btw, I also realise on rereading, both statements can be true at the same time. In the podcast as well, I was being very transparent that I am happily using transformers (Salesforce codegen) in production for my primary work use cases, and I am still happily doing so. My work into RWKV is to support a new usecase which transformer could not support even today. And in no means should it threaten your happiness factor in using existing AI models. I suspect in the long run, AI architecture wars may slowly mirror that of the database wars, in software development (SQL vs NoSQL vs ??) Each of them will have substantial benefits in one use case over another. And may have many overlaps, with lots of happy users for all of them =)