(interviewer here, but not on RWKV team and no ties) so if you're looking for social proof - this is something we cover in the pod but the original idea came fr

(interviewer here, but not on RWKV team and no ties) so if you're looking for social proof - this is something we cover in the pod but the original idea came from Apple (Attention Free Transformers) and Microsoft recently put out the RetNet which is a similar idea. If you believe that the reasoning benchmarks shown were legit (and these are pretty standard benchmarks imo, and audited by other academics not strictly on the RWKV team like Quentin Anthony (also our past guest!), tho he is with Eleuther), then that's pretty much all the proof you need. plus the fact that you can spin it up on huggingface spaces right now and try it out yourself (link in the show notes). bottomline is this thing is being built by the community that uses it - there is no higher form of dogfooding. if you wanna wait 3-4 years for big names to use it before you take it seriously, then we'll just have to wait. i call this out explictly on the pod intro that i'm trying to be early here, i think we might be the first big ai pod to seriously cover RWKV