6 ms·
RWKV is definitely cool. Using GitHub stars to extract meaningful insights is impossible on the other hand. I don’t think coolness is a qualifier for “foundatio
by ShamelessC 3y ago
RWKV is definitely cool. Using GitHub stars to extract meaningful insights is impossible on the other hand. I don’t think coolness is a qualifier for “foundational” either. RWKV needs to be widely deployed to the point that even its embeddings are more useful than an otherwise superior model (because embeddings are somewhat costly to calculate if you were to recalculate every time state of the art changes e.g. CLIP)
- swyx 3y agoRWKV probably has more usage than, say, AI21 Jurassic-2 on this chart
- ShamelessC 3y agoAh I see. So the answer really is just VC/FAANG funding then. Indeed, GitHub stars is effective in that case. The whole idea of foundation models is such an obvious ploy to either get citations by reputable labs or as the foundation (no pun) for a legal framework that lets big companies and no one else license their models.
- swyx 3y agowouldnt be that cynical. everyone just touching different parts of the elephant.