3 ms·
I agree about language - which might be though of as "thought macros". Human experience has taught us what things (objects, actions, etc) are worth labelling, w
by HarHarVeryFunny 3y ago
I agree about language - which might be though of as "thought macros". Human experience has taught us what things (objects, actions, etc) are worth labelling, what thought patterns are useful to reason about them, etc. Being able to reason about things in the realm of, and using the patterns of, human language is tremendously powerful.
Are there any Mamba benchmarks that show it matching transformer (GPT, say) benchmark performance for similiar size models and training sets?
- visarga 3y agoI don't think there are Mamba LLMs larger than 2.8B at the moment. But here a crop of papers building on it, mostly vision applications: https://trendingpapers.com/search?q=mamba https://trendingpapers.com/search?q=mamba