3 ms·
Does anyone know if there were any attempts to test Mamba on really large scale? To me this model looks as the most promising successor to the transformer archi
by solomatov 1y ago
Does anyone know if there were any attempts to test Mamba on really large scale? To me this model looks as the most promising successor to the transformer architecture. Does anyone know why it might not be the case or what are other alternatives?
- tangjurine 1y agoTencent's 'Hunyuan-T1'–The First Mamba-Powered Ultra-Large Model: https://news.ycombinator.com/item?id=43447254 https://news.ycombinator.com/item?id=43447254