4 ms·
GPT-5 will not, because the T in GPT stands for Transformer and Mamba/SSMs/S6 are not Transformers. But I would bet that we see a SOTA S6 LLM from Meta by this
by MacsHeadroom 3y ago
GPT-5 will not, because the T in GPT stands for Transformer and Mamba/SSMs/S6 are not Transformers.
But I would bet that we see a SOTA S6 LLM from Meta by this Spring.
- brcmthrowaway 3y agoS6?