3 ms·
GPT-5 would have this enhancement
by brcmthrowaway 3y ago
GPT-5 would have this enhancement
- MacsHeadroom 3y agoGPT-5 will not, because the T in GPT stands for Transformer and Mamba/SSMs/S6 are not Transformers. But I would bet that we see a SOTA S6 LLM from Meta by this Spring.
- brcmthrowaway 3y agoS6?