4 ms·
LLMs architectures have not changed at all since 2023. > but mmuh latest SOTA from CloudCorp (c)! You don't know how these things work and all you have to go
by otabdeveloper4 6mo ago
LLMs architectures have not changed at all since 2023.
> but mmuh latest SOTA from CloudCorp (c)!
You don't know how these things work and all you have to go on is marketing copy.
- HumanOstrich 6mo agoYea you don't know anything about LLM architectures. They often change with each model release. You also aren't aware that there's more to it than "LLM architecture". And you're rather confident despite your lack of knowledge. You're like the old LLMs before ChatGPT was released that were kinda neat, but usually wrong and overconfident about it.
- otabdeveloper4 6mo agoIt's still attention and next-token-prediction and nothing else. The only new innovation is MoE, something that's used to optimize local models and not for the "SOTA" cloud offerings you're so fond of.
- HumanOstrich 6mo agoYou no listen. Me give up. Go learn on fruit phone.
- otabdeveloper4 6mo agoLLMs are literally next token prediction engines and nothing else. Diffusion for text is not even an academic toy at this point and will likely never be a real thing.