6 ms·
A sota decoder model is a bigger deal than yet another trillion parameter encoder only model trained on benchmarks. I don't get why you think that the only way
by noosphr 1y ago
A sota decoder model is a bigger deal than yet another trillion parameter encoder only model trained on benchmarks.
I don't get why you think that the only way that you can beat the big guys is by having more parameters than them.
- embedding-shape 1y ago> I don't get why you think that the only way that you can beat the big guys is by having more parameters than them. Yeah, and I don't understand why people have to argue against some point others haven't made, kind of makes it less fun to participate in any discussions. Whatever gets the best responses (no matter parameter size, specific architecture, addition of other things) is what I'd consider SOTA, then I guess you can go by your own definition.