5 ms·
Well, then it doesn't, but why would you expect that to be the case? Why would transformers be so ideal that there is no major improvement left?
by impossiblefork 1y ago
Well, then it doesn't, but why would you expect that to be the case?
Why would transformers be so ideal that there is no major improvement left?
- iLoveOncall 1y agoWhy would you expect otherwise? You're the one with an extraordinary claim. I'm not saying that transformers are ideal or that there's no major improvement left. I'm saying that a major improvement over something that is barely a net positive is nowhere near the extinction level event you're making it seem to be.
- lostmsu 1y agoIt's not like the proof to the claim is not extraordinary. 4GB of weights demonstrates reasoning abilities unthinkable 4 years ago.
- iLoveOncall 1y agoNext token generation is not reasoning.
- lostmsu 1y agoI would argue that is more reasoning than you do in the specific instances of SotA LLMs. Because you are demonstrating a rather simple logical mistake by claiming "T is in NTG => T is not in R" when you have no information about relationship between NTG and R sets. But I wasn't even talking about reasoning. I specifically said "demonstration".