2 ms·
This is pretty pessimistic. I don't know what kind of expectations you have about LLMs. Less than 10 years have passed since the original Transformers paper and
by mrbungie 4y ago
This is pretty pessimistic. I don't know what kind of expectations you have about LLMs. Less than 10 years have passed since the original Transformers paper and we're seeing tangible and useful software out of it. I've seen far worse vaporware.
PS: Anyways, regarding your argument, yes, transformer-based models right now are "shit" (by whatever measure you are using, though I still don't know what you are comparing them with. I suppose human level intelligence), but more training data is not the only way to make better models.