4 ms·
If you add “This generation of” to the beginning of all of this research on existing LLMs you’ll have a clearer understanding. Like all young technologies it’s
by happytiger 3y ago
If you add “This generation of” to the beginning of all of this research on existing LLMs you’ll have a clearer understanding.
Like all young technologies it’s a constant failure in so many important ways, and will continue to be until it’s not or another superior model built on what we’ve learned replaces it.
But the important thing to remember is that this process is fairly standard for any technology innovation wave.
They suck at the beginning and take a longer time to mature than people realize even while they’re going through them. The early Internet was mindblowingly amateur. Early cell phones were basically pager quality and the smart phone revolution started with things like palm pilots that couldn’t even connect to one another or barely could.
You have to look at LLMs as cell phones from 1991 or maybe 1993, and when you do you realize how freekin’ crazy these technology direction could be.
This generation of LLMs are simply designed to regurgitate information in a coherent fashion, not be right about the information or maintain consistency (they literally dont have the memory capacity — it’s just like early computers were lol).
People are poor predictors of technology progress because they tend to extend current reality forward and don’t realize that technology works in leaps and bounds and isn’t linearly predictable with any substantive reliability either.