4 ms·
The author labels LLMs as "empty hype". LLMs are inappropriately hyped. Surrounded in shady practices to make them a reality. I understand why so many people a
by jasonjmcghee 1y ago
The author labels LLMs as "empty hype".
LLMs are inappropriately hyped. Surrounded in shady practices to make them a reality. I understand why so many people are anti-LLM.
But empty hype? I just can't disagree more.
They are generalized approximation functions that can approximate all manner of modalities, surprisingly quickly.
That's incredibly powerful.
They can be horribly abused, the failure modes unintuitive, using them can open entirely new classes of security vulnerabilities and we don't have proper observability tooling to deeply understand what's going on under the hood.
But empty hype?
Maybe we'll move away from them and adopt something closer to world models or use RL / something more like Sutton's OaK architecture, or replace back prop with something like forward-forward, but it's hard to believe Hal-style AI is going anywhere.
They are just too useful.
We have a rough draft of AI we've only seen in sci-fi. Pandora's box is open and I don't see us closing it.
- politelemon 1y agoI would love to reach a point where competent language models become commodities that anyone can run on low key hardware. Having one at your disposal can open up for some gorgeous applications and workflows by the community. As it stands at present though, there are insurmountable moats or very expensive ones.