4 ms·
"And it feels like we are a half-dozen more insights away from having the equivalent of our biological agents." And "If you took the things that people talk a
by RetroTechie 2y ago
"And it feels like we are a half-dozen more insights away from having the equivalent of our biological agents."
And
"If you took the things that people talk about—GPT-3, Imagen, AlphaFold—the source code for all these in their frameworks is not big. It’s thousands of lines of code, not even tens of thousands. Now, they’re built on top of a big framework of supporting ecosystem stuff, but the core logic is not a big program."
I'm with mr. Carmack there. He regards today's hotness like LLMs not as pointing the way, but as pieces of the puzzle. We need a few more pieces. And the overall picture probably won't be too complex. Big (as in: scale), probably. But not very complex.
We just don't know (yet) what pieces are missing, how they fit together, and how to get there. But (at least to mr. Carmack) it feels like we're within arms reach of that.
I think he's right. And maybe he'll come up with one of those missing pieces? At least to some people that's worth a $20M gamble.