3 ms·
> It’s true It's not. "Brains as electrical circuits" is a gross simplification based on our ignorance and prejudices. (In the 18th century they spoke of brain
by otabdeveloper4 2mo ago
> It’s true
It's not. "Brains as electrical circuits" is a gross simplification based on our ignorance and prejudices. (In the 18th century they spoke of brains as "clockwork mechanisms".)
LLMs, in contrast, are literally next token predictors. We know exactly how LLMs work, and they are exactly that.
- zahlman 2mo ago> We know exactly how LLMs work I think you imply a rather loose standard for "exactly" here. I wouldn't even say this of major deterministic software projects that are orders of magnitude smaller than frontier LLM weight-dumps. In principle we could work our way through these systems eventually, sure, maybe even a single person could do so. But if we really understand exactly how our software works, how have we been tolerating bugs that lay dormant for years before being discovered by AI-assisted processes?
- doc_ick 2mo agoOh that’s ez, for software we know that has bugs, one reason could be the cost of fixing isn’t worth it.
- Dylan16807 2mo agoWhen we're speaking mechanically, we can ignore the weights and just look at the math. And that math is very simple compared to most software.