4 ms·
Words like attention, awareness and care do not apply to computers. At least, not yet. Intelligence and sentience are not applicable to servers. They are just
by Bender 5mo ago
Words like attention, awareness and care do not apply to computers. At least, not yet. Intelligence and sentience are not applicable to servers. They are just machines with logic states. LLM's are just really cool math formulas with big-data fed into them. Big data is not intelligence. It is a massive data-set sorted, filtered down and interpreted by a language model.
- esprehn 5mo agoI assume they meant the Attention process in LLMs, not the human concept of paying attention: https://en.wikipedia.org/wiki/Attention_(machine_learning) https://en.wikipedia.org/wiki/Attention_(machine_learning)
- slibhb 5mo agoLLMs are intelligent by any reasonable standard. Arguing otherwise is like arguing that chess algorithms aren't good at chess when they easily beat the best humans.
- larodi 5mo agoDoesn’t take intelligence to beat a human.
- Bender 5mo agoI disagree. LLM's are a language model math formulas that interpret and utilize big-data. Take away the math formulas and we are just back to a massive set of data. Adding to that I would suggest not even the purist forms of data meaning that the data-sets include knowledge from the open and anonymous internet and formulaic tuning from the AI owners and operators.
- anon84873628 5mo agoYour brain is mostly just a Principal Component Analysis calculator. Take away that "math formula" and you don't have intelligence either. The LLM weights are not intelligent. But if you give an agent a mutable memory store and allow it to iterate, it is obviously intelligent. Not massively - it's constrained by the context window - but definitely somewhat. The confusing thing is that their language ability far outpaces their true intelligence, and humans aren't used to that. Normally those things are highly correlated, so it tricks us.
- deleted 5mo ago[deleted]
- slibhb 5mo agoIf you want to talk about whether LLMs are intelligent, you have to define intelligence. "They're just math formulae" isn't a definition of intelligence.
- horacemorace 5mo agoRight. But at their core they are math formulas devised by a process designed to produce mimicry of task completion. The math formulas themselves aren’t fully effable. We’re sure studying the heck out of how they complete the tasks! Bet they converged on how we do it, since it’s our language, but who knows.