6 ms·
> these language models don't know anything. The examples of them making up information, or being persuaded by people are all over the place Sounds just like h
by ben_w 4y ago
> these language models don't know anything. The examples of them making up information, or being persuaded by people are all over the place
Sounds just like humans to me.
Primary school, some people showed up to explain blood donation, showed and told us they were putting a bag of fake blood up the teacher's sleeve and would take from that rather than from our actual teacher, and yet when the fake blood went into the collection thingie the kid next to me screamed "they're killing her!"
Same school, show-and-tell, astronomy textbook showing the circular orbit of a moon at two different points of the parent planet's orbit around the star. "This is a picture of a mouse".
Secondary school. Main teacher and replacement teacher cover the same passage of a sort story, one interpreting the word "patronised" as in "patron" the other as in talking down to people whose intelligence you underestimate.
A-levels. Philosophy. What even is knowledge anyway? Tripartite definition. Example given was "shaggy" dog, one of the other students stifles a laugh at the double entendre.
But to your core point:
> the technology we bring in to the classroom has to be well understood and directed in order to be effective
Yes, absolutely.
But it's deeper than that. When this tech is flawless, we will have to ask ourselves: "What is school for?"
After all, being flawless in this context means it already knows all that can be taught, so why not just have it do the work related to those things instead of putting humans through ever longer school years so they can do the same things less well?
This isn't the first time technology has forced such questions; my generation never had to learn how to starch clothes, shoe horses, look after a tinder box, or send and receive Morse code.
- lm28469 4y agoIt's about scale and reach, 100 teachers/educators will be biased/wrong in 100 ways but you'll average it out by interacting with each over your education. If an AI is wrong about one thing you'll have the same bias over entire generations, once a full generation is skipped it's very hard to go back That's why we need diversity, political pluralism, &c. because not many things are inherently "true", it's all about nuance, personal perception, mitigation, ... > "What is school for?" Socialisation, experiencing new things, general culture, deciding where you want to go in life, &c. Many things you learn in school aren't used for jobs but for day to day life and for the well being of society If we take that out and replace it by "kids in front of screens" we're in for a massive and quick change with potential deep and long lasting effects. By the way keep in mind a shit ton of jobs aren't even close to being automatised, and a shit ton of jobs aren't done by people sitting in front of screens
- ben_w 4y ago> If an AI is wrong about one thing you'll have the same bias over entire generations, once a full generation is skipped it's very hard to go back Sounds like intellectual monoculture? If so, I absolutely agree. Already a problem with respect to many thinking it's unpatriotic to suggest their country is anything other than "the good guys", or blasphemous to ask if their religion is anything less than the actual truth of the divine, and AI can extend that to every single topic. (Oh hey, another possible Great Filter for the Fermi paradox). > Socialisation, experiencing new things, general culture, deciding where you want to go in life, &c. Many things you learn in school aren't used for jobs but for day to day life and for the well being of society Do we need schools for that, or will kids learn the same by messing around in multiplayer Minecraft or whatever the zeitgeist is? > If we take that out and replace it by "kids in front of screens" we're in for a massive and quick change with potential deep and long lasting effects. Sure, but that's going to happen regardless. Too many other things are changing also.
- LawTalkingGuy 4y ago> that's going to happen regardless So why make it worse? Why gives kids tablets for things we know don't need tablets, and where a device is more of a distraction? Shiny new technology is great for distracting from a failure to perform basic childcare like keeping children physically safe so they can learn. And then it's a rhetorical weapon "We can't listen to parents, they don't even want their children to have state of the art equipment!"
- ben_w 4y agoFirst, that's presuming it's bad. Second, the parents are mostly buying the tablets anyway. Thirdly, about this: > distracting from a failure to perform basic childcare like keeping children physically safe so they can learn Pretty much the one kind of safety I can guarantee kids have when using a computer is their physically safety. And learn what, exactly, given the hypothetical scenario you're replying to here is that the only thing left to learn is being sociable which they can ultimately do best by experiencing whatever medium they will be sociable in as adults, and for all other learning you're just being a nerd like me who learns for the fun of it.
- iamwpj 4y agoHumans can know nearly everything that any other human knows (hence...teaching). AI can't know anything (right now). The youth who are critical of capitalism certainly have turned a wary eye on the school system -- after all primary education has been designed to create money makers for corporations. Is a new tool the answer? Likely not. Will it help to change the philosophy of education? Maybe not independent of the change that is already occurring.
- ben_w 4y ago> AI can't know anything (right now). Only for very specific (and IMO useless) definitions of the word "know". Does it matter if the thing a submarine does is called "swimming" or not? In any practical sense, even obsolete ancestors of this model definitely "know" more French than I learned in 5 years of mandatory school lessons. That said, regardless of the definition of the word "know"… > The youth who are critical of capitalism certainly have turned a wary eye on the school system -- after all primary education has been designed to create money makers for corporations. I don't know what you're talking about here. The soviet bloc countries were very proud of their schooling system, rightly or wrongly; and conversely corporations don't really get much out of primary education, which is often described as being essentially no better than daycare for slightly older kids.
- kurthr 4y agoIf you're not developing tools for human teachers to evaluate the learning of their students (eg summarizing what was presented/discussed/learned) then you're going to have preventable failures. And you can't just rely on simple metrics (Goodhart's Law). The kinds of failures you can have teaching kids are pretty bad.
- ben_w 4y agoYes, and we were explicitly taught how to maximise our test results. Alignment failure is still a problem when it's organic brains doing it, regard of what anyone tries to hand-wave with the cliché "common sense". :)
- krainboltgreene 4y ago> Sounds just like humans to me. I love when tech people reveal that they have no idea how other humans act and behave.
- deleted 4y ago[deleted]
- ben_w 4y agoI gave a bunch of examples. I can give many more. A middle aged woman who said I had to be lying about being vegetarian because she couldn't believe it was possible for humans. A coworker who insisted it was impossible to speed up some code in a daily standup, for me to come back to on the next stand up and announce I had sped it up from 15 minutes to 0.2 seconds. Basically every time I hear the cliché "common sense", the claim being made is somewhere between totally wrong or just misleading in various situations. My mum was a firm believer in homeopathy, Bach flower remedies, magic of crystals, called herself a Catholic, and had a statue of (IIRC) Vishnu with her collection of books on how to tell your fortune with viking rune stones. At one point her dislike of "chemicals" came up, so my brother and I riffed on the dangers of dihydrogen monoxide for a bit; she was engaged with the list of issues until we told her what that is, and never took on board the lesson that "one atom away from being bleach" means "is not bleach". I was exactly the right age for Wakefield's claims about the MMR vaccine to convince me not to get it, and I only got around to doing the sensible thing several years after he was struck off the UK medical register and (if I understand right) downgraded from Doctor to Mr. Compare what the British public as a whole say about Boris Johnson with what specifically the members of the Conservative Party say about him. One of my friends in middle school was completely convinced that all gay men hospitalised each other from every sexual act. I vastly overestimated my German language skills when I first got here, and my self-estimate of my skill level hasn't changed no matter how much better I get. My brother was convinced that Captain America was the first MCU film to be released. My father took several years to realise Google search results had a scroll bar and it wasn't just the top 3 that fitted onto his 640x480 screen. (He became a software developer almost as early as was possible, so that wasn't merely a case "old person can't use computer", unlike my gran who held the mouse at 90 degrees and expected it to still move as if she hadn't). He also believed that water drained in particular directions due to the Coriolis effect, thanks to (what he didn't realise was) a magic trick performed somewhere near the equator some time when he visited Kenya. Someone who got on a train from somewhere in London to Liverpool Lime St instead of to Liverpool Street station, and who only dared ask me when we'd arrive as we were half way through the country. There was a young-Earth-creationist fundamentalist Baptist who I wasted half an hour arguing with on his microphone. Too many mistakes to count, and not just the mistake I made by wasting time engaging with his nonsense. Every exam question I ever get wrong, every personality I misjudge, every scam I fall for, every troll I am baited by… even a few April Fool's jokes I didn't realise were jokes until years later. I know the LLMs aren't human, but that specific flaw of "can be wrong without realising it, can be convinced by nonsense"? That flaw is very human. It can't cringe over its mistakes like we can, so at least we've still got that.