4 ms·
>Picture this: You're a seventh-grade student who struggles to keep up in math. But now, you have an AI tutor like the one Sal describes by your side. Picture
by croes 2y ago
>Picture this: You're a seventh-grade student who struggles to keep up in math. But now, you have an AI tutor like the one Sal describes by your side.
Picture this: You're a seventh-grade student who struggles to solve the equations in math. But now you have an AI that solves it for you.
I bet that there will be more students of the later type than the former.
- chii 2y ago> But now you have an AI that solves it for you. and then the AI explains how it was solved, step by step. You can repeatedly ask it to clarify, and it has endless patience and won't get bored or sick of you. Eventually, you understand how the equation is solved. No human teacher would be able to achieve this.
- GolfPopper 2y agoBut sometimes it makes up answers that are wrong but sound plausible to you. You have no way to tell when it does this, and neither does it.
- arresin 2y agoOr when you tell it you think the answer is something else it agrees with you and apologies that yes, now it can see, 2+2 does equal 5.
- neuralnetes-COO 2y agoThat is the entire purpose of LLMOps. Provide guardrails to prevent hallucination and ensure precise control of GenAI output.
- tayo42 2y agoHow can you tell what's true or not?
- neuralnetes-COO 2y agoYou have to develop your own QA methods to ensure output is exactly what you want.
- falcor84 2y agoNeither can you easily notice that when a human teacher/tutor does that. At least with math, you're able to try it yourself and see if it works. I've had many cases where following through on a misleading explanation by a teacher/book actually ended up leading to me better retaining the topic.
- xscott 2y agoThat's absolutely a bug that needs to be fixed, but I think it's possible. Maybe have the network which generates the answer be moderated by another network that assesses the truthiness of it. It's just a matter of priorities for the company designing the models.
- ben_w 2y agoIt might be possible, but nobody knows for sure, because these models are rather more mysterious than their architecture suggests. > Maybe have the network which generates the answer be moderated by another network that assesses the truthiness of it. Like a GAN? Sometimes you can do that, but it seems not always. If this was simple and obvious, they'd have done it as soon as the first one was interesting-but-wrong.
- jobs_throwaway 2y agoEspecially in a limited domain like grade school math, it seems entirely plausible that we can have models in very short order that ~never hallucinate. There's no external dependencies and the problem space is extremely well-defined and constrained. Much, much, much easier than making something like Chat-GPT never hallucinate
- jsbg 2y agoExactly. In school I couldn't understand the Heine-Borel theorem and a professor actually got annoyed at me asking about it even though it was just one time. When ChatGPT was first released one of the first things I did was ask it to explain it to me. Even the 3.0 model was pretty good at it!
- atonse 2y agoWhat I also love is that you can ask it to explain with varying degrees of simplicity. You can say, ELI5 (like the Explain Like I'm 5 years old Subreddit), or explain it like a child, or explain it in very simple English (which is like Simple English wikipedia). It is actually going to be the greatest learning tool, but only for people that genuinely want to learn.
- CamelCaseName 2y agoI must admit, I am quite envious of students with these tools. I wish I had this during my studies. Certainly as my parent's generation must have been with the internet and computers for me. I'm not sure what to do with this envy. Though, it has made me want to have a child even more, just to see first hand how they could develop so much faster and smarter than me.
- koolba 2y ago> No human teacher would be able to achieve this. This immediately reminds me of the scene in Terminator 2 where Sarah Connor is reflecting on how the terminator, reprogrammed to aid John Connor, is the best father figure he’s ever had. https://www.youtube.com/watch?v=tksN5Jaan9E https://www.youtube.com/watch?v=tksN5Jaan9E “It would never leave him, and it would never hurt him. Never shout at him or get drunk and hit him or say he was too busy to spend time with him. It would always be there, and it would die to protect him.”
- llm_trw 2y ago>Eventually, you understand how the equation is solved. No human teacher would be able to achieve this. One of the things I have hugely enjoyed about LLMs is asking the same question again and again until I finally get why it is the way it is. No human could deal with "I don't get it, try explaining it another way..." after the 10th time.
- Ghexor 2y agoA human teacher can see the problem from the students perspective and understand the error they make and why they make it. No current ai would be able to achieve this. But alas, few human teachers can or will take the time to do this per student. Infinite time and patience really are the ai's superpower here IMO.
- chii 2y ago> A human teacher can see the problem from the students perspective ... No current ai would be able to achieve this Not all teachers are able to see the POV of the student. In fact, i would argue that only exceptionally good teachers are able to. Whether AI can achieve this level of understanding is still yet to be seen, but i would hope it is possible.
- mminer237 2y agoThat requires a young student who is really self-motivated to keep asking it to clarify things. Plenty of teachers, parents, and tutors are willing to keep trying new ways of explaining things to kids until they understand it. The kid giving up is way more common than the adult without someone pushing him to keep trying or coming back to it regularly. Obviously, not every child has someone in his life that cares enough to do that, but I can't see AI as anything other than a subpar substitute.
- theyinwhy 2y agoFor many the alternative would be no substitute at all.
- anon7725 2y agoI guess the difference is that there is a social dynamic at play between a student and an instructor. The student may tire of some aspect of the relationship before they tire of learning the material. For example, unless the instructor has some kind of Jedi master level self control they may begin to show frustration at being asked the same question repeatedly or with minor variations.
- chii 2y agoif the student is not motivated at all, they will be in the same situation whether there's an AI or not around. If they choose to use an AI to "cheat" and not learn, then it is no different than them using any other methods to not learn (such as truancy).
- jgalt212 2y ago> Eventually, you understand how the equation is solved. No human teacher would be able to achieve this. Not true, but only available at great expense.
- chii 2y agoa technicality that is irrelevant to most people.
- miki123211 2y ago> no human teacher would be able to achieve this. They would, but only if you were rich enough to afford a personal tutor. There's plenty of scientific evidence that students who have one learn a lot faster than those stuck in a classroom. With AI, you can probably get most of the benefits of a personal tutor for a fraction of the price.
- itronitron 2y agoThere are already multiple websites that will solve math problems that the user submits and then walk through the individual steps one by one. I'm pretty sure the solutions are based on mathematics and not a trained AI.
- LegitShady 2y agoI have coworkers who already stop to type things into a GPT before using any part of their mind to think about things. At this point I assume its inevitable that for large segments of people, who are not actively trying to maintain the independence of their mind, will allow these computers to do their thinking and decision making for them.
- lannisterstark 2y agoNot everything needs to be analyzed ad-nauseum. Sometimes I just want an answer so I can move on and use that for something productive in my life.
- nicce 2y ago> I just want an answer The issue is that AI is not at least yet accurate enough for that. You need think on your own and be expert to spot all the inaccuracies. But then again, we are talking about how students can learn based on that...
- add-sub-mul-div 2y agoCalculators keep us from having to practice a certain skill and we accept whatever consequences of that, we've survived it. But yeah, imagine if the skill we no longer had to practice was critical thinking period.
- asabla 2y agoFor sure! But idea behind these AI tutors are to help and guide you through the process of asking questions until you understands. Will it be perfect? hell no! Just another tool for teachers to either enhance and/or give extra help with almost no extra resources. Hopefully this will pan out for the better then the worse
- PheonixPharts 2y ago> pan out for the better then the worse While I'm sure this is a typo, I also expect this is exactly how it will play out. For the better initially, then, for the worse a short time later.
- nicce 2y agoWhere is the opportunity, there is a crime. The most of the students will not use it for improving their own text or iteration process, unless the penalties for cheating are very high. They instead copy-paste the instructions, add some adjustments, and then copy-paste the output. This will give them results in the shortest amount of time, if there are assignments where something needs to be returned. But how to detect cheaters? Too many students do tasks as in "completion" oriented way, not in learning oriented way. I am mostly talking from college/university perspective.
- tombert 2y agoI dunno, I've found ChatGPT (and its clones) have been immensely useful as a learning tool for me. Having it summarize stuff in different ways and being able to immediately ask clarifying questions has been sort of a game-changing learning tool, at least for me. I don't think they should allow use of AI during tests because yeah, it'd just do all the work for them and they wouldn't learn anything, but I absolutely think there's value in being able to use it as a 24/7 instant tutor, particularly since ChatGPT can be coerced into explaining things in basically any style that you'd like. Something I've found fun and bizarrely useful is having ChatGPT explain stuff in terms of scripts from King of the Hill. It's fun to hear Hank Hill compare ZF Set Theory to something as reliable and efficient as propane while Dale goes into tirades about how the government imposed the axiom of choice to distract away from System F.
- ben_w 2y ago> I don't think they should allow use of AI during tests because yeah, it'd just do all the work for them and they wouldn't learn anything, but I absolutely think there's value in being able to use it as a 24/7 instant tutor, particularly since ChatGPT can be coerced into explaining things in basically any style that you'd like. For any test where there's an AI good enough to cheat with and cheap enough students can afford it, the test itself is no longer important — it is as pointless as testing how well students can use fountain pens when everyone uses a keyboard for actual work. Or how well they can play chess. I'm not sure the exact shape of what each model can and can't do, but I am confident that this means they're never be an important "cheating" risk, not even when they're technically capable of it.
- tombert 2y agoWell, no, I absolutely and fundamentally disagree with that. We didn't just stop teaching children how to read the second that text-to-speech stuff came about, and we didn't stop teaching basic arithmetic the second that calculators were invented, and we didn't stop teaching algebra the second that Wolfram Alpha was released. There is value in learning the fundamentals of things. If you never actually learn algebra, then it becomes effectively impossible to do the more advanced stuff.
- falcor84 2y agoBut does a typical teenager actually need to "keep up in math"? I would hazard a guess that only maybe 5% of people would need to ever utilize any math beyond basic algebra. Wouldn't it make more sense to leave these kids to do something else with their time, while offering personalized (possibly AI supported) math programs to those who actually intend to do something with it?
- Phiwise_ 2y agoThose 5% go on to make an upper-class salary sitting in an air-conditioned office instead of a lower-class salary turning wrenches and stacking boxes. What makes more sense than enabling everyone who can to attain that life? (Plus every one of them who gets out makes life better for the rest at least by reducing downward pressure on wages, and hopefully also by creating new business opportunities that raise wages further by increasing supply. Rigorous education is almost always a win-win: https://matiane.wordpress.com/2021/09/15/democratic-education-by-c-s-lewis/ https://matiane.wordpress.com/2021/09/15/democratic-educatio... )
- falcor84 2y agoSpeaking of AI, I wouldn't be surprised if, in the next decade, jobs that involve turning wrenches would pay significantly more than most jobs that can be done fully on a computer.
- Phiwise_ 2y agoPerhaps, but only because most jobs done on computers today are by people who also have little if any math or programming ability. Change that and it's a different world to make those predictions in.
- viking123 2y agoI mean wouldn't those blue collar jobs get more and more saturated then if office jobs get less and less pay so people start moving to those? Personally I very much respect people who do those jobs, but I could never do them because of my disability so my only good choice is pretty much computer related jobs or then it's back to some sort of government benefits.
- photochemsyn 2y agoSolve one problem with the help of a LLM, then solve three problems of the same type without the help of a LLM. Might need a human teacher to explain to the student why this approach is necessary, though.
- Phiwise_ 2y agoWhy would you assume this? Wouldn't Sal Kan want to design his version of a teacher AI to avoid that behavior?
- nicklecompte 2y agoPicture this: you're a high school junior struggling to understand simple free-body diagrams. You ask the AI tutor for help and it gives you a pile of bullshit. Unfortunately the bullshit is written in the exact same authoritative tone as your (correct) textbook, and the AI temporarily gaslights the actual human teacher into accepting a wrong answer, even though the teacher has a B.S. in physics. (Source: a very smart science teacher I know and won't name. Keep in mind most high school science teachers have weak scientific backgrounds. This technology is poison.)
- red_admiral 2y agoWe've had phone apps that you can point at an equation in a textbook and it solves it for you, for several years now: https://apps.apple.com/us/app/fastmath-take-photo-solve/id1438642238 https://apps.apple.com/us/app/fastmath-take-photo-solve/id14... I don't think we need Generative AI for 7th grade. College, perhaps, but how much advanced math is there in 7th grade these days?
- dmvdoug 2y agoCame here to point this out, as a history teacher who is often told by students they use phone apps for math.
- theptip 2y agoThere is an important point here; the curriculum needs to change, a lot. There is little point in writing essays any more. We’ll need to find other ways of testing knowledge acquisition. But also, we’ll need other menus of skills/knowledge to acquire. It seems to me that rote memorization of facts is even less useful than it was 5 years ago. However being able to synthesize facts and ideas, this is where the human edge will be concentrated. With AI to do the grunt work, maybe we can have our kids actually building meaningful things much earlier than they would otherwise be capable of.
- radicaldreamer 2y agoPeople who find the tool to do the work for them will be fine. I remember “learning” to use Mathematica so I could easily complete copious calculus assignments and homework in high school. It didn’t keep me from learning the material - a lot of those assignments and problem sets were simply busy work — but did improve ho much free time I had to read and surf the net and learn new tech things.
- deleted 2y ago[deleted]