5 ms·
ChatGPT has entered the classroom: how LLMs could transform education
- ImHereToVote 3y agoI think the elephant in the room is that if LLM's improve at the same pace as diffusors. Then there won't be much to educate towards. What does a decade of agentic multimodal model progress look like? https://rocketdash.io/midjourney-and-the-progress-of-ai-in-2023-a-year-of-milestones/ https://rocketdash.io/midjourney-and-the-progress-of-ai-in-2...
- danpalmer 3y agoI disagree, I think very little of what is taught in school would be made unnecessary by LLMs. We teach maths, but calculators didn't stop this. Even if LLMs can take a less structured question and call a calculator, it just means maths moves more high level, and to understand the goals students would still need a foundational understanding anyway. We teach language for communication, and we'll still need to communicate. LLMs can write emails for us, but only if we can communicate what we want written. We need to be able to understand the output, decide what we want to change about it, and voice that back to the LLM. They're a time saver but don't really remove the necessity of the skills development in some sense. We teach languages for communication with others. Translation apps haven't stopped this. Being able to speak to someone is still worth a lot. If this does get solved in the future it'll be by UX improvements not AI improvements. We teach creative skills, but we know most students don't go into creative jobs. These skills are taught for pleasure, for cultural reasons, and to create well-rounded individuals. We teach history, geography, and science, not so that students can regurgitate facts (even if that is what ultimately gets tested) but because we as a society believe it is important to understand and learn from what came before us and how the world around us works, and be able to ask the right questions about the world. LLMs, if they continue to improve, might change how we assess students, and they might change the focus somewhat, just like the introduction of the ubiquitous home PC or the internet did, but I don't think they're going to eliminate most of what is taught in school.
- Workaccount2 3y agoI think the fundamental question to be answered is "Will humans be needed to move society forward in the future?" People stand behind "Sure, AIs can write emails, but they won't know what to write emails about". But to me that doesn't make sense. The holy grail of AI, what we are racing towards at a breakneck pace, what every company really wants, is the AI that knows what to write the email about... OpenAI, Meta, Google, homebrew. None of them are trying to build a calculator. They are all trying to build a calculator user. It's a very big difference and their progress has been nothing short of remarkable and unexpectedly fast.
- kiba 3y agoAre we looking to create AI agents? Citizens, not slaves?
- danpalmer 3y agoEven then, I don't think that changes many or any of the arguments. Perhaps you could drop the maths, but people still need to speak to each other, will probably still write to each other, will probably still write to persuade or describe even if it's just for pleasure. People will still want to know how the world works, we should definitely still learn from our history. As I said, the focus on why we're learning may change, and the testing may change, but I don't think that just because there are no jobs that require a human to write an email means we won't teach kids to write.
- Telemakhos 3y agoEarly education especially is not something that AI can handle, because it isn't just about learning facts or processes. Take small motor skill acquisition, for example: you have kids play with play-dough, finger-paint, fold origami, play musical instruments, and learn various handwriting styles like block and cursive and calligraphic styles, all to teach kids how to move their hands in complex ways to achieve what their brains want. AI isn't going to do that for kids, and tablets seem to have made motor-skills acquisition worse since the range of movements needed for a tablet is much smaller than that needed for 3d manipulation of objects in the real world. I don't think AI is going to excel in language education, either: I get bored chatting with a bot very quickly. Language education is all about keeping students engaged and communicating about tasks they actually care about. I don't see chatbots like ChatGPT doing that.
- hashtag-til 3y agoThis really could be a plot for "Idiocracy 2", showing humanity hundreds of years in future, where all education was given up in favour of LLMs and a bunch of undergrads/startups.
- ozr 3y agoI'm not sure how this connects. Diffusion models are great for certain tasks, not for others. They have sort of a niche use in audio and are the SOTA for image generation, but there is a lot of education (almost all) that doesn't apply to those domains. When we're talking about multimodal ML systems, the core is generally a transformer-based LLM with no diffusion component.
- niceice 3y agoHow accurate is it compared to the average teacher? In other words, what's the teacher error rate vs the AI tutor error rate? And what happens when these rates achieve parity?
- Someone1234 3y ago> And what happens when these rates achieve parity? Is there data to suggest that teachers are lowering their error rate enough to eventually reach parity? In particular out-pacing the technology which continues to lower its error rate. I don't think error rate is a useful metric, otherwise we'd already be replacing teachers. There is much more to teaching than being hyper-accurate.
- jncfhnb 3y agoError rate is not as relevant as patience, flexibility, and availability to answer questions
- lallysingh 3y agoAs this technology becomes cheaper and more specialized, this is really exciting. Imagine being able to ask your textbook specific questions about what you're trying to understand.
- xwdv 3y agoFor some jobs, why bother with classrooms? Throw people straight into a job and have the LLM teach them as they go. It’s a return to apprenticeship but your overseer is an AI. Cheap and very scalable.
- ImHereToVote 3y agoWhy not hire an agentic multimodal instead? When they are developed.
- ktaube 3y agoOne nice thing with LLMs is that there are no "stupid questions". You can throw it whatever is on your mind and get some insights.
- Someone1234 3y agoYou're right; but it should be noted that that is a design choice not an inherent property of the technology. Currently, the design goal isn't to make LLMs feel "lifelike." It is likely that lifelike LLMs will be released in the future, which could result in sarcastic or dismissive replies to poor questions or missing information.
- jncfhnb 3y agoBackwards. LLMs will naturally adapt lifelike patterns of their training data and are at least easy to prompt into behaving as such. We tune them to specifically not do that.
- keiferski 3y agoI expect public school systems to place limits on LLMs. "Don't ask about that." "You can't talk about that topic at school." And so on.
- colinrand 3y agoI always get very skeptical with putting more technology in the classrooms (at least here in the US). The primary problem is funding and too many kids for a single teacher. Educational innovation comes in with a bang and out with a whimper when the study turns out to be flawed, often quite severely. I'm sure LLMs can augment learning in some settings, esp in higher ed, but putting more computer time for kids learning basics (I mean K-8 mostly) I hope is handled more carefully than things like Quizlet...
- visarga 3y ago> I'm sure LLMs can augment learning in some settings, esp in higher ed LLMs are great explainers of known theory. They can adapt to the level of the user and illustrate with concrete examples. They have infinite patience, there is no pressure.
- eropple 3y ago> LLMs are great explainers of known theory. When they don't lie. When they don't make up citations that don't exist. I think GPT-4 is moderately useful for software development, and I use it daily, but I have to check even very minor things, and having ~25 years of programming experience means I can do that intuitively. A kid doesn't have that.
- justrealist 3y ago> When they don't lie. When they don't make up citations that don't exist. I think this will be close to 0 of a problem when explaining to a HS biology student something like, what a mitochondria does or what mitosis is. It only fails (increasingly rarely) when you push the boundaries of human knowledge.
- eropple 3y agoThat assumes that the asker doesn't then ask follow-up questions that do probe beyond the could've-been-a-Wikipedia-page starting point. And I don't know about you, but how `structlog` should be configured had better not be "the boundaries of human knowledge". As I experienced yesterday evening, GPT-4 doesn't even do that right without human assistance. LLMs are useful tools. They are dramatically less useful if you can't detect bullshit. By definition, a student is poorly equipped to do so, and moreso if allowed to atrophy in the area of research capacity because they can just ask an LLM. (A pocket calculator is a good analogy--life carries much less friction when you can efficiently do arithmetic and basic algebra in your head, because the affordances of dragging out a calculator to know how to minimize the change you get back are bad.)
- keiferski 3y agoI generally find LLMs to be useful, but I think these kinds of proclamations are a bit overblown. Many students do not want the kind of introspective, solo learning experience that a chatbot on a laptop provides. They want a social experience or a physically active experience, not one that requires them to sit quietly in a chair for 8 hours a day. And honestly, a classroom of students staring at screens talking to AI bots sounds like a dystopia to me. All of the best educational experiences I've had in high school and college came from a passionate teacher that conveyed excitement to the students. Or (especially in college-level philosophy courses) they were small discussion groups that went on for hours. Neither of these things is going to be replicated by talking to a chatbot and most of these applications are just further extensions of a (in my opinion) broken industrial educational model. That aside, I do think LLMs could be useful as a supplementary tutor, especially when your teacher isn't up to par.
- jncfhnb 3y ago> And honestly, a classroom of students staring at screens talking to AI bots sounds like a dystopia to me. Would it be less dystopian if it were replaced with a hologram of a historical figure / scientist speaking as though an actual primary source on the matter but with the same LLM behind it?
- sebastiennight 3y agoSame-same. The problem with the ChatGPT-tutor future is not "having to read". Also, I believe that having tens of thousands of teachers with their unions and quirks has its issues, but is a much more resilient system at the nation level than a centralized tutor system. (The centralized tutor is too easy to game, bias, get seeded with native ads, etc.)
- jncfhnb 3y agoAs someone who learned by listening to teachers and otherwise skipping all the readings I find that not compelling
- papichulo2023 3y agoYoutube was for many years the best place to find educational material. Sadly every year is harder to search for with all those "you may also like", "people who searched this also search this other irrelevant thing", "shorts".
- warner25 3y agoI'm a PhD student, mostly off on my own doing dissertation research and writing at this point, and typically getting one hour per week one-on-one with my advisor to ask questions and get guidance. So I'm already in the habit of reading and experimenting as much as I can to figure things out for myself, leaving only the toughest questions for those meetings with my advisor. Since he turned me on to using ChatGPT, however, I've found that I have fewer and fewer of those questions. ChatGPT seems to be able to answer most of them for me, instantly instead of waiting until next Monday afternoon, and probably better than my advisor could answer them off the top of his head. With that said, most kids are not mature PhD students who have already "learned how to learn", know what they need to learn about, know when and how to verify things by consulting other sources, and have an intrinsic motivation to attain a deep understanding of things.
- xnx 3y agoRelated, Sal Khan of Khan Academy, "How AI could save (not destroy) education" https://www.ted.com/talks/sal_khan_how_ai_could_save_not_destroy_education?language=en https://www.ted.com/talks/sal_khan_how_ai_could_save_not_des...
- georgejefferson 3y ago[dead]