5 ms·
Professor Malan said students would be warned of the pitfalls of the AI, saying they should “always think critically” when presented with information. I want t
by userbinator 3y ago
Professor Malan said students would be warned of the pitfalls of the AI, saying they should “always think critically” when presented with information.
I want to believe that this will actually happen, but my experience with people blindly trusting what a tool (not even an AI-based one) says, including but not limited to students, suggests that's not going to happen.
- imchillyb 3y ago> ..."always think critically"... Y'know, the thing we /human/ were supposed to be teaching you.
- p-e-w 3y agoThat's because authority figures don't actually mean it when they tell people to "always think critically". What they really mean is "think critically when others tell you something, but accept as gospel everything I am telling you".
- donkey_oaty 3y agoOn my experience most lecturers and professors welcome challenge because it allows them to expand on what they are teaching.
- p-e-w 3y agoThey welcome shallow challenges that allow them to demonstrate their intellectual superiority by correcting them. They most certainly don't welcome challenges to the basic assumptions on which their teachings rest. Not that professors are in any way unique in that regard; it is a trait shared by all people with power and authority.
- misnome 3y agoIt sounds like you had a bad experience with a bad professor, or - came in starting with this attitude. Because this doesn’t match my experience, at all.
- literalis 3y agoThere is just enormous variability with professors. The more MOOCs you take the more obvious this becomes. If you had good professors in college you should consider yourself lucky. There is a lot of absolutely terrible professors.
- michaelt 3y agoWell, there are challenges and there are challenges. A professor teaching about evolution will answer students' questions within reason - and students with a religious background might have heard some anti-evolution gotchas the professor will be happy to explain - like how something as complex as the eye could evolve. But that doesn't extend to debating bible verses, allowing so many challenges that it disrupts the class, or changing the exam so you can pass it while denying evolution exists.
- p-e-w 3y agoThat you leap from "basic challenges" to anti-science fundamentalism really shows how deep-rooted this problem is. Most educated people today earnestly believe that the only ones who would disagree on basic issues with the high priests of academia are fanatics, conspiracy nuts, and quacks. The idea that academics are on the right path has turned from something that must be continuously demonstrated to something that is assumed by default, as part of a new orthodoxy that ironically is almost indistinguishable from the religious and ideological orthodoxies that science once sought to replace.
- fn-mote 3y ago> The idea that academics are on the right path has turned from something that must be continuously demonstrated to something that is assumed by default [...] You're talking about a Ph.D. level investigation, not something that is usually considered at the level of an undergraduate in the US. Most beginners lack the contextual knowledge to recognize even glaring errors. For example, I once saw a distributed application that occasionally updated a central database without any locking. Occasionally the data would get corrupted by simultaneous writes, and the original dev had no idea why. Consider adding more context if you want to continue to write about dogma in academia. Share your own experence. At the level of generality you are writing it's impossible to engage more because we don't share the same context.
- michaelt 3y agoI don't know how you arrived at that interpretation of my post. I chose evolution merely because a substantial and politically important group of Americans earnestly disagree with the academic consensus; it's an area where there has been genuine public debate; it's foundational to some academic fields; and it would believably come up in first year compulsory classes. I might disagree with academics about whether mailing a survey to mentally competent adults counts as human experimentation that needs ethics board approval, as outside of academia people use surveys all the time. But that's hardly something an academic would refuse to discuss. I might disagree with academics about feminism or marxism or underwater basket weaving - but that stuff's all elective, why would I have taken an elective module from a teacher I thought was full of shit? I might disagree with the high tuition costs of universities, and the money wasted on sports, overpaid administrators, and overpriced journal subscriptions. But most academics would actively agree with me, they just can't change it. I might disagree with details of how a course is taught, like whether Java is a good language for an introductory CS class. Or whether we really need so much math in the CS curriculum. But that's not really a fundamental belief. I might disagree with academics because I think the moon is made of cheese, but that would be a straw man argument.
- chongli 3y agoThey most certainly don't welcome challenges to the basic assumptions on which their teachings rest. Professors are trying to teach a class, not engage in a debate with a student. Challenging basic principles that everyone in the class are already assumed to have accepted is usually seen as an attempt to derail the lecture. Derailing the lecture and drawing the professor into a debate with you effectively denies the other students access to education. It’s roughly equivalent to heckling a comedian. If you want to debate your professor, do it on your own time, in office hours. If the professor is still offended and unwilling to debate then you have reasonable grounds to complain. Most professors I’ve met absolutely love to debate outside of class.
- civilized 3y ago"Always think critically"? "Simply read the textbook" would be a more practical instruction, and also what I did in university anyway. Critical thinking is a useful description but not a good prescription. It's like telling someone to always be orange. If you want that to happen you have to eat carrots. It won't just happen by fiat or willpower.
- quickthrower2 3y agoYoutube + textbook + good discord (slack or IRC etc.) can replace an undergrad CS course pretty well IMO for at least the practical skills. AI can help but is a minor piece, at least right now.
- danuker 3y agoWhatever a student encounters in a field probably has search results on the web. I find it hard NOT to find the same question on sites like StackOverflow, Quora, or Reddit.
- civilized 3y agoMy last contact with the educational system as a learner was around 2009, so I missed pretty much the whole YouTube / Khan Academy revolution. It would be very interesting to see what it's like to learn today, what resources I'd find most effective.
- dools 3y agoI saw a project where someone had trained an AI on classic novels so you could have a conversation with the book. I think AI trained on text books should be able to achieve the same thing relatively easily. It’s just an interactive textbook, seems like a pretty good idea to me.
- msla 3y agoIt could be a sink-or-swim kind of thing: Saying you trusted the AI isn't accepted as a reason for bad work, so anyone who trusts the AI and gets burned learns a lesson. Maybe I'm imputing too much intelligence to Harvard's administration.
- donmcronald 3y agoDoesn’t thinking critical require enough basic knowledge about a topic to be critical of information? How does that even work if you’re there specifically to learn? Education requires an information source you can (mostly) trust blindly. How else do you learn? If they think ChatGPT is ready to teach, they should offer an electrical course using it and force the administration to take it.
- Lio 3y agoMy experience with LLMs so far is that they very confidently give you an answer and very convincingly explain that answer but for certain portion of the time that answer is very wrong. You can even get it to break its reasoning down into little convincing but, none the less, incorrect steps. If I was running this course I would make that "artefact" part of the process. i.e. I would tell students that the chatbot will occasionally very convincing lead them in the wrong direction but that they can fact check its answers in the course material. I would set traps to ensure that they are doing that. ;) Use LLMs but never trust them, they're the Cliff Clavin of information tools.
- Hendrikto 3y ago> I would set traps to ensure that they are doing that. ;) You won‘t have to. Students are extraordinarily skilled at fining endless pitfalls on their own.
- DistractionRect 3y agoThat can be a double edged sword, particularly when the lesson is about an edge case/pitfall. You'd be surprised how they can seemingly blunder their way to the solution while waltzing around the edge case, and thus not learning the intended lesson. Setting the stage where they either land in the pit, or start from within, ensures they're interacting with the material as intended.
- ekianjo 3y ago> My experience with LLMs so far is that they very confidently give you an answer and very convincingly explain that answer but for certain portion of the time that answer is very wrong. This is true of humans just as well
- Topfi 3y agoWhilst that is true, I feel that if that human is an educator employed by a reputable institution, answering questions in their field, the expectation of most is going to be that they provide accurate information. As this is an introductory class, any arguments that even experienced teachers can occasionally cling to incorrect or outdated information becomes moot in my opinion. LLMs as of now simply appear not reliable enough for an institution like this one to attach their name (which brings credibility in the eyes of the public), especially as their comments on the need for users to be vigilant ("they should always think critically when taking in information as input") make it sound like they did not in fact find some new way of reliably grounding output in accurate information. Mind you, this is coming from someone who has great hopes for the future of LLMs in education as they can more effectively deal with students on an individual level. I just feel that currently LLMs are still too error-prone for an institution such as Harvard to incorporate them into an introductory course to assist. Until these insitution stop putting the majority of responsibility on students finding erroneous output, I feel this is not ready for wider educational use.
- latexr 3y ago“Always think critically” is poised to become the “drink responsibly” of AI. A convenient and counterproductive way to push responsibility onto the users. https://en.wikipedia.org/wiki/Alcohol_advertising#Drink_responsibly https://en.wikipedia.org/wiki/Alcohol_advertising#Drink_resp... https://youtube.com/watch?v=DnSp2S7vzH4&t=31s https://youtube.com/watch?v=DnSp2S7vzH4&t=31s
- grumpyprole 3y agoAgreed, and due to the way LLM works, misinformation tends to look very plausible.
- scotty79 3y agoFrom the perspective of learning how to tell lies from the truth it's a very good lesson that things can be bs no matter how plausibly and nice they sound. So you always need to check sources and read a lot on the subject.
- ekianjo 3y agoMisinformation was never a problem on the provider end but the receiver
- dr_dshiv 3y agoYes. Definitely users are responsible for knowing this. And it is one of the key things that education needs to teach.
- chongli 3y agoI’m generally skeptical of the critical thinking movement. There is not much evidence that students can be taught to transfer their critical thinking skills from one subject to another. I think much of what people refer to as critical thinking is more aptly called subject expertise.
- hgsgm 3y ago
- agumonkey 3y agoDepending on the level of pupils it can be safe, but after taking part in moocs with people of various skill levels, it's fair to assume that a lot will be lost in confusion without the ability to discern correct from incorrect.
- c7b 3y agoIn some sense, for a class like CS50, experiencing first-hand that current LLMs are often confidently wrong could be seen as part of the educational mission. If you asked me what the first thing that a young user should know about today's tech is, then it's probably that.
- David_SQOX 3y agoHumans love taking the path of least resistance. It's tempting to trust whatever ChatGPT says, especially if you are a young student. Getting burned and learning the hard way is how most students are going to learn this lesson, just like any other lesson in life. Being efficient and being lazy are rubbing up against each other with LLMs. A lot of blurred cognitive lines with this budding technology.