5 ms·
I Used to Teach Students. Now I Catch ChatGPT Cheats
- turtleyacht 2y agoIf AI enables rapid synthesis up to the frontier of knowledge, educators must guide students to their edge of ignorance. A new approach to the Socratic method, where we don't always know the answer at the end, but have collected some useful tools or models along the way.
- stereolambda 2y agoThe thing is, having access to AI generating "writeups" for you, or even reading through what you've generated, does not equal knowledge in a useful sense. The act of writing would prove you have the knowledge, and can organize it and operationalize it to an extent of writing a text about it. So there's a real difference between being able to write your own summary and faking it. If we're looking for bright sides, there are parts of education/public debate which have been merely about stringing words together and mastering a discourse. This can be made more irrelevant by being indistinguishable from ravings of a generative model. Remember that even something like literary studies is supposed to be about themes, ideas and parts of human experience reflected in art, history of intellectual formations and stylistic techniques etc. I was gonna say, knowing educated people I doubt any of this makes you wiser by itself. This would disprove the 'prepare for life' bit of the OP. But thinking about it, the most ridiculous scams and traps in life aren't generally targeted at people who've read Milton, Moliere etc. So maybe there's something about exercising your mind about human condition, and thought and experience accumulated by mankind, that I'm not appreciating enough. It does allow you to have a wider language to speak and listen, more dimensions to understand things in, and experience life.
- kittikitti 2y ago"Many of the students who enrol aspire to careers in medicine" This should be enroll.
- juped 2y agoCanadians are allowed to use British spellings.
- glonq 2y agoCan confirm, even though our neighbours don't respect the honour of this behaviour ;)
- kittikitti 2y agoSorry, I wasn't aware of this alternate spelling.
- sammyoos 2y ago*One consequence of this boom in AI use is that, in my online classes, I can no longer be sure of what my students are learning. I have no way of determining which concepts they are grasping and which are proving elusive.* As someone who regularly interviews students for jobs, it is clear that the universities that have permissive use of AI for assignment completion produce graduates that know very little about the core concepts of their studies. Many students cannot explain simple concepts and base level assignments take significantly longer.
- david38 2y agoCheating != permissive.
- behnamoh 2y agoon the other hand, they might produce students that know how to use AI tools, and in the long-term that might be what businesses prefer – employees who know how to use AI, not employees who have memorized facts in school.
- alwa 2y agoOn the third hand, it’s hard to develop meta-level skills—nuanced judgment and wisdom in a domain—without engaging over a long period with the peas-and-carrots aspects of the domain. I guess it’s kind of the “where’s our next crop of senior engineers going to come from?” worry around these parts. Then again maybe you’re right, maybe AI Operator is the domain where it’s important to develop meta-skills now. I can’t imagine someone who chose to use their school years specializing in that is anybody I’d want to hire or work with, though: it would seem to signal an incurious and timid mind, one that chose to optimize for metrics (grades) rather than the substance of the work at hand. But that bias is the same reason I don’t thrive in large corporate environments in the first place. Still I have a hard time imagining that AI Operation skills take enough developing to be worth somebody’s time to specialize in as a student. Could just be old-fashioned, though—spoken like an outsider ignorant of the finer points of AI Operation...
- thesuitonym 2y ago
- asimpletune 2y agoIn Italy there's a fantastic way to allow students to use LLMs to their hearts content, but still discern whether they learned anything at the end of the day: the oral exam. Students one by one wait to be called into a room where the professors can ask them literally anything. Because this is a part of the academic tradition, professors are also very good at administering these exams. They know how to give hints and clues, but also to pounce when they detect BS. I'm not saying it's perfect, but I do think that the outcome is a much better reflection of your grasp on the course material than anything else, besides maybe project-oriented tests. There's also the added benefit of not having to grade so many exams or papers, and usually all the professors from the department conduct the exams together.
- jjmarr 2y agoI do competitive debate—which is improv essaying. ChatGPT still isn't up to the standard of tournaments because it just dumps a bunch of irrelevant points, when the hardest part of debate is showing the impact of a fact. It fails to grasp the broader context you want to situate your essay in. In my experience, the vast majority of university students are unable to impact because they've been taught a formulaic five-paragraph essay format based around spamming three facts with very little emphasis on linkage. That's devoid of context as it's easier to grade. Profs should grade essays based on whether they address the main themes of the author's thesis rather than adherence to form, spelling, and grammar. ChatGPT usage will go down because it's unable to do that.
- recursivedoubts 2y agoI have adopted the following explicit policy: I am here to teach you. I am a good teacher, and if you work hard you will learn important material in this course. If I catch you cheating you will be referred to the university for a disciplinary infraction. However my job is not to ensure that you are not cheating. Again, it is my job to teach you. And, likewise, it is your job to learn from me. You (or your parents) are paying good money for you to be here, and it is your responsibility to make good use of that time. It is likely possible to pass this class by simply cheating. However, that is deeply pointless for you. I get paid the same regardless. When you sit down at your first job, staring at a mess of unfamiliar code you have been given, you will either be glad you didn't cheat or regretful that you did. Let's begin.
- zeta0134 2y agoRealizing that my professors were being paid by the university and not by me, and that they had no natural incentives to ensure I actually passed the course, was a necessary wakeup call. At some point I realized I was spending that money on the opportunity rather than the outcome. I just wish I had clocked it sooner. I never did graduate, but the classes I did complete, when actually exerting the required effort, taught me what I needed to know. Once I had learned how to make myself learn, I found that I was able to adapt adequately to the workforce and the degree became little more than a signal. It's ... odd, to have arrived at this conclusion. On paper, the decision to drop out once I had a real IT job would be seen as a failure. But it's not like I ever stopped learning. I love to challenge myself to learn new things. And I do feel like GPT and friends somewhat short circuits that process. It's handy for a quick lookup in a subject I'm not interested in, but to actually learn a thing I need to practice doing it. There is no substitute.
- svilen_dobrev 2y ago> had learned how to make myself learn Someone told me ~30y ago, that the purpose of the higher education is: so you learn how to learn. (okay, ought to be). Not the memorizing, or the get-drunk parties :) Now, whether the system-as-is actually even targets that, is a separate question. So if one achieves that earlier, yeah, no need to waste further years there. Although as with most institutional artefacts.. , these diplomas - let's call them <tags> - are still used across the institutions, to prove institution-"tax" has been paid.
- A_D_E_P_T 2y ago> That moment, when you start to understand the power of clear thinking, is crucial. The trouble with generative AI is that it short-circuits that process entirely. One begins to suspect that a great many students wanted this all along: to make it through college unaltered, unscathed. To be precisely the same person at graduation, and after, as they were on the first day they arrived on campus. As if the whole experience had never really happened at all. If nothing else, LLMs have completely vindicated Bryan Caplan's signaling theory of education. The author of the piece comes across as really quite solipsistic and as somebody who has never attempted to understand the motivations of other people; it comes as a shock to him that they'd seek the path of least resistance.
- whatshisface 2y agoThere are a lot of tricks that unscrupulous used car salesmen can apply to sell a lemon, but that's not vindication for a signalling theory of cars. It's simply the case that in any market, some sellers will try to match the appearance of the best goods with as little labor and cost as possible.
- ceejayoz 2y ago"The path of least resistance" is not necessarily the good one.
- velcrovan 2y agoTeachers used to be able to talk at students and then use asynchronous writing assignments as convenient shortcuts for verifying understanding. Teaching is still very possible, just less logistically convenient than it used to be. I naively envision a next-gen college where admission and instruction are conducted by interview and conversation.
- tomsmeding 2y agoThat would be very nice. Who is going to pay for the teachers, of whom you're going to need many more with this (superior) teaching style?
- aantix 2y agoThe University of Texas has 51,000 students. In state tuition and fees are $31,000 per year. Out of state is $42,000.
- thesuitonym 2y agoMaybe we could try taxing the rich?
- code_for_monkey 2y agooh no! Anything but that! Everything will fall apart!
- ghaff 2y agoI don't think that anyone seriously disputes that at least some degree of personalized instruction and perhaps hands-on (depending on the subject) is valuable. But it doesn't really scale.
- velcrovan 2y agoWhat’s the point of a question like this? “Who pays for teachers” is a policy choice, like it always has been. Whether and how people are willing to pay for effective education vs. ineffective education depends on cultural values and priorities. Does that help? edit to add: maybe what you’re implicitly asking is “Particularly in America where people view education as an indulgence and a luxury good, how would we ever fit this model into existing starvation-level budgets of the public school system, or into the existing academic institutions which pass all their costs onto students?” This doesn’t change my answer but it makes that answer a little more obvious.
- theyknowitsxmas 2y agoThe old fashioned way: make students stand in front of the class and drill them on anything. quickly weeds out the idiots.
- ghaff 2y agoAnd anyone who just doesn't function well under pressure. And maybe that's OK but there are people who know their stuff but don't deal well with answering hard questions on their feet.
- unyttigfjelltol 2y ago> this enthusiasm is hardly dampened by, say, a clear statement in one’s syllabus prohibiting the use of AI. I've learned from AI about weird wonderful, obscure and niche topics, important and trivial. The university used to be defined by the size of its library, when knowledge was confined to physical places. Now the academy locks a modern storehouse of knowledge? And students pay for this? Education needs to evolve. It's no longer enough to teach students to think deeply and critically. It reminds of my first month of law school when some chipper professors painfully educated us on "Sheperdizing" case decisions using the printed volumes. The equivalent of printing your database and indices to run your next query. Several layers of obsolete, pointless activity they should have stricken from the syllabus in favor of a future-oriented curriculum. So too here.
- whatshisface 2y agoThey're not banning using it as a "storehouse of knowledge," they're banning using it as a way to go from prompt to essay without passing either one through your own brain.
- Ukv 2y agoAuthor does also say: > Or: 'I just used it to help with the research.' (More and more, I have been forbidding outside research in these papers for this very reason.
- boesboes 2y agoGive it time, when I was younger I was not allowed to use Wikipedia as a source. Change takes time and in the meanwhile people will complain.
- GJim 2y ago> I was not allowed to use Wikipedia as a source Ummmmm One of the "rules" of referencing is that one never references an encyclopaedia. An encyclopaedia is where you get only the basic background information for your study, not details worthy of referencing. Reference an encyclopaedia in an academic paper and the referees will, quite rightly, reject it and request a better source for your reference.
- ninetyninenine 2y agoI would be using ChatGPT to grade the paper.
- iamleppert 2y agoAI is here to stay. Instead of shouting to the wind and pining for a world that doesn't exist, this educator needs to adapt -- or die. Probably will end up doing the later before the former. It is very fitting and very apropo to this life that the irony of the pursuit of knowledge has been distilled down into an algorithm that feels nothing, cares for nothing, wants for nothing. It has no life to live, yet is approaching perfection in its execution in all human knowledge endeavors. It's as if the entire time that which those like him hold sacred, knowledge and its worldly pursuit, has been shown to be nothing more than yet another vanity and a form of pride itself. I see no difference here in those that likely carried with them pride of tilling the land by hand, how they must felt when machines came along and did it that much better, faster, cheaper and without a care in the world. What were the teachers of the manual labor saying in the last industrial revolution? I don't really feel sorry for him or the rest of the prideful educators, perched in their ivory towers. The day of reckoning has finally come for them and I'm here for it.
- ceejayoz 2y agoChatGPT isn't doing original research. It relies heavily on the compiled output of the folks "perched in their ivory towers". Kill off those ivory towers and it'll look as dated as IE6 in a few decades.
- jayd16 2y agoReplace AI with plagiarism in your statement. Now what do you think?
- GimbalLock 2y agoAh yes the industrial revolution, which had no far reaching negative consequences at all. What a great metaphor to go along with your LLM promotion.
- ghaff 2y agoI mean, one can always point to negative consequences of change, but if you look at the overall results of industrial advance it's pretty hard to see the net negative for most people. Social advance on a lot of different axes had pretty impressive growth because of the industrial revolution.
- mhb 2y agoSo an example of Goodhart's Law? Once there is less reward for high grades, the issue goes away. Sounds like grade inflation already is making that happen.
- josefritzishere 2y agoI remain unimpressed with AI. The results are mostly trash.
- SubiculumCode 2y agoYou know, oral exams are a thing.
- deleted 2y ago[deleted]
- TrackerFF 2y agoUnfortunately, more and more students view higher education as a pure formality - in order to get jobs. The disillusionment kind of kicks inn when you take on your first internship, or full-time position, and discover that there's a huge gap between what you learn and what you actually use. It is unfortunately even worse when it comes to grad school - some people are in job positions where you're required to hold a masters degree, if you want to climb the career ladder. My own MBA was a pretty expensive diploma that only served as a door to more senior positions. Pretty much all the topics I had, I had taken before, or had been exposed to through work - maybe a whole 10% of new / fresh knowledge...and I'm the intellectually curious type. So I'm not at all surprised that a bunch of students today will more or less offload all their schooling onto these models.
- Netcob 2y agoIf anything, this is just putting the huge disconnect between the ideals and the realities of higher education on display. I studied CS because I love computers and programming and I wanted an SWE job. The idea was to earn a living doing something I enjoy / am good at, and I needed a degree for that. I didn't mind "learning how to learn", getting to know topics I probably wouldn't have chosen to learn on my own, meeting people pursuing the same goals and so on. That was nice, especially the idea of it, but it wasn't really my goal. The reality was that during that time my primary worries were getting to lectures on time and passing exams while barely having enough money to afford anything beyond food and shelter. It wasn't me and my teachers engaging in the noble pursuit of science. I was worrying about exams while they were probably worrying about grading while taking a break from worrying about funding and authoring enough papers. Thanks to some fluke I had a few weeks with almost nothing to do during one semester, so I decided to try and write a 3D engine. That was actually me learning just for the sake of learning: not thanks to the education system, but despite of it. If AI brings this entire illusion down, maybe that's a good thing.
- instagib 2y agoIt is in some jobs. Newly educated or plain new employees are fairly useless until they have 1-3 years experience in my job area. We would routinely pay graduates or masters levels less than experienced technicians or field engineers because they took so long to create any value. I’ve taken many courses and many stop short of giving actual usable skills. You’re supposed to do that on your own time supposedly. You don’t get start to finish an internship experience until senior year for software engineering. Electrical Engineering you may not learn soldering or how to actually build a power supply from physical parts.
- Ukv 2y agoWhile widespread LLM access may have exacerbated the problem, for courses with grades determined solely by uncontrolled out-of-classroom assignments there were almost definitely already a good chunk of students essentially just paying their way through. Having at least some portion of the assessment, maybe a defense of their written paper, take place in a controlled environment seems necessary to verify that it's actually the student doing the work and not someone else or a chatbot. Alternatively, in some cases it might make sense to assess students by what they can do when fully allowed to use LLMs, given they'll likely be able to use one in their job. If even a student knowing the course material can add nothing to what an LLM already does alone, it may be a good idea to revise the syllabus. I know the author says "Look, even if that were true, you have to understand that I don’t equate education with job training" and to a large extent I agree, but equally they in turn should understand that a lot of students do want jobs and so want to learn at least some material that isn't already automated.
- zebomon 2y agoWorking as a freelance writer on Fiverr for the last ten years, I would receive daily inquiries from students asking me to write their papers. I always turned them down. It was explicitly against Fiverr's rules, and I wasn't going to help them cheat anyway. I often wondered whether or not they ended up finding someone else to do it for them. Those inquiries don't find their way into my inbox anymore, so I guess I have my answer. A little self-promotion here. I'm building a tool to help combat this issue. If you're a teacher, I'd love to talk to you about it. Give it a look: https://itypedmypaper.com https://itypedmypaper.com
- Netcob 2y agoIn a perfect world, we would have had a very broad conversation not just about AI in education, but about the role of education in society. I don't think it has ever been a purely intellectual pursuit. Especially in societies that tell you that you'll never get a well-paying job unless you get a degree - students feel significantly more pressured to pass tests by any means necessary so they can present a certificate to their future employer than they feel encouraged to learn and grow. For the ones who are actually interested in their field it's probably something in between. But the deal is pretty clearly "Get to a prestigious school, make sure you don't spend any more time than necessary, and if you don't get a degree then it's been a huge waste of time and money". Of course it's very disrespectful to just generate some AI slop and expect a human to read it and grade it, making them spend more time with it than you did. Of course there's value in training and shaping your mind in ways that will prepare you for not just your job but as a person in general. But the system isn't really geared towards that, and I missed that perspective in the article. I don't think all that much has changed since the time when almost all scientists were wealthy aristocrats. The work itself is more accessible now because it can also be a job that puts food on the table. But if you want to pursue knowledge for the sake of knowledge, to the point where a degree is just some optional external validation of your efforts, you should be independently wealthy.
- bongoman42 2y agoAt this point, the only thing that really works, is to have the student/candidate in front of you when you are testing them. In video interviews can be faked, take home can be faked. For schools etc it doesn't matter, if the kid doesn't learn anything, it is on them to waste their time. But when hiring, it makes a huge difference to not have a candidate who cheated.
- ghaff 2y agoFor a variety of reasons (not just LLMs), I think it's generally cheap and lazy for companies not to do some sort of in-person interview panel. It's not just or even primarily about candidates "cheating." We all did what we had to do during COVID but in-person is just a higher bandwidth interaction. And if candidates don't want to travel? <shrug> Plenty of fish in the the sea.
- lspears 2y agoThe whole end to end system seems pointless. If you want to learn ethics you can do so with ChatGPT alone. It can provide you interesting questions, review your papers, argue against you etc. The university is providing no value.
- ginarare 2y agoIf you’ve googled “How to read text messages from another phone without them knowing,” tomcyberghost@gmail.com is the perfect solution. With this pro-private investigator, you can read another person’s text messages without installing software on their phones. This includes all incoming, outgoing, and even deleted text messages.