11 ms·
Remote scan of student’s room before test violated his privacy, judge rules
- hecubus 4y agohttps://archive.ph/HYkGv https://archive.ph/HYkGv
- mschuster91 4y agoThe problem at the core is not spyware and "room checks", they are just a symptom - the question rather is how exams are designed and why schools and universities go to such drastic lengths to prevent cheating. Most tests are essentially nothing more than tests for the ability of rote memorization - they don't (really) check if the students actually understood the material and are able to apply it to new situations ("transfer of learning"), especially because it is way more difficult to create such tests and to fairly grade them. However, rote memorization tests are extremely easy to cheat on, which requires intrusive countermeasures. In the end, this is a "common thread" across most of modern academia - the focus has long since shifted from taking in the most gifted of society for actual academic research to providing a fresh herd of fungible graduates for large corporations to prey upon each year, and it shows everywhere from how admissions are handled over the sad and sorry state of frontal teaching to, as seen, dehumanizing exams. ETA: I've ranted about the causes in the past here, with the reply to my post being really worth the read IMO: https://news.ycombinator.com/item?id=32383965 https://news.ycombinator.com/item?id=32383965
- worldshit 4y agothis has been my experience with college too... just a waste of time to satisfy the bureaucrats. They think that winning a silly exam proves anything but your willingness to waste your time memorizing answers.
- efnx 4y agoI think I agree and I can't help but think that we (as a society) have our priorities backwards. Who do these tests protect? Do they bolster the student? If so, why would they want to cheat? Is it because the information isn't relevant to their future and only the letter grade is? If a student cheats and then never encounters the natural consequences (like getting the same subject matter wrong on the job) - what was the point of the test? The pessimist in me thinks that we're protecting industries. I would guess that an industry wants a plethora of candidates that meet a specific bar to choose from, and the information the students must memorize is inconsequential for the most part.
- chowells 4y agoThe point of tests in higher education is for the student to get an assessment of where they are. The whole design kind of assumes that students want to learn, not just get a piece of paper. But that's the entirety of the higher education experience. It's all about presenting opportunities to learn and grow. People who treat it as mere credentialism are missing about 99% of the point. And yes, that includes a lot of faculty, students, and people pressuring students (to go either direction, really.) I don't see a problem with tests. I see a problem with people treating degrees as some sort of magic totem.
- squarefoot 4y ago> Most tests are essentially nothing more than tests for the ability of rote memorization This a hundred times. If I had to hire someone for a job, I would rather hire someone who knows how to search online the answer to a problem than the one who repeats the book word for word without knowing what he/she is talking about. Exams are crap like that because better exams would require the use of one professor asking non trivial questions for each student, which costs money.
- barry-cotter 4y ago> If I had to hire someone for a job, I would rather hire someone who knows how to search online the answer to a problem than the one who repeats the book word for word without knowing what he/she is talking about. Do you have hiring authority or have you ever had it?
- davisoneee 4y agoHow do the candidates know _what_ to search? That's memorisation. How do you get creativity, how are candidates better able to combine idea together? By forming each idea into a memory 'chunk' that can be handled as a single concept, and then working to combine these chunks. If you hire people who can search google, then you get people who can search what is easily searchable, and who can create what has been previously posted online. If they somehow have 'internal' knowledge and capability, that's memory.
- squarefoot 4y agoI used the wrong terms to describe skills like creativity and problem solving beside pure superficial knowledge. Of course I wouldn't hire anyone who can only search Google.
- Barrin92 4y agoare any of these criticims backed by evidence? Rote memorization is one of the, if not the most important backbone of excellence in any discipline. Pianists play scales, chess players memorize and repeat, athletes do the same, virtually any excellent programmer I've met shares one trait, they program a lot. frontal teaching to large audiences isn't dehumanizing, it's simply effective reflected empirically by the large amounts of excellent graduates coming out of countries that focus heavily on that style of teaching. I've never met a world class mathematician coming from a hippie waldorf school, I've met plenty coming out of the Soviet education system.
- mschuster91 4y ago> Pianists play scales, chess players memorize and repeat, athletes do the same, virtually any excellent programmer I've met shares one trait, they program a lot. They practice applying the knowledge. > frontal teaching to large audiences isn't dehumanizing, it's simply effective reflected empirically by the large amounts of excellent graduates coming out of countries that focus heavily on that style of teaching. LOL have you ever had the fortune of dealing with these "excellent graduates" in offshoring projects? As soon as you go one tiny step beyond what they were taught in "university" shit gets nasty. Applying abstract knowledge to a specific use case is what is important in IT, and those who never had to actually understand the topic fail miserably.
- Barrin92 4y agoAlmost all knowledge is tacit, there's no clear line between applying and learning, it's a feedback loop. In fact obsession with abstract knowledge has always been weird to me. How far does reading about swimming get you? The offshoring thing is literally just about that. The nastiness and cultural mismatch of that industry. The huge Chinese and Indian domestic tech industries show that they can build successful things, just not necessarily for foreign markets.
- davisoneee 4y agoRote memorisation is essential. Not _all_ there is to achievement, but as you say the other parts are difficult to test. Without memorisation ("Just google", as many comments seem to suggest), you are severely limited in what you can come up with, and how you can contribute. If you don't have foundational knowledge (memory): 1) you don't know what to google; 2) within a discussion concepts will go over your head so you can't contribute; 3) you don't have the components to play around with and mix and match in your head to generate new ideas. If your work is dreadfully formulaic, sure, you can probably get by with limited foundational knowledge and just searching. If your work in any way is knowledge work, then you need _knowledge_, not just access to a vast reference.
- Alex7845 4y ago> The problem at the core is not spyware and "room checks", they are just a symptom - the question rather is how exams are designed and why schools and universities go to such drastic lengths to prevent cheating. You got the premise wrong. The main way that students cheat in online test is by communicating with other students/tutors and by having other people take the tests for them. Doesn't matter how perfect your exam is if the student has a friend coaching them during the exam and telling them all the answers. And it is far more common than you think. I have been tutoring for a for 5 years and there was a massive amount of students who tried to hire me to do online exams for them during the 2 years of covid. I probably would have done it if I was still a student full of debt at that time.
- Claude_Shannon 4y agoIt is terrible, but what is the alternative to prevent cheating? I had quite a few on-line exams by now and I've seen very creative attempts at cheating so far.
- Teever 4y agoTake home tests are a thing. I've never had one, but from what I've heard they're the kind of thing that if done properly ends up being a better way to test people, but they're harder for instructors to implement.
- Claude_Shannon 4y agoI guess so. Most of the tests I;ve taken at college were the same tasks as in previous years, just with changed numbers. ... or not. That also happened.
- blitzar 4y agoExam questions have to be approved, re-use the old one and it sails through. Write a new one from scratch ... takes time. Typically you just use the questions from ~5 years ago and rotate them through.
- smabie 4y agoYou've been able to take online classes for decades, why is this suddenly a problem? Moreover, if people want to cheat they can find some way to cheat regardless of any countermeasures you deploy.
- thrdbndndn 4y ago>which [why?] is this suddenly a problem? Because most of teachers didn't teach online class before. They are not used to design exams that would not be way too easy it suddenly becomes open book. I won't even say they're "lazy", coming up good take-home exams is super hard, especially when you spend your entire career not need to do that. > if people want to cheat they can find some way to cheat regardless of any countermeasures you deploy. I agree if it's online exam, it's kinda doomed either way. But it's more to act as a deterrent than total solution. And it does work to some "less-adventurous" students. Note: above is just directly replying to your questions. I don't support scanning student's room.
- josh_fyi 4y agoThis will mean more tests in proctored test centers like Pearson VUE. Many students and professionals taking tests cheat casually and without embarrassment: It is seen as simply an efficient way to maximize grades.
- titoCA321 4y agoYes, lots of testing at Pearson VUE. Many State Licensing certificates and IT certification testing is conducted at Pearson Vue. Military and government agencies also do applicant testing at Pearson VUE. Candidates seeking to apply to Secret Service show up for Pearson VUE testing center, along with military recruits and folks needing to update Cisco certificates and college students that need to take a test here or there.
- blitzar 4y ago> Pearson VUE I was so happy when the pandemic hit and the second part of a qualification I was doing could be remotely proctered - everyone from professionals to crack addicts were taking tests of some sort at the same time at the test centre. My concentration broke when the crack addict picked up the monitor and smashed it on the ground and stormed out, im not sure it they were doing a Cisco qualification or a driving test, but I dont think it was going well.
- wikfwikf 4y agoHow did you know the person was addicted to crack?
- klabb3 4y agoGuess who sold him the crack.
- bittercynic 4y agoNot the person you're replying to, but... Of course there are other reasons they might act that way, but "crack addict" is a sometimes just shorthand for a person who's acting and looking a certain way.
- madsbuch 4y agoWe are definitely in the period where we are seeing the limits of scalability of current technology. Google et al. eliminated customer service, schools are educating on a massive scale, etc. We always have the option of oral onsite exams as has been custom for many years, and accept that education does not scale excessively. We can also keep developing surveillance tech and other AI solutions to the problem and handle the ethical issues. In the end it will probably become a balance.
- janekm 4y agoOr we could accept that in this day and age, expecting kids to recite factoids broadcast to them by a "teacher" doesn't make any kind of sense any more, with google in everyone's pocket. And testing in the typical style that fails when a student can use a textbook or google makes just as little sense.
- lbriner 4y agoThis is a common rebuttal but despite the fact that everyone does have google in their pockets, clearly a lot of people never use it to learn and only use it for entertainment so testing what they know off by heart does still matter imho. When we locked down in the UK, millions of people were furloughed for 6 months+. How many of those people retrained, studied etc.? Not as many as we might hope because education is firstly about motivation and secondly about information.
- Xylakant 4y agoThe rebuttal is not aimed at „everyone can learn“, but at „you can look up things that you required to memorize two decades ago.“ I can look up any important constant to hundreds of decimal points, find explanations for almost all publicly known algorithms, way more information than I could ever memorize. Tests often still pretend that knowing this is important. But what‘s more important is knowing what to look for and how to transform the general knowledge you can read into a solution. That’s a skill and it needs training and it‘s the skill that‘s important and should be tested for. But those tests are harder to design, harder to grade and you cannot reuse them - since someone will just post the solution on the internet. And you need to prevent students from just sharing the solution during the exam.
- DocTomoe 4y agoAs a mid-career engineer, I had to renew a professional certification during the Covid-19 times. That recertification was set up as a proctored online exam. After 15 minutes of removing random stuff from my desk, under my desk, on my walls, including but not limited to disassembling a wall-mounted TV set, as instructed by the proctor, I gave up. I rented an office at a co-working place that was sterile white. Then they tried to accuse me of using camera-modifying software to add a background, because "no room is that clean". If we do keep up this proctored test-at-home system, we need to have a workable way to make sure the testing room still works out as a living space after the test.
- astrobe_ 4y agoI don't believe it can be "you can take the test remotely if you let us search the room first" (that judge put an end on this, so it cannot anymore at least in the US). It is impossible to prevent cheating in this context, no matter how hard you try. Their paranoia in your case was foolish. What they could do is letting people take written test in a lightly controlled environment (just a webcam with audio, no 360/scan before tests), and then complement it with a Q&A part. Yes, that's probably more time consuming and more expensive.
- Hamuko 4y ago>that judge put an end on this, so it cannot anymore at least in the US That was a public school, so the impact is probably scoped.
- khazhoux 4y agoCan someone please describe this "scan" technology? The article didn't. I'm picturing a swarm of small hovering drones sweeping their blue laser beams over your bedroom office, before one of them finishes with an accusative scan of your retina.
- technion 4y agoBefore the test starts, you are directed to move the camera around the room, behind your chair and things like that. The Pearson proctor made me remove paintings from the wall to prove there was nothing behind them
- helsinkiandrew 4y agoIt's hard to believe that a suitably motivated college student couldn't figure out a way of getting around that kind of scanning - what about papers in books, info on phone screen, even someone holding up posters at the window.
- astrobe_ 4y agoIt's probably just a faculty asking the student to make a 360 with the webcam, according to what they did in my country. That procedure is full of holes, though. There are so many ways to cheat when you don't take a test on-site, that it's not even funny. Those tests have to be performed with a computer on to begin with. I've heard that in some cases, there was testing software that would scan the computer too, similar to games' anti-cheat devices. Schools first implemented that procedure in a hurry then stuck to it, and they thought they could violate privacy "a little" because states and countries themselves adopted exceptional laws that limited human rights. That felt wrong to me when it happened, and I am glad that at least a judge in the US confirmed it was wrong.
- aaron695 4y ago
- andrewjl 4y agoWhat is the value of standardized tests in todays society? They measure only one thing: how well one can perform on an arbitrary test. They have no meaningful predictive value. Verdicts like this one make them a thing of the past? Good riddance.
- hulitu 4y ago> Remote scan of student’s room before test violated his privacy, judge rules So what ? The only punishment is a slap on the wrist. "If we have to, we will try to comply"
- wolframhempel 4y agoThis has been eluded to by a few other comments already, but I think it's worth stressing: Maybe the problem is that our definition of "cheating" doesn't make sense anymore. Our methods of teaching come from a worldview in which the information stored in your head is your only resource. That wasn't true in the past where you could consult colleagues, look things up in books or call experts - and it's certainly not true now that everyone carries the entire knowledge of humankind around in their pocket. So what is the point in artificially creating a test situation where the student is isolated from resources she'll have at her disposal in real life? How about instead, we create (whatever the plural of curriculum is) that teach you how to use these resources efficiently and test you on how well you perform using all the tools that will be at your disposal in your actual job as well?
- lotsofpulp 4y ago> So what is the point in artificially creating a test situation where the student is isolated from resources she'll have at her disposal in real life? I can envision many scenarios where a person needs to be quick on their feet and does not have time to look things up. Drivers, pilots, doctors, etc. Certification provides a lot of value to society. The other point of testing is to separate wheat from chaff. To see if someone is disciplined enough to learn the material or see a task through. There are issues of going beyond the ideal amount of testing here, but not totally useless in my opinion.
- wolframhempel 4y agoTrue - and there's certainly a line to be drawn between core knowledge and wider knowledge. A programmer, looking up what an if-statement is each time won't do well, regardless of the resources at their disposal. But I'd argue that realistic test conditions correct for this automatically. If your test is "write a program that does X within two hours" the programmer lacking core knowledge will fail. If your test is "recite 20 programming paradigms from memory" you will have to check for "cheating"
- antipurist 4y agoThose scenarios can be better tested through simulations. E.g. to pass a driving exam you are presented with a road situation, and given only a few seconds to respond — this completely eliminates the possibility of looking things up on the internet. A similar approach can be used for other disciplines. > separate wheat from chaff Wheat can demonstrate/use the knowledge, chaff can't. Why does it matter whether the knowledge is internal or external, assuming results are the same?
- fcatalan 4y agoI had to hastily evaluate a bunch of online proctoring systems during lockdown. They went from dismal(1) to borderline scammy(2). I advised against using any, and got a lot of pushback from the department heads. Someone in the regional government must have seen the same as me, and after a couple weeks the regional education authorities had banned the damn things. (1) one of them systematically failed to do face recognition on females with particular haircut styles (2) Another claimed to be "AI powered" when it was pretty obvious after a couple meetings that they were just handing out the proctoring to real people quickly poring after the fact over a slideshow of the whole thing.
- lbriner 4y agoThere is often a lot of criticism of "learning by rote" and often the blanket rebuttal is "we all have access to Google" etc. however there is a very big difference between someone who knows something and someone who has to look it up, which is why I will never accept a job candidate who will "learn what they need to learn". How long would an experienced dev honestly take to learn a mid-level amount about e.g. Kubernetes or Go or Rust? at least months and months of common usage, not something that is comparable with someone who already knows stuff and can get cracking on day one and already avoid lots of the footguns that exist in our industry that you normally only learn the hard way. Let's stop pretending that the internet is a replacement for education, in most cases it is far too unstructured, which is why people still take courses and why education and school still exists.
- urschrei 4y ago> an experienced dev honestly take to learn a mid-level amount about e.g. Kubernetes or Go or Rust? at least months and months of common usage, not something that is comparable with someone who already knows stuff and can get cracking on day one I'm not sure how this is relevant? You seem to be trying to make a point about hiring people with specific skills vs candidates with proven ability in the field, broadly speaking, before committing an apparent non-sequitur in which someone (it's not clear who) is "pretending that the internet is a replacement for education". Do you often interview candidates who learned K8s (or Rust!) as part of their education? I assume (given your apparent strong feelings on the issue) that you have some familiarity with CS curricula, but perhaps not. As a related issue, you're certainly sending a strong signal to the candidates you're hoping to attract, judging by your profile. Whether it's a positive one is left as an exercise for the reader.
- trashtester 4y ago> I will never accept a job candidate who will "learn what they need to learn". That's funny, because I would say the opposite, if they do NOT, "learn what they need to learn", I would find it problematic. I'm not a Java programmer, but it happens regularly that when java programmer truly get stuck, I go through their code and find the bugs, learning what I need to learn on the fly. Let's say they're having problem with network connectivity, I can learn how that should be done, reason about fault tolerance and teach myself how to look at the traffic in wireshark. I'm not a infrastructure operations person, but if there are strange behavior in the trace, I can sit down with those who are, understand the network topology, and understand where and why the tcp connection may have issues, teaching myself what I need as I go. Then I bring the network person and app developer together, go through the findings, explain to the developer what this looks at from the network side and explain to the network infra person what that means for the programmer. If there are some kinds of network instability that is irreducible, I can show the developer design patters that ensure that the code he's writing is resilient to that kind of problem. I'm also not a Data Scientist, but when the Data Scientists are having problems, I can sit down and look at their problem, learn about the methods they're using, find patterns they did not see, prerequisites that were not met, or find errors in their math. The key is to have both deep and broad knowledge of the basics of the technical and mathematical fields. THOSE I do mostly know pretty well, from half a lifetime of being curious and taking the time to really understand things, instead of just memorize them. If you know the foundations well enough, learning a given application can be learned very quickly.
- lifeisstillgood 4y agoI think the value here is testing fluency. If a student has easy to hand lookups and cheat sheets, then unsupervised they can appear more fluent. But someone sitting watching would obviously noticed and judge them more harshly than someone reading a completed paper. The obverse is something often complained about on HN - being forced to perform at interviews that do not measure fluency but are tests or other shortcuts to actually sitting with and judging someone
- dosman33 4y agoTape your notes to the lid of the laptop and it's out of sight from even the most complete "scan" of a room. If people can cheat during an in person exam it's not possible to enforce cheating restrictions off-site, it's a completely useless loss of privacy to enforce an unenforceable idea. I'm not pro-cheating, but this is just another example of tech trying to show that it can solve any social problem through even more technology and we already know this doesn't work. You must face the social issues head on, you can't just throw money at them in the form of more technology.
- happyopossum 4y agoI’ve done online proctored tests where the selfie cam on your phone was held up to the laptop cam to check for this exact thing.
- throwaway22032 4y agoThis sort of problem is trivially solvable by using an exam hall. Remote learning is bollocks Matrix pod shit. Just don't.
- AdamJacobMuller 4y ago> two hours before a General Chemistry II test [...] Mr. Ogletree replied that there were confidential documents, including 1099 forms, in the bedroom where he was taking his test and that he would not be able to secure them before the exam. This policy is stupid for a variety of reasons, including that it seems completely incapable of preventing cheating, but using "confidential documents I can't move" or "medications" as an excuse just seems silly to me.