15 ms·
Protect student privacy: ban eproctoring
- aero-glide2 5y agoBanning e-proctoring is unfair to students who worked hard.
- josephcsible 5y agoYou don't think students who worked hard deserve privacy?
- aero-glide2 5y agoDo you have privacy when you sit in the exam hall?
- josephcsible 5y agoProctors and cameras in exam halls can't see inside your house, so yes.
- maweki 5y agoWe employed the method of mixing the order of questions, not giving question titles, and having a pool of subtly different questions (a negation or a different constant slipped in) in order to vastly increase the amount of necessary communication to collaborate. We had the students turn on their webcams just to discourage them sitting in the same room, which basically would negate our former efforts. Neither did we flag any behavior nor did we record anything or used some automatic software. I believe that worked quite nicely. A few cheaters were easily spotted when they had the wrong constants in their answer. I understand that not every course and exam style is suitable for that. But for our databases course, it was applicable. I think that this was not much more invasive than a traditional exam. Anything more, like watching the screen, or having audio, would make me feel uncomfortable.
- undfg 5y ago>We employed the method of mixing the order of questions, not giving question titles, and having a pool of subtly different questions (a negation or a different constant slipped in) What an awful burden to put on the shoulders of the already overworked and underpaid professors.
- maweki 5y agoWe did this through the exam software (Browser-Based). Everything not checked automatically (multiple choice) was sorted by question in the backend. We (the examiners) had all the information. It was just hidden from the students.
- undfg 5y agoGlad that you had an automatic system going, but most universities don't have one and can't fund its development, and wanting to shift this burden to professors is unreasonable.
- maweki 5y agoIn Germany we have multiple state-sponsored open-source e-learning platforms that basically all support examinations.
- p49k 5y agoYour stance is that it’s unaffordable for a university to spend a small amount of money on randomized browser tests, therefore they should spend a large amount of money on intrusive spying software?
- undfg 5y agoI don't believe a public institution would be able to come up with a system like this that works reasonably and have it developed in a reasonable amount of time within a reasonable budget.
- deleted 5y ago[deleted]
- ShroudedNight 5y agoI may not be neurotypical, but surely I'm not the only one having a hard time not parsing the domain name as "Bane Proctoring", which admittedly sounds rather ominous.
- ckastner 5y agoI also read it that way. One would think that after the issues with whorepresents.com and expertsexchange.com (and dozens of other popular examples) from at least a decade ago, people would be somewhat more careful as to how their domain name could be misread.
- mercora 5y agoi could not unsee it anymore after it got pointed out to me in "therapists" and sometimes giggle childishly when i encounter it
- drudu 5y agoGiven that "bane" is a nearly infinitely more common word than "eproctoring" I bet you (and I) are in the majority.
- Hamuko 5y agoMore people should use dashes in domain names.
- Negitivefrags 5y agoI can see why universities want to use a system like this. A friend of mine is a University lecturer for physics and one of his students gave him an invite to the discord channel where half his students are in there sharing all the answers during the final exam. He basically told me there is nothing he can do about it. He talked to the head of department and they basically said if you have proof of specific people cheating then they can escalate it for those people but short of that, nothing can be done. Not that I’m saying these systems are great either. But I really don’t know how exams in the current form can be conducted remotely without endemic cheating.
- mytailorisrich 5y agoI think the only alternative to eproctoring is standard in-person exams in a room at the school/university. We can debate how far eprotoring solutions should reasonably go but really if someone is allowed to take an exam remotely alone there has to be a form a surveillance. This can include providing an approved, locked laptop with monitoring sofware instead of letting students use their own devices with eproctoring software but that obviously comes with an additional cost.
- elliekelly 5y agoWe allow students to take exams alone, unsupervised, all the time and we have been doing it just fine for hundreds of years. Have you ever written a paper as a final for a class? Or done a problem set? Or a project? Or even a take home test? No surveillance needed if you structure the format of the final to suit the “testing” environment. If the answers to your final are easily Googled then you’ve written a shitty final.
- mytailorisrich 5y agoA final paper is different and the concept itself obviously does not lend itself to surveillance, which used to be less important because it is/was less easy to cheat. There are growing problems with this as well because of all the online "help" students may get access to these days. Allowing students to take exams alone, at home, unsupervised is just a recipe for disaster without surveillance. It's not just Google but any sort of help in the room or remote, which can go all the way to someone else taking the exam. That really simply is the reality. I don't think this is contentious and I am surprised by the debate. On the other hand, it is of course possible to discuss how far surveillance should go and how perhaps to avoid too much intrusion (as mentioned in my previous comment). That said, with the expensive connectivity people have these days, in addition to all they can think of if the exam takes place at home this is really an arm race situation. So, again, the alternative is good old in-person, on-site exams, where students are also under surveillance, by the way, but that feels less intrusive because students aren't in their own private space at home.
- fcatalan 5y agoWe tested a couple eproctoring products last year while we geared up to move every exam online. We disliked them on ethical grounds, but also as ultimately unpractical. I had also a bad feeling about the vendors, there was a strong whiff of "bad used car salesmanship" in the whole interaction. I also felt there was a correlation between the push for these tools and bad or antiquated teaching methods. Then to our relief the education authorities in our region straight banned the practice so we just drew up a document with various ideas about how to go about online assessment in a humane and reasonable way and we went through thousands of online exams with very few incidents.
- hrnnnnnn 5y agoI took a course recently and the final exam had this kind of eproctoring setup where I would have to install proprietary software, show the examiner around my room, under my desk and so on. I did not take the exam.
- ShroudedNight 5y ago> I did not take the exam. I assume at significant cost? I feel similarly strongly about my dominion over my own computing devices and the boundaries placed on their intrusion into my environment. I wonder, at what point should this reasonably be considered equivalent to a religious belief and provided the same sort of protection.
- dspillett 5y ago> I feel similarly strongly about my dominion over my own computing devices Same here. If I ever need to take remote exams like described I'll get a cheap laptop, or something like a Pi attached to a TV/monitor, and take the exam on that. They can have me install anything they like, it will be on a guest wireless network that can't cross to the rest of the local network, will be freshly installed with an account that is not one of my primaries, and will be wiped down when the exams are done. In fact I have an old slow laptop that would do, assuming it still works. Of course, not everyone has the luxury of being financially and technically able to do that. I'm the same with work. If work wants specific control on the devices I use, then they need to provide devices instead of taking control of my personal ones. I did install the comms software on an old phone in 2020 but if the ability to remote-wipe this granted is ever used (accidentally or purposefully) I'll lose nothing but my "get up for work" alarm as that is the only other thing on the device. If I work from home it is via RDC over VPN to my machine at the office - if there becomes a requirement for more control of the machine I'm VPN+RDCing from then either they provide a machine they control or I stop being able to work out of hours (not a problem for me!) or work from home should that be convenient/required (which isn't often, other than during lockdowns over the last 18 months). I don't have an adversarial relationship with work (which might be implied by the above paragraph), at least not as far as I can tell, but I find it better for my mental health (and my work, I think, though that is the secondary concern from my PoV) to silo my work and personal life somewhat. I can see a day when extra requirements will turn up, as we work with clients in strongly regulated industries and many of them are actively tightening their internal controls and making increasing demands on their suppliers (including us) to do the same. > and the boundaries placed on their intrusion into my environment. That you can do less about in many cases, though again I'd have options. I only have a two-bedroom flat, but the little bedroom is used as a training room, so I could setup a chair and something as a desk in there. All they'll see in the tour of the room is the treadmill, weights, mats, and related bits & bobs. Again, many do not have the luxury of this option.
- LysPJ 5y agoFor anyone unfamiliar with the term (like me!), Wikipedia says Eproctoring is: [...] a form of exam proctoring which involves monitoring student behaviour during exams administered electronically [...]
- deadfish 5y agoMassive failure to not have "What is Eproctoring" as the first section of the page.
- dspillett 5y agoI assume the target audience would all know the term, and others could work it with a little deduction or Googling. Though it is a bit US centric I think. Here in the UK what I think is referred to as a proctor would instead be called an invigilator. Though again, unless the target audience is international, that probably does not matter.
- noodlesUK 5y agoI would add as an aside that the invigilated exam halls you likely remember from your British education don’t really exist in most US universities. Final exams are generally administered by the lecturers themselves rather than independent invigilators, and there’s (generally) less emphasis on having a standardised process from one course to another.
- onorton 5y agoFunny, at my UK university for Computer Science we did not have independently invigilated exams. I would assume other courses were similar. We did have them for secondary education though.
- dspillett 5y agoAt York we certainly piled into Central Hall or other large locations for exams, often multiple in the same room not all Computer Science at the same time. Though this was more than two decades ago so a lot may have changed.
- news_user 5y agoRelated: Bengaluru (India), Student alleges invigilator addressed her as ‘baby’, sparks row. https://indianexpress.com/article/cities/bangalore/bengaluru-christ-university-female-student-alleges-invigilator-addressed-her-as-baby-7372044/ https://indianexpress.com/article/cities/bangalore/bengaluru...
- quenix 5y agoNot related, really.
- insomniacity 5y agoI think it's related because eproctoring often forces people to electronically invite strangers into their homes and show them round. Creeps are going to creep, but it's legitimate to want to reduce the number of avenues they can do that.
- dna_polymerase 5y ago> A federally-funded study found that even the best facial recognition algorithms fail to work on Black and brown people, trans and non-binary people, as well as children and women in general. I assume it is black and brown trans and non-binary people. I don't see an algorithm fail because someone identifies as anything. However, why even mention it here, in this context? It makes the people behind this sound ridiculous. Aside from the technical difficulties with image recognition on BPoC which make this sort of tech a non-starter, I think universities and schools need to (finally) find a way to assess people that does not involve anything that can be cheated by having a book open next do the computer. Projects and papers and weekly problem sets to solve are a way better way to assess people.
- MattGaiser 5y agoIt isn't so much a book that is a problem. It is divide and conquer by groups of students.
- spoonjim 5y agoEveryone wants a tie-in to the hot button issue of the day. You don’t need to get black trans kids involved to point out all of the flaws in Eproctoring.
- wizzwizz4 5y agoTo point out enough flaws to disqualify e-proctoring, no. To point out all of them, yes.
- fcatalan 5y agoIn our initial trials involving about 5 people the software systematically failed to recognise one woman just because her (pretty standard) hairstyle. It also failed to detect my kids coming up on camera a few times.
- dna_polymerase 5y agoSounds like these solutions are just outright garbage. I wonder if ML/CV will ever work outside of GAFAM.
- spoonjim 5y agoI agree that these e-proctoring measures seem draconian, but the flip side of this is absolutely RAMPANT cheating at universities. I don’t know what kind of fair system lies between these two issues. Also, the domain is poorly chosen, “Bane Proctoring” sounds like a particularly terrifying proctoring service.
- bruce343434 5y ago> but the flip side of this is absolutely RAMPANT I REALLY doubt this. There's plenty of alternative or hardened testing methods.
- MattGaiser 5y agoOnes that scale?
- noodlesUK 5y agoYou’d be absolutely shocked by the amount of flagrant plagiarism that you get in certain courses. There are ads for essay writing services targeting every university student out there. A lot of them take those offers. It’s usually a symptom of a larger problem though.
- tchalla 5y agoThe banning of such a tool is a good start. One could also think about creation of requirements for tools to protect student privacy in the future that goes beyond a specific tool or software.
- bitL 5y agoAlgo for teachers affected by cheating: 1) make questions brutal and unique (compared to previous year or current groups) if possible 2) make everything open-book 3) set a tough time limit 4) curve the results to a desired grade distribution (that is often imposed from above anyway) 5) use software that can the catch most obvious frauds (i.e. 360 degree room scanning, ban use of phones/second computers etc.) 6) if the exam requires algos, use software analyzing AST of the code produced to catch possible "cooperation", then decide on those cases individually (i.e. if an algo is common, then there is a high chance of very similar AST for non-cooperating people, but if it's unique, the chance is low)
- wizzwizz4 5y ago> i.e. 360 degree room scanning Tape a smartphone to the laptop screen. Out of view of the webcam at all times. (This isn't hard.) Such room scanning is harmful, and doesn't prevent cheating.
- op00to 5y agoThe tests I’ve taken (amateur radio, tech certs) require a second device to show the rest of the first device.
- bitL 5y agoSome tests I've taken required a 360-degree scan first including under-the-desk walk (to show no cheat sheets were glued anywhere) and then required a second device with a side-view of the desk I was sitting at. When I was taking an ETS test for a Stanford admission, they just required 360 room scan and the test itself only with a laptop camera.
- ShroudedNight 5y agoDo you have personal experience finding success with #6? My limited experience with detecting code plagiarism has been that detecting re-use that has been non-trivially obfuscated is a rather difficult problem.
- deleted 5y ago[deleted]
- masondunn 5y agoSnowflakes... "Youth were never more sawcie, yea never more savagely saucie . . . the ancient are scorned, the honourable are contemned, the magistrate is not dreaded."
- mvanaltvorst 5y agoMe and my roommate are first year undergraduate students. We do different bachelors; I have taken all my tests this year with online proctoring, my roommate has had all his tests without online proctoring. The proctoring process is actually pretty simple: I have a Google Chrome extension installed that I enable when I have to take an exam. It takes 5 extra minutes before the exam: I have to show my identification, the materials I'm using on my desk, my ears to check whether I'm using wireless earphones, and do a quick sweep around the room. It records my screen, my webcam, and my microphone. Of course, the system is not fool proof (I've heard some students use post-its on their display), but communicating with other students becomes nearly impossible. My roommate is actually jealous of my proctoring. He does not cheat, but knows most others in his year do. There are groups of students who meet up and take exams with each other. As a result, some of his peers consistently get higher grades, while my roommate clearly put in more effort and is more capable of achieving a high grade on his own. Because the barrier to cheating is so low, it almost becomes a requirement to cheat if you want to achieve grades that are high relative to your peers. I do not believe proctoring is a breach of my privacy. Google Chrome's sandbox is good at explaining what information the extension is requesting, and when it is turned on. Chrome's battle-tested sandboxing makes me confident that the extension is not snooping through my files, for example. It only sees my screen. I can hide things I do not want the online proctor to see before the exam starts. Similarly with my room, you can hide everything that would breach your privacy before the exam starts. Of course, online proctoring is invasive, but I believe students should think more carefully about the dilemma our teachers are facing. Lack of online proctoring discourages smart students, discourages learning, and hurts the reputation of the university in the long term with unreasonable diploma's. This pandemic requires flexibility from everyone, and simply crying "privacy" without considering both sides is short-sighted. The data recorded for online proctoring is reasonable, and does not bring us closer to any kind of "big brother" scenario.
- MereInterest 5y ago> Similarly with my room, you can hide everything that would breach your privacy before the exam starts. The need to hide things is itself an effect of privacy having been breached. Privacy isn't just to keep information secret, but also to provide a space in which you can be comfortable because it is your own space. Needing to hide things away is a reaction to privacy being breached, not a way to preserve privacy.
- noodlesUK 5y agoEproctoring is a terrible solution to a real problem. There is cheating at universities. Traditional invigilated exams are fairly effective at detecting certain kinds of cheating, and ensuring a minimum level of competence in some subjects. I’m aware of a number of different notions of cheating, though I am by no means an expert: The sort of looking over somebody’s shoulder to see their answers is what comes to mind first, and this is fairly easy to detect through existing means (turnitin etc for written work). This is a common form of plagiarism. There is collusion, where people try to share answers. There are varying schools of thought on how bad this is. I personally don’t worry too much about it because most assignments are primarily formative rather than summative examinations, and in these cases it is basically peer learning a lot of the time. The most heinous kind of cheating and the hardest to detect is commissioning. This is basically when students use essay writing services or similar. They will generate an original work of appropriate quality. It’s almost always possible to detect the kind of blatant cheating people are particularly worried about (commissioning and plagiarism) through sufficient contact time between the students and staff. A brief conversation every now and then with students will promptly reveal blatant cheaters. There is no magic technological solution to this. Eroding student trust and privacy through invasive surveillance will inevitably lead to worse outcomes. The solutions to this are to set better assignments, which require thoughtful answers, rather than scantron-like quizzes where answer keys can be shared, high levels of contact time to get to know students, and occasionally controlled exams to ensure nothing is slipping through the cracks. There’s a big difference between teaching and certification, and it’s very hard to balance those needs. Anything summative needs to be marked anonymously (or at least pseudonymously), and often needs to be done under controlled conditions. It is not possible to detect a sufficiently advanced cheater (particularly people commissioning work) working in an environment they control, on a device they control. The cheaters will beat you. They do in video games, and they will in academic pursuits too. The people selling this are preying on a legitimate fear of cheating that universities have, but their solutions are snake oil, and degrading to the majority of students who are honest and want to learn. Better teaching solves many of these problems, and individual projects with vivas are an extremely effective solution for where you need higher assurance. We can go back to invigilated exams if we desperately need to after covid.
- alanfranz 5y agoRecent gatech OMSCS graduate here. I fail to recognize any real issue with proctoring. I have used proctortrack and honorlock. * proctoring software can be installed before an exam and uninstalled afterwards. It doesn’t need to stay on your pc/browser, and its activation is very obvious. I have no info about permanent security issues caused by such software. * what proctoring does is mostly recording video and audio (possibly with room scans at the beginning ) and uploading it to a remote server for later verification. Then, such footage is automatically scanned for anomalies. The teacher can then check what happened in flagged content parts and choose what to do. The system does not impose a “cheater” label by itself. * proctoring systems don’t force a closed book approach. I took open book exams where the only enforcement was “be alone and no collaboration with other people during the exam”. It seems that some people are concerned with some very specific details of some implementations, or with shitty teachers that say some people cheated just because they were flagged for whatever reason. Some things that happened to me and I still passed the exam: * a coworker accidentally entered the room where I was taking the exam and I had to talk with him to send him away. * I had to change my position since I had setup my laptop in a way that was unbearable for a many-hours exam, and I briefly exited the webcam view. I contacted the teachers when this happened and I got no issue at all. Of course some teachers happened to be silly, at the beginning of the pandemics: I heard things like “no drinking, no eating, no restroom” for 4 hours exams. Blame the people, not the software.
- reayn 5y ago1. The software should’ve never existed, it’s a testimony to the failure of our education system. 2. You are far luckier than most when it comes to your circumstances, i have seen myself people failing exams for similar mishaps to yours.
- jackvalentine 5y agoMy institution is currently undergoing a review of our assessment policy and I am participating as a stakeholder. Nobody, academic or otherwise, wants to use e-proctoring ongoing. It was a kludge for sudden covid in 2020 but ongoing use will be restricted by policy to where it is used to accommodate a student's need for an alternative assessment arrangement.
- jl6 5y agoI was recently sponsored by my employer to do a professional certification which involved an online e-proctored exam. I was asked to install the e-proctoring software on my personal computer, because corporate security policy does not allow unvetted 3rd party software onto company devices. I told my employer that's my policy too, and that I would need to be supplied with a separate laptop if they wanted me to take the exam. They did. I think if universities want to mandate use of e-proctoring software, they need to provide temporary/burner devices too.
- pastech 5y agoThe (almost) only problem that's left is the requirement of having the webcam on. Regardless of the client-side software that you can't trust, there are also third-party servers that will store all the recordings with personal information for a potentially long time, which is unacceptable and isn't fixable by temporary hardware (as we don't have a temporary face).
- MisterSandman 5y agoI think most people couldn't care less about installing software on their PC. You can always dual boot and create a partition for proctored exams and wipe it (which isn't 100% the same but pretty close) The issue is the fact that I have my camera on and there are people who I do not know who can see me and my room. I don't know how this information is being stored and who is seeing it.
- inglor_cz 5y agoI wonder to what degree is the cheating epidemics rooted in the fact that we have made a college title something of a Golden Calf. Or at least Bronze Calf with a thin gold finishing. (Even idol vendors cheat...) Too many people feel the push to have a degree even if their capabilities (not just raw intelligence, but things like grit) aren't on the necessary level. Then they resort to cheating.
- accurrent 5y agoWhen I was TAing last year we had to proctor the students via zoom (trust me its not fun for anyone). Quite frankly I found different professors approached things in different ways. All the exams were made open book, because its impossible to figure out if people are looking at their notes. One of the profs decided to make it impossible to cheat by basically making the exam so hard that even the A+ students would have a hard time solving it. This worked well in preventing cheating because for the A+ students to collaborate with others they would need spare time. On the other hand it left lot of students very demoralized. Some of the other profs came up with question randomization schemes. So the assesment tool would shuffle questions for different students. People were still on discord channels but to not much effect. Of course this required that the professors (or the TAs) were conversant with basic programming skills. For humanities oriented assessments however, I know most of the profs chose to do things via project work (it's a bit hard to cheat when writing essays. You can't possibly have the same argument as someone else so...) One thing I can't help but wonder is that I realized when we moved things online we missed out a lot on student interaction. Students were generally far more aggressive for their own grades, often at the cost of other students. Furthermore, I found students were far more ready to abuse the teaching staff than when we were physically there. Conversely, teaching staff was far more strict and stressed out than before. I can't help but wonder if the same courses were conducted face to face whether there would be more kindness all round.
- noodlesUK 5y ago> For humanities oriented assessments however, I know most of the profs chose to do things via project work (it's a bit hard to cheat when writing essays…) This is true of copying and collusion generally, but not of commissioning unique work from an essay mill, which is shockingly prevalent in humanities subjects for this very reason. I am aware of no effective defence against this other than in-person exams or oral vivas. I’m glad I’m not a humanities lecturer right now.
- mkl 5y agoI think making the exam really hard is more likely to backfire and push people to cheat. One of the main drivers of cheating is the perception of unfairness. The time limitation is not really an obstacle if you're organised, just divide and conquer doing a subset of the questions each.
- erhk 5y agoAmazon requires you show ID and have a camera on for their online peogramming screening. I chose to not enable my laptop webcam and to instead apply elsewhere, mostly from self respect. In paying an institute for education i doubt students have a similar luxury. I hope that the EU might enforce privacy similar to the move against cookies. Likewise i would love to see restrictions that prohibit facial recognition in private businesses without consent
- miki123211 5y agoThis seems not to be a thing in the EU at all. At least in Poland where I live, it's pretty much unheard of. Sure, cameras are required once in a while, sometimes you need to show your student ID, but the scary e-proctoring software doesn't exist at all.
- Etheryte 5y agoAnecdotal evidence, but I heard TU Delft (in the Netherlands) used e-proctoring software like this in some high level exams. So it might not be that black and white. If anything, I'd wager you mostly just don't hear about it because most students have nearly no leverage in situations like this.
- user_7832 5y agoI’m a TU Delft master’s student so I can comment on this. E-proctoring here is highly dependent on your department (also called faculty). I am in the TPM faculty where we don’t have any proctoring whatsoever (most of our exams are open book). But I do know from my friend that Aerospace has quite heavy proctoring with closed book exams. Similarly CS too (if I recall correctly) has proctoring. Additionally, proctoring is unsurprisingly quite unpopular amongst students - for privacy reasons, and also perhaps because of the “assumed guilt”. There’s a lot of push to completely stop e-proctoring university wide. Here are some interesting articles from our newsletter, TU Delta, with a lot of relevant information: 1. https://www.delta.tudelft.nl/article/online-proctoring-i-was-tears-my-laptop# https://www.delta.tudelft.nl/article/online-proctoring-i-was... 2. https://www.delta.tudelft.nl/article/why-ae-students-have-so-many-proctored-exams# https://www.delta.tudelft.nl/article/why-ae-students-have-so... 3. https://www.delta.tudelft.nl/article/dont-want-online-proctoring-tu-delft-offers-alternative# https://www.delta.tudelft.nl/article/dont-want-online-procto...
- kzrdude 5y agoI think this site should use one sentence to explain what Eproctoring means or what it is.
- heisenbit 5y agoPeople who have to cheat to get through university and succeed doing so have cheating skills to succeed without having to invest the time and money for a degree. People who would pass but cheat anyways because they believe grades matter are stupid enough that they will fail in any job. We are all poorer for the importance we assign to grades and the resulting design for testability of education Anyone here giving anything on grades when hiring? I know I never did.
- alistairSH 5y agoAnyone here giving anything on grades when hiring? I know I never did. For a new graduate with little other experience, I'd look at it. But, on the list of things that really mattered, it was near the bottom - at most, a "low" GPA would trigger me to ask more basic tech questions than I might normally. For anybody with career experience, I don't care.
- raverpundit 5y agoHow I am hacking my university exams. - installed a virtual machine - renamed reg keys values to hide drivers name - use vm hardner etc. - on host machine installed charles to get response(html) of the proctor website - wrote a python script that takes in response html and outputs google search result for all the questions at once I got lucky and University hosted a mock test through which i was able to grab the whole proctor website The proctor software dev. Didn’t obscure the JS Found so many vulnerabilities that led me to go full god mode. I can get questions paper 60min before the exam starts.
- RegBarclay 5y agoThere are basic technical hurdles for a lot of users too. My wife recently took a professional certification exam at home. She is an RN. We had to borrow my son's desktop gaming system, set it up in the kitchen, and jump some technical hoops (buy an external web cam) to meet the proctoring requirements. My wife probably couldn't have done it without my technical help and it was more stressful for her than going to a testing center.
- kevin_young 5y agoNothing to hide, nothing to fear. Simple really.
- tyingq 5y agoAn adjacent issue, not from a privacy standpoint, but from an "inappropriate use of tech" standpoint, is anti-plagiarism software. A relative of mine recently took an English course, and constantly had to lobby for re-evaluation of low grades caused by false positives with Turnitin[1]. The issues were varied, but the most frustrating one was that passages in her paper that were quoted and footnoted were marked as "sourced from the internet". Turns out that would happen with any passage quoted from a book that someone put on the internet, somewhere. Of course, instructors are supposed to manually review for this sort of thing, but it's such a basic miss. One that's going to get worse over time. People put existing source material on the internet, and it gets indexed. Also, see this example from Reddit: https://www.reddit.com/r/WTF/comments/h731k/thank_god_for_turnitincom_now_i_understand_what/ https://www.reddit.com/r/WTF/comments/h731k/thank_god_for_tu... Argh. [1] https://www.turnitin.com/ https://www.turnitin.com/
- 542458 5y agoIn turnitin’s defence, in my recollection their training material explicitly and repeatedly tells you not to do this - that a positive turnitin result is not the same as plagiarism, and that all positives should be manually reviewed. The student-facing side of it can be bad, as it errs on the side of extreme caution. When I (as a TA) had to mark dozens and dozens of papers pre-screening for obviously copied paragraphs was a very nice time saver. Otherwise the only students I would catch are the ones with poor English skills (grammar switching from flawless to flawed and back again is a pretty good tell that the paragraph was written by somebody else).
- tyingq 5y agoI do agree that instructors hold a fair amount of responsibility for using the tool right. But the tool is shite. It misses some very basic stuff. Like "stuff in quotes followed by a footnote/citation" is copied, by definition, on purpose. It also notes things like missing commas as if it's 100% authoritative. Even though the passage in question passed Grammarly, Word, etc. There's no notion of nuance or suggestion, just "right/wrong".
- stuartbman 5y agoMedical students in the UK were forced into incontinence for their exams due to proctoring failures. The same has also been happening with doctors doing their postgraduate exams.
- TravisHusky 5y agoJust to throw it out there, I graduated during the pandemic, and it was so frustrating not only the amount of cheating that occurred, which meant that if you didn't cheat you fell behind; but also how professors responded. I had a few professors who made exams ridiculously hard with strict time limits, just because they expected people to cheat. So the exams were designed in a way they cheating was the only way to get through it, which just encouraged more people to cheat. Not to say every person cheated, or every professor designed tests to be harder, but both groups were larger than you'd expect. The good news is I think that with classes being in person again things will go relatively back to normal. Honestly I don't think I can fault students who cheated during the pandemic, it was just so abnormal that most people did whatever they had to to cope.
- tppiotrowski 5y agoDoes anyone in academia know if tests are designed on a curve? You can give a test that everyone gets 100% on (assuming they show up) and you can give a test that everyone fails. Is part of creating a test thinking about how many students in your class are capable of scoring A’s, etc or is it just a side effect
- mikepurvis 5y agoI had a highschool calculus teacher who was very explicit about designing their tests on an A/B/C system. The idea was that the A section was the basic plug-n-chug versions of the problem that everyone should be able to get if you were even half paying attention in class; the B section is stuff that requires a bit more reasoning and analysis, and may have a pitfall or two, but they'll be things that were at least mentioned; and the C section is effectively extra credit— a problem where you needed to have a deeper understanding in order to figure out something novel about it, or like you needed to re-derive something from first principles in a way that was slightly different from what was shown in class, that kind of thing. And the sections weren't equally weighted; I think it was usually like 50/30/20, or even 60/30/10. Some people hated this, but I really liked how explicit it was. There was no mystery meat— the whole evaluation scheme was very open about its design and intent.
- 5y ago
- poplarstand 5y agoImagine a business that sells deliverable medical testing kits. This business is the best at what they do; they sell more kits than any other organization, they cost less, they're delivered faster, and are superior in any way, shape, KPI, or form imaginable to traditional alternatives. The only issue being that each kit is in fact a bloodletting kit, and their intended use is to inform you which of your four humours is out of balance. I'm of the opinion that e-proctoring, whatever its privacy concerns, is fundamentally an exercise in "doing the wrong thing faster". Our exams are a poor reflection of student ability. Our exams have no bearing on actual proficiency in the subject matter. Our exams are ineffectual at catching cheaters. Leaving aside any discussion of privacy, e-proctoring (and traditional proctoring) fails to accomplish its fundamental goals. To automate these exams, to make them ever-more scalable and easier to distribute, is not a victory. We've merely perpetuated a flawed system. If we want a meaningful assessment of student ability then we need to use better methods. Dethrone exams from our curriculum. Leverage project-based assessments. Use oral exams where feasible. Replace the infinitely looping lecture halls with recorded videos and open-source textbooks. Use the recovered instructor time for something meaningful. This is not a Gordian knot. It can be solved with a little courage and a little pragmatism.
- DreamScatter 5y agoI've been saying this for years, but academia is filled with stupid administrators who are incapable of evolving the state of teaching / learning because their salary depends on having administrative bloat.
- tristor 5y agoWhen I was in college, cheating was already rampant. I ended up dropping out the semester prior to graduation, despite performing well, because I just couldn't muster the desire to continue. Part of that was because of seeing how many people around me were blatantly and consistently cheating compared to the work I put in. Without the credential it's definitely created some challenges in my career, but I took the far more valuable /education/ with me into my career and have been very successful overall. When I look up most of my former classmates, they have not achieved near my level of success, partly because they failed to learn due to their rampant cheating. They may have received the credential, but they failed to learn anything they could take forward in life with them. I'm of two minds on this. I think that rampant cheating greatly undermines student morale for those students that don't cheat, but on the other hand it doesn't really matter because in the long-run it cheats the student who's cheating, not the class. The piece of paper at the end doesn't matter. All that aside, the way e-proctoring is done now, and new "advancements" with facial recognition being added into it, is horrifyingly privacy invading and often done in a way which is effectively malicious software being forced to be installed on a student's personal equipment. As a strong advocate for privacy and security, I cannot be anything but opposed to the way things are going. When I do remote proctored certification exams for continuing education, I've always preferenced taking them in a testing center kiosk specifically so I don't need any such software installed on my own computer systems.
- zelphirkalt 5y agoThank you for standing up for what you thought is the right thing to do. Takes character to swim against the stream and not simply falling back to group behavior.
- zamalek 5y ago> discriminate against students with disabilities. As someone who actually has learning disabilities (ADHD, dyslexia) this definitely isn't universally true. I have yet to complete a degree, but the most progress that I have ever made was in one was almost completely thanks to eproctoring. I had virtually no anxiety because I was in the comfort of my own home, and couldn't over-hear worrying discussions other students were having prior to the exam. It almost a complete 180 from every other examination experience that I've had. I had a few courses which required on-site (Pearson Vue) examination, and I experienced far more anxiety (by virtue of experiencing none at home). I can certainly understand how certain (potentially the majority of) disabilities could face discrimination, as described by the linked article, but this is worded as a blanket statement. > Want to tell Fight for the Future about your eproctoring horror story? We’d like to hear it. I'd prefer to submit my in-person horror stories. I have more than a decade of them.
- VLM 5y agoTo amuse a client who did "security by checkbox" everyone needed some entry level comptia certs, even old timers who "wrote the book" back in the old days LOL, so I took some proctored tests live at a testing center recently. I read a lot of reports of eproctor'd tests being cancelled by rando e-proctors with zero recourse. There are three problems. The first is some of these tests cost hundreds of dollars, although I suppose getting kicked out of uni for cheating would be even more expensive, its just a huge risk to e-proctor compared to the human touch at my local test center. Secondly there is no feedback no oversight and no escalation procedure for most e-proctor systems that I'm aware of, some amazon turk nobody can cancel your test on you for any reason they feel like with zero recourse and you're out all the money and theres absolutely nothing you can do about it. Infinite power with no oversight will be infinitely abused. Thirdly the demands for a sterile test location were kind of a PITA. Honestly its easier to go to a test center than to provably and verifiably remove every book and piece of paper and anything with writing on it, from my office at home. I need to remove the kids from the house as any sight of another person is an instant disqualification and loss of my expensive test fee. I can't take it outside what if my neighbor starts mowing the lawn or it starts raining, instant fail when I leave the camera view. I have to silence every electronics device in the house because any interruption is again another forfeited expensive test. (edited to add, I remember another complaint about e-proctor that to prevent brain dumps and copying questions out of their "secret test" any mumbling or even facial expressions were considered an autofail according to some online reports of people taking my test. I did the net+ and found it quite easy but sure enough I can't discuss for NDA reasons or whatever but I was eye rolling "you gotta be kidding" about one question and at a testing center locked in a room alone nobody cares when I roll my eyes but that would have cost me $350 if I did e-proctor testing. also to prevent copying their top secret test they needed proof I had no electronics devices in sight, so it wasn't just removal of all paper products but anything electronic had to be removed from my office/lab it was just ridiculous) Its just easier and faster and vastly less stressful to get out of the house and test onsite at the nearest Vue facility, which is a school I formerly attended LOL.
- fddddd 5y agofrom the other comments, it is a pain for honest ppl and a blessing for cheaters.
- holstvoogd 5y agoIt took me 5 minutes to figure out what eproctoring is
- JasonFruit 5y agoOne problem here is analogous to the separation of powers in government: education and testing are separate powers, and shouldn't be exercised by the same body. Educators ought to be doing everything they can to help students gain understanding, and such evaluation as is necessary for them to guide that process ought to be consequence-free, except to alert the educator to what next step is needed. Doing otherwise creates a needlessly antagonistic relationship between teacher and student, and causes all sorts of unhelpful incentives in both parties. Evaluation of the success of that education, on individual and institutional levels, ought to be done by people not involved in the process of education. Such testing should be infrequent enough that live, in-person proctoring would be no burden. There is no reason for high-stakes evaluation to be a constant feature of education. I don't think that'll happen anytime soon, but it seems like the right approach, to me.
- edtechdev 5y agoThis is how Western Governors University works - they have separate instructors and evaluators. Not sure how well it works in practice, however. I have read a few complaints.
- jjeaff 5y agoThis is an interesting point. Testing and professors and their curriculum were always so intertwined in my college days that I never even considered a "separation of powers" but it makes sense.
- jrm4 5y agoImportant to suss out the two issues, because they are in conflict: 1) EProctoring is bad when it does not work as intended (racism, getting people wrong, etc) 2) EProctoring is bad when it works exactly as intended. The second is the bigger issue, IMHO. I refuse to use it categorically. We teachers need to learn to adapt to the current world. This means understanding that there is very little use for this kind of testing in general. Very few situations in life require rote memorization in a time sensitive environment where you can't talk to people or use the internet. Teachers, teach better.
- krull10 5y agoHow are you supposed to assess whether a student has learned quantum mechanics, or chemistry, or calculus if any questions you ask them they can simply contact another student for help, or get someone to do it for them on sites like Chegg? Short of giving an individualized oral exam, which is not feasible for anything but tiny classes, proctored exams are necessary for assessment in such classes. This has nothing to do with memorization or time pressures, and everything to do with making sure the student is the one who actually did the work. In an ideal world one could trust students to do take-home exams on their own, but I’ve yet to be at a university where undergraduates did not take advantage of such trust…
- jrm4 5y agoI can't speak for those other disciplines, but I'd flip the question -- how valuable, really, is the act of "determining the source of the work, via proctored exams" when the goal is "ensuring that students learn." This is just an ongoing arms race, and other ways have to be experimented with. Again, the biggest stupidity is "discouraging collaboration." I teach web design and some programming, and FAR AND AWAY the best thing I've done is "get all my students on discord and encourage them to help each other on their assignments." I set up a "make sure your website has this and this; content is up to you." And I end up with 40-50 different very cool websites, and I've gotten a pretty good sense that learning takes place because I'm in the chat too.
- imwillofficial 5y agoOn the linked site it calls the eproctoring algorithms that have difficulty with dark skin tones “racist” I think it’s foolish to ascribe human belief systems to computer vision frameworks. Instead you could describe them as “buggy” or “missing critical features that make it unusable” But no, the article linked on baneproctoring.com is instead saying something more along the lines of “eproctoring hates black people” This isn’t helpful.
- rednerrus 5y agoHonest question: Who cares if people are cheating? It's not like I can't call my friend when I have a question at work.
- aeorgnoieang 5y agoI'd imagine your friend(s) would care if you called them with questions frequently enough!
- known 5y agoI always prefer to believe the best of everybody, it saves so much trouble --Rudyard Kipling (b. 1865)