4 ms·
> I still have yet to hear anyone propose a workable solution for the ultimate problem of remote assessment in CS What about 1-on-1 interviews? Ask people the
by chrisseaton 7y ago
> I still have yet to hear anyone propose a workable solution for the ultimate problem of remote assessment in CS
What about 1-on-1 interviews? Ask people the questions face-to-face, ask them to talk you through their answers. That's how advanced degrees like PhDs are assessed.
- NullPrefix 7y ago1on1's take too long and don't InternetScale^tm
- deleted 7y ago[deleted]
- indigochill 7y agoThis is also what my team does for professional interviews. We give them a take-home test with some simple problems, but we actually care much more about how they talk through their solution with us than the solution itself. We don't even care if they copy/pasted stuff from Stack Overflow. What we care about is that they can demonstrate they understand the problem and solution. The code is just the starting point for that conversation. We have hired people who submitted failing solutions because they were able to think through the problem on the spot when we told them it failed and asked why.
- acbart 7y agoI'm 1-on-1 interviewing my 59 Algorithms students this semester. 20 minute interviews, and I have 2.5 TAs to help offset the workload. Starts on Wednesday, I'm absolutely dreading it. This would never scale to my 180 Intro students that I'll be getting this fall.
- turndown 7y agoWhat are the 59 algorithms?
- chrisseaton 7y ago59 students of algorithms, not students of 59 algorithms, I would guess.
- acbart 7y agoYes, thank you for the clarification :)
- chongli 7y agoI would definitely take a course entitled "59 Algorithms". What a fantastic idea for a second course in algorithms! Looking at 59 of the most important algorithms (in the opinion of the professor). It's even more intriguing since it's not a round number, so you know the prof didn't add a bunch of filler just to get a nice number.
- ahefner 7y ago"59 Algorithms" would be a fantastic book title. I'd buy it.
- lonelappde 7y agoRecruit proctors from big companies.
- im3w1l 7y agoThere are entertainers streaming with appearance-modifier and voice-modifier filters. You can't know you are interviewing the person you think you are. I don't think there is an off-the-shelf product for cheaters, but it's only a question of time. Especially now that I mentioned it.
- chrisseaton 7y agoI think ideally you should know your students well enough to be able to judge whether they're giving you answers which correspond their ability and their own take on the topic. If you've been tutoring them up to this point in the year you should know them pretty well.
- noodlesUK 7y agoYes, you would hope so in smaller, more specialised classes. However, in a ~200+ person class, you just won’t have that kind of relationship with each student. Additionally, this completely breaks the anonymous marking that many institutions strive for.
- dahfizz 7y agoI don't know if you have been to college recently, but I had a handful of intro classes with 200+ students. I never spoke to those professors once.
- jancsika 7y agoThose aren't classes. They are class theater. They probably failed even by the simple arithmetic that the time required to make a minimally good faith effort at applying a grading rubric is greater than the time a teaching assistant is paid to "assist" in the grading. Your teaching assistants almost certainly scaled back their time grading your assignments to fit their allotted hours. If any of those intro classes fulfilled a writing credit you can probably start with available undergrad writing credit requirements, figure out how many hours your TA got paid, and look back at the number of students for a given TA to figure out just how much money you and/or your parents lost on the deal.
- dasudasu 7y agoThis is how all exams at the university level used to be conducted. Not really practical however when you have large class sizes.
- tnecniv 7y agoIn my experience, this is definitely the best way to evaluate how competent someone is in an area. If they can easily hold a casual conversation and express / defend some sensible opinions about an area, it's likely they know what they're talking about. Obviously, you should ask technical questions in the interview, but it's the little things in the conversation that say a lot. Unfortunately, this approach doesn't scale to the size of the AP Exams. Dijkstra exclusively gave oral final exams on a board. Allegedly, he stopped one of his former students after the first question and told him something to the effect of "you clearly know what you are doing by how you answered that, so you'll get an A, but your handwriting is atrocious." He spent the rest of the exam time making the student practice penmanship.
- acbart 7y agoDjikstra - not a professor I would want to emulate. I'm unconvinced that oral exams provide the most secure and consistent form of assessment. I'm not even sure how to evaluate such a claim, though, so it may have to stand as an opinion.