4 ms·

I work in a small university with local students that are aggressively average, if not a bit below that. Especially when it comes to writing a thesis, our expec

I work in a small university with local students that are aggressively average, if not a bit below that. Especially when it comes to writing a thesis, our expectations are extremely low, and the success rate is abysmal (something like 30% of the students in a year will actually defend their theses). If a student can reach something like, say, 10 people to do a usability test, we are extremely happy and will pass them with a smile on our faces. This year one of my students claimed to have done a user experience test with 30+ people, all of which came in person to his house during a period of 4 days. This is extremely unlikely, not to say absurdly unrealistic. If he had done it via Zoom I might maybe believe, but in person? Sorry, but no. I asked him what did his parents think of it, and magically they were both travelling that specific week. Then I asked him to scan and send me the signed consent forms for each participant; he promptly said "ok, coming!" then about 8h later I got a bunch of signed scans. Not sure what to do anymore, I guess he'll have his thesis.

lcnPylGDnU4H9OF 3y ago
> This year one of my students claimed to have done a user experience test with 30+ people, all of which came in person to his house during a period of 4 days. This is extremely unlikely, not to say absurdly unrealistic. I'm not familiar with conducting a user experience test. Why is this so unbelievable? (Also, the rest of the story is kinda hilarious; there will definitely need to be some standards and process changes in academia.)
- q845712 3y ago
  depends on the situation but generally most people aren't that enthusiastic to be your UX guinea pigs, and it isn't that much fun to administer the same test so many times in a single day (think of how bored your optometrist sounds as they ask you which lens is better). I worked at a shop that had a target of 3-5 users for any given UX testing because usually it starts to get repetitive after that - you tend to hit the diminishing returns portion of the curve. So if you assume that the UX tests were short (20-30 minutes) you're still talking ~15 total hours spent on UX testing, or two full work days. That would be a surprising amount of time. As someone else said, it's conceivable that they ran very short studies on a large number of people in the context of having a party or a couple of small gatherings, but it does seem unlikely overall.
  - lcnPylGDnU4H9OF 3y ago
    Just to recap: very generously, a college student with money to spend (that might sound like a joke but I consider fortunate circumstances) convincing people that it’s worth their time to sit through a usability test actually going through with it “for the lulz”. The part about a person being willing to do a bunch of work to avoid doing a bunch of work makes sense (typical “mental gymnastics”) but it kinda falls apart at 30+ real people legitimately agreeing. It’s ironic that a single-digit amount is just as useful; that’s even a more believable lie. (And this real-life scenario where every request is answered with “Coming right up!” and a convincing “successful” completion of the request just cracks me up. My sympathies go out to the people to whom this is a genuine problem.) Thanks for explaining!
- low_tech_love 3y ago
  You have to get people to actually come to your house voluntarily in the middle of the week to sit down and do some boring stuff in your computer. And it all just clicked with everyone’s schedules in four days. I usually can’t get people to even answer a 5-minute online form, let alone get them to drive to my house. Maybe he’s just popular (which he isn’t, by the way; and a confessed previous cheater.)
krisoft 3y ago
> This year one of my students claimed to have done a user experience test with 30+ people, all of which came in person to his house during a period of 4 days. Is it possible that maybe he thrown a big party (or a series of parties) and asked the folks there to try his stuff? Not sure what is the length and depth of the usability test in question, but if it is a short questionnaire that might work? But I see where your suspicion is coming from.
- low_tech_love 3y ago
  I believe in Occam’s Razor, so I’d say no. This guy was already caught cheating before, also.
k0k0r0 3y ago
This surprisingly remind me of the last to birthday parties I organized for myself. Unexpectedly I managed to get much more people together than I expected. Simply by actually trying to ask as many people as possible. I was really happy about this. Both times. Maybe that student was doing the same. Simply asking a lot of people. And other studends usually do not. I find it really hard to overcome my own shyness in this regard. And I wouldn't consider myself particularly shy. I assume a lot of people simply do not try asking enough people in order to get a decent amount of them to join. Of course that guy might be simply cheating, but I just wanted to share the story.
anonymouskimmer 3y ago
> Not sure what to do anymore, Scan the signatures and reverse image search them. Or look one or two of the people up on facebook and ask them whether they did the study.
- anonymouskimmer 3y ago
  To add: If it turns on this is legit, ask him how he did it so that you can advise others on what to do for their theses.
- sebzim4500 3y ago
  Surely the guy just wrote a bunch of random signatures. Otherwise it would be obvious that they weren't captured by the same device.
  - anonymouskimmer 3y ago
    I don't believe it's easy to make up 30 different signatures without them having similar style.
bachmeier 3y ago
In middle school, I put a lot of time into a paper for a history class, at least three times what anyone else did (probably more). I got a B for the class. The teacher said it felt like the paper was copied, because the writing was "too professional" and that middle school students don't write like that. The teacher was wrong. I just happened to have worked really hard because the topic was interesting to me.
washadjeffmad 3y ago
Are there rules about investigation? In general, if someone makes a claim, it invites testing. The consent forms are likely friends, so calling to ask questions about the experience should give you an idea of what to believe. The outcome can be your decision. Meet with the student and tell them their degree is in jeopardy and use it as a teaching lesson, or prove to them that they can get away with believable lies as long as no one has the courage to catch them. Your colleagues should have some insights, as well.

lcnPylGDnU4H9OF 3y ago

> This year one of my students claimed to have done a user experience test with 30+ people, all of which came in person to his house during a period of 4 days. This is extremely unlikely, not to say absurdly unrealistic. I'm not familiar with conducting a user experience test. Why is this so unbelievable? (Also, the rest of the story is kinda hilarious; there will definitely need to be some standards and process changes in academia.)

q845712 3y ago
depends on the situation but generally most people aren't that enthusiastic to be your UX guinea pigs, and it isn't that much fun to administer the same test so many times in a single day (think of how bored your optometrist sounds as they ask you which lens is better). I worked at a shop that had a target of 3-5 users for any given UX testing because usually it starts to get repetitive after that - you tend to hit the diminishing returns portion of the curve. So if you assume that the UX tests were short (20-30 minutes) you're still talking ~15 total hours spent on UX testing, or two full work days. That would be a surprising amount of time. As someone else said, it's conceivable that they ran very short studies on a large number of people in the context of having a party or a couple of small gatherings, but it does seem unlikely overall.
- lcnPylGDnU4H9OF 3y ago
  Just to recap: very generously, a college student with money to spend (that might sound like a joke but I consider fortunate circumstances) convincing people that it’s worth their time to sit through a usability test actually going through with it “for the lulz”. The part about a person being willing to do a bunch of work to avoid doing a bunch of work makes sense (typical “mental gymnastics”) but it kinda falls apart at 30+ real people legitimately agreeing. It’s ironic that a single-digit amount is just as useful; that’s even a more believable lie. (And this real-life scenario where every request is answered with “Coming right up!” and a convincing “successful” completion of the request just cracks me up. My sympathies go out to the people to whom this is a genuine problem.) Thanks for explaining!
low_tech_love 3y ago
You have to get people to actually come to your house voluntarily in the middle of the week to sit down and do some boring stuff in your computer. And it all just clicked with everyone’s schedules in four days. I usually can’t get people to even answer a 5-minute online form, let alone get them to drive to my house. Maybe he’s just popular (which he isn’t, by the way; and a confessed previous cheater.)

krisoft 3y ago

> This year one of my students claimed to have done a user experience test with 30+ people, all of which came in person to his house during a period of 4 days. Is it possible that maybe he thrown a big party (or a series of parties) and asked the folks there to try his stuff? Not sure what is the length and depth of the usability test in question, but if it is a short questionnaire that might work? But I see where your suspicion is coming from.

low_tech_love 3y ago
I believe in Occam’s Razor, so I’d say no. This guy was already caught cheating before, also.

k0k0r0 3y ago

This surprisingly remind me of the last to birthday parties I organized for myself. Unexpectedly I managed to get much more people together than I expected. Simply by actually trying to ask as many people as possible. I was really happy about this. Both times. Maybe that student was doing the same. Simply asking a lot of people. And other studends usually do not. I find it really hard to overcome my own shyness in this regard. And I wouldn't consider myself particularly shy. I assume a lot of people simply do not try asking enough people in order to get a decent amount of them to join. Of course that guy might be simply cheating, but I just wanted to share the story.

anonymouskimmer 3y ago

> Not sure what to do anymore, Scan the signatures and reverse image search them. Or look one or two of the people up on facebook and ask them whether they did the study.

anonymouskimmer 3y ago
To add: If it turns on this is legit, ask him how he did it so that you can advise others on what to do for their theses.
sebzim4500 3y ago
Surely the guy just wrote a bunch of random signatures. Otherwise it would be obvious that they weren't captured by the same device.
- anonymouskimmer 3y ago
  I don't believe it's easy to make up 30 different signatures without them having similar style.

bachmeier 3y ago

In middle school, I put a lot of time into a paper for a history class, at least three times what anyone else did (probably more). I got a B for the class. The teacher said it felt like the paper was copied, because the writing was "too professional" and that middle school students don't write like that. The teacher was wrong. I just happened to have worked really hard because the topic was interesting to me.

washadjeffmad 3y ago

Are there rules about investigation? In general, if someone makes a claim, it invites testing. The consent forms are likely friends, so calling to ask questions about the experience should give you an idea of what to believe. The outcome can be your decision. Meet with the student and tell them their degree is in jeopardy and use it as a teaching lesson, or prove to them that they can get away with believable lies as long as no one has the courage to catch them. Your colleagues should have some insights, as well.