15 ms·
It's possible OP is in a Theranos type situation, and that's a good thing to look out for. It's also conceivable the company is doing Wizard of Oz exercises (e
by neilv 8y ago
It's possible OP is in a Theranos type situation, and that's a good thing to look out for.
It's also conceivable the company is doing Wizard of Oz exercises (e.g., having humans simulate what they ultimately want software to do), to refine their model and build ML training data, which is an entirely valid approach, but they'd have to be upfront about that.
Upfront to users, and especially, investors. For example, if someone were telling an investor that they have a DNN servicing the customer requests, but it's actually humans, that would create a very difficult situation, and fixing it would probably include consulting a lawyer. In that scenario, there might be others in the company who are pissed at the person who ran off their mouth, but not want to take a hit of fixing it in a good way (and then things can get worse; "the coverup is worse than the crime" is a thing).
I suspect OP's situation is much more easily corrected, or might even just be a small misunderstanding.
- boulos 8y agoWizard of Oz experiments don't work if you tell the user (from a user study perspective). You could tell them afterwards, but depending on the product / service that may not make sense.
- neilv 8y agoThis isnt necessarily an experiment, users' perception of how might not be a concern at this time, and there's different kinds of Wizard of Oz exercises. For example, when I first learned the term (in HCI, or human factors engineering), they used the example of a mockup by photocopier designers, in which obviously the people using it knew there was a human moving sheets of paper to the slots. Maybe there's a better term?