3 ms·
When I interviewed for a data analyst position at a known startup, I was asked to define a target KPI for a controlled pseudo-A/B experiment, and I suggested to
by minimaxir 8y ago
When I interviewed for a data analyst position at a known startup, I was asked to define a target KPI for a controlled pseudo-A/B experiment, and I suggested total revenue. The interviewer replied "that's a dumb answer because revenue can be gamed; you should have said # of sales."
I was too taken aback to follow up asking why # of sales can't be gamed too.
- bsg75 8y agoNumber of sales (or customers) is a vanity metric favored by startups looking to entice investment. Revenue is a metric useful for measuring actual business health. Any chance the interviewer was overly exit eager ?
- minimaxir 8y agoIt is a startup very well known for being a loss-leader.
- rhizome 8y agoCredit where due, I think this is the first time I've read of anybody being told how they got something wrong in an interview.
- geofft 8y agoWhy is that credit? Good interview questions don't have a right or wrong answer, they have a right or wrong process of coming up with an answer. Especially for a question like "Pick a metric," almost any relevant metric is defensible and has tradeoffs, and the question should be about how the interviewee analyzes engineering tradeoffs, gathers requirements, defends their initial proposal, and is open to counterarguments. (If there's a correct answer, you can just give them a quiz. If there's a Googleable correct answer, you can just employ them and give them Google.)
- abiox 8y ago> interviewer replied "that's a dumb answer a bit ot, but was that the actual response? personally, stuff like this would have me ending the interview early.
- minimaxir 8y agoThat was one of the tamer criticism of my answers during my interviews that day. I wasn't extended a job offer, but would likely have not accepted it if I had.
- dredmorbius 8y agoAnd what is your gentle phrasing for that action?
- breakingcups 8y agoIt's an interview, not a competition. The interviewer would've been much better of asking: "Why?"
- dredmorbius 8y agoI meant for excusing yorself. I'd tend to go to "I'm sorry, but I'm afraid I'm wasting your time," for example.