3 ms·
>4. How do you determine if a given data sample is statistically significant? That's a weird question - what am I to prove? Are there differences in the datase
by a_bonobo 14y ago
>4. How do you determine if a given data sample is statistically significant?
That's a weird question - what am I to prove? Are there differences in the dataset? How does the data look like? Is there a second dataset against which to compare? What kind of data is it, ordinal or nominal? Is the dataset normally distributed?
I can't just say "that data sample is statistically significant" without a background against which to compare against!
>3. Explain how Bayesian spam filtering works.
I would say the majority of non-web developer scientists don't know how this works, why should we?
- tymekpavel 14y agoIf you've had any exposure to Bayesian statistics, it's very easy to explain the approach. You're basically tokenizing the email by word, and then predicting the probability that P(email is spam|token). I would expect any data science candidate to have (at least) a basic understanding of Bayesian statistics.
- a_bonobo 14y agoIt's just that an e-mail filter is the last thing most scientists working in biology, chemistry, physics, medicine are actually working with, so it's (in my opinion) a rather unfitting example, you might be selecting against these people who fit the bill of "data scientist" probably better than the average "I once did something in Excel"-web guy.