3 ms·

Working data scientist here. As many have said, this is, effectively a Kaggle challenge. I mean honestly at this point, I don't care, at all, how well someone c

Working data scientist here. As many have said, this is, effectively a Kaggle challenge. I mean honestly at this point, I don't care, at all, how well someone can predict anything to be a data scientist - there is very little correlation between that and how good of a data scientist they are. Tools to hire data scientists and going to continually fail until they realize that the interesting, hard part of being a data scientist is closer akin to a business lead (which can't really be tested in 60 minutes). Concrete feedback: - You ask for writing and descriptions on why a model was chosen, why features matters - are you grading this automatically? That would be a feat. - The task is waaay to easy (even if you do believe there is a market for identifying people who can predict well). - Python is overly limited. Why not SQL or R?

minimaxir 7y ago
Disclosure: Got a preview of this product, my opinions only. > You ask for writing and descriptions on why a model was chosen, why features matters - are you grading this automatically? That would be a feat. Grading is apparently not automatic, which is good as I am not a fan of the Kaggle approach in this demo. > The task is waaay to easy (even if you do believe there is a market for identifying people who can predict well) You'd be very surprised about how candidates can respond to these types of questions! > Python is overly limited. Why not SQL or R? The full product allows Python, R, and Julia, with popular packages preinstalled for Python/R.
shikharja 7y ago
Thank you for the feedback! - We are not automatically grading it. We have learned that in the past that trying to automatically grade candidates on such challenges biases their approach, which breaks the point of a good data science challenge. - that's good to know. we are not really focusing on the final outcome but how creatively a candidate can go about the problem. the dataset allows for some good amount of creativity. - Ah. can you elaborate what you mean by overly limited? We do support R.
okl 7y ago
Isn't the most important part weeding out the most unqualified applicants? For that purpose such a test might be fine.
iamwil 7y ago
What is a business lead?

minimaxir 7y ago

Disclosure: Got a preview of this product, my opinions only. > You ask for writing and descriptions on why a model was chosen, why features matters - are you grading this automatically? That would be a feat. Grading is apparently not automatic, which is good as I am not a fan of the Kaggle approach in this demo. > The task is waaay to easy (even if you do believe there is a market for identifying people who can predict well) You'd be very surprised about how candidates can respond to these types of questions! > Python is overly limited. Why not SQL or R? The full product allows Python, R, and Julia, with popular packages preinstalled for Python/R.

shikharja 7y ago

Thank you for the feedback! - We are not automatically grading it. We have learned that in the past that trying to automatically grade candidates on such challenges biases their approach, which breaks the point of a good data science challenge. - that's good to know. we are not really focusing on the final outcome but how creatively a candidate can go about the problem. the dataset allows for some good amount of creativity. - Ah. can you elaborate what you mean by overly limited? We do support R.

okl 7y ago

Isn't the most important part weeding out the most unqualified applicants? For that purpose such a test might be fine.

iamwil 7y ago

What is a business lead?