3 ms·
For me PCA is strictly in a bucket labeled "this comes up a lot in data science interviews but you never actually need to use it at work".
by jstx1 5y ago
For me PCA is strictly in a bucket labeled "this comes up a lot in data science interviews but you never actually need to use it at work".
- civilized 5y agoFor me the contents of this bucket are things like SVM, Naive Bayes, and k-means. PCA is actually in a slightly higher tier than those three.
- kleene_op 5y agok-means are actually useful for bootstrapping statistical mixtures when you don't have good priors. Just for this convenient use alone I would place them above PCA.
- civilized 5y agoWhat does bootstrapping statistical mixtures mean? Why not just bootstrap in the regular old non-parametric way? Why inject k-means into it?
- kleene_op 5y agoWhen you try to approximate your data with a mixture of distributions, say Gaussians for instance, you have to initialize their parameters with some values before running your EM loop. Finding good ones can be very problematic. The k-means process is a reasonable method to get good enough starting values without having to think/compute too much. https://en.wikipedia.org/wiki/Expectation%E2%80%93maximization_algorithm https://en.wikipedia.org/wiki/Expectation%E2%80%93maximizati...
- civilized 5y agoOK, so for you, "bootstrapping statistical mixtures" means "warm-starting EM mixture modeling". Personally I never would have guessed that, in retrospect it makes sense... to each their own!
- it_does_follow 5y agoYou've never had to any kind of factor analysis in your work or done any searching for latent variables that map to customer/stakeholder question? Given the number of people I've worked with that are interested in modeling "engagement", I find this hard to believe. PCA is an incredibly valuable tool that I've used in most jobs I've had. It's just a terrible idea as a default part of a feature engineering pipeline (which is what the author is talking about in terms of "feature selection"), for reasons outline in this article. I suggest you don't be quite so quick to dismiss important concepts in this area, and before criticizing this post, at least read through it (I noticed your comment about misunderstand what the author is discussing by "feature selection" is the top comment here).
- jstx1 5y ago> You've never had to Nope, never. I'm not dismissing PCA altogether; I'm sharing my experience and pointing out that some topics come up much more often in interviews than on the job.
- nerdponx 5y agoMy experience is the opposite of yours. It has never come up in a job interview but I have used it for real work several times.