3 ms·
It's[0] a non-linear dimensionality reduction technique in the vein of t-SNE[1] that is very well known in the field. My two cents is that if your problem can
by jszymborski 3y ago
It's[0] a non-linear dimensionality reduction technique in the vein of t-SNE[1] that is very well known in the field.
My two cents is that if your problem can be solved with something like UMAP + kNN[2], then you really shouldn't be using Deep Learning to solve it.
[0] https://en.wikipedia.org/wiki/Nonlinear_dimensionality_reduction#Uniform_manifold_approximation_and_projection https://en.wikipedia.org/wiki/Nonlinear_dimensionality_reduc...
[1] https://en.wikipedia.org/wiki/T-distributed_stochastic_neighbor_embedding https://en.wikipedia.org/wiki/T-distributed_stochastic_neigh...
[2] https://en.wikipedia.org/wiki/K-nearest_neighbors_algorithm https://en.wikipedia.org/wiki/K-nearest_neighbors_algorithm
- selimthegrim 3y agoDoesn’t your choice of initialization really affect the results? Lior Pachter really seems to keep beating that drum
- jszymborski 3y agoThere's some work[0] that argues that UMAP's performance relative to t-SNE is not that great when you control for the initialization. I'm not sure where I sit on that, but regardless, my understanding is that getting UMAP to separate MNIST doesnt really require you to turn knobs. [0] https://www.biorxiv.org/content/10.1101/2019.12.19.877522v1 https://www.biorxiv.org/content/10.1101/2019.12.19.877522v1