3 ms·
About fickleness... indeed i've found this a kinda problematic thing when running large-d text embeddings through umap -- it always comes out spherical, blob-sh
by isoprophlex 2y ago
About fickleness... indeed i've found this a kinda problematic thing when running large-d text embeddings through umap -- it always comes out spherical, blob-shaped, without any obvious segregation in the low-d projected space.
IMO it's very difficult to make a "fire and forget" embedding interpreter. Maybe I never found the right parameters to umap but the results of running it (or any dimension reduction algo) always left me a bit underwhelmed.
- antman 2y agoHave you tried PaCMAP? It should be better and faster
- wenc 2y agoThanks for the pointer to PacMap. I just tried it. My verdict? PacMap >= UMAP >> t-SNE. UMAP captures the basic pattern but PacMap makes it crisper.
- isoprophlex 2y agoWow, thanks for that!