3 ms·
I built a map of all the PDF urls on the internet recently. I used a tiny embeddings model and PCA for dimensionality reduction. https://weblog.snats.xyz/post
by snats 3y ago
I built a map of all the PDF urls on the internet recently.
I used a tiny embeddings model and PCA for dimensionality reduction.
https://weblog.snats.xyz/posts/2024/03/20/ https://weblog.snats.xyz/posts/2024/03/20/
- ubutler 3y agoInteresting, did you try also using PaCMAP or UMAP for dimensionality reduction? It might result in a more meaningful representation of their underlying semantic structure: see the 'mammoth' example in my article.
- snats 3y agoNo! I only tried PCA, but I still have the embeddings. I'll try later and post results.
- deleted 3y ago[deleted]
- ProllyInfamous 3y agoJust a UI/UX comment: I cannot read the tiny text on your website's main graphic, on a 43" 4K display.