3 ms·
In the bottom left "?" button it says it performs PCA down to 3 dimensions. That's going to lose a ton of information, rendering the space mostly useless.
by kaoD 3y ago
In the bottom left "?" button it says it performs PCA down to 3 dimensions. That's going to lose a ton of information, rendering the space mostly useless.
- behnamoh 3y agoYeah, it's a fun useless project.
- tikimcfee 3y agoI don’t know about useless. I think there is some real magic waiting to be discovered in mapping language language to some specific and enlightening visualization. I think it involves something like this. Using high statistics and simple, spatial relationships to create a “mapping” of a single individuals wordspace. Imagine walking around the world and seeing everyone’s slightly unique relationship space of words. This is something I have envisioned for a very long time.
- kaoD 3y agoWhat you're describing exists. It's called "embeddings" and it's one of the first steps ChatGPT does to do its magic and it's indeed very useful. What renders this useless is reducing the dimensionality from thousands to just 3.
- tikimcfee 3y agoThank you.. sincerely, thank you. You just unlocked something in my brain about how this works in a certain way and I.. am incredibly excited to explore this more. If I’m intuitively understanding that, I really really really feel like I can… get this. Do something with this. Thank you. Now I need to go understand embedding a more. And use them. If you have any resources or ideas or keywords to look for (I think i expect a long YouTube trek for myself…) I’m happy to read and share my thoughts.
- kaoD 3y agoPeople are talking about embeddings in these comments, you'll get plenty of info and keywords here.
- smrtinsert 3y agoIt is lossy, but doesn't PCA function as a grouping even when forced like this?