5 ms·
I think that's going to be a geodesic in a hyper-dimensional manifold. There was an article here about 'wordlets' on a hyper-sphere and a piece on time and LLM
by tudorw 3y ago
I think that's going to be a geodesic in a hyper-dimensional manifold. There was an article here about 'wordlets' on a hyper-sphere and a piece on time and LLM and the relating manifold. Visualising LLM topology (multi-dimensional topological manifolds) is a very rich area for exploration. I'm waiting for someone to use PHATE to do the dimension reduction, it's used in neuroscience to reduce dimensionality providing information not visible using PCA, t-SNE, LDA or UMAP.
- patcon 3y agoYep, been thinking on that paper as well: Traveling words. There's code! https://arxiv.org/abs/2309.07315 https://arxiv.org/abs/2309.07315 https://github.com/santiag0m/traveling-words https://github.com/santiag0m/traveling-words