3 ms·
"starting from an embedding and working backwards to generate a piece of text that is semantically close by?" Apparently this is called embedding inversion and
by luke-stanley 1y ago
"starting from an embedding and working backwards to generate a piece of text that is semantically close by?"
Apparently this is called embedding inversion and Universal Zero-shot Embedding Inversion https://arxiv.org/abs/2504.00147 https://arxiv.org/abs/2504.00147
Going incrementally closer and closer to the target with some means to vary seems to be the most general way, there are lots of ways to be more optimal though. Image diffusion with CLIP embeddings and such is kinda related too.
- luke-stanley 1y agoI meant to say: Apparently this is called "embedding inversion", and that "Universal Zero-shot Embedding Inversion" is a related paper that covers a lot of the basics. Recently I learned that a ArXiv RAG agent by ArXiv Labs is a really cool way for people wanting to find out about research: https://www.alphaxiv.org/assistant https://www.alphaxiv.org/assistant Though I had ran into "inversion" before, the AlphaXiv Assistant introduced me to "embedding inversion".