4 ms·
How would flow matching work? In language we have inputs and outputs but it's not clear what the intermediate points are since it's a discrete space.
by kevmo314 9mo ago
How would flow matching work? In language we have inputs and outputs but it's not clear what the intermediate points are since it's a discrete space.
- Etheryte 9mo agoOne of the core ideas behind LLMs is that language is not a discrete space, but instead a multidimensional vector field where you can easily interpolate as needed. It's one of the reasons LLMs readily make up words that don't exist when translating text for example.