4 ms·
The process you describe is referred to as diffusion
by byteknight 2y ago
The process you describe is referred to as diffusion
- szvsw 2y agoYep yep I know, but I was trying to suggest something diffusion-like occurring with a language model through a totally separate mechanism that does not rely on the denoising process (at least not literally).
- byteknight 2y agoIt kinda does that but one token at a time.
- immibis 2y agoI'm fairly certain diffusion refers to the overall architecture, not the emergent self-organization process.
- byteknight 2y agoIt refers to the process of taking noise and "diffusing" it until visually appealing