3 ms·
> It doesn’t go out and google for reference material based on the prompt. And note that even if it did (which is definitely architecturally possible given pr
by gwern 5y ago
> It doesn’t go out and google for reference material based on the prompt.
And note that even if it did (which is definitely architecturally possible given progress in retrieval and demos like WebGPT), it still wouldn't necessarily be 'copying', in the goalpost-moving excuse.
Facebook has a neat diffusion model which uses retrieval on a dataset of images for generation: https://arxiv.org/abs/2204.02849#facebook https://arxiv.org/abs/2204.02849#facebook You can see the exemplars it uses: they both greatly improve the quality of generated samples, but also don't look that much like the generated sample.