3 ms·
> but is a bit more tricky to get to work well with text than pixels Interesting. Can't you just start with 4K of randomly assigned tokens and tweak it until i
by earthboundkid 3y ago
> but is a bit more tricky to get to work well with text than pixels
Interesting. Can't you just start with 4K of randomly assigned tokens and tweak it until it's right (including the tokens for EOF), like they do for images where they start with noise and move towards an image?
- carlosbaraza 3y agoAnyone knows why this isn't possible?
- jszymborski 3y agoThis is not my corner of DL research, but my understanding is that pixel noise is far more acceptable in a e.g. 1084 x 1084 canvas than it is when dealing with a sentence of 36 words.