3 ms·
I don't know if this is quite correct. The inpainted text has zero bits of information only if you already have on your end the exact, very large model they wou
by andrewflnr 4y ago
I don't know if this is quite correct. The inpainted text has zero bits of information only if you already have on your end the exact, very large model they would have used. If you don't, and they only sent their prompt rather than the full text, you're in for a bit of a download.
Put another way, their prompt is arguably a pointer to data buried in that model. You're raising the question of whether they should only send the pointer, or just cache the query result, in a sense, and save you the trouble of looking it up.