4 ms·
I don't think calling it a stencil copy is the right mental model. These models take 5bn+ images and use them to influence the weights on a giant array of floa
by simonw 4y ago
I don't think calling it a stencil copy is the right mental model.
These models take 5bn+ images and use them to influence the weights on a giant array of floating point numbers. Each input image has a truly tiny effect on the finished product.
The final model is on the order of 4.5GB - the compression ratio is unreal. Nothing of the original images remains.
So "stencil copy" doesn't work for me.