4 ms·
We tried doing just that and the short answer is that we couldn't fit the gradients for arbitratily-placed tiles into a DGX with 320 GB of GPU RAM. For 32x32 pi
by fxtentacle 4y ago
We tried doing just that and the short answer is that we couldn't fit the gradients for arbitratily-placed tiles into a DGX with 320 GB of GPU RAM. For 32x32 pixel tiles, free location placement will 1024x your memory usage.
- bl0rg 4y agoPerhaps hard attention could be a thing here. Possibly too tricky to train though.