3 ms·
I happen to have a couple of 16 core Xeons available with 128GB RAM and a decent high end Radeon GPU. Could I run a decent text transform model on this?
by winstonprivacy 4y ago
I happen to have a couple of 16 core Xeons available with 128GB RAM and a decent high end Radeon GPU. Could I run a decent text transform model on this?
- sp332 4y agoIt's not as starightforward, because the M1 has a unified memory model while the PC will have to copy data between system RAM and VRAM. But it should be possible, see FlexGen for example.
- cjbprime 4y agoIt is straightforward for this code, which is CPU-only.
- sp332 4y agoWithin the last couple of hours, AVX support was added to the repo. Should be a lot faster on your Intel CPUs.