4 ms·
For the small 124M model, it’s already runable on the CPU. It’s going beyond that is tricky.
by minimaxir 6y ago
For the small 124M model, it’s already runable on the CPU.
It’s going beyond that is tricky.
- FreakyT 6y agoI’ve run the 1.5B model on my CPU, and it works...just very very slowly.