2 ms·
At this size (~400 million parameters), does it become viable running directly on CPU?
by tarruda 14d ago
At this size (~400 million parameters), does it become viable running directly on CPU?
- rcarmo 14d agoYep. Not instantly though. I am hacking away at these things over on https://github.com/rcarmo/go-pherence https://github.com/rcarmo/go-pherence (I do SIMD versions of common inference algos) and trying to improve that.