4 ms·
For small-scale transformer CPU inference you can use, e.g., Fabrice Bellard's https://bellard.org/libnc/ https://bellard.org/libnc/ Similarly, for small-scale
by 37ef_ced3 4y ago
For small-scale transformer CPU inference you can use, e.g., Fabrice Bellard's https://bellard.org/libnc/ https://bellard.org/libnc/
Similarly, for small-scale convolutional CPU inference, where you only need to do maybe 20 ResNet-50 (batch size 1) per second per CPU (cloud CPUs cost $0.015 per hour) you can use inference engines designed for this purpose, e.g., https://NN-512.com https://NN-512.com
You can expect about 2x the performance of TensorFlow or PyTorch.
- tombert 4y agoIs there a thing that Fabrice Bellard hasn't built? I had no idea that he was interested in something like machine learning, but I guess I shouldn't have been surprised because he has built every tool that I use.
- mistrial9 4y agohttps://en.wikipedia.org/wiki/Fabrice_Bellard https://en.wikipedia.org/wiki/Fabrice_Bellard
- deleted 4y ago[deleted]
- nl 4y agoIf you are in the "data compression ~= intelligence" camp then Fabrice Bellard is currently leading the race to AI too. http://prize.hutter1.net/ http://prize.hutter1.net/ https://bellard.org/nncp/ https://bellard.org/nncp/ http://www.mattmahoney.net/dc/text.html http://www.mattmahoney.net/dc/text.html