3 ms·
how fast is this compare to python based?
by treksis 10mo ago
how fast is this compare to python based?
- rcarmo 10mo agoThe Python libraries are themselves written in C/C++, so what this does performance-wise is, at best, cutting through some glue. Don't think about this as a performance-driven implementation.
- antirez 10mo agoVery slow currently, I added the benchmarks in the README. To go faster it needs to implement inference faster than the current float32-only kernels.
- throwaway314155 10mo agoPyTorch MPS is about 10x faster per the README.md.