3 ms·It is an inference engine for 1bit LLMs, not really comparable.by eptcyka 2y agoIt is an inference engine for 1bit LLMs, not really comparable.