4 ms·
If you really want to cheap—run it in your browser via webgpu.
by sroussey 2y ago
If you really want to cheap—run it in your browser via webgpu.
- sroussey 2y agoI got downvoted, but you really can run it in the browser. ONNX version: https://huggingface.co/onnx-community/DeepSeek-R1-Distill-Qwen-1.5B-ONNX https://huggingface.co/onnx-community/DeepSeek-R1-Distill-Qw...
- zubiaur 2y agoNot comparable. That is a quantized distill.
- sroussey 2y agoOh yes, for sure. Don’t mean otherwise.