3 ms·
deepseek-v4-flash feels so fast and snappy, i'm loving it. Happy to trade speed for the the 5% degraded benchmarking performance.
by sparkling 2mo ago
deepseek-v4-flash feels so fast and snappy, i'm loving it. Happy to trade speed for the the 5% degraded benchmarking performance.
- k__ 2mo agoI wouldn't exactly call it snappy, but faster than Pro, yes.
- ericd 2mo agoSingle request depth on vllm with dspark, I'm getting ~200 tps, I'd say it's pretty snappy.
- JacobAsmuth 2mo agoWell sure but you're running on tens of thousands of dollars of hardware.
- ericd 2mo agoIt's much faster than other models on that same hardware in the same size class. I've tested a few, it's by far the fastest I've tested. And it wasn't tens* until recently. Didn't expect this to be one of my best performing assets this year.
- k__ 2mo agoI get like 80.
- ericd 2mo agoWhat's your setup? Happy to try to point you in the direction that worked for me.
- saaga 2mo agoI feel the same too. I like the speed. I'm also a big fan of glm 5.2 fast. I can't wait for like 2000 t/s on these haha.