3 ms·
NVFP4 would buy them a huge increase in capacity but I think it would be noticeable.
by selectodude 23d ago
NVFP4 would buy them a huge increase in capacity but I think it would be noticeable.
- Caracas288 23d agoWhy doesn't someone just try to measure this next time!?
- embedding-shape 23d agoCan't really measure without being sure you aren't being messed around with, when it's a remote platform. Stupidly easy to detect when people run such benchmarks/tests against you as well.