4 ms·

Does anyone use it though? Apparently ANEForge got 16.8 tok/s of Qwen3-8B + 0.6B draft using private APIs. Not big enough