4 ms·
Good point. When I use it, the inference doesn't seem very fast compared to the big providers, esp Time to First (non-reasoning)Token.
by kristianp 5mo ago
Good point. When I use it, the inference doesn't seem very fast compared to the big providers, esp Time to First (non-reasoning)Token.