4 ms·

the writing is on the wall for it, I have switched to gemma-4-26b-a4b. At least in benchmarks, it scores higher and is faster.

• 3stacks 3mo ago
  How does it compare cost-wise for you?
  • swe_dima 3mo ago
    About the same, using cloudflare. For some very bizarre reason Vertex has a very low non-adjustable quota.