3 ms·
I was only getting like 200 tk/s with groq on K2, was expecting it to be faster tbh. I think the bottleneck is file read/write tooling right now
by adenta 1y ago
I was only getting like 200 tk/s with groq on K2, was expecting it to be faster tbh.
I think the bottleneck is file read/write tooling right now