2 ms·

We'd bought 4 x $11K Mac Studios at my college and via exo, we had Kimi K2.5 at 30 TPS. Not too wild an idea!

• arjie 2mo ago
  30 tok/s generation? Nice! What was prefill by the way? Also, these are 256 GB RAM studios? Good timing on those!
  • sh3rl0ck 2mo ago
    512 GB!