4 ms·

2k tokens/second is insane. While I'm very much against vibe coding, such performance essentially means you can get near-github copilot level speed with drastic

2k tokens/second is insane. While I'm very much against vibe coding, such performance essentially means you can get near-github copilot level speed with drastically better quality. For in-editor use that's game changing.

itsafarqueue 1y ago
At full pace that means 62 mins until you hit the daily cap.
- kvemkon 1y ago
  Reminds me of high write speed on SSD (1.5 GB/s continuously to TLC) means 1 TB SSD warranty expires instead of 5 years just in less than 5 days (600 TB written).
  - sliken 1y ago
    Or comcast's 1 gb service with a 1TB limit, which means you hit the limit in 140 minutes at full rate.