3 ms·
And their disk-based caching is amazing. I got a long 700k context session spanning more than a week, with pauses in between that was longer than a day, and som
by throwdbaaway 4mo ago
And their disk-based caching is amazing. I got a long 700k context session spanning more than a week, with pauses in between that was longer than a day, and some rewinds mixed in as well.
Stats from pi:
↑400k ↓438k R432M 71.9%/1.0M
Half a billion tokens, $2.12