4 ms·
Pretty cool idea, but whats the stack behind this? As 15-25 tok/s seems a bit low as expected SoA for most providers is around 60 tok/s and quality of life dram
by scottcha 6mo ago
Pretty cool idea, but whats the stack behind this? As 15-25 tok/s seems a bit low as expected SoA for most providers is around 60 tok/s and quality of life dramatically improves above that.
- jrandolf 6mo ago15-25 was a rate based on oversubscription. Now it's 60 like others :).