3 ms·
beautiful work as always jared! one of the useful things from nat.dev was the tokens/second calculation, latency is impt as usual. would be nice to enable? i'
by swyx 4y ago
beautiful work as always jared!
one of the useful things from nat.dev was the tokens/second calculation, latency is impt as usual. would be nice to enable?
i'm excited to see what the upcoming products are. making things default sharable like this across all frameworks would be really nice.
- palmdeezy 4y agoThanks man! Good idea on token/s. Will add
- tough 4y agoWould be nice to know cost too! tokmon is on showHN today too https://news.ycombinator.com/item?id=35616871 https://news.ycombinator.com/item?id=35616871
- cramforce 4y agoI'm super excited in graphing this over time. Will be interesting to see how the providers develop over the coming months. FWIW we also need TTFB not just tokens per second. The first token is key for UX