4 ms·
Do you have any data on how many more tokens I would use with the increased speed? In the demo alone I just used way more tokens than I normally would testing
by pwillia7 3y ago
Do you have any data on how many more tokens I would use with the increased speed?
In the demo alone I just used way more tokens than I normally would testing an LLM since it was so amazingly fast.
- tome 3y agoInteresting question! Hopefully being faster is so much more useful to you that you use a lot more :)