4 ms·
Tried a few queries and was surprised how fast it responded vs how slow chatgpt can be. Responses seemed just as good too.
by dawnerd 3y ago
Tried a few queries and was surprised how fast it responded vs how slow chatgpt can be. Responses seemed just as good too.
- gliched_robot 3y agoInference speed is not a great metric given the horizontal scalability of LLMs.
- jaimex2 3y agoBecause no one is using it