4 ms·
Together.ai seems to be the best, incredibly fast.
by bearjaws 3y ago
Together.ai seems to be the best, incredibly fast.
- RupertEisenhart 3y agoThese guys are much faster than openrouter, and their llama2 runs faster than 3.5-turbo. Amazing work.
- T_S_ 3y agoNot so sure about that. Check out https://github.com/ray-project/llmperf-leaderboard https://github.com/ray-project/llmperf-leaderboard And try mixtral on chat.groq.com