3 ms·
That is probably because they did not try the model yet. I tried and was stunned. It's not better yet in all areas, but where is better, is so much better than
by belter 2y ago
That is probably because they did not try the model yet. I tried and was stunned. It's not better yet in all areas, but where is better, is so much better than Claude or anything from OpenAI.
- attentionmech 2y agoPlus, the speed at which it replies is amazing too. Claude/Chatgpt now seem like inefficient inference engines compared to it.
- IanCal 2y agoI've been trying through openrouter today and it seems quite slow, but this may just be a scaling thing. I tried the chat when it first came out and that was extremely fast.
- attentionmech 2y agoYea, they might be scaling is harder or may be more tricks up their sleeves when it comes to serving the model.
- TuxSH 2y agoAgreed. It's worse than competitors at code completion/fill the blanks/"coding_completion" (it's introduced bugs in functions it didn't need to modify), and language, but is stellar elsewhere: - excellent and very detailled answer for highly technical info searches, like "Is there a C++ proposal to make std::format constexpr?" - excellent at logic where it gets the answer correct on the first try: "Alice has 2 sisters and 1 brother. How many sisters does Alice's brother have?" - excellent in reverse-engineering (prompt looked like: "here's a bunch of Arm ASM with reg names, the reg correspond to this particular datasheet, explain"