3 ms·

> The Chinese models are not good enough for anything other than pair programming, which is just a very last-gen way of using agents. This matches my experienc

> The Chinese models are not good enough for anything other than pair programming, which is just a very last-gen way of using agents. This matches my experience with DeepSeek V4 Pro at Max reasoning, the preview version of the model kept regularly messing things up. About 30-60% of additional time to fix the output was needed. On similar tasks, GLM 5.2 at Max reasoning screwed up maybe 20-30% of the time, while it still definitely made noticeable mistakes, they were far fewer in total and less egregious. Kimi K3 at Max reasoning drops that value to below 10%, it's about as good as Opus or approaches Fable in some tasks. At High reasoning it also seems to be pretty close to Opus 4.8, not sure about the latest Opus model yet, but it's up there. Only problem is that K3 is nowhere near as cheap as DeepSeek models, despite me personally liking the writing tone more (less Anthropic slop) and finding that it doesn't block my cybersecurity prompts, recently reproduced SQLi with a proof of context so I could justify fixing it. My overall thoughts (released over some time): https://blog.kronis.dev/blog/ai-slop-is-a-self-inflicted-tragedy/ https://blog.kronis.dev/blog/ai-slop-is-a-self-inflicted-tra... https://blog.kronis.dev/blog/kimi-k3-is-out-is-anthropic-done/ https://blog.kronis.dev/blog/kimi-k3-is-out-is-anthropic-don... https://blog.kronis.dev/blog/z-ai-s-glm-5-2-is-a-great-model-but-is-it-good-value/ https://blog.kronis.dev/blog/z-ai-s-glm-5-2-is-a-great-model... I'd say as Chinese models get better, whatever moat Anthropic and OpenAI have dissipates. Currently the main things keeping me with Anthropic are their performance (tokens/second) and the fact that their visualization abilities within the app are pretty good.

re-thc 2mo ago
> This matches my experience with DeepSeek V4 Pro at Max reasoning, That was ages ago (in LLM release timelines). DeepSeek V4 Flash beats it now and a lot cheaper. > On similar tasks, GLM 5.2 at Max reasoning screwed up maybe 20-30% of the time, GLM 5.3 bridges this gap. > I'd say as Chinese models get better, whatever moat Anthropic and OpenAI have dissipates. Their moat, especially OpenAI is funding and hardware resources. They gain train models 10x as large and also serve at large scale. That's it.
- KronisLV 2mo ago
  > GLM 5.3 bridges this gap. I’m sure the next models will only get better, when they’re released. Also super curious about what Moonshot will achieve and the full DeepSeek V4 Pro release! > Their moat, especially OpenAI is funding and hardware resources. They gain train models 10x as large and also serve at large scale. That's it. I’ve seen how much slower Kimi K3 can be and that part seems correct, their own GPU production still has ways to go and export restrictions definitely limit what they can do. Not sure about the size part, if Kimi K3 achieves SOTA performance at 2.8T parameters, western models being >2x that size would be insanely bad in regards to efficiency. I bet they’re all within the same order of magnitude and below 10T and won’t really have a reason to go even that high for the foreseeable future. As investors will start squeezing them for profitability, I suspect focusing more on efficiency will be commonplace.
  - re-thc 2mo ago
    > Not sure about the size part, if Kimi K3 achieves SOTA performance at 2.8T parameters, western models being >2x that size would be insanely bad in regards to efficiency. I bet they’re all within the same order of magnitude and below 10T and won’t really have a reason to go even that high for the foreseeable future. They're a lot larger e.g. Fable. It is insanely bad. Do you know how much more resources "Western" companies have? Most in China don't have random GPUs to "play with" like every "frontier lab" employee does. > As investors will start squeezing them for profitability, I suspect focusing more on efficiency will be commonplace. They're born lucky though. Efficiency is "free". The next generation hardware e.g. Nvidia claims Blackwell -> Rubin is 10x efficiency (verified by Neoclouds apparently).

re-thc 2mo ago

> This matches my experience with DeepSeek V4 Pro at Max reasoning, That was ages ago (in LLM release timelines). DeepSeek V4 Flash beats it now and a lot cheaper. > On similar tasks, GLM 5.2 at Max reasoning screwed up maybe 20-30% of the time, GLM 5.3 bridges this gap. > I'd say as Chinese models get better, whatever moat Anthropic and OpenAI have dissipates. Their moat, especially OpenAI is funding and hardware resources. They gain train models 10x as large and also serve at large scale. That's it.

KronisLV 2mo ago
> GLM 5.3 bridges this gap. I’m sure the next models will only get better, when they’re released. Also super curious about what Moonshot will achieve and the full DeepSeek V4 Pro release! > Their moat, especially OpenAI is funding and hardware resources. They gain train models 10x as large and also serve at large scale. That's it. I’ve seen how much slower Kimi K3 can be and that part seems correct, their own GPU production still has ways to go and export restrictions definitely limit what they can do. Not sure about the size part, if Kimi K3 achieves SOTA performance at 2.8T parameters, western models being >2x that size would be insanely bad in regards to efficiency. I bet they’re all within the same order of magnitude and below 10T and won’t really have a reason to go even that high for the foreseeable future. As investors will start squeezing them for profitability, I suspect focusing more on efficiency will be commonplace.
- re-thc 2mo ago
  > Not sure about the size part, if Kimi K3 achieves SOTA performance at 2.8T parameters, western models being >2x that size would be insanely bad in regards to efficiency. I bet they’re all within the same order of magnitude and below 10T and won’t really have a reason to go even that high for the foreseeable future. They're a lot larger e.g. Fable. It is insanely bad. Do you know how much more resources "Western" companies have? Most in China don't have random GPUs to "play with" like every "frontier lab" employee does. > As investors will start squeezing them for profitability, I suspect focusing more on efficiency will be commonplace. They're born lucky though. Efficiency is "free". The next generation hardware e.g. Nvidia claims Blackwell -> Rubin is 10x efficiency (verified by Neoclouds apparently).