4 ms·

The current panic is happening precisely because Chinese open weight models like Kimi and Qwen are demonstrably competitive with SotA models like Fable, but far

The current panic is happening precisely because Chinese open weight models like Kimi and Qwen are demonstrably competitive with SotA models like Fable, but far cheaper. https://fireworks.ai/blog/kimik3-fable https://fireworks.ai/blog/kimik3-fable

ngl999 3mo ago
No, the Chinese tech companies routinely super optimize for a given 'famous' or 'established' or 'mainstream' benchmarks. Any other concern is secondary. In other words, they look good on surface, but suck whenever anyone put them to any serious use. That's why they are cheap, they have to be cheap because they suck.
- numpad0 3mo ago
  how can you say that with a username of "ngl999", that doesn't make sense (IIUC, -ngl [NUM_LAYERS] specify number of layers to offload to GPU in llama.cpp, 999 on most use cases might as well be -1)
  - ngl999 3mo ago
    what relation does a username string have to the observations I made?