3 ms·
Related interesting find on Qwen. "Qwen's base models live in a very exam-heavy basin - distinct from other base models like llama/gemma. Shown below are the e
by alecco 6mo ago
Related interesting find on Qwen.
"Qwen's base models live in a very exam-heavy basin - distinct from other base models like llama/gemma. Shown below are the embeddings from randomly sampled rollouts from ambiguous initial words like "The" and "A":"
https://xcancel.com/N8Programs/status/2044408755790508113 https://xcancel.com/N8Programs/status/2044408755790508113
- nxtfari 6mo agoThis makes a lot of my experience with Qwen make sense. I’ve watched all the benchmarks imply how close it should be to various GPT or Claude releases, but in my own use chatting with it or trying to get it do agentic tasks it was nowhere near as smart as even GPT-3.5 for example. Meanwhile Gemma 4 casually dropped and even the 4B models were performing better than Qwen 3.5 MOE in my chats. Benchmaxxing.