FranckDernoncou

3 ms·

1.
Orthrus-Qwen3: up to 7.8×tokens/forward on Qwen3, identical output distribution(github.com)
246 points by FranckDernoncou 5mo ago|45 comments
2.
by FranckDernoncou 5mo ago
Paper: https://arxiv.org/abs/2605.12825 ; Code+models: https://github.com/chiennv2000/orthrus ; Disclosure: co-author. Idea: Inject a trainable diffusion attention module into each layer of a froz
3.
by FranckDernoncou 9mo ago
But harder questions will typically get no replies and/or get closed for being too niche and/or get downvoted because someone got upset they didn't understand the question. That's my experience.
4.
by FranckDernoncou 9mo ago
> LLMs are terrible, but stackoverflow is definitely worse. Exactly. Some stackoverflow users keep complaining about AI slop but they fail to realize that human slop is much more rampant.
5.
by FranckDernoncou 9mo ago
> In fact, SO has a great opportunity to specialize in answering questions that LLMs cannot answer (bleeding edge technology, complex debugging problems, emerging issues, you name it.) But they are missing that opportunity because such q
6.
by FranckDernoncou 9mo ago
The entire Stack Exchange network is collapsing: [The number of questions has decreased 10-fold: where did users go and what can be done to prevent that?]( https://meta.stackexchange.com/q/408728/178179 ) As for Sta
7.
by FranckDernoncou 1y ago
The research study is behind a paywall: https://doi.org/10.1038/s41591-025-03773-w I'm always amazed that some people still choose to publish in paywalled journals.
8.
by FranckDernoncou 2y ago
I posted a similar plot showing the steep decline of SO questions on https://meta.stackoverflow.com/a/432618/395857 two weeks ago and surprise surprise, it got removed by a mod... Can still see on https:/&#x