4 ms·

https://github.com/nex-agi/Nex-N2/issues/4 https://github.com/nex-agi/Nex-N2/issues/4 Seems that they didn't make/train a new novel model, they did a mix of tw

https://github.com/nex-agi/Nex-N2/issues/4 https://github.com/nex-agi/Nex-N2/issues/4 Seems that they didn't make/train a new novel model, they did a mix of two existing models and then gave it an instruction to say it was 'Rio, trained by Rio AI Labs'

w4yai 4mo ago
> The model is built via a merge of https://huggingface.co/nex-agi/Nex-N2-Pro https://huggingface.co/nex-agi/Nex-N2-Pro and https://huggingface.co/Qwen/Qwen3.5-397B-A17B https://huggingface.co/Qwen/Qwen3.5-397B-A17B, proceeded by On-Policy Distillation from a stronger model. We detected an incorrect upload in the previous version, where the base merged version was upload instead of the final distilled model. We are sorry for the confusion and apologize profusely. https://huggingface.co/prefeitura-rio/Rio-3.5-Open-397B/commit/a778c1ec4e21180ee55c3ea016a348e549e75f09 https://huggingface.co/prefeitura-rio/Rio-3.5-Open-397B/comm...
- daquisu 4mo ago
  It was a recent edit though. Yesterday snapshot: https://web.archive.org/web/20260613072958/https://huggingface.co/prefeitura-rio/Rio-3.5-Open-397B https://web.archive.org/web/20260613072958/https://huggingfa...
  - giancarlostoro 4mo ago
    How does that contradict that they uploaded the wrong model?
- danieldrehmer 4mo ago
  can you offer a 4-bit quantized version and name it Zé Pequeno, pretty please?
- scotty79 4mo ago
  I'd love to see people figuring out how to build models from several smaller ones. We could then train small specialized models and deploy setups more optimized for any given task. Modular LLMs should be a thing.
  - giancarlostoro 4mo ago
    This is something I've been trying to figure out for a bit, some models are really good at instructions, but their context window is too small, I do wonder if having a cluster of smaller models would be feasible. Been building a custom coding harness so once its nice and polished I might experiment with this more.
urbnspacecowboy 4mo ago
See discussion: https://news.ycombinator.com/item?id=48528371 https://news.ycombinator.com/item?id=48528371
pixel_popping 4mo ago
To be fair, I still find it to be a great initiative.

w4yai 4mo ago

> The model is built via a merge of https://huggingface.co/nex-agi/Nex-N2-Pro https://huggingface.co/nex-agi/Nex-N2-Pro and https://huggingface.co/Qwen/Qwen3.5-397B-A17B https://huggingface.co/Qwen/Qwen3.5-397B-A17B, proceeded by On-Policy Distillation from a stronger model. We detected an incorrect upload in the previous version, where the base merged version was upload instead of the final distilled model. We are sorry for the confusion and apologize profusely. https://huggingface.co/prefeitura-rio/Rio-3.5-Open-397B/commit/a778c1ec4e21180ee55c3ea016a348e549e75f09 https://huggingface.co/prefeitura-rio/Rio-3.5-Open-397B/comm...

daquisu 4mo ago
It was a recent edit though. Yesterday snapshot: https://web.archive.org/web/20260613072958/https://huggingface.co/prefeitura-rio/Rio-3.5-Open-397B https://web.archive.org/web/20260613072958/https://huggingfa...
- giancarlostoro 4mo ago
  How does that contradict that they uploaded the wrong model?
danieldrehmer 4mo ago
can you offer a 4-bit quantized version and name it Zé Pequeno, pretty please?
scotty79 4mo ago
I'd love to see people figuring out how to build models from several smaller ones. We could then train small specialized models and deploy setups more optimized for any given task. Modular LLMs should be a thing.
- giancarlostoro 4mo ago
  This is something I've been trying to figure out for a bit, some models are really good at instructions, but their context window is too small, I do wonder if having a cluster of smaller models would be feasible. Been building a custom coding harness so once its nice and polished I might experiment with this more.

urbnspacecowboy 4mo ago

See discussion: https://news.ycombinator.com/item?id=48528371 https://news.ycombinator.com/item?id=48528371

pixel_popping 4mo ago

To be fair, I still find it to be a great initiative.