๐ค Release of the Rio 3.5 Open 397B Multimodal Model
The Rio de Janeiro Administration has released Rio 3.5 Open 397B โ a large multimodal model created by merging Nex-N2-Pro and Qwen3.5-397B-A17B followed by distillation. The model features a context window of up to 1,010,000 tokens and has approximately 397 billion parameters (with ~17 billion active).
๐ The emergence of a powerful open model with a massive context window and an efficient MoE architecture intensifies competition with proprietary solutions. The distillation method used to improve the base Qwen models confirms the effectiveness of knowledge transfer.
๐ค High-performance, GPT-4/5 level models can now be used in projects for free and locally, processing massive amounts of text โ such as entire books or codebases โ in a single pass.
Source 1: https://huggingface.co/prefeitura-rio/Rio-3.5-Open-397B Source 2: https://huggingface.co/nex-agi/Nex-N2-Pro
