LogoAIRosetta

Alibaba launches open-source Qwen3-Next model series, ushering in a new era of AI efficiency

Combined
00:0000:00

SummaryAlibaba Cloud's Qwen team released the open-source Qwen3-Next LLM series. The flagship 80B MoE model uses dynamic activation and adaptive expert routing to cut training cost by about 10×, speed up inference about 5×, supports 1M-token context, and is available under Apache-2.0 on Hugging Face for enterprise and broad AI scenarios.

Beijing time, September 12, 2025, amid intensifying global AI competition, Alibaba Cloud's Qwen team today officially released the open‑source large language model series Qwen3‑Next. Centered on "extreme efficiency," this family marks a major shift in open‑source AI from "scale first" to "intelligent efficiency." The flagship Qwen3‑Next‑80B‑A3B‑Thinking contains 80 billion parameters but activates only 3 billion parameters per token, achieving roughly a 10× reduction in training cost and a roughly 5× increase in inference speed. The series is open‑sourced on Hugging Face under the Apache‑2.0 license and is already generating strong interest in the developer community, hailed as a "blueprint for open‑source AI." As an iteration of the Qwen3 line, Qwen3‑Next inherits prior multilingual and agent capabilities while introducing major architectural innovations to help Chinese AI firms compete with OpenAI and Google DeepMind globally.

Since its initial release in 2023, the Qwen family has become a benchmark in open‑source LLMs. Qwen1 surprised the industry with a 7B model, Qwen2.5 expanded to multimodal capabilities, and Qwen3, released on April 29 of this year, expanded pretraining data to 360 trillion tokens across 119 languages. However, the growth in parameter scale has made training and deployment costs a bottleneck. Qwen3‑Max‑Preview, the peak of the Qwen3 line, set new records with over 1 trillion parameters and exceeded Claude Opus 4 and DeepSeek V3.1 on complex reasoning and coding benchmarks, but its high energy consumption put it out of reach for many small and medium enterprises. Qwen3‑Next was developed to address this pain point: over eight months, more than 1,000 engineers worked to deliver a "next‑generation ultra‑efficient model architecture." The series includes Qwen3‑Next‑80B‑A3B‑Thinking (optimized for thought‑mode) and Qwen3‑Next‑80B‑A3B‑Instruct (instruction‑tuned), pretrained on a 150‑trillion‑token dataset covering STEM knowledge, codebases, and long‑context documents.

The key innovation of Qwen3‑Next is its "Mixture‑of‑Experts (MoE) + dynamic activation" architecture, a revolutionary design paradigm. Traditional MoE models such as Mixtral 8x7B are efficient but use fixed routing, causing resource waste. Qwen3‑Next introduces "Adaptive Expert Routing," activating only 3.75% of total parameters per token (i.e., 3B) and dynamically selecting expert submodules via reinforcement learning (RL). This mechanism stems from the Qwen team's deep analysis of Transformer bottlenecks: they found that 80% of compute load came from redundant activations. By adding "Thinking Budget Control," the model can automatically switch between "shallow routing" for simple queries and "deep routing" for complex reasoning, reducing inference latency from Qwen3's 2.5s to 0.5s. On the Arena‑Hard v2 benchmark, Qwen3‑Next‑80B‑A3B‑Thinking scored 92.7%, surpassing Qwen3‑30B‑A3B's 88.5% and DeepSeek‑R1's 90.2%, while consuming only one‑tenth of the energy.

Another highlight is Ultra‑Long Context Handling. Qwen3‑Next supports context windows up to 1M tokens, far exceeding GPT‑4o's 128K and matching Gemini 2.5 Pro's 1M (the latter requiring high‑end hardware). The innovation lies in a Hierarchical Attention mechanism that decomposes long sequences into macro‑blocks and micro‑blocks, applying full attention only to relevant blocks. This reduces O(n²) complexity toward near‑linear and improves long‑document summarization accuracy by about 15%. For example, in the LiveBench 20241125 test, the model achieved a 95% recall when processing a 100‑page PDF report, compared with 82% from Qwen3. Alibaba emphasizes this design targets enterprise applications such as legal document analysis and medical report generation, significantly lowering preprocessing costs.

In agent capabilities and multimodal fusion, Qwen3‑Next continues to stand out. Inheriting Qwen3's "Hybrid Thinking Modes," it supports a "thinking mode" (step‑by‑step reasoning for complex problems) and a "non‑thinking mode" (fast responses for simple tasks), with user‑definable compute budgets. Qwen3‑Next also integrates Model‑Centric Programming (MCP), allowing the model to autonomously call external tools such as APIs or databases for end‑to‑end task automation. On the GPQA benchmark, its agent score reached 89%, comparable to o1 models. Multilingual support expands to 129 languages, including low‑resource languages such as Mongolian and Swahili, with synthetic data augmentation (using Qwen3‑VL generation) boosting translation accuracy by 20%. Additionally, the coding‑focused Qwen3‑Next‑Coder variant (coming soon) excelled on LiveCodeBench v6 with a 98.3% score, supporting autonomous code generation and debugging for DevOps scenarios.

Performance benchmarks further underscore its innovations. In the AIME25 math contest simulation, Qwen3‑Next achieved an 85% solve rate, outperforming Qwen3‑235B‑A22B's 82% and Grok‑3's 80%. Equally notable is efficiency: deployed on standard NVIDIA A100 GPUs, throughput reached 1,500 tokens/s versus ~300 tokens/s for comparable models. Alibaba attributes this to a "four‑stage post‑training pipeline": long‑chain thinking cold start, rule‑based RL reinforcement, thinking‑mode fusion, and universal RL across 20+ tasks. Compared with OpenAI's closed‑source o3‑mini, Qwen3‑Next's open‑source nature allows developers to fine‑tune freely and accelerates ecosystem building.

The release of Qwen3‑Next has broad implications for the global AI landscape. First, it reinforces China's leadership in open‑source AI. Hugging Face data shows Qwen series downloads have exceeded 1 billion, and Qwen3‑Next reportedly reached 500,000 downloads on its first day. This is likely to attract more international developers and challenge Western AI dominance. Second, in an era focused on energy efficiency, Qwen3‑Next's low‑cost design benefits SMEs and emerging markets, promoting more inclusive AI. For example, Southeast Asian startups could use its long‑context capability to build localized chatbots without exorbitant cloud costs. Strategically, Alibaba offers API access via its Model Studio platform with an input‑token price reportedly at $0.861 per million, well below Claude's $2, which may strengthen Alibaba Cloud's position in the Asia‑Pacific market and introduce new dynamics into US⁠–⁠China AI competition⁠—⁠where open‑source cooperation could serve as a bridge.

Challenges remain. While Qwen3‑Next is efficient, safety alignment requires further work to mitigate hallucination risks. The EU AI Act demands transparency, and Alibaba has pledged to publish detailed technical reports. Facing Google's Gemini 3.0, the Qwen team plans a multimodal Next edition next year.

Qwen3‑Next is not only a technical leap but a manifesto for democratizing AI. Its MoE dynamic activation, ultra‑long context handling, and agent integration are poised to reshape the open‑source ecosystem and shift the paradigm from "compute‑intensive" to "intelligence‑intensive." Alibaba CTO Zhou Jingren stated, "Qwen3‑Next proves that efficient AI need not sacrifice performance; it will empower millions of developers to co‑create an intelligent future." As the model repository updates on GitHub, the global AI community is set for a new wave of innovation.

CopyrightStatement

Comment

Please login before commenting

NoComments

RelatedNews

LoadingMore

Alibaba launches open-source Qwen3-Next model series, ushering in a new era of AI efficiency - Airosetta News