, , , , In the Qwen3 Technical Report, a team led by An Yang and including researchers such as Anfeng Li, Baosong Yang, Beichen Zhang, and many others introduces the latest iteration of the Qwen model family. Qwen3 is a significant advancement in large language models (LLMs), with a focus on enhancing performance, efficiency, and multilingual capabilities. The series includes models with both dense and Mixture-of-Expert (MoE) architectures, featuring parameter scales ranging from 0.6 to an impressive 235 billion. One notable innovation in Qwen3 is the integration of thinking mode for complex, multi-step reasoning tasks and non-thinking mode for rapid context-driven responses within a unified framework. This eliminates the need to switch between different models optimized for specific tasks like chat interactions or dedicated reasoning processes. Instead, dynamic mode switching based on user queries or chat templates is enabled. Additionally, Qwen3 introduces a thinking budget mechanism that allows users to allocate computational resources adaptively during inference to balance latency and performance based on task complexity. By leveraging knowledge from flagship models, the team behind Qwen3 has significantly reduced the computational resources required to build smaller-scale models while maintaining highly competitive performance levels. Empirical evaluations demonstrate that Qwen3 achieves state-of-the-art results across diverse benchmarks including code generation, mathematical reasoning, agent tasks, among others. It competes favorably against larger MoE models and proprietary models in various domains. Compared to its predecessor Qwen2.5, one of the key enhancements in Qwen3 is the expansion of multilingual support from 29 languages and dialects to an impressive 119 languages. This expansion enhances global accessibility through improved cross-lingual understanding and generation capabilities. To promote reproducibility and foster community-driven research and development efforts, all models within the Qwen3 series are made publicly accessible under Apache 2.0 licensing terms. The collaborative effort showcased in this technical report underscores a commitment to advancing language modeling capabilities while ensuring broad accessibility for researchers worldwide.

• - Qwen3 is a significant advancement in large language models (LLMs) with a focus on performance, efficiency, and multilingual capabilities.
• - Qwen3 includes models with dense and Mixture-of-Expert (MoE) architectures, with parameter scales ranging from 0.6 to an impressive 235 billion.
• - Qwen3 integrates thinking mode for complex reasoning tasks and non-thinking mode for rapid context-driven responses within a unified framework, enabling dynamic mode switching based on user queries or chat templates.
• - Qwen3 introduces a thinking budget mechanism that allows adaptive allocation of computational resources during inference to balance latency and performance based on task complexity.
• - Qwen3 achieves state-of-the-art results across diverse benchmarks including code generation, mathematical reasoning, agent tasks, competes favorably against larger MoE models and proprietary models in various domains.
• - One key enhancement in Qwen3 is the expansion of multilingual support from 29 languages to 119 languages, enhancing global accessibility through improved cross-lingual understanding and generation capabilities.
• - All models within the Qwen3 series are publicly accessible under Apache 2.0 licensing terms to promote reproducibility and foster community-driven research efforts.

SummaryQwen3 is a new and improved type of computer program that can understand and use many different languages. It can think deeply for hard problems and quickly for simple questions. Qwen3 can switch between these modes based on what it needs to do. It also manages its resources smartly to work efficiently. Qwen3 does very well in tests compared to other similar programs. Definitions- Advancement: A step forward or improvement in something. - Language models: Programs that help computers understand and generate human language. - Efficiency: Doing things well without wasting time or resources. - Multilingual: Able to work with multiple languages. - Framework: A structure or system that helps organize and guide something. - Latency: The time delay between a request and a response in computing. - State-of-the-art: The most advanced or current level of development in a particular field. - Accessibility: How easy it is for people to use or access something. - Reproducibility: The ability to repeat an experiment or process and get the same results.

Introduction

In recent years, large language models (LLMs) have gained significant attention in the field of natural language processing (NLP). These models are trained on massive amounts of text data and can generate human-like text responses to various prompts. One such model family is Qwen, which has been continuously evolving and improving since its initial release. In the Qwen3 Technical Report, a team led by An Yang introduces the latest iteration of this model series, showcasing significant advancements in performance, efficiency, and multilingual capabilities.

The Qwen Model Family

The Qwen model family includes both dense and Mixture-of-Expert (MoE) architectures with parameter scales ranging from 0.6 billion to an impressive 235 billion. The previous version, Qwen2.5, had already achieved state-of-the-art results across various NLP benchmarks. However, the team behind Qwen3 has further enhanced its capabilities through innovative features such as thinking mode and thinking budget mechanism.

Thinking Mode

One of the key innovations in Qwen3 is the integration of thinking mode for complex reasoning tasks and non-thinking mode for rapid context-driven responses within a unified framework. This eliminates the need to switch between different models optimized for specific tasks like chat interactions or dedicated reasoning processes. With thinking mode enabled, users can input multi-step queries that require more comprehensive understanding and reasoning abilities from the model. On the other hand, non-thinking mode is suitable for simpler tasks where quick responses based on contextual information are sufficient.

Thinking Budget Mechanism

Another notable feature introduced in Qwen3 is the thinking budget mechanism that allows users to allocate computational resources adaptively during inference based on task complexity. This means that for simpler queries or tasks requiring faster response times, fewer resources will be allocated to reduce latency without compromising performance significantly. This dynamic resource allocation is a crucial step towards making large language models more practical for real-world applications. It also highlights the team's commitment to improving efficiency and reducing computational costs.

Multilingual Support

Qwen3 has significantly expanded its multilingual capabilities, with support for 119 languages compared to Qwen2.5's 29 languages and dialects. This expansion not only enhances global accessibility but also improves cross-lingual understanding and generation capabilities. With the increasing demand for NLP solutions in various languages, this enhancement makes Qwen3 a highly valuable tool for researchers worldwide. It also showcases the team's efforts towards promoting diversity and inclusivity in language modeling research.

Evaluation Results

Empirical evaluations of Qwen3 demonstrate its state-of-the-art performance across diverse benchmarks such as code generation, mathematical reasoning, agent tasks, among others. The model competes favorably against larger MoE models and proprietary models in various domains, showcasing its versatility and effectiveness. Compared to its predecessor Qwen2.5, Qwen3 has shown significant improvements in performance while maintaining similar or even reduced computational requirements. This achievement is a testament to the team's dedication to advancing language modeling capabilities while ensuring broad accessibility for researchers worldwide.

Open-source Availability

To promote reproducibility and foster community-driven research and development efforts, all models within the Qwen3 series are made publicly accessible under Apache 2.0 licensing terms. This open-source approach allows other researchers to build upon the work done by the team behind Qwen3 and further advance language modeling capabilities. This collaborative effort underscores a commitment to driving progress in NLP through shared knowledge and resources rather than individual achievements.

Conclusion

In conclusion, the Qwen3 Technical Report introduces an impressive iteration of the Qwen model family with significant advancements in performance, efficiency, and multilingual capabilities. The integration of thinking mode, thinking budget mechanism, and expanded multilingual support make Qwen3 a highly versatile and practical tool for various NLP tasks. The team's efforts towards promoting diversity, inclusivity, and open-source availability in language modeling research are commendable. With Qwen3's release, the field of NLP takes another step forward towards more advanced and accessible language models.