M1-3B
About this model
This is the model is trained using paper, M1: Towards Scalable Test-Time Compute with Mamba Reasoning Models.
| Model | AIME 2025 | AIME 2024 | MATH 500 | AMC 2023 | OlympiadBench |
|---|---|---|---|---|---|
| Qwen2.5-Math-7B-Instruct (Transformer) | – | 13.3 | 79.8 | 50.6 | 40.7 |
| rStar-Math-7B (Transformer) | – | 26.7 | 78.4 | 47.5 | 47.1 |
| Eurus-2-7B-PRIME (Transformer) | – | 26.7 | 79.2 | 57.8 | 42.1 |
| Qwen2.5-7B-SimpleRL (Transformer) | – | 26.7 | 82.4 | 62.5 | 43.3 |
| DeepSeek-R1-Distill-Qwen-1.5B (Transformer) | 23.0 | 28.8 | 82.8 | 62.9 | 43.3 |
| M1-3B (Mamba Hybrid Models) | 23.5 | 28.5 | 84.0 | 62.8 | 47.3 |
Code: https://github.com/jxiw/M1
@article{wang2025m1scalabletesttimecompute,
title={M1: Towards Scalable Test-Time Compute with Mamba Reasoning Models},
author={Junxiong Wang and Wen-Ding Li and Daniele Paliotta and Daniel Ritter and Alexander M. Rush and Tri Dao},
journal={arXiv preprint arXiv:2504.10449},
year={2025},
url={https://arxiv.org/abs/2504.10449},
}
Benchmark Scores
Technical Specs
- Parameters: 3.0B
- Architecture: transformers
- Input Modalities: text
Hardware Requirements
- API-only (no local hardware needed)
Related Models
More Open Source →
Description: The NVIDIA DeepSeek-V4-Pro-NVFP4 model is the quantized version of the DeepSeek-V4-Pro model, which is a Mixture-of-Experts (MoE) language model with 1.6 trillion total parameters and 49 billion activated parameters. For more information, please check here. The NVIDI…
Description: The NVIDIA GLM-5.2 NVFP4 model is the quantized version of ZAI’s GLM-5.2 model, which is an auto-regressive language model that uses an optimized transformer architecture. GLM-5.2 is a Mixture-of-Experts (MoE) model for reasoning and coding that uses sparse attention…
👋 Join our WeChat or Discord community. 📖 Check out the GLM-5.2 blog and GLM-5 Technical report . 📍 Use GLM-5.2 API services on Z.ai API Platform. 🔜 Try GLM-5.2 here .
👋 Join our WeChat or Discord community. 📖 Check out the GLM-5.2 blog and GLM-5 Technical report . 📍 Use GLM-5.2 API services on Z.ai API Platform. 🔜 Try GLM-5.2 here .