AI Agent Hub

Compare LLM Models

Select 2-5 models to compare side by side.

Select models to compare 0 / 5 selected
Top downloads
Select 2-5 models
Attribute
allenai
Company allenai
Release Date 2025-11-18
Parameters (B) 7
Architecture transformers
Context Window —
Input Modalities text
Open Source Yes
License apache-2.0
Score 6
VRAM (GB) —
Compute
Benchmark: AGIEval 77.2
Benchmark: AIME-2024 91.6
Benchmark: AIME-2025 57.6
Benchmark: Aider 81.3
Benchmark: BBH 84.1
Benchmark: GPQA 45.8
Benchmark: HumanEval 88.2
Benchmark: IFEval 77.9
Benchmark: MATH 94.4
Benchmark: MATH-500 98.1
Benchmark: MBPP 63.2
Benchmark: MMLU 74.9
Benchmark: MMLU-Pro 85.6
Benchmark: MMMU 82.9
Benchmark: SimpleQA 49.4
Pricing (Input) —
Pricing (Output) —