AI Agent Hub

Compare LLM Models

Select 2-5 models to compare side by side.

Select models to compare 0 / 5 selected
Top downloads
Select 2-5 models
Attribute
allenai
Company allenai
Release Date 2025-03-13
Parameters (B) 32
Architecture Transformer
Context Window 128000
Input Modalities text
Open Source Yes
License apache-2.0
Score 0
VRAM (GB) 64
Compute Single NVIDIA A100 or H100 80GB GPU (BF16 inference)
Benchmark: Arena-Elo 1251
Benchmark: BBH 70.6
Benchmark: DROP 78
Benchmark: GPQA-Diamond 32.8
Benchmark: GSM8K 87.6
Benchmark: HLE 3.7
Benchmark: IFEval 85.6
Benchmark: MATH 49.7
Benchmark: MMLU 77.3
Benchmark: MMLU-Pro 51.1
Benchmark: TruthfulQA 73.2
Pricing (Input) —
Pricing (Output) —