AI Agent Hub

Compare LLM Models

Select 2-5 models to compare side by side.

Select models to compare 0 / 5 selected
Top downloads
Select 2-5 models
Attribute
allenai
Company allenai
Release Date 2025-04
Parameters (B) 1
Architecture Transformer
Context Window 4096
Input Modalities text
Open Source Yes
License apache-2.0
Score 0
VRAM (GB) 4
Compute Runs on a single consumer GPU with ~4 GB VRAM for bf16/fp16 inference; CPU inference supported but slower. Compatible with Hugging Face Transformers (v4.48+) and vLLM.
Benchmark: BBH 33
Benchmark: DROP 34.5
Benchmark: GSM8K 59
Benchmark: IFEval 67.1
Benchmark: MATH 14.1
Benchmark: MMLU 39.9
Benchmark: TruthfulQA 46.4
Pricing (Input) —
Pricing (Output) —