AI Agent Hub

Compare LLM Models

Select 2-5 models to compare side by side.

Select models to compare 0 / 5 selected
Top downloads
Select 2-5 models
Attribute
NousResearch
Company NousResearch
Release Date 2024-04-18
Parameters (B) 70
Architecture Transformer
Context Window 8192
Input Modalities text
Open Source Yes
License other
Score 0
VRAM (GB) 140
Compute 2x NVIDIA A100 80GB
Benchmark: AGIEval 63
Benchmark: ARC 93
Benchmark: BBH 81.3
Benchmark: DROP 79.7
Benchmark: GPQA 39.5
Benchmark: GPQA-Diamond 37.9
Benchmark: GSM8K 93
Benchmark: HLE 4.4
Benchmark: HumanEval 81.7
Benchmark: LiveCodeBench 19.8
Benchmark: MATH 50.4
Benchmark: MATH-500 48.3
Benchmark: MMLU 82
Benchmark: MMLU-Pro 56.2
Pricing (Input) —
Pricing (Output) —