AI Agent Hub

Compare LLM Models

Select 2-5 models to compare side by side.

Select models to compare 0 / 5 selected
Top downloads
Select 2-5 models
Attribute
meta-llama
Company meta-llama
Release Date 2024-07-23
Parameters (B) 405
Architecture Transformer
Context Window 128000
Input Modalities text
Open Source Yes
License llama3.1
Score 8
VRAM (GB) 405
Compute 8x NVIDIA H100 80GB GPUs with tensor parallelism (FP8 weights; ~405 GB model memory)
Benchmark: AGIEval 71.6
Benchmark: ARC 96.9
Benchmark: BBH 89.2
Benchmark: DROP 84.8
Benchmark: GPQA 50.7
Benchmark: GSM8K 96.8
Benchmark: HellaSwag 88.5
Benchmark: HumanEval 89
Benchmark: IFEval 88.6
Benchmark: LiveCodeBench 30.2
Benchmark: MATH 73.8
Benchmark: MBPP 88.6
Benchmark: MMLU 87.3
Benchmark: MMLU-Pro 73.3
Benchmark: SimpleQA 17.1
Benchmark: TruthfulQA 65.3
Pricing (Input) —
Pricing (Output) —