AI Agent Hub

Compare LLM Models

Select 2-5 models to compare side by side.

Select models to compare 0 / 5 selected
Top downloads
Select 2-5 models
Attribute
meta-llama
Company meta-llama
Release Date 2024-07-23
Parameters (B) 405
Architecture Transformer
Context Window 128000
Input Modalities text
Open Source Yes
License llama3.1
Score 8
VRAM (GB) 810
Compute Multi-node setup with 8+ NVIDIA H100 80GB GPUs (~810GB VRAM for FP16 weights; INT4 quantization reduces to ~203GB)
Benchmark: BBH 89.2
Benchmark: GSM8K 96.8
Benchmark: HumanEval 89
Benchmark: MATH 73.9
Benchmark: MBPP 88.6
Benchmark: MMLU 88.6
Benchmark: MMLU-Pro 61.6
Benchmark: TruthfulQA 0
Pricing (Input) —
Pricing (Output) —