AI Agent Hub

Compare LLM Models

Select 2-5 models to compare side by side.

Select models to compare 0 / 5 selected
Top downloads
Select 2-5 models
Attribute
openbmb
Company openbmb
Release Date 2024-02-01
Parameters (B) 2.4
Architecture Transformer
Context Window 4096
Input Modalities text
Open Source Yes
License
Score 0
VRAM (GB) 16
Compute Single NVIDIA GPU with 16GB VRAM for bf16 inference; RTX 3090/4090 (24GB) recommended for full-parameter fine-tuning
Benchmark: ARC 68
Benchmark: BBH 36.9
Benchmark: C-Eval 51.1
Benchmark: GSM8K 53.8
Benchmark: HellaSwag 68.2
Benchmark: HumanEval 50
Benchmark: MATH 10.2
Benchmark: MBPP 47.3
Benchmark: MMLU 53.5
Pricing (Input) —
Pricing (Output) —