AI Agent Hub

Compare LLM Models

Select 2-5 models to compare side by side.

Select models to compare 0 / 5 selected
Top downloads
Select 2-5 models
Attribute
openbmb
Company openbmb
Release Date 2024-09-05
Parameters (B) 4
Architecture Transformer
Context Window 32768
Input Modalities text
Open Source Yes
License apache-2.0
Score 0
VRAM (GB) 8
Compute Single GPU with 8GB+ VRAM for BF16 inference; ~4GB with Q4 quantization
Benchmark: BBH 70.2
Benchmark: C-Eval 73.6
Benchmark: GSM8K 81.1
Benchmark: HumanEval 68.3
Benchmark: IFEval 68.4
Benchmark: LiveCodeBench 22.6
Benchmark: MATH 46.6
Benchmark: MBPP 63.2
Benchmark: MMLU 67.2
Pricing (Input) —
Pricing (Output) —