Compare LLM Models
Select 2-5 models to compare side by side.
Select models to compare
0 / 5 selected
Top downloads
Select 2-5 models
| Attribute |
allenai
|
|---|---|
| Company | allenai |
| Release Date | 2024-11-21 |
| Parameters (B) | 8 |
| Architecture | Transformer |
| Context Window | 128000 |
| Input Modalities | text |
| Open Source | Yes |
| License | llama3.1 |
| Score | 0 |
| VRAM (GB) | 16 |
| Compute | Single GPU with 16GB+ VRAM (e.g. RTX 4090, A10) for BF16 inference; 8 GPUs with DeepSpeed for DPO training |
| Benchmark: BBH | 65.8 |
| Benchmark: DROP | 62.5 |
| Benchmark: GSM8K | 84.3 |
| Benchmark: HumanEval | 83.9 |
| Benchmark: IFEval | 81.1 |
| Benchmark: MATH | 42 |
| Benchmark: MMLU | 68.7 |
| Benchmark: TruthfulQA | 56.1 |
| Pricing (Input) | — |
| Pricing (Output) | — |