Meta-Llama-3-8B-Instruct
About this model
Meta-Llama-3-8B-Instruct 是 Meta 于 2024 年 4 月发布的 Llama 3 系列 80 亿参数指令微调大语言模型，面向对话与助手类应用场景。模型采用优化的自回归 Transformer 架构，并引入分组查询注意力（GQA）以提升推理效率；在超过 15 万亿 token 的公开数据上预训练，知识截止时间为 2023 年 3 月，随后通过监督微调（SFT）与基于人类反馈的强化学习（RLHF）对齐人类偏好。
在标准评测中，该模型在多项主流基准上显著优于 Llama 2 同级别模型：MMLU（5-shot）68.4、GSM8K（8-shot, CoT）79.6、HumanEval（0-shot）62.2、MATH（4-shot, CoT）30.0、GPQA（0-shot）34.2，MMLU-Pro 40.98。它支持 8K 上下文窗口，仅接受文本输入并生成文本与代码输出，适用于聊天机器人、虚拟助手及各类对话式 AI 应用。
模型以 Meta Llama 3 Community License 开源发布，可商用（需遵守许可条款与可接受使用政策）。Meta 同时提供了 Llama Guard 2 等安全工具，并针对拒答率与有害内容进行了红队测试与缓解。后续版本 Llama 3.1 8B Instruct 已扩展至 128K 上下文并进一步增强工具调用能力。
Benchmark Scores
Technical Specs
- Parameters: 8.0B
- Architecture: Transformer
- Context Window: 8,192 tokens
- Input Modalities: text
Hardware Requirements
- VRAM: 16.0 GB
- Compute: ~16GB VRAM GPU (e.g. RTX 4090, A10, A100); BF16 inference recommended
Related Models
More Open Source →
Description: The NVIDIA DeepSeek-V4-Pro-NVFP4 model is the quantized version of the DeepSeek-V4-Pro model, which is a Mixture-of-Experts (MoE) language model with 1.6 trillion total parameters and 49 billion activated parameters. For more information, please check here. The NVIDI…
Description: The NVIDIA GLM-5.2 NVFP4 model is the quantized version of ZAI’s GLM-5.2 model, which is an auto-regressive language model that uses an optimized transformer architecture. GLM-5.2 is a Mixture-of-Experts (MoE) model for reasoning and coding that uses sparse attention…
👋 Join our WeChat or Discord community. 📖 Check out the GLM-5.2 blog and GLM-5 Technical report . 📍 Use GLM-5.2 API services on Z.ai API Platform. 🔜 Try GLM-5.2 here .
👋 Join our WeChat or Discord community. 📖 Check out the GLM-5.2 blog and GLM-5 Technical report . 📍 Use GLM-5.2 API services on Z.ai API Platform. 🔜 Try GLM-5.2 here .