AI Agent Hub
Back to models
gemma-1.1-2b-it logo

gemma-1.1-2b-it

Open Source google Released 2024-04-05
-- 2.0B params 8.2K context Open Source

About this model

Gemma 1.1 2B IT is Google's instruction-tuned update to the original Gemma 2B model, released in April 2024 as part of the Gemma open-weight family built on the same research foundation as Gemini. It is a decoder-only Transformer language model with 2 billion parameters, trained on 6 trillion tokens spanning web text, code, and mathematics, and further aligned using a novel RLHF method that improves quality, coding ability, factuality, instruction following, and multi-turn conversation.

The model supports an 8192-token context window and uses a chat template with role-based turn delimiters for conversational use. Gemma 1.1 also fixes a multi-turn conversation bug from the prior release and reduces repetitive "Sure," response prefixes. Weights are available under the Gemma license on Hugging Face in bfloat16, with optional 4-bit/8-bit quantization for lower-memory deployment.

At 2B parameters, Gemma 1.1 2B IT is designed for resource-constrained environments such as laptops, desktops, and modest cloud instances. It suits question answering, summarization, lightweight coding assistance, and general chat applications where a small footprint matters more than frontier-scale reasoning performance.

Benchmark Scores

GPQA
9.19

Technical Specs

  • Parameters: 2.0B
  • Architecture: Transformer
  • Context Window: 8,192 tokens
  • Input Modalities: text

Hardware Requirements

  • VRAM: 5.1 GB
  • Compute: Runs on a single consumer GPU with ~6GB VRAM (e.g. NVIDIA RTX 3060) in bfloat16; also deployable on CPU with 8GB+ RAM