ViqusViqus
Navigate
Company
Blog
About Us
Contact
System Status
Enter Viqus Hub

Google Launches Gemma 4: Open-Weights Model with Massive Context and Strong Coding Ability.

Gemma 4 LLM Hugging Face Apache 2.0 Context window Multimodal Codeforces ELO
April 11, 2026
Source: AIModels.fyi
Viqus Verdict Logo Viqus Verdict Logo 7
Significant Open-Weight Advancement.
Media Hype 7/10
Real Impact 7/10

Article Summary

Google DeepMind has launched Gemma 4, an expanded family of open-weights models, featuring models ranging from E2B to a 31B dense architecture. The 31B variant boasts a massive 256K context window and implements a hybrid attention mechanism for memory efficiency. Licensing has improved significantly with the shift to Apache 2.0, facilitating broader commercial use. Benchmarks show strong performance, particularly the 31B model's Codeforces ELO of 2150, and the smaller E2B model demonstrating competitive capabilities against older generation models. Furthermore, the family supports multimodality—handling text, images, and, for the smaller versions, audio input.

Key Points

  • The 31B model supports a massive 256K token context window via a hybrid attention mechanism, enabling long-context tasks.
  • The move to an Apache 2.0 license for the 31B variant significantly reduces commercial friction compared to previous custom Google licenses.
  • Smaller models (E2B/E4B) maintain high performance and now support audio input, enabling more comprehensive single-model pipelines.

Why It Matters

The release of Gemma 4 is a major competitive offering in the open-source AI space. The combination of an increased context window (256K) and a permissive license makes this highly attractive for enterprise adoption. While the performance claims are strong, the accompanying discussion on VRAM footprint highlights a critical practical challenge: running these large-context, multimodal models requires significant and careful hardware planning, which will be a key factor for developers implementing these models in production.

You might also be interested in