Google: Gemma 3 12BModel24/100 via “vision-language understanding with 128k context window”
Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities,...
Unique: Unified 128k-token context window spanning both vision and language modalities in a single model, avoiding the latency and complexity of separate vision encoders and language models — implemented as a single transformer with shared attention mechanisms across image patches and text tokens
vs others: Maintains longer coherent context than GPT-4V (which uses separate vision encoder with ~8k effective context) and avoids the two-stage processing overhead of models like LLaVA that require separate vision-to-text encoding