Instruction Following With System Prompt Control

via “instruction-following with custom system prompt format”

Mistral's 123B flagship model rivaling GPT-4o.

Unique: Dedicated system prompt format with special tokens and attention masking prioritizes instructions over user input, reducing prompt injection risk and improving instruction adherence vs standard chat templates used by competitors

vs others: More robust instruction following than GPT-4o's system message format because special tokenization prevents user input from overriding system directives, and simpler than Claude's system prompt which requires careful phrasing to avoid conflicts

via “instruction-following and system prompt customization”

Claude 3.7 Sonnet is an advanced large language model with improved reasoning, coding, and problem-solving capabilities. It introduces a hybrid reasoning approach, allowing users to choose between rapid responses and...

Unique: System prompts are processed through special token handling that prioritizes them in attention mechanisms, ensuring consistent behavior influence across all responses without requiring fine-tuning or model retraining

vs others: More reliable instruction-following than GPT-4 due to training on diverse instruction types, with better resistance to prompt injection than some competitors, though still vulnerable to sophisticated adversarial prompts

via “system prompt customization with role-based behavior control”

Gemini 3 Flash Preview is a high speed, high value thinking model designed for agentic workflows, multi turn chat, and coding assistance. It delivers near Pro level reasoning and tool...

Unique: System prompt is processed as a separate instruction layer that influences token generation without being repeated in context, reducing token overhead compared to including instructions in every user message

vs others: More efficient than prompt-engineering approaches that repeat instructions in every message, and more flexible than fine-tuning for rapid behavior changes across different use cases

via “instruction-following-with-system-prompts”

MiniMax-M2.1 is a lightweight, state-of-the-art large language model optimized for coding, agentic workflows, and modern application development. With only 10 billion activated parameters, it delivers a major jump in real-world...

Unique: Uses sparse expert routing to activate instruction-following experts based on system prompt patterns, enabling efficient behavior customization without fine-tuning while maintaining generation speed

vs others: More flexible than fine-tuned models for rapid behavior changes, but less reliable than fine-tuned models for consistent instruction adherence in production systems

via “instruction-following with system prompt customization”

The 2024-11-20 version of GPT-4o offers a leveled-up creative writing ability with more natural, engaging, and tailored writing to improve relevance & readability. It’s also better at working with uploaded...

Unique: Implements system prompt handling through a dedicated attention mechanism that treats system tokens differently from user tokens during decoding, ensuring system instructions influence token selection throughout generation rather than only at the start.

vs others: More robust system prompt adherence than Claude 3.5 (which sometimes deprioritizes system instructions for user requests) and Llama 3.1 (which lacks specialized system prompt processing).

via “instruction-following with system prompt control”

GPT-4-0314 is the first version of GPT-4 released, with a context length of 8,192 tokens, and was supported until June 14. Training data: up to Sep 2021.

Unique: GPT-4's instruction-following is more robust to adversarial prompts and better respects system-level constraints than GPT-3.5, with improved consistency across multiple calls with identical system prompts

vs others: More flexible than fine-tuning (no retraining required) but less reliable than true fine-tuning for highly specialized tasks; comparable to prompt engineering with other LLMs but GPT-4's stronger reasoning makes complex instructions more effective

via “instruction-conditioned response generation with system prompts”

A 7.3B parameter model that outperforms Llama 2 13B on all benchmarks, with optimizations for speed and context length.

Unique: Instruction-tuned specifically for following explicit directives in system prompts, with training data emphasizing adherence to system-level constraints. The 7.3B parameter size is optimized for instruction-following rather than generic language modeling.

vs others: More reliable instruction-following than base language models, and more efficient than fine-tuned models since system prompts require no additional training or model updates.

via “instruction-following with system prompt conditioning”

MiMo-V2-Flash is an open-source foundation language model developed by Xiaomi. It is a Mixture-of-Experts model with 309B total parameters and 15B active parameters, adopting hybrid attention architecture. MiMo-V2-Flash supports a...

Unique: Integrates system prompt conditioning into the attention mechanism so that system instructions influence token selection throughout generation rather than just at the beginning, enabling more consistent instruction-following than models that treat system prompts as simple context — a design choice that prioritizes behavioral consistency

vs others: More reliable instruction-following than models without explicit system prompt support, though less guaranteed than fine-tuned models and dependent on prompt engineering quality

via “instruction-following-with-system-prompts”

Granite-4.0-H-Micro is a 3B parameter from the Granite 4 family of models. These models are the latest in a series of models released by IBM. They are fine-tuned for long...

Unique: Granite 4.0 Micro's fine-tuning includes explicit instruction-following optimization using IBM's proprietary instruction dataset focused on enterprise and technical tasks, improving adherence to complex multi-step instructions compared to base models without specialized instruction tuning.

vs others: More reliable instruction-following than generic 3B models due to enterprise-focused training; comparable to Llama 2 Instruct for instruction adherence but with lower inference cost and smaller model size.

via “instruction-following with system prompt behavioral steering”

This model offers four times the context length of gpt-3.5-turbo, allowing it to support approximately 20 pages of text in a single request at a higher cost. Training data: up...

Unique: System prompt implementation uses special token sequences that influence model attention and generation at the architectural level, not just as text context; enables more reliable behavioral steering than treating system instructions as regular user messages

vs others: More reliable than instruction-only approaches because system prompts have special token treatment; more flexible than fine-tuning because behavioral changes don't require model retraining; better consistency than prompt-in-context approaches used by some competitors

via “instruction-following with system prompt injection and role definition”

gpt-oss-20b is an open-weight 21B parameter model released by OpenAI under the Apache 2.0 license. It uses a Mixture-of-Experts (MoE) architecture with 3.6B active parameters per forward pass, optimized for...

Unique: Leverages the model's pre-training on instruction-following data to enable dynamic role and behavior definition at inference time, avoiding fine-tuning overhead while maintaining flexibility through system prompt composition

vs others: More flexible than fine-tuned models because behavior can be changed per-request without retraining, while more reliable than few-shot prompting alone because system prompts establish persistent context that influences all token generation

via “instruction-following with system prompt customization”

command-r-08-2024 is an update of the [Command R](/models/cohere/command-r) with improved performance for multilingual retrieval-augmented generation (RAG) and tool use. More broadly, it is better at math, code and reasoning and...

Unique: Command R's instruction-following is trained on diverse instruction types, enabling it to handle complex, multi-part instructions better than models trained on simpler instruction sets. The model explicitly reasons about instructions before responding, improving compliance.

vs others: More reliable instruction-following than Llama 2 due to larger and more diverse instruction-tuning dataset. Comparable to GPT-4 while offering lower latency and cost.

via “system prompt injection for task-specific behavior shaping”

NVIDIA-Nemotron-Nano-9B-v2 is a large language model (LLM) trained from scratch by NVIDIA, and designed as a unified model for both reasoning and non-reasoning tasks. It responds to user queries and...

Unique: Standard LLM system prompt mechanism with no proprietary extensions — system prompts are processed identically across OpenRouter models, enabling prompt portability

vs others: Simpler than fine-tuning or prompt engineering libraries, while less reliable than model fine-tuning for critical behavior constraints