Model Sampling And Inference Server Selection

via “sampling api for client-side llm inference with streaming responses”

Specification and documentation for the Model Context Protocol

Unique: Inverts the typical LLM client-server relationship by allowing servers to request inference from clients, enabling servers to be stateless and leverage client-side LLM access. Supports streaming responses with explicit content block types (text, tool_use, image) and stop reasons, enabling servers to implement complex multi-step reasoning patterns.

vs others: Unique among protocol specifications in enabling server-initiated LLM inference, allowing servers to be lightweight and stateless while delegating reasoning to clients