multi-domain instruction-following with function-calling support
Processes natural language instructions across code, math, reasoning, and agent tasks using a transformer-based decoder architecture fine-tuned on 7+ specialized datasets (Dolphin, OpenHermes, CodeFeedback, Agent-FLAN). Implements ChatML format for structured multi-turn conversations with explicit function-calling schema support via the Locutusque/function-calling-chatml dataset, enabling the model to generate tool invocations alongside natural language responses.
Unique: Combines 7 diverse training datasets (Dolphin reasoning, OpenHermes instruction-following, CodeFeedback code quality, Agent-FLAN agent reasoning, Orca math, Samantha conversational, function-calling-chatml) into a single 34B model with explicit function-calling support via ChatML format, rather than relying on post-hoc prompt engineering or separate specialized models
vs alternatives: Outperforms base Yi-1.5-34B by 15-25% on instruction-following benchmarks while maintaining function-calling capabilities that require separate fine-tuning in most open-source alternatives; smaller than Mixtral-8x34B but with better instruction adherence due to targeted dataset curation
code generation and understanding across multiple programming languages
Generates syntactically correct and semantically sound code across Python, JavaScript, SQL, and other languages through training on CodeFeedback-Filtered-Instruction and dolphin-coder datasets. Uses the Yi-1.5 base architecture's token embeddings to understand code structure, variable scoping, and language-specific idioms, enabling both code completion and code-from-description generation without language-specific tokenizers.
Unique: Trained on CodeFeedback-Filtered-Instruction (human-curated code quality feedback) and dolphin-coder datasets, enabling the model to generate not just syntactically valid code but code that follows best practices and idioms, rather than generic token-matching approaches used in simpler code completion models
vs alternatives: Generates more idiomatic and maintainable code than base language models due to CodeFeedback training, while remaining fully open-source and deployable locally unlike Copilot; smaller than Codex-scale models but with better instruction-following for code generation tasks
mathematical reasoning and word problem solving
Solves mathematical word problems and performs step-by-step reasoning through training on Microsoft's Orca-Math-Word-Problems-200K dataset. The model learns to decompose complex math problems into intermediate reasoning steps, leveraging the Yi-1.5 base's strong numerical understanding and the Dolphin training's chain-of-thought patterns to produce verifiable mathematical solutions.
Unique: Integrates Microsoft's Orca-Math-Word-Problems-200K dataset (200K curated math problems with reasoning traces) with Dolphin's chain-of-thought training, enabling the model to produce explicit intermediate reasoning steps rather than just final answers, making solutions auditable and educational
vs alternatives: Provides transparent step-by-step reasoning for math problems unlike black-box proprietary models; smaller and faster to deploy than specialized math models like Minerva while maintaining competitive accuracy on word problems within training distribution
agent-based task decomposition and planning
Decomposes complex user requests into executable sub-tasks and generates action plans through training on internlm/Agent-FLAN dataset. The model learns to identify task dependencies, prioritize steps, and generate structured action sequences that can be executed by downstream systems, enabling autonomous agent behavior without explicit prompt engineering for each task type.
Unique: Trained on internlm/Agent-FLAN dataset (agent-specific instruction following with task decomposition patterns), enabling the model to natively understand and generate agent-compatible task plans without requiring separate planning modules or prompt engineering for each agent framework
vs alternatives: Produces more structured and executable task plans than general-purpose instruction-following models due to Agent-FLAN specialization; fully open-source and deployable locally unlike proprietary agent planning APIs, with explicit task dependency awareness
conversational dialogue with multi-turn context management
Maintains coherent multi-turn conversations through ChatML format support and training on Samantha-data and OpenHermes-2.5 conversational datasets. The model tracks conversation history, maintains persona consistency, and generates contextually appropriate responses by leveraging the ChatML message structure (system/user/assistant roles) to explicitly separate conversation turns and context boundaries.
Unique: Combines Samantha-data (conversational personality and empathy training) with OpenHermes-2.5 (instruction-following dialogue) and explicit ChatML format support, enabling the model to maintain both conversational naturalness and instruction adherence across multi-turn interactions without separate dialogue state management
vs alternatives: Produces more natural and contextually coherent conversations than base instruction-following models due to Samantha training; fully open-source and deployable locally with explicit ChatML support, unlike proprietary conversational APIs that require cloud inference
instruction-following with reasoning transparency
Follows complex natural language instructions with explicit reasoning traces through training on Dolphin-2.9 dataset (curated instruction-following with reasoning explanations). The model generates not just task outputs but also intermediate reasoning steps, enabling users to understand and audit the model's decision-making process. Uses the Dolphin training methodology of pairing instructions with detailed reasoning chains to improve both accuracy and interpretability.
Unique: Trained on Dolphin-2.9 dataset (instruction-following with explicit reasoning traces), enabling the model to generate transparent intermediate reasoning steps alongside task outputs, rather than treating reasoning as an optional post-hoc explanation or relying on prompt engineering for chain-of-thought behavior
vs alternatives: Produces more transparent and auditable reasoning than base instruction-following models; reasoning quality is built into the model weights rather than dependent on prompt engineering, making it more reliable across diverse task types