Logical Deduction And Inference Evaluation

via “logical deduction task evaluation”

Zero-shot LLM evaluation for reasoning tasks.

Unique: Provides unified evaluation framework for both symbolic logic and natural language reasoning puzzles in zero-shot setting, with answer verification that can handle both formal symbolic validation and semantic similarity-based matching for natural language conclusions

vs others: More specialized than general reasoning benchmarks; focuses specifically on logical deduction without few-shot examples, enabling cleaner measurement of foundational logical capability vs. pattern-matching from examples

23 hardest BIG-Bench tasks where models initially failed.

Unique: Isolates formal logical reasoning as a distinct capability by presenting logic problems in natural language with few-shot examples, testing whether models can apply logical rules consistently without explicit training. This approach measures logical inference generalization.

vs others: More focused on formal logical reasoning than general reasoning benchmarks; more accessible than formal logic verification because it uses natural language rather than symbolic logic notation.

via “logical-reasoning-and-formal-inference”

INTELLECT-3 is a 106B-parameter Mixture-of-Experts model (12B active) post-trained from GLM-4.5-Air-Base using supervised fine-tuning (SFT) followed by large-scale reinforcement learning (RL). It offers state-of-the-art performance for its size across math,...

Unique: RL post-training optimizes for logical consistency and formal correctness in reasoning traces; uses chain-of-thought patterns that decompose inference into verifiable steps rather than end-to-end black-box reasoning

vs others: Produces more transparent and verifiable reasoning than single-step models while maintaining efficiency through MoE routing that activates only reasoning-specific experts

via “logical-reasoning-and-deduction”

Mercury 2 is an extremely fast reasoning LLM, and the first reasoning diffusion LLM (dLLM). Instead of generating tokens sequentially, Mercury 2 produces and refines multiple tokens in parallel, achieving...

Unique: Applies diffusion-based parallel reasoning to logical deduction and constraint satisfaction, enabling fast multi-step logical reasoning without sequential token overhead

vs others: Faster logical reasoning than sequential reasoning models because parallel token refinement computes multiple logical steps simultaneously while maintaining logical coherence

via “reasoning and logical inference”

via “logical reasoning and deduction”