Fine Grained Mixture Of Experts Language Generation With 36b Active Parameters

via “code generation and completion across 40+ programming languages”

text-generation model by undefined. 1,06,54,004 downloads.

Unique: DeepSeek-V3.2 uses sparse mixture-of-experts routing where language-specific experts are activated based on input tokens, allowing the model to maintain specialized code generation quality across 40+ languages without diluting capacity on any single language

vs others: Generates syntactically correct code in 40+ languages with 25% fewer parameters than CodeLlama-34B, while maintaining competitive accuracy on HumanEval and MultiPL-E benchmarks due to language-specific expert routing