Local Inference With Variable Model Sizes 0 5b To 32b

via “multi-size model family scaling from 0.5b to 72b parameters for deployment flexibility”

Alibaba's 72B open model trained on 18T tokens.

Unique: Seven-size family (0.5B-72B) with unified architecture enables single codebase deployment across edge to enterprise hardware, with consistent instruction-following and capability scaling. Smaller variants (0.5B-7B) competitive with Llama 2/3 equivalents while maintaining Apache 2.0 licensing and 128K context window across all sizes.

vs others: Broader size range than Llama 2 (7B, 13B, 70B) and Llama 3 (8B, 70B), enabling more granular hardware-performance tradeoffs. Specialized variants (Qwen2.5-Coder, Qwen2.5-Math) available at multiple sizes, vs. single-size specialization of CodeLlama and other alternatives.