Capability
Lightweight Inference For Edge And Resource Constrained Deployments
13 artifacts provide this capability.
Want a personalized recommendation?
Find the best match →Top Matches
1
Llama 3.2 3BModel46/100
via “lightweight code generation and reasoning for edge deployment”
Compact 3B model balancing capability with edge deployment.
Unique: Combines code generation capability with 128K context window and ARM optimization, enabling local analysis of entire codebases without chunking — most lightweight code models (1B, 2B) either lack reasoning capability or have 4K context windows
vs others: Faster inference than 7B+ code models (Codellama, StarCoder) on edge devices while supporting longer code context, though code quality likely lower for complex algorithms