Capability
Distributed Multi Gpu Inference With Model Parallelism
20 artifacts provide this capability.
Want a personalized recommendation?
Find the best match →Top Matches
1
StarCoder2Model46/100
via “distributed inference with accelerate library”
Open code model trained on 600+ languages.
Unique: Leverages accelerate's device-agnostic API to enable single-code-path distributed inference across GPUs and nodes, with automatic mixed precision and gradient accumulation. Reduces boilerplate compared to manual DistributedDataParallel setup.
vs others: Simpler than manual DistributedDataParallel setup; comparable to Ray Serve but with tighter Hugging Face integration.