Heterogeneous Hardware Abstraction

via “hetero plugin with explicit device assignment and fallback chains”

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Unique: Provides explicit operation-to-device assignment with automatic fallback chains, enabling fine-grained control over heterogeneous execution. Unlike AUTO plugin (which uses heuristics), HETERO requires explicit configuration but provides more predictable behavior.

vs others: Offers more explicit control than AUTO plugin and more flexible fallback mechanisms than manual device selection in other frameworks.