Model Architecture Registry With Automatic Name Resolution

via “model registry with automatic architecture detection”

High-throughput LLM serving engine — PagedAttention, continuous batching, OpenAI-compatible API.

Unique: Implements automatic architecture detection from config.json with dynamic plugin registration, enabling model-specific optimizations without user configuration

vs others: Reduces configuration complexity vs manual architecture specification, enabling new models to benefit from optimizations automatically