yolos-fashionpedia

Detects and localizes fashion items in images using YOLOS (You Only Look at Sequences), a vision transformer-based object detection architecture that treats image patches as sequences rather than using convolutional feature pyramids. The model is fine-tuned on the Fashionpedia dataset containing 46k+ annotated fashion product images across 27 clothing categories, enabling detection of apparel, accessories, and footwear with bounding box coordinates and class labels.

Classifies detected fashion items into one of 27 predefined categories (e.g., shirt, pants, dress, jacket, shoes, accessories) with per-detection confidence scores indicating model certainty. The classification head is integrated into the YOLOS detection pipeline, outputting both bounding box predictions and category logits for each detected object in a single forward pass.

Processes multiple images in batches through the YOLOS model with configurable inference parameters including confidence thresholds, NMS (non-maximum suppression) IoU thresholds, and maximum detections per image. Leverages PyTorch's batch processing and GPU acceleration to parallelize inference across images, with support for variable image sizes through dynamic padding or resizing.

Outputs detected object bounding boxes in multiple coordinate formats (xyxy, xywh, normalized, pixel coordinates) with flexible serialization to JSON, COCO format, or custom formats. The model natively outputs normalized coordinates [0-1] which are converted to pixel coordinates based on input image dimensions, enabling seamless integration with downstream annotation tools and visualization libraries.

Integrates with HuggingFace Hub for model distribution, versioning, and one-line loading via the transformers library's AutoModel API. The model is versioned on Hub with model card documentation, inference examples, and automatic compatibility checks. Users load the model with a single line of code: `AutoModelForObjectDetection.from_pretrained('valentinafevu/yolos-fashionpedia')`, which handles downloading, caching, and device placement.

Model is compatible with Azure ML endpoints and containerized deployment through Docker, enabling serverless inference scaling on Azure infrastructure. The model can be packaged with inference code into a container image and deployed as an Azure ML endpoint with automatic scaling based on request volume. Supports both batch and real-time inference modes through Azure's managed inference services.

Released under MIT license, enabling unrestricted commercial use, modification, and redistribution without attribution requirements. The model weights, architecture, and training code are open-source, allowing users to fine-tune, quantize, or integrate into proprietary systems without licensing restrictions or royalty obligations.