Visio Linguistic Alignment Probing And Diagnostic Evaluation

via “visio-linguistic alignment probing and diagnostic evaluation”

* ⭐ 04/2022: [Winoground: Probing Vision and Language Models for Visio-Linguistic... (Winoground)](https://arxiv.org/abs/2204.03162)

Unique: Introduces Winoground benchmark specifically designed to test visio-linguistic alignment through minimal-difference contrastive pairs, moving beyond standard image-text retrieval metrics to probe fine-grained semantic understanding — distinct from generic vision-language benchmarks that measure retrieval or generation quality

vs others: More sensitive to semantic alignment failures than Flickr30K or COCO retrieval benchmarks because it uses adversarial minimal-difference pairs that expose brittleness in learned representations

via “learning objective alignment verification”