Zero Shot Vision Task Generalization

via “zero-shot vision task generalization”

* ⏫ 12/2023: [VideoPoet: A Large Language Model for Zero-Shot Video Generation (VideoPoet)](https://arxiv.org/abs/2312.14125)

Unique: Achieves zero-shot generalization through training on 5.4B diverse annotations spanning multiple spatial hierarchies and semantic granularities, enabling instruction-following without task-specific fine-tuning. Contrasts with models trained on single-task datasets that require supervised adaptation.

vs others: Outperforms task-specific zero-shot models (CLIP for grounding, standard captioning models for novel domains) by leveraging unified multi-task representation, reducing need for ensemble approaches or task-specific prompt engineering.