Text Guided Iterative Image Editing Via Embedding Interpolation

via “image inpainting and conditional generation in embedding space”

Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch

Unique: Implements inpainting at both embedding level (via masked DiffusionPrior) and pixel level (via masked Decoder), enabling semantic-aware inpainting that respects both image content and text semantics. Provides utilities for mask preprocessing and guidance strength scheduling.

vs others: More semantically aware than pixel-space inpainting (which lacks semantic understanding) and more flexible than single-stage approaches because it can leverage both text and image embeddings for guidance.