RPG-DiffusionMasterRepository39/100 via “itercomp iterative refinement with multi-step region optimization”
[ICML 2024] Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs (RPG)
Unique: Closes a feedback loop between vision (generated images) and language (MLLM analysis) by using MLLM to analyze generated images and propose refined region definitions, enabling multi-step optimization without external human feedback. Treats image generation as an iterative planning problem rather than single-pass synthesis.
vs others: More automated than manual prompt iteration because MLLM analyzes images and suggests refinements; more efficient than sequential per-region regeneration because it optimizes all regions jointly based on visual feedback