Prompt Guided Generative Creature Synthesis

via “prompt-guided inference with learned subject token embedding”

Implementation of Dreambooth (https://arxiv.org/abs/2208.12242) with Stable Diffusion

Unique: Uses a unique token identifier as an anchor point in the text embedding space, allowing the learned subject to be composed with arbitrary prompts without fine-tuning. The token acts as a semantic placeholder that the model learns to associate with the subject's visual features during training.

vs others: More flexible than style transfer (enables compositional generation) and more controllable than unconditional generation, but less precise than image-to-image editing for specific visual modifications.