Customized Appearance And Motion Composition

[ECCV 2024 Oral] MotionDirector: Motion Customization of Text-to-Video Diffusion Models.

Unique: Implements LoRA weight composition in the attention module where spatial and temporal LoRAs are applied to different attention heads/layers without interference, enabling true orthogonal composition rather than simple weight addition.

vs others: Provides finer control than single-LoRA approaches and avoids retraining for each character-motion combination, unlike traditional animation pipelines requiring separate motion capture per character.

via “animation-style-customization”

via “character and asset customization”