ByteDance’s DreamActor-M1 Turns Images into Stunningly Real Human Videos

ByteDance has introduced DreamActor-M1, a new framework designed to generate realistic human animations from reference images. This framework addresses key issues in current animation models to achieve finer control, greater adaptability, and better consistency.

This comes in right after ByteDance announced Goku and InfiniteYou AI models.

The research paper compares DreamActor-M1 with several state-of-the-art human image animation models. For body animation, DreamActor-M1 was compared against Animate Anyone, Champ, MimicMotion, and DisPose.

In portrait animation, the model was evaluated alongside LivePortrait, X-Portrait, SkyReels-A1, and Runway Act-One. 

The results of these comparisons demonstrate that DreamActor-M1 outperforms existing methods in generating more expressive and consistent animations. 

The researchers also acknowledged that these AI models can be misused. They stated, “To reduce these risks, clear ethical rules and responsible usage guidelines are necessary. We will strictly restrict access to our core models and codes to prevent misuse. Images and videos are all from publicly available sources.”

While DreamActor-M1 represents a significant advancement, the researchers acknowledge certain limitations. The model struggles with controlling dynamic camera movements and generating physical interactions with environmental objects. Their future work aims to address these challenges and further enhance the model’s capabilities.