Human Motion Diffusion Model

AI-generated keywords: Computer animation Natural human motion Generative models Diffusion models Motion generation

AI-generated Key Points

  • The field of computer animation aims to achieve natural and expressive human motion generation
  • Current generative solutions often lack quality and expressiveness
  • The Motion Diffusion Model (MDM) is a promising solution for human motion generation
  • MDM is a diffusion-based generative model tailored for human motion, incorporating insights from existing literature
  • MDM supports various forms of conditioning and different generation tasks like text-to-motion and action-to-motion
  • MDM achieves state-of-the-art results with user studies showing preference over real motions 42% of the time
  • MDM excels in tasks such as inpainting gaps in motion sequences under textual conditions while maintaining semantic consistency, completion, and editing capabilities
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Guy Tevet, Sigal Raab, Brian Gordon, Yonatan Shafir, Amit H. Bermano, Daniel Cohen-Or

License: CC BY-SA 4.0

Abstract: Natural and expressive human motion generation is the holy grail of computer animation. It is a challenging task, due to the diversity of possible motion, human perceptual sensitivity to it, and the difficulty of accurately describing it. Therefore, current generative solutions are either low-quality or limited in expressiveness. Diffusion models, which have already shown remarkable generative capabilities in other domains, are promising candidates for human motion due to their many-to-many nature, but they tend to be resource hungry and hard to control. In this paper, we introduce Motion Diffusion Model (MDM), a carefully adapted classifier-free diffusion-based generative model for the human motion domain. MDM is transformer-based, combining insights from motion generation literature. A notable design-choice is the prediction of the sample, rather than the noise, in each diffusion step. This facilitates the use of established geometric losses on the locations and velocities of the motion, such as the foot contact loss. As we demonstrate, MDM is a generic approach, enabling different modes of conditioning, and different generation tasks. We show that our model is trained with lightweight resources and yet achieves state-of-the-art results on leading benchmarks for text-to-motion and action-to-motion. https://guytevet.github.io/mdm-page/ .

Submitted to arXiv on 29 Sep. 2022

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2209.14916v1

The field of computer animation strives to achieve natural and expressive human motion generation. This is a challenging task due to the complexity and diversity of possible motions, as well as human perceptual sensitivity to them. Current generative solutions often fall short in terms of quality and expressiveness. However, the Motion Diffusion Model (MDM) presents a promising solution for human motion generation. , , , , MDM is a classifier-free diffusion-based generative model specifically tailored for human motion. It incorporates insights from existing motion generation literature and utilizes a key design choice of predicting the sample rather than the noise in each diffusion step. This allows for the use of established geometric losses such as foot contact loss. , , , , <kd>Fidelity and diversity trade-off </ kd> The MDM framework supports various forms of conditioning and different generation tasks including text-to-motion, action-to-motion, and unconditioned generation. It is trained in a classifier-free manner, enabling a balance between diversity and fidelity in generated motions. < kd >State-of-the-art results </ kd > , user studies indicating preference over real motions 42% of the time, outperforming existing models on benchmarks like HumanAct12 and UESTC - these are just some of the impressive achievements showcased by MDM in evaluations on benchmarks like HumanML3D and KIT. < kd >Text-to-motion tasks </ kd > , inpainting gaps in motion sequences under textual conditions while maintaining semantic consistency, completion and editing capabilities - MDM excels in all of these areas. Its ability to generate diverse and high-quality motions makes it a significant advancement in the field of computer animation. , , , , <kd>High-quality results </ kd> In summary, the Motion Diffusion Model is a powerful and versatile approach to human motion generation that excels in quality across multiple tasks with minimal training requirements. Its ability to generate diverse and high-quality motions makes it a significant advancement in the field of computer animation.
Created on 26 Mar. 2025

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.