STMPL: Human Soft-Tissue Simulation

Anton Agafonov, Lihi Zelnik-Manor
Technion - Israel Institute of Technology
Code arXiv Dataset
Descriptive text about the image

STMPL able to simulate the soft tissue deformation of human bodies in real time is demonstrated through interactions with external interactions of varying shapes. We illustrate the capabilities of the STMPL model when simulating contact with grasping hands and 'ECCV' block letters, showcasing the detailed and realistic deformation such interactions produce.

Abstract

In various applications, such as virtual reality and gaming, simulating the deformation of soft tissues in the human body during interactions with external objects is essential. Traditionally, Finite Element Methods (FEM) have been employed for this purpose, but they tend to be slow and resource-intensive. In this paper, we propose a unified representation of human body shape and soft tissue with a data-driven simulator of non-rigid deformations. This approach enables rapid simulation of realistic interactions. Our method builds upon the SMPL model, which generates human body shapes considering rigid transformations. We extend SMPL by incorporating a soft tissue layer and an intuitive representation of external forces applied to the body during object interactions. Specifically, we mapped the 3D body shape and soft tissue and applied external forces to 2D UV maps. Leveraging a UNET architecture designed for 2D data, our approach achieves high-accuracy inference in real time. Our experiment shows that our method achieves plausible deformation of the soft tissue layer, even for unseen scenarios.

Dynamic Deformation

BibTeX


@misc{agafonov2024stmpl,
      title={STMPL: Human Soft-Tissue Simulation}, 
      author={Anton Agafonov and Lihi Zelnik-Manor},
      year={2024},
      eprint={2403.08344},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}