1. [Publications](/index.php/publications)
2. Synthesizing Physical Character-Scene Interactions
 
 # Synthesizing Physical Character-Scene Interactions

  ![](/sites/default/files/styles/wide/public/publications/Synthesizing%20Physical%20Character-Scene%20Interactions_1.png?itok=IN0PQDQz)

 In this work, we present a system that uses adversarial imitation learning and reinforcement learning to train physically-simulated characters that perform scene interaction tasks in a natural and life-like manner. Our method learns scene interaction behaviors from large unstructured motion datasets, without manual annotation of the motion data. These scene interactions are learned using an adversarial discriminator that evaluates the realism of a motion within the context of a scene. We demonstrate the effectiveness of our approach through three challenging scene interaction tasks: carrying, sitting, and lying down, which require coordination of a character's movements in relation to objects in the environment. Our policies learn to seamlessly transition between different behaviors like idling, walking, and sitting.



 ## Authors



Mohamed Hassan (Max-Planck-Institute)

Yunrong Guo (NVIDIA)

Tingwu Wang (NVIDIA)

Michael Black (Max-Planck-Institute)

Sanja Fidler (NVIDIA)

Xue Bin Peng (NVIDIA)

 

 

 ## Publication Date



Sunday, August 6, 2023

 

 ## Published in



[SIGGRAPH 2023](https://s2023.siggraph.org/)

 

 ## Research Area



[Artificial Intelligence and Machine Learning ](/index.php/research-area/machine-learning-artificial-intelligence)

[Computer Graphics](/index.php/research-area/computer-graphics)

 

 

 ## Uploaded Files



[Synthesizing Physical Character-Scene Interactions.pdf](https://d1qx31qr3h6wln.cloudfront.net/publications/Synthesizing%20Physical%20Character-Scene%20Interactions.pdf "Open file in new window")11.81 MB