1. [Publications](/publications)
2. Motion Policy Networks
 
 # Motion Policy Networks

  ![Publication image](/sites/default/files/styles/wide/public/default_images/default.jpeg?itok=qUFsuJCP "Publication image")

 Collision-free motion generation in unknown environments is a core building block for robot manipulation. Generating such motions is challenging due to multiple objectives; not only should the solutions be optimal, the motion generator itself must be fast enough for real-time performance and reliable enough for practical deployment. A wide variety of methods have been proposed ranging from local controllers to global planners, often being combined to offset their shortcomings. We present an end-to-end neural model called Motion Policy Networks (MπNets) to generate collision-free, smooth motion from just a single depth camera observation. MπNets are trained on over 3 million motion planning problems in over 500,000 environments. Our experiments show that MπNets are significantly faster than global planners while exhibiting the reactivity needed to deal with dynamic scenes. They are *46%* better than prior neural planners and more robust than local control policies. Despite being only trained in simulation, MπNets transfer well to the real robot with noisy partial point clouds.



 ## Authors



Adam Fishman (NVIDIA, UW)

[Adithya Murali](/person/adithya-murali)

Clemens Eppner (NVIDIA)

Bryan Peele (NVIDIA)

Byron Boots (NVIDIA, UW)

Dieter Fox (NVIDIA)

 

 

 ## Publication Date



Thursday, December 1, 2022

 

 ## Published in



[Conference on Robot Learning (CoRL), 2022](https://arxiv.org/abs/2210.12209)

 

 ## Research Area



[Artificial Intelligence and Machine Learning ](/research-area/machine-learning-artificial-intelligence)

[Computer Vision](/research-area/computer-vision)

[Robotics](/research-area/robotics)

 

 

 ## External Links



[Project Website](https://mpinets.github.io/)

[Code](https://github.com/NVlabs/motion-policy-networks)