1. [Publications](/publications)
2. Open-World Task and Motion Planning via Vision-Language Model Inferred Constraints
 
 # Open-World Task and Motion Planning via Vision-Language Model Inferred Constraints

  ![Publication image](/sites/default/files/styles/wide/public/default_images/default.jpeg?itok=qUFsuJCP "Publication image")

 ## Authors



Nishanth Kumar (MIT CSAIL)

William Shen (MIT CSAIL)

[Fabio Ramos](/person/fabio-ramos)

Dieter Fox (NVIDIA)

Tomás Lozano-Pérez (MIT CSAIL)

Leslie Pack Kaelbling (MIT CSAIL)

[Caelan Garrett](/person/caelan-garrett)

 

 

 ## Publication Date



Monday, January 5, 2026

 

 ## Published in



[IEEE Robotics and Automation Letters (RA-L)](https://arxiv.org/abs/2411.08253)

 

 ## Research Area



[Artificial Intelligence and Machine Learning ](/research-area/machine-learning-artificial-intelligence)

[Natural Language Processing](/research-area/natural-language-processing)

[Robotics](/research-area/robotics)