1. [Publications](/index.php/publications) 2. Toward Low-Flying Autonomous MAV Trail Navigation using Deep Neural Networks for Environmental Awareness # Toward Low-Flying Autonomous MAV Trail Navigation using Deep Neural Networks for Environmental Awareness ![](/sites/default/files/styles/wide/public/publications/thumbnail.png?itok=_Jdsp6Wv) We present a micro aerial vehicle (MAV) system, built with inexpensive off-the-shelf hardware, for autonomously following trails in unstructured, outdoor environments such as forests. The system introduces a deep neural network (DNN) called TrailNet for estimating the view orientation and lateral offset of the MAV with respect to the trail center. The DNN-based controller achieves stable flight without oscillations by avoiding overconfident behavior through a loss function that includes both label smoothing and entropy reward. In addition to the TrailNet DNN, the system also utilizes vision modules for environmental awareness, including another DNN for object detection and a visual odometry component for estimating depth for the purpose of low-level obstacle detection. All vision systems run in real time on board the MAV via a Jetson TX1. We provide details on the hardware and software used, as well as implementation details. We present experiments showing the ability of our system to navigate forest trails more robustly than previous techniques, including autonomous flights of 1 km. ## Authors Nikolai Smolyanskiy (NVIDIA) Alexey Kamenev (NVIDIA) Jeffrey Smith (NVIDIA) [Stan Birchfield](/index.php/person/stan-birchfield) ## Publication Date Sunday, September 24, 2017 ## Published in [IROS 2017](https://www.iros2017.org/) ## Research Area [Computer Vision](/index.php/research-area/computer-vision) [Robotics](/index.php/research-area/robotics) ## External Links [arXiv paper](https://arxiv.org/abs/1705.02550) [video](https://youtu.be/H7Ym3DMSGms) [code](https://github.com/NVIDIA-Jetson/redtail) ## Uploaded Files [TrailMAV-IROS2017.pdf](https://research.nvidia.com/sites/default/files/pubs/2017-09_Toward-Low-Flying-Autonomous//TrailMAV-IROS2017.pdf "Open file in new window")5.38 MB ## Copyright This material is posted here with permission of the IEEE. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to .