Transformers for Challenging Navigation

This chapter discusses a multi-task transformer model tailored for navigation in difficult environments, focusing on its training process, efficiency, and the advantages of a non-autoregressive approach. It also examines the model's capabilities in multitasking, terrain patch reconstruction, and the challenges related to current hardware and computation needs.