Intelligent autonomous ship navigation using multi-sensor modalities

This paper explores the use of machine learning and deep learning artificial intelligence (AI) techniques as a means to integrate multiple sensor modalities into a cohesive approach to navigation for autonomous ships. Considered is the case of a fully autonomous ship capable of making decisions and determining actions by itself without active supervision on the part of onboard crew or remote human operators. These techniques, when combined with advanced sensor capabilities, have been touted as a means to overcome existing technical and human limitations as unmanned and autonomous ships become operational presently and in upcoming years. Promises of the extraordinary capabilities of these technologies that may even exceed those of crewmembers for decision making under comparable conditions must be tempered with realistic expectations as to their ultimate technical potential, their use in the maritime domain, vulnerabilities that may preclude their safe operation; and methods for development, integration and test. The results of research performed by the author in specific applications of machine learning and AI to shipping are presented citing key factors that must be achieved for certification of these technologies as being suitable for their intended purpose. Recommendations are made for strategies to surmount present limitations in the development, evaluation and deployment of intelligent maritime systems that may accommodate future technological advances. Lessons learned that may be applied to improve safety of navigation for conventional shipping are also provided.