Remote-controlled tug operation via VR/AR: results of an in-situ model test

The German-funded FernSAMS project aimed at the development of an unmanned, remote-controlled tug operation with AR/VR technology. After an extensive simulation test with ship-handling simulators, the developed FernSAMS AR/VR system has now been in-situ tested with a scale model of the tug. The model test results showed very robust stability in remote operations with improved situational awareness with the VR/AR system and sensors. After a short introduction of the FernSAMS concept as well as some first insights into FernSAMS Human-Machine-Interface tests within the simulator, this paper introduces the technical setup of the scale-model tests being conducted with the FernSAMS concept to test the operational and technical feasibility of AR/VR-based remote control. This includes an overview of the systems and sensors integration and an analysis of the effectiveness of AR/VR system combined with 360-degree video streaming.