- Tytuł:
- Reinforcement Learning in Discrete and Continuous Domains Applied to Ship Trajectory Generation
- Autorzy:
-
Rak, A.
Gierusz, W. - Powiązania:
- https://bibliotekanauki.pl/articles/259073.pdf
- Data publikacji:
- 2012
- Wydawca:
- Politechnika Gdańska. Wydział Inżynierii Mechanicznej i Okrętownictwa
- Tematy:
-
ship motion control
trajectory generation
autonomous navigation
reinforcement learning
least-squares policy iteration - Opis:
- This paper presents the application of the reinforcement learning algorithms to the task of autonomous determination of the ship trajectory during thein-harbour and harbour approaching manoeuvres. Authors used Markov decision processes formalism to build up the background of algorithm presentation. Two versions of RL algorithms were tested in the simulations: discrete (Q-learning) and continuous form (Least-Squares Policy Iteration). The results show that in both cases ship trajectory can be found. However discrete Q-learning algorithm suffered from many limitations (mainly curse of dimensionality) and practically is not applicable to the examined task. On the other hand, LSPI gave promising results. To be fully operational, proposed solution should be extended by taking into account ship heading and velocity and coupling with advanced multi-variable controller.
- Źródło:
-
Polish Maritime Research; 2012, S 1; 31-36
1233-2585 - Pojawia się w:
- Polish Maritime Research
- Dostawca treści:
- Biblioteka Nauki
Artykuł