- Tytuł:
- A Deep Q-Learning Network for ship stowage planning problem
- Autorzy:
-
Shen, Y.
Zhao, N.
Xia, M.
Du, X. - Powiązania:
- https://bibliotekanauki.pl/articles/260614.pdf
- Data publikacji:
- 2017
- Wydawca:
- Politechnika Gdańska. Wydział Inżynierii Mechanicznej i Okrętownictwa
- Tematy:
-
Deep Q-Leaning Network (DQN)
container terminal
ship stowage plan
markov decision process
value function approximation
generalization - Opis:
- Ship stowage plan is the management connection of quae crane scheduling and yard crane scheduling. The quality of ship stowage plan affects the productivity greatly. Previous studies mainly focuses on solving stowage planning problem with online searching algorithm, efficiency of which is significantly affected by case size. In this study, a Deep Q-Learning Network (DQN) is proposed to solve ship stowage planning problem. With DQN, massive calculation and training is done in pre-training stage, while in application stage stowage plan can be made in seconds. To formulate network input, decision factors are analyzed to compose feature vector of stowage plan. States subject to constraints, available action and reward function of Q-value are designed. With these information and design, an 8-layer DQN is formulated with an evaluation function of mean square error is composed to learn stowage planning. At the end of this study, several production cases are solved with proposed DQN to validate the effectiveness and generalization ability. Result shows a good availability of DQN to solve ship stowage planning problem.
- Źródło:
-
Polish Maritime Research; 2017, S 3; 102-109
1233-2585 - Pojawia się w:
- Polish Maritime Research
- Dostawca treści:
- Biblioteka Nauki
Artykuł