- Tytuł:
- Fusion of Depth and Thermal Imaging for People Detection
- Autorzy:
-
Gutfeter, Weronika
Pacut, Andrzej - Powiązania:
- https://bibliotekanauki.pl/articles/2058486.pdf
- Data publikacji:
- 2021
- Wydawca:
- Instytut Łączności - Państwowy Instytut Badawczy
- Tematy:
-
depth imaging
person detection
sensor fusion
thermal imaging - Opis:
- The methodology presented in this paper covers the topic of automatic detection of humans based on two types of images that do not rely on the visible light spectrum, namely on thermal and depth images. Various scenarios are considered with the use of deep neural networks being extensions of Faster R-CNN models. Apart from detecting people, independently, with the use of depth and thermal images, we proposed two data fusion methods. The first approach is the early fusion method with a 2-channel compound input. As it turned out, its performance surpassed that of all other methods tested. However, this approach requires that the model be trained on a dataset containing both types of spatially and temporally synchronized imaging sources. If such a training environment cannot be setup or if the specified dataset is not sufficiently large, we recommend the late fusion scenario, i.e. the other approach explored in this paper. Late fusion models can be trained with single-source data. We introduce the dual-NMS method for fusing the depth and thermal imaging approaches, as its results are better than those achieved by the common NMS.
- Źródło:
-
Journal of Telecommunications and Information Technology; 2021, 4; 53--60
1509-4553
1899-8852 - Pojawia się w:
- Journal of Telecommunications and Information Technology
- Dostawca treści:
- Biblioteka Nauki
Artykuł