- Tytuł:
- ADDP : Anomaly Detection Based on Denoising Pretraining
- Autorzy:
-
Ge, Xianlei
Li, Xiaoyan
Zhang, Zhipeng - Powiązania:
- https://bibliotekanauki.pl/articles/27311945.pdf
- Data publikacji:
- 2023
- Wydawca:
- Polska Akademia Nauk. Czasopisma i Monografie PAN
- Tematy:
-
Anomaly Detection
Diffusion Models
image denoising
Pretraining
transfer learning - Opis:
- Acquiring labels in anomaly detection tasks is expensive and challenging. Therefore, as an effective way to improve efficiency, pretraining is widely used in anomaly detection models， which enriches the model's representation capabilities, thereby enhancing both performance and efficiency in anomaly detection. In most pretraining methods, the decoder is typically randomly initialized. Drawing inspiration from the diffusion model, this paper proposed to use denoising as a task to pretrain the decoder in anomaly detection, which is trained to reconstruct the original noise-free input. Denoising requires the model to learn the structure, patterns, and related features of the data, particularly when training samples are limited. This paper explored two approaches on anomaly detection: simultaneous denoising pretraining for encoder and decoder, denoising pretraining for only decoder. Experimental results demonstrate the effectiveness of this method on improving model’s performance. Particularly, when the number of samples is limited, the improvement is more pronounced.
- Źródło:
-
International Journal of Electronics and Telecommunications; 2023, 69, 4; 719--726
2300-1933 - Pojawia się w:
- International Journal of Electronics and Telecommunications
- Dostawca treści:
- Biblioteka Nauki
Artykuł