- Tytuł:
- A survey of factors influencing MLP error surface
- Autorzy:
-
Kordos, M.
Duch, W. - Powiązania:
- https://bibliotekanauki.pl/articles/970445.pdf
- Data publikacji:
- 2004
- Wydawca:
- Polska Akademia Nauk. Instytut Badań Systemowych PAN
- Tematy:
-
sieć neuronowa
powierzchnia błędów
wizualizacja
trajektoria uczenia się
neural networks
MLP
error surface
visualization
learning trajectory - Opis:
- Visualization of neural network error surfaces and learning trajectories helps to understand the influence of numerous factors on the neural learning process. This understanding can be used to improve training and design of MLP networks. The following topics are discussed using a few benchmark datasets for illustration: general error surface properties including local minima, plateaus and narrow funnels, their dependence on network structure, input data, transfer and error functions, consequences of weight initialization, and interesting directions in the weight space. The error surfaces are shown in 3-dimensional PCA-based projections. Finally a possibility of effective weight number reduction is discussed.
- Źródło:
-
Control and Cybernetics; 2004, 33, 4; 611-631
0324-8569 - Pojawia się w:
- Control and Cybernetics
- Dostawca treści:
- Biblioteka Nauki