MATHEMATICAL APPROACH OF THE BACKPROPAGATION METHOD FOR CONSTRUCTING ARTIFICIAL NEURAL NETWORKS
Backpropagation isthe core part of a neural network. This method is used to efficiently train a network using a chain rule that allows differentiation of complex functions. In other words, after each pass through the network, the backpropagation method performs a backward pass to adjust the model parameters, such as weights and biases. This article highlights the importance of using the backpropagation method from the point of view of mathematical formulas for neural networks. The importance of using the backpropaga-tion learning algorithm to calculate the gradient (gradient descent) and the need to use the activation function to minimize the loss function is mathematically described and calculated by formulas, and also proven by calculating the matrix products of vectors for each layer of parameters - weights and biases and applying complex differential equations.
Сведения
- Опубликовано
- 2024 · Т. 5, № 3(19), С. 32-48
- Язык
- Английский
- Цитирований
- 1
- ISSN
- 2708-2032 · 2708-2040
- Издатель
- International Information Technology University
- Аффилиации
- Master in CSSE, lecturer, Computer Engineering, International Information Technology University
PhD Computer Science, Professor, Gachon University, Seoul, the Republic of Korea
Doctoral (PhD) student Computer Engineering, senior-lecturer, International Information Technology University
PhD CSSE, assistant-professor, Computer Engineering, International Infor-mation Technology University