Neural Network – A Black Box Model

Kuok, Kuok King and Chan, Chiu Po and Md. Rezaur, Rahman and Khairul Anwar, Mohamad Said and Chin Mei, Yun (2024) Neural Network – A Black Box Model. In: Metaheuristic Algorithms and Neural Networks in Hydrology. Cambridge Scholars Publishing, pp. 1-34. ISBN 978-1-0364-0804-6

PDF 978-1-0364-0804-6-sample.pdf - Published Version Download (639kB)

Abstract

Artificial Neural Network (ANN) is a computational model based on the structure and operation of biological neural networks. It is a black box model due to its complexities and difficulties in understanding how to make decisions and predictions with complicated internal structures and huge parameters involved. The basic unit of ANN is the artificial neurons. A group of neurons forms a layer. There are three layers in ANN, namely, the input, hidden, and output layers. Forward and backward propagation are two common learning processes adopted for adjusting weights and biases in ANN. Various activation functions are used, such as Hard limit, Tan-Sigmoid, Linear, Log-Sigmoid, Rectified Linear Unit (ReLU), Hyperbolic Tangent (tanh), and Softmax, enabling ANN to simulate complicated relationships and perform nonlinear transformations. Three learning paradigms of ANN include supervised, unsupervised, and reinforcement learning. A variety of metaheuristic algorithms have been used to train ANN, including Genetic Algorithms (GA), Particle Swarm Optimization (PSO), Simulated Annealing (SA), Ant Colony Optimization (ACO), Tabu Search (TS), and Harmony Search (HS). To date, ANN has been successfully adopted in streamflow prediction, rainfall-runoff modeling, groundwater modeling, water quality modeling, and water demand forecasting.

Actions (For repository members only: login required)

View Item