A Generalized Overview of Artificial Neural Network and Genetic Algorithm

  • Mrinmoy MajumderEmail author
  • Pankaj Roy
  • Asis Mazumdar


Artificial Neural Network (ANN) and Genetic Algorithms are now widely used in various scientific problems including hydrology, and the results from the studies recommend more in depth studies in this regard. A neural network generally summed the weighted data of the input variables and with the help of some activation function, output variable is tried to be estimated. The advantages of such networks mainly lie in their ability to learn problems from the observed dataset of the variables. The network structure, number of layers and nodes, activation function varies with variation in problem domains which the model learns from the data with which it was trained. The drawbacks of such models are their disability to predict data for a relation which was not included in the training data which in turn make the model nonflexible. In addition, the required computation energy and model development time are little more than the conceptual hydrologic models. The selection of network structure, training algorithms, and activation functions are determined with the help of trial and error procedures. Variable dataset of different scales also reduces the model performance. The present note tries to give an overview of the different structures, activation functions, learning process of neural network, and the use of genetic algorithm to remove the trial and error methodology of selecting the ideal model structures and configurations Application of the iteration technique is also discussed.


Activation functions artificial neural network genetic algorithm hydrology 


  1. Ahmed JA, Sarma AK (2005) Genetic algorithm for optimal operating policy of a multipurpose reservoir. J Water Resour Manage 19:145–161CrossRefGoogle Scholar
  2. Araujo L, Ramos H, Coelho S (2006) Pressure control for leakage minimisation in water distribution systems management. Water Resour Manage 20(1):133–149CrossRefGoogle Scholar
  3. ASCE Task Committee on Application of Artificial Neural Networks in Hydrology (2000) Artificial neural networks in hydrology I: preliminary concepts. J Hydrol Eng 5(2):115–123CrossRefGoogle Scholar
  4. Burn DH, Yulianti JS (2001) Waste-load allocation using genetic algorithms. J Water Resour Plan Manage ASCE 127(2):121–129CrossRefGoogle Scholar
  5. Castanedo F, Patricio M, Molina J (2006) Evolutionary computation technique applied to HSPF model calibration of a Spanish watershed. pp 216–223Google Scholar
  6. Cheng C-T, Wang W-C, Xu D-M, Chau K (2007) Optimizing hydropower reservoir operation using hybrid genetic algorithm and chaos. Water Resour Manage. URL
  7. Clair TA, Ehrman JM (1998) Using neural networks to assess the influence of changing seasonal climates in modifying discharge, dissolved organic carbon, and nitrogen export in eastern Canadian rivers. Water Resour Res 34(3):447–455CrossRefGoogle Scholar
  8. Confesor RB, Whittaker GW (2007) Automatic calibration of hydrologic models with multi-objective evolutionary algorithm and Pareto optimization. J Am Water Resour Assoc 43(4):981–989CrossRefGoogle Scholar
  9. Coulibaly P, Anctil F, Bobee B (2000) Daily reservoir inflow forecasting using artificial neural networks with stopped training approach. J Hydrol 230(3–4):244–257CrossRefGoogle Scholar
  10. Dong S-H (2008) Genetic algorithm based parameter estimation of Nash model. Water Resour Manage 22(4):525–533CrossRefGoogle Scholar
  11. Elshorbagy A, Simonovic SP, Panu US (2000) Performance evaluation of artificial neural networks for runoff prediction. J Hydrol Eng 5(4):424–427CrossRefGoogle Scholar
  12. Eslami HR, Mohammadi K (2002) Application of ANN for reservoir inflow forecasting using snowmelt equivalent in the Karaj river watershed. Lowland Technol Int 4(2):17–26Google Scholar
  13. Eusuff MM, Lansey KE (2004) Optimal operation of artificial groundwater recharge systems considering water quality transformations. Water Resour Manage 18(4):379–405CrossRefGoogle Scholar
  14. Fahlam SE (1988) An empirical study of learning speed in back-propagation networks. Technical Report cwU-CS-88-w, JuneGoogle Scholar
  15. Fernando DA, Jayawardena AW (1998) Runoff forecasting using RBF networks with OLS algorithm. J Hydrol Eng 3(3):203–209CrossRefGoogle Scholar
  16. Hinton GE, Sejnowski TJ (1986) Learning and relearning in Boltzmann machines. In Rumelhart, D. E. and McClelland, J. L., editors, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations, MIT Press, Cambridge, MAGoogle Scholar
  17. Hsu K, Gupta HV, Sorooshian S (1995) Artificial neural network modeling of the rainfall-runoff process. Water Resour Res 31(10):2517–2253CrossRefGoogle Scholar
  18. Imrie CE, Durucan S, Korre A (2000) River flow prediction using neural networks: generalization beyond the calibration range. J Hydrol 233(3–4):138–154CrossRefGoogle Scholar
  19. Jain A, Prasad Indurthy SKV (2003) Comparative analysis of event-based rainfall-runoff modeling techniques – deterministic, statistical, and artificial neural networks. J Hydrol Eng 8:93–98CrossRefGoogle Scholar
  20. Jain SK, Das A, Srivastava DK (1999) Application of ANN for reservoir inflow prediction and operation. J Water Resour Plan Manage 125(5):263–271CrossRefGoogle Scholar
  21. Jha MK, Nanda G, Samuel MP (2004) Determining hydraulic characteristics of production wells using genetic algorithm. Water Resour Manage 18(4):353–377CrossRefGoogle Scholar
  22. Jian-Xia C, Qiang H, Yi-Min W (2005) Genetic algorithms for optimal reservoir dispatching. Water Resour Manage 19(4):321–331CrossRefGoogle Scholar
  23. Jourdan L, Corne D, Savic D, Walters G (2005) Preliminary investigation of the ‘learnable evolution model’ for faster/better multiobjective water systems design, Springer Verlag, Berlin pp 841–855Google Scholar
  24. Kisi O (2004) Multilayer perceptrons with Levenberg–Marquardt training algorithm for suspended sediment concentration prediction and estimation. Hydrol Sci J 49(6):1025–1040CrossRefGoogle Scholar
  25. Kim T, Heo JH (2006) Application of multi-objective genetic algorithms to multireservoir system optimization in the Han River basin. KSCE J Civil Eng 10(5):371–380CrossRefGoogle Scholar
  26. Lapedes A, Farber R (1987) Nonlinear signal processing using neural networks: prediction, and system modelling, LA-VR-87-2662, Los AlamosGoogle Scholar
  27. Liong SY, Khu ST, Chan WT (2001) Derivation of Pareto front with genetic algorithm and neural network. J Hydrol Eng 6(1):52–61CrossRefGoogle Scholar
  28. Majumder M, Roy P, Mazumdar A (2007) Optimization of the water use in the river Damodar in West Bengal in India: an integrated multi-reservoir system with the help of artificial neural network. J Eng Comput Architect 1(2):1192Google Scholar
  29. Maier HR, Dandy GC (1999) Empirical comparison of various methods for training feed-forward neural networks for salinity forecasting. Water Resour Res 35(8):2591–2596CrossRefGoogle Scholar
  30. Minsky M, Papert S (1969) Perceptrons. MIT Press, Cambridge.Google Scholar
  31. Neelakantan TR, Pundarikanthan NV (2000) Neural network based simulation-optimization model for reservoir operation. J Water Resour Plan Manage 126(2):57–64CrossRefGoogle Scholar
  32. Parasuraman K, Elshorbagy A (2007) Cluster-based hydrologic prediction using genetic algorithm-trained neural networks. J Hydrol Eng 12(ASCE):52–62CrossRefGoogle Scholar
  33. Ray C, Klindworth KK (2000) Neural networks for agrichemical vulnerability assessment of rural private wells. J Hydrol Eng 5(2):162–171CrossRefGoogle Scholar
  34. Reddy M, Kumar D (2006) Optimal reservoir operation using multi-objective evolutionary algorithm. Water Resour Manage 20(6):861–878CrossRefGoogle Scholar
  35. Sanderson L (2009) Using genetic algorithms to explore the effects of changes in hydrologic variables and suspended sediment on fish biodiversity, Sandusky river, Ohio. Geol Soc Am Abst Program 41(4):13Google Scholar
  36. Scott F (1988) An empirical study of learning speed in back-propagation networks, CMU technical report, CMU-CS-162, Sep. 1988Google Scholar
  37. Sudheer KP (2005) Knowledge extraction from trained neural network river flow models. J Hydrol Eng 10(4):264–269CrossRefGoogle Scholar
  38. Tokar AS, Johnson PA (1999) Rainfall-runoff modeling using artificial neural networks. J Hydrol Eng 4(3):232–239CrossRefGoogle Scholar
  39. Tospornsampan J, Kita I, Ishii M, Kitamura Y (2005) Optimization of a multiple reservoir system operation using a combination of genetic algorithm and discrete differential dynamic programming: a case study in Mae Klong system, Thailand. Paddy Water Environ 3(1):29–38CrossRefGoogle Scholar
  40. Wang QJ (1991) The genetic algorithm and its application to calibrating conceptual rainfall-runoff models. Water Resour Res 27(9):2467–2471CrossRefGoogle Scholar
  41. Wardlaw R, Sharif M (1999) Evaluation of genetic algorithms for optimal reservoir system operation. J Water Resour Plan Manage 125(1):25–33CrossRefGoogle Scholar
  42. Wang AP, Liao HY, Kou CH, Huang CY (2006) Artificial neural networks on reservoir inflows forecasting during typhoon season – a case in Taiwan. WSEAS Trans Math 5(4):416–422Google Scholar
  43. Wei CC, Hsu NS (2007) Development of a real-time optimization model for flood control of a multipurpose reservoir. J Chinese Inst Civil Hydraulic Eng 19(3):355–365Google Scholar
  44. Xu ZX, Li JY (2001) Short-term inflow forecasting using an artificial neural network model. Wiley, New YorkGoogle Scholar
  45. Yitian L, Gu RR (2003) Modeling flow and sediment transport in a river system using an artificial neural network. J Environ Manage 31(1):122–134CrossRefGoogle Scholar
  46. Zhang Q, Stanley SJ (1999) Real-time treatment process control with artificial neural networks. J Environ Eng 125(2):153–160CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media B.V. 2010

Authors and Affiliations

  1. 1.School of Water Resources EngineeringJadavpur UniversityKolkataIndia
  2. 2.Regional Center, National Afforestation and Eco-development BoardJadavpur UniversityKolkataIndia

Personalised recommendations