Skip to main content
Skip main navigation
No Access

Using genetic algorithms for automatic recurrent ANN development: an application to EEG signal classification

Published Online:pp 182-191https://doi.org/10.1504/IJDMMM.2013.053695

ANNs are one of the most successful learning systems. For this reason, many techniques have been published that allow the obtaining of feed-forward networks. However, few works describe techniques for developing recurrent networks. This work uses a genetic algorithm for automatic recurrent ANN development. This system has been applied to solve a well-known problem: classification of EEG signals from epileptic patients. Results show the high performance of this system, and its ability to develop simple networks, with a low number of neurons and connections.

Keywords

artificial neural networks, ANNs, genetic algorithms, GAs, signal classification, epilepsy detection

References

  • 1. Alba, E. , Aldana, J.F. , Troya, J.M. (1993). ‘Fully automatic ANN design: a genetic approach’. Lecture Notes in Computer Science, Proc. Int. Workshop Artificial Neural Networks (IWANN’93). 686, 399-404 Google Scholar
  • 2. Andrzejak, R.G. , Lehnertz, K. , Rieke, C. , Mormann, F. , David, p. , Elger, C.E. (2001). ‘Indications of non-linear deterministic and finite dimensional structures in time series of brain electrical activity: dependence on recording region and brain state’. Physical Review E. 64, 6, 0619071–8 Google Scholar
  • 3. Cantú-Paz, E. , Kamath, C. (2005). ‘An empirical comparison of combinations of evolutionary algorithms and neural networks for classification problems’. IEEE Transactions on Systems, Man and Cybernetics – Part B: Cybernetics. 35, 5, 915-927 Google Scholar
  • 4. Darwin, C.R. (1859). On the Origin of Species by Means of Natural Selection, or the Preservation of Favoured Races in the Struggle for Life. 1st ed., 1st issue, London:John Murray Google Scholar
  • 5. DasGupta, B. , Schnitger, G. (1992). ‘Efficient approximation with neural networks: a comparison of gate functions’. Dep. Comput. Sci., Pennsylvania State Univ Google Scholar
  • 6. Greenwood, G.W. (1997). ‘Training partially recurrent neural networks using evolutionary strategies’. IEEE Transactions on Speech Audio Processing. 5, 2, 192-194 Google Scholar
  • 7. Harp, S.A. , Samad, T. , Guha, A. (1989). ‘Towards the genetic synthesis of neural networks’, in Schafer, J.D. (Ed.):. Int. Conf. Genetic Algorithms and Their Applications, Morgan Kaufmann, San Mateo, CA Google Scholar
  • 8. Haykin, S. (1999). Neural Networks. 2nd ed., Englewood Cliffs, NJ:Prentice Hall Google Scholar
  • 9. Holland, J.H. (1975). Adaptation in Natural and Artificial Systems. Ann Arbor, MI:University of Michigan Press Google Scholar
  • 10. Hwang, M.W. , Choi, J.Y. , Park, J. (1997). ‘Evolutionary projection neural networks’. IEEE Int. Conf. Evolutionary Computation Google Scholar
  • 11. Kitano, H. (1990). ‘Designing neural networks using genetic algorithms with graph generation system’. Complex Systems. 4, 461-476 Google Scholar
  • 12. Merrill, J.W.L. , Port, R.F. (1991). ‘Fractally configured neural networks’. Neural Networks. 4, 1, 53-60 Google Scholar
  • 13. Miller, G.F. , Todd, p.M. , Hedge, S.U. , Kaufmann, M. (1989). ‘Designing neural networks using genetic algorithms’. Third International Conference on Genetic Algorithms, San Mateo, CA Google Scholar
  • 14. Mohseni, H.R. , Maghsoudi, A. , Shamsollahi, B. (2006). ‘Seizure detection in EEG signals: a comparison of different approaches’. Engineering in Medicine and Biology Society, EMBS06, 28th Annual International Conference of the IEEE Google Scholar
  • 15. Nolfi, S. , Parisi, D. (2002). ‘Evolution of artificial neural networks’. Handbook of Brain Theory and Neural Networks. 2nd ed., Cambridge, MA:MIT Press Google Scholar
  • 16. Rabunal, J.R. , Dorado, J. (2005). Artificial Neural Networks in Real-Life Applications. London:Idea Group Google Scholar
  • 17. Rivero, D. , Dorado, J. , Rabuñal, J.R. , Pazos, A. , Zhang, Q. Segall, R.S. Cao, M. (2011). ‘Database analysis with ANNs by means of graph evolution’. Visual Analytics and Interactive Technologies: Data, Text and Web Mining Applications. Information Science Reference Google Scholar
  • 18. Rivero, D. , Dorado, J.R. , Rabuñal, J. , Pazos, A. (2009). ‘Evolving simple feed-forward and recurrent ANNs for signal classification: a comparison’. Neural Networks, IEEE – INNS – ENNS International Joint Conference on Google Scholar
  • 19. Rivero, D. , Dorado, J.R. , Rabuñal, J. , Pazos, A. (2010). ‘Generation and simplification of artificial neural networks by means of genetic programming’. Neurocomputing. 73, 16–18, 3200-3223 Google Scholar
  • 20. Rumelhart, D.E. , Hinton, G.E. , Williams, R.J. (1986). ‘Learning internal representations by error propagation’. Parallel Distributed Processing: Explorations in the Microstructures of Cognition. 1, 318-362 Google Scholar
  • 21. Sutton, R.S. (1986). ‘Two problems with backpropagation and other steepest-descent learning procedure for networks’. 8th Annual Conference on Cognitive Science Society, Erlbaum, Hillsdale, NJ Google Scholar
  • 22. Turney, p. , Whitley, D. , Anderson, R. (1996). ‘Special issue on the Baldwinian effect’. Evolutionary Computation. 4, 3, 213-329 Google Scholar
  • 23. Yao, X. , Liu, Y. (1998). ‘Toward designing artificial neural networks by evolution’. Applied Mathematical Computation. 91, 1, 83-90 Google Scholar