Analytical Comparison of Swarm Intelligence Optimization versus Behavioral Learning Concepts Adopted by Neural Networks (An Overview)

Hassan M. H. Mustafa^1,

¹Currently with Al-Baha University, Faculty of Eng., Computer Eng. Department (K.S.A), On leave from Faculty of Specified Education-Banha University Egypt

Cite this paper:
Hassan M. H. Mustafa. Analytical Comparison of Swarm Intelligence Optimization versus Behavioral Learning Concepts Adopted by Neural Networks (An Overview). American Journal of Educational Research. 2015; 3(7):800-806. doi: 10.12691/education-3-7-2

Abstract

Generally, in nature, non-human creatures perform adaptive behaviors to external environment they are living in. i.e. animals have to keep alive by improving their intelligent behavioral ability to be adaptable to their living environmental conditions. This paper presents an investigational comparative overview on adaptive behaviors associated with two diverse biological systems (Neural and Non-Neural). In more details, intelligent behavioral performance of Ant Colony System () in order to reach optimal solution of Traveling Sales-man Problem (TSP) is considered. That's investigated herein versus concepts of adaptive behavioral learning concerned with some animals (cats, dogs, and rats), in order to keep survive. More precisely, investigations of behavioral observations tightly related to suggested animals, supposed to obey discipline of biological information processing. So, Artificial Neural Network () modeling is a relevant tool to investigate such biological system observations. Moreover, an illustrative brief of optimal intelligent behaviors to solve is presented. Additionally, considering effect of noisy environment on learning convergence, an interesting analogy between both proposed biological systems is introduced. Finally, performance of three learning algorithms shown to be analogously in agreement with behavioral concepts of both suggested biological systems' performance.

Keywords:
artificial neural network modeling animal learning ant colony system traveling salesman problem and computational biology

This work is licensed under a Creative Commons Attribution 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

References:

[1]	H. M. Hassan. “On principles of biological information processing concerned with learning convergence mechanism in neural and non-neural bio-systems”, Published at CIMCA 2005 28-30 Nov. 2005.
[2]	Dorigo, M., & Gambardella, L. M. (1997). Ant colony system: a cooperative learning approach to the travelling salesman problem. IEEE Transactions on Evolutionary Computation, 1(1), 53-66.
[3]	Dorigo, M.: Optimization learning and natural algorithms, (in Italian), Ph.D Thesis Dip. Electronico, Politecnico di Milano, (1992).
[4]	Dorigo, C, M., Maniezzo, V. : Distributed optimization by Ant Colonies. In: Proceedings of The First European conference on Artificial Life (ECAL 91), pp 134-142 Elevier, (1991).
[5]	Dorigo, M., Maniezzo, V. : Positive feedback as search strategy. Technical report 91-016, Dip .Electronico, Politecnicodi Milano, (1991).
[6]	H. M. Hassan. “On Learning Performance Evaluation for Some Psycho-Learning Experimental Work versus an Optimal Swarm Intelligent System.”, Published at ISSPIT 2005 (18-20 Dec.2005).
[7]	H. M. Hassan “Comparative Performance Analysis for Selected Behavioral Learning Systems versus Ant Colony System Performance (Neural Network Approach)”. Published at the International Conference on Machine Intelligence (ICMI) 2015.Held on Jan 26-27, 2015, in Jeddah, Saudi Arabia.
[8]	Hassan M. H. Mustafa, et al. “Comparative Performance Analysis and Evaluation for One Selected Behavioral Learning System versus an Ant Colony Optimization System” Published at the Proceedings of the Second International Conference on Electrical, Electronics, Computer Engineering and their Applications (EECEA2015), Manila, Philippines, on Feb. 12-14, 2015.
[9]	Thorndike E.L. Animal Intelligence, Darien, Ct. Hafner, 1911.
[10]	Pavlov, I.P. Conditional Reflex, An Investigation of The Psychological Activity of the Cerebral Cortex, New York , Oxford University press, 1927.
[11]	Hampson, S.E. Connectionistic Problem Solving, Computational Aspects of Biological Learning, Berlin, Birkhouser, 1990.
[12]	H.M. Hassan. “A Comparative Analogy of Quantified Learning Creativity in Humans Versus Behavioral Learning Performance in Animals: Cats, Dogs, Ants, and Rats. (A Conceptual Overview), submitted at WSSEC08 conference to be held on 18-22 August 2008, Derry, Northern Ireland.
[13]	Fukaya, M., et al. Two level Neural Networks: Learning by Interaction with Environment, 1st ICNN, San Diego, 1988.
[14]	Ghoaimy M. A., et al. learning of Neural Networks using Noisy Data, Second International Conference On Artificial Intelligence Application, Cairo, Egypt, 389-399, Jan. 22-24, 1994.
[15]	David J., Jilk, Danial M. Cer, and Randall C. O'Rilly., “Effectiveness of neural network learning rules generated by a biophysical model of synaptic plasticity.”, Technical report, Department of Psychology, University of Colorado, Boulder, (2003).
[16]	Mariaty, E.D et al, 1999: Evolutionary algorithms for reinforcement learning, journal of AI research 11:241.
[17]	Folino G., Pizzuti C. and Spezzano G. Parallel genetic programming for decision tree induction. Technical Report ISI-CNR, Università della Calabria, 87036 Rende (CS), Italy, 2002.
[18]	Sejnowski, T.J: Neural pulse coding” foreword article for (Pulsed neural networks), MIT press, 1999, pp 13-23, 1999.
[19]	Wilson, M. A. and McNaughton, B. L., 1993: Dynamics of the hippocampal ensemble code for space. Science, 261: 1055-8.
[20]	H. M. Hassan. “Evaluation of Learning / Training Convergence Time Using Neural Network (ANNs)” published at, the Proceeding of 4th International Conference of Electrical Engineering ICEENG Conference, Military Technical College, Cairo, Egypt, pp.542-549, 24-26 Nov. 2004.
[21]	H.M. Hassan “On Quantifying Learning Creativity Using Artificial Neural Networks (A Mathematical Programming Approach)” published at CCCT 2007 conference held on July 12-17,2007-Orlando,Florida,USA.
[22]	Haykin, S. Neural Networks, Englewood Cliffs, NJ: Prentice-Hall pp 50-60, 1999.
[23]	Zhang et al. “Interpreting neuronal population activity by reconstruction.” Journal of Neurophysiology, 79:1017-44, 1998.
[24]	Hebb, D.O. “The organization of Behavior, A Neuropsychological Theory”, New York, Wiley, 1949.
[25]	Roseborough and Murase. at web site http://www-white.media.mit.edu/people/jebara/uthesis/node64.html, 2000.
[26]	Jebara T., 2000: at web site http://www-white. media.mit. edu/people/jebara/ uthesis/node64.html.
[27]	Alberto C., et al. Distributed optimization by ant colonies. Proceeding of ECAL91, Elsevier Publishing, pp 134-142, 1991.
[28]	H.M. Hassan, Ayoub Al-Hammadi, Bernd Michael” Evaluation of Memorization Brain Function Using a Spatio-temporal Artificial Neural Network (ANN) Model” published at CCCT 2007 conference held on July12-15 ,2007 – Orlando, Florida, USA.