Local Termination Criteria for Swarm Intelligence: A Comparison Between Local Stochastic Diffusion Search and Ant Nest-Site Selection

  • Andrew O. Martin
  • J. Mark BishopEmail author
  • Elva J. H. Robinson
  • Darren R. Myatt
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11370)


Stochastic diffusion search (SDS) is a global Swarm Intelligence optimisation technique based on the behaviour of ants, rooted in the partial evaluation of an objective function and direct communication between agents. Although population based decision mechanisms employed by many Swarm Intelligence methods can suffer poor convergence resulting in ill-defined halting criteria and loss of the best solution, as a result of its resource allocation mechanism, the solutions found by Stochastic Diffusion Search enjoy excellent stability.

Previous implementations of SDS have deployed stopping criteria derived from global properties of the agent population; this paper examines new local SDS halting criteria and compares their performance with ‘quorum sensing’ (a termination criterion naturally deployed by some species of tandem-running ants). In this chapter we discuss two experiments investigating the robustness and efficiency of the new local termination criteria; our results demonstrate these to be (a) effectively as robust as the classical SDS termination criteria and (b) almost three times faster.


Collective decision making Ant nest selection Stochastic Diffusion Search Swarm Intelligence Global Search 


  1. 1.
    Aleksander, I., Stonham, T.J.: Guide to pattern recognition using random access memories. Comput. Digit. Tech. 2(1), 29–40 (1979)CrossRefGoogle Scholar
  2. 2.
    Al-Rifaie, M.M., Bishop, J.M.: Stochastic diffusion search review. J. Behav. Robot. 4(3), 155–173 (2013)Google Scholar
  3. 3.
    Anoop, K., Sumana, A.: Response to a change in the target nest during ant relocation. J. Exp. Biol. 218(6), 887–92 (2015)CrossRefGoogle Scholar
  4. 4.
    Arthur, W.B.: Inductive reasoning and bounded rationality (The El Farol Problem). Amer. Econ. Rev. 84, 406–411 (1994)Google Scholar
  5. 5.
    Back, T.: Evolutionary Algorithms in Theory and Practice. Oxford University Press, Oxford (1996)zbMATHGoogle Scholar
  6. 6.
    Beattie, P.D., Bishop, J.M.: Self-localisation in the ‘SENARIO’ autonomous wheelchair. J. Intell. Robot. Syst. 22, 255–267 (1998)CrossRefGoogle Scholar
  7. 7.
    Bishop, J.M.: Stochastic Searching Networks. In: Proceedings of 1st IEE International Conference on Artificial Neural Networks. IEE Conference Publication (313), pp. 329–331. IEE, London (1989)Google Scholar
  8. 8.
    Bishop, J.M.: Anarchic techniques for pattern classification. Ph.D. thesis, Reading University, UK (1989)Google Scholar
  9. 9.
    Bishop, J.M., Torr, P.H.S.: The stochastic search network. In: Linggard, R., Myers, D.J., Nightingale, C. (eds.) Neural Networks for Images, Speech and Natural Language. Chapman Hall, New York (1992)Google Scholar
  10. 10.
    Bishop, J.M., Nasuto, S.J., De Meyer, K.: Dynamic knowledge representation in connectionist systems. In: Dorronsoro, J.R. (ed.) Artificial Neural Networks ICANN. LNCS, vol. 2415, pp. 308–313. Springer, Heidelberg (2002). Scholar
  11. 11.
    Bishop, J.M., Andrew, O.M., Robinson, E.J.H.: Local termination criteria for stochastic diffusion search: a comparison with the behaviour of ant nest-site selection. In: Nguyen, N., Iliadis, L., Yannis, M., Bogdan, T. (eds.) Computational Collective Intelligence. Lecture Notes in Computer Science, vol. 9875, pp. 474–486. Springer, Heidelberg (2016). Scholar
  12. 12.
    Bonabeau, E., Dorigo, M., Theraulaz, G.: Swarm Intelligence: From Natural to Artificial Systems. Oxford University Press, Oxford (1999)zbMATHGoogle Scholar
  13. 13.
    Bonabeau, E., Dorigo, M., Theraulaz, G.: Inspiration for optimisation from social insect behaviour. Nature 406, 3942 (2000)CrossRefGoogle Scholar
  14. 14.
    Cao, T.T.: High social density increases foraging and scouting rates and induces polydomy in Temnothorax ants. Behav. Ecol. Sociobiol. 67(11), 1799–1807 (2013)CrossRefGoogle Scholar
  15. 15.
    Carroll, C.R., Janzen, D.H.: Ecology of foraging by ants. Annu. Rev. Ecol. Syst. 4, 231–257 (1973)CrossRefGoogle Scholar
  16. 16.
    Chadab, R., Rettenmeyer, C.: Mass recruitment by army ants. Science 188, 1124–1125 (1975)CrossRefGoogle Scholar
  17. 17.
    Deneubourg, J.L., Pasteels, J.M., Verhaeghe, J.C.: Probabilistic behaviour in ants: a strategy of errors? J. Theor. Biol. 105(2), 259–271 (1983)CrossRefGoogle Scholar
  18. 18.
    Dornhaus, A., Franks, N.R., Hawkins, R.M., Shere, H.N.S.: Ants move to improve: colonies of Leptothorax albipennis emigrate whenever they find a superior nest site. Anim. Behav. 67(5), 959–963 (2004)CrossRefGoogle Scholar
  19. 19.
    Dornhaus, A., Holley, J.A., Pook, V.G., Worswick, G., Franks, N.R.: Why do not all workers work? Colony size and workload during emigrations in the ant Temnothorax albipennis. Behav. Ecol. Sociobiol. 63(1), 43–51 (2008)CrossRefGoogle Scholar
  20. 20.
    Dorigo, M., Maniezzo, V., Colorni, A.: Positive feedback as a search strategy, Dipartimento di Elettronica e Informatica, Politecnico di (1991)Google Scholar
  21. 21.
    Dorigo, M.: Optimisation, learning and natural algorithms. Politecnico di Italy, Milano (1992)Google Scholar
  22. 22.
    Dorigo, M., Caro, G.D., Gambardella, L.M.: Ant algorithms for discrete optimisation. Artif. Life 5(2), 137–172 (1999)CrossRefGoogle Scholar
  23. 23.
    Franklin, E.L.: The journey of tandem running: the twists, turns and what we have learned. Insectes Sociaux 61, 1–8 (2014)CrossRefGoogle Scholar
  24. 24.
    Franks, N.R., Dornhaus, A., Metherell, B., Nelson, T., Lanfear, S.A., Symes, W.: Not everything that counts can be counted: ants use multiple metrics for a single nest trait. Proc. R. Soc. Lond. Ser. B 273, 165–169 (2006)CrossRefGoogle Scholar
  25. 25.
    Franks, N.R., Hooper, J.W., Dornhaus, A., Aukett, P.J., Hayward, A.L., Berghoff, S.M.: Reconnaissance and latent learning in ants. Proc. R. Soc. Lond. Ser. B 274(1617), 1505–1509 (2007)CrossRefGoogle Scholar
  26. 26.
    Franks, N.R., et al.: Moving targets: collective decisions and flexible choices in house-hunting ants. Swarm Intell. 1(2), 81–94 (2007)CrossRefGoogle Scholar
  27. 27.
    Franks, N.R., Mallon, E.B., Bray, H.E., Hamilton, M.J., Mischler, T.C.: Strategies for choosing between alternatives with different attributes: exemplified by house-hunting ants. Anim. Behav. 65, 215–223 (2003)CrossRefGoogle Scholar
  28. 28.
    Frank, N.R., et al.: How ants use quorum sensing to estimate the average quality of a fluctuating resource. Sci. Rep. 5, 11890 (2015)CrossRefGoogle Scholar
  29. 29.
    Goldberg, D.: Genetic Algorithms in Search, Optimisation and Machine Learning. Addison Wesley, Reading (1989)zbMATHGoogle Scholar
  30. 30.
    Goodman, L.J., Fisher, R.C.: The Behaviour and Physiology of Bees. CAB International, Oxon (1991)Google Scholar
  31. 31.
    Grech-Cini, E.: Locating facial features. Ph.D. dissertation, University of Reading, Reading UK (1995)Google Scholar
  32. 32.
    Holldobler, B., Wilson, E.O.: The Ants. Springer, Heidelberg (1990)CrossRefGoogle Scholar
  33. 33.
    Holland, J.H.: Adaptation in Natural and Artificial Systems. The University of Michigan Press, Ann Arbor (1975)Google Scholar
  34. 34.
    Fan, H., Hua, Z., Li, J.J., Yuan, D.: Solving a shortest path problem by ant algorithm. In: Proceedings of 2004 International Conference on Machine Learning and Cybernetics, vol. 5, pp. 3174–3177 (2004)Google Scholar
  35. 35.
    Krieger, M.J., Billeter, J.B., Keller, L.: Ant-like task allocation and recruitment in cooperative robots. Nature 406(6799), 992–995 (2000)CrossRefGoogle Scholar
  36. 36.
    Iosifescu, M.: Finite Markov Processes and Their Applications. Wiley, Chichester (1980)zbMATHGoogle Scholar
  37. 37.
    Kennedy, J., Eberhart, R.C., Shi, Y.: Swarm Intelligence. Morgan Kauffman, San Francisco (2001)Google Scholar
  38. 38.
    Kennedy, J., Eberhart, R.C.: Particle swarm optimisation. In: Proceedings of the IEEE International Conference on Neural Networks IV, pp. 1942–1948 (1995)Google Scholar
  39. 39.
    Kramer, B.H., Scharf, I., Foitzik, S.: The role of per-capita productivity in the evolution of small colony sizes in ants. Behav. Ecol. Sociobiol. 68(1), 41–53 (2013)CrossRefGoogle Scholar
  40. 40.
    De Meyer, K.: Explorations in stochastic diffusion search: soft and hardware implementations of biologically inspired spiking neuron stochastic diffusion networks. Technical report KDM/JMB/2000-1. University of Reading, Reading UK (2000)Google Scholar
  41. 41.
    De Meyer, K., Bishop, J.M., Nasuto, S.J.: Small world network behaviour of stochastic diffusion search. In: Dorronsoro, J.R. (ed.) Artificial Neural Networks, ICANN, Madrid. LNCS, vol. 2415, pp. 147–152. Springer, Heidelberg (2002). Scholar
  42. 42.
    De Meyer, K., Nasuto, S.J., Bishop, J.M.: Stochastic diffusion optimisation: the application of partial function evaluation and stochastic recruitment. In: Abraham, A., Grosam, C., Ramos, V. (eds.) Stigmergic Optimisation. SCI, vol. 31, pp. 185–207. Springer, Heidelberg (2006). Scholar
  43. 43.
    Kurvers, R.H.J.M., Wolf, M., Krause, J.: Humans use social information to adjust their quorum thresholds adaptively in a simulated predator detection experiment. Behav. Ecol. Sociobiol. 68(3), 449–456 (2014)CrossRefGoogle Scholar
  44. 44.
    Miller, M.B., Bassler, B.L.: Quorum sensing in bacteria. Annu. Rev. Microbiol. 55(1), 165–199 (2001)CrossRefGoogle Scholar
  45. 45.
    Mitrus, S.: The cavity-nest ant Temnothorax crassispinus prefers larger nests. Insectes Sociaux 62(1), 43–49 (2015)CrossRefGoogle Scholar
  46. 46.
    Moglich, M., Maschwitz, U., Holldobler, B.: Tandem calling: a new kind of signal in ant communication. Science 186(4168), 1046–1047 (1974)CrossRefGoogle Scholar
  47. 47.
    Mugford, S.T., Mallon, E.B., Franks, N.R.: The accuracy of Buffon’s needle: a rule of thumb used by ants to estimate area. Behav. Ecol. 12, 655–658 (2001)CrossRefGoogle Scholar
  48. 48.
    Myatt, D.M., Bishop, J.M., Nasuto, S.J.: Minimum stable convergence criteria for stochastic diffusion search. Electron. Lett. 22(40), 112–113 (2004)CrossRefGoogle Scholar
  49. 49.
    Myatt, D., M., Nasuto, S.J., Bishop J.M., : Alternative recruitment strategies for SDS. In: Proceedings of AISB06: Symposium on Exploration vs. Exploitation in Naturally Inspired Search, Bristol, UK, pp. 181–187 (2006)Google Scholar
  50. 50.
    Nasuto, S.J.: Analysis of resource allocation of stochastic diffusion search. Ph.D. dissertation. University of Reading, Reading UK (1999)Google Scholar
  51. 51.
    Nasuto, S.J., Bishop, J.M.: Convergence of the stochastic diffusion search. Parallel Algorithms Appl. 14, 89–107 (1999)CrossRefGoogle Scholar
  52. 52.
    Nasuto, S.J., Bishop, J.M., Lauria, S.: Time complexity of stochastic diffusion search. In: Heiss, M. (ed) Proceedings of International ICSC/IFAC Symposium on Neural Computation, Vienna (1998)Google Scholar
  53. 53.
    Nasuto, S.J., Dautenhahn, K., Bishop, J.M.: Communication as an emergent metaphor for neuronal operation. In: Nehaniv, C. (ed.) Computation for Metaphors, Analogy, and Agents. LNCS, vol. 1562, pp. 365–379. Springer, Heidelberg (1999). Scholar
  54. 54.
    Nasuto, S.J., Bishop, J.M., De Meyer, K.: Communicating neurons: a connectionist spiking neuron implementation of stochastic diffusion search. Neurocomputing 72(4–6), 704–712 (2008)Google Scholar
  55. 55.
    Nasuto, S.J., Bishop, J.M.: Steady state resource allocation analysis of the stochastic diffusion search. Biol. Inspired Cogn. Arch. 12, 65–76 (2015)Google Scholar
  56. 56.
    Neumaier, A.: Complete search in continuous global optimisation and constraint satisfaction. In: Isereles, A. (ed.) Acta Numerica 2004. Cambridge University Press, Cambridge UK (2004)Google Scholar
  57. 57.
    Pratt, S.C.: Behavioural mechanisms of collective nest-site choice by the ant Temnothorax curvispinosus. Insectes Sociaux 52, 383–392 (2005)CrossRefGoogle Scholar
  58. 58.
    Pratt, S.C.: Quorum sensing by encounter rates in the ant Temnothorax albipennis. Behav. Ecol. 16, 488–496 (2005)CrossRefGoogle Scholar
  59. 59.
    Pratt, S.C., Mallon, E.B., Sumpter, D.J.T., Franks, N.R.: Quorum sensing, recruitment, and collective decision-making during colony emigration by the ant Leptothorax albipennis. Behav. Ecol. Sociobiol. 52(2), 117–127 (2002)CrossRefGoogle Scholar
  60. 60.
    Pratt, S.C., Pierce, N.E.: The cavity-dwelling ant Leptothorax curvispinosus uses nest geometry to discriminate among potential homes. Anim. Behav. 62, 281–287 (2001)CrossRefGoogle Scholar
  61. 61.
    Pratt, S.C., Sumpter, D.J.T., Mallon, E.B., Franks, N.R.: An agent-based model of collective nest site choice by the ant Temnothorax albipennis. Anim. Behav. 70, 1023–1036 (2005)CrossRefGoogle Scholar
  62. 62.
    Robinson, E.J.H., Feinerman, O., Franks, N.R.: How collective comparisons emerge without individual comparisons of the options. Proc. Royal Soc. B 281, 20140737 (2014). Scholar
  63. 63.
    Robinson, E.J.H., Franks, N.R., Ellis, S., Okuda, S., Marshall, J.A.R.: A simple threshold rule is sufficient to explain sophisticated collective decision-making. PLoS One 6, e19981 (2011)CrossRefGoogle Scholar
  64. 64.
    Robinson, E.J.H., Smith, F.D., Sullivan, K.M.E., Franks, N.R.: Do ants make direct comparisons? Proc. Royal Soc. B 276, 2635–2641 (2009)CrossRefGoogle Scholar
  65. 65.
    Sasaki, T., Colling, B., Sonnenschein, A., Boggess, M.M., Pratt, S.C.: Flexibility of collective decision making during house hunting in Temnothorax ants. Behav. Ecol. Sociobiol. 69, 707–714 (2015)CrossRefGoogle Scholar
  66. 66.
    Sasaki, T., Pratt, S.C.: Emergence of group rationality from irrational individuals. Behav. Ecol. 22(2), 276–281 (2011)CrossRefGoogle Scholar
  67. 67.
    Seeley, T.D.: The Wisdom of the Hive. Harvard University Press, Cambridge (1995)Google Scholar
  68. 68.
    Seeley, T.D., Visscher, P.K.: Quorum sensing during nest-site selection by honeybee swarms. Behav. Ecol. Sociobiol. 56, 594–601 (2004)CrossRefGoogle Scholar
  69. 69.
    Seeley, T.D., Visscher, P.K., Schlegel, T., Hogan, P.M., Franks, N.R., Marshall, J.A.R.: Stop signals provide cross inhibition in collective decision-making by honey bee swarms. Science 335, 108–111 (2012)CrossRefGoogle Scholar
  70. 70.
    Stroeymeyt, N., Robinson, E.J.H., Hogan, P.M., Marshall, J.A.R., Giurfa, M., Franks, N.R.: Experience-dependent flexibility in collective decision-making by house-hunting ants. Behav. Ecol. 22(3), 535–542 (2011)CrossRefGoogle Scholar
  71. 71.
    Sueur, C., Deneubourg, J.L., Petit, O.: Sequence of quorums during collective decision making in macaques. Behav. Ecol. Sociobiol. 64, 1875–1885 (2010)CrossRefGoogle Scholar
  72. 72.
    Sumpter, D.J.T., Pratt, S.C.: Quorum responses and consensus decision making. Proc. R. Soc. B 364(1518), 743–753 (2009)Google Scholar
  73. 73.
    Ward, A.J.W., Sumpter, D.J.T., Couzin, I.D., Hart, P.J.B., Krause, J.: Quorum decision-making facilitates information transfer in fish shoals. Proc. Nat. Acad. Sci. 105(19), 6948–6953 (2008)CrossRefGoogle Scholar
  74. 74.
    Whitaker, R.M., Hurley, S.: An agent based approach to site selection for wireless networks. In: Proceedings of 2002 ACM Symposium on Applied Computing (Madrid), pp. 574–577. ACM, New York (2002)Google Scholar
  75. 75.
    Wilson, E.O.: Communication by tandem running in the ant genus Cardiocondyla. Psyche 66(3), 29–34 (1959)CrossRefGoogle Scholar
  76. 76.
    Wilson, E.O.: Chemical communication among workers of the fire ant Solenopsis saevissima (Fr. Smith) 1. The organisation of mass-foraging. Anim. Behav. 10, 134–147 (1962)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2019

Authors and Affiliations

  • Andrew O. Martin
    • 1
  • J. Mark Bishop
    • 1
    Email author
  • Elva J. H. Robinson
    • 2
  • Darren R. Myatt
    • 3
  1. 1.TCIDA, Goldsmiths, University of LondonNew Cross, LondonUK
  2. 2.York Centre for Complex Systems Analysis and Department of BiologyUniversity of YorkYorkUK
  3. 3.Acrefield House, Belle Vue EstateLondonUK

Personalised recommendations