Behaviour-Based Web Spambot Detection by Utilising Action Time and Action Frequency

  • Pedram Hayati
  • Kevin Chai
  • Vidyasagar Potdar
  • Alex Talevski
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6017)


Web spam is an escalating problem that wastes valuable resources, misleads people and can manipulate search engines in achieving undeserved search rankings to promote spam content. Spammers have extensively used Web robots to distribute spam content within Web 2.0 platforms. We referred to these web robots as spambots that are capable of performing human tasks such as registering user accounts as well as browsing and posting content. Conventional content-based and link-based techniques are not effective in detecting and preventing web spambots as their focus is on spam content identification rather than spambot detection. We extend our previous research by proposing two action-based features sets known as action time and action frequency for spambot detection. We evaluate our new framework against a real dataset containing spambots and human users and achieve an average classification accuracy of 94.70%.


Web spambot detection Web 2.0 spam spam 2.0 user behaviour 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Gyongyi, Z., Garcia-Molina, H.: Web spam taxonomy. In: Proceedings of the 1st International Workshop on Adversarial Information Retrieval on the Web, Chiba, Japan (2005)Google Scholar
  2. 2.
    Hayati, P., Potdar, V.: Toward Spam 2.0: An Evaluation of Web 2.0 Anti-Spam Methods. In: 7th IEEE International Conference on Industrial Informatics Cardiff, Wales (2009)Google Scholar
  3. 3.
    Tan, P.-N., Kumar, V.: Discovery of Web Robot Sessions Based on their Navigational Patterns. Data Mining and Knowledge Discovery 6, 9–35 (2002)CrossRefMathSciNetGoogle Scholar
  4. 4.
    Hayati, P., Chai, K., Potdar, V., Talevski, A.: HoneySpam 2.0: Profiling Web Spambot Behaviour. In: 12th International Conference on Principles of Practise in Multi-Agent Systems, Nagoya, Japan, pp. 335–344 (2009)Google Scholar
  5. 5.
    von Ahn, L., Blum, M., Hopper, N., Langford, J.: CAPTCHA: Using Hard AI Problems for Security. In: Biham, E. (ed.) EUROCRYPT 2003. LNCS, vol. 2656, pp. 646–646. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  6. 6.
    Mertz, D.: Charming Python: Beat spam using hashcash, (2004), (August 3, 2009) (Accessed)
  7. 7.
    Park, K., Pai, V.S., Lee, K.-W., Calo, S.: Securing Web Service by Automatic Robot Detection. In: USENIX 2006 Annual Technical Conference Refereed Paper (2006)Google Scholar
  8. 8.
    Uemura, T., Ikeda, D., Arimura, H.: Unsupervised Spam Detection by Document Complexity Estimation. In: Discovery Science, pp. 319–331 (2008)Google Scholar
  9. 9.
    Sarafijanovic, S., Le Boudec, J.-Y.: Artificial Immune System for Collaborative Spam Filtering. In: Nature Inspired Cooperative Strategies for Optimization (NICSO 2007), pp. 39–51 (2008)Google Scholar
  10. 10.
    Ogbuji, U.: Real Web 2.0: Battling Web spam (August 3, 2009) (2008), (Accessed)
  11. 11.
    Abram, H., Michael, W.G., Richard, C.H.: Reverse Engineering CAPTCHAs. In: Proceedings of the 2008 15th Working Conference on Reverse Engineering, vol. 00. IEEE Computer Society, Los Alamitos (2008)Google Scholar
  12. 12.
    Salvatore, J.S., Shlomo, H., Chia-Wei, H., Wei-Jen, L., Olivier, N., Ke, W.: Behavior-based modeling and its application to Email analysis. ACM Trans. Internet Technol. 6, 187–221 (2006)CrossRefGoogle Scholar
  13. 13.
    Le, Z., Jingbo, Z., Tianshun, Y.: An evaluation of statistical spam filtering techniques. ACM Transactions on Asian Language Information Processing (TALIP) 3, 243–269 (2004)CrossRefGoogle Scholar
  14. 14.
    Cooley, R., Mobasher, B., Srivastava, J.: Data Preparation for Mining World Wide Web Browsing Patterns. Knowledge and Information Systems 1, 5–32 (1999)Google Scholar
  15. 15.
    Cooley, R., Mobasher, B., Srivastava, J.: Web mining: information and pattern discovery on the World Wide Web. In: Proceedings of Ninth IEEE International Conference on Tools with Artificial Intelligence 1997, pp. 558–567 (1997)Google Scholar
  16. 16.
    Chang, C., Lin, C.: LIBSVM: a library for support vector machines, S. a. a. Ed (2001),
  17. 17.
    Rijsbergen, C.J.V.: Information retrieval Butterworths (1979)Google Scholar
  18. 18.
    Yiqun, L., Rongwei, C., Min, Z., Shaoping, M., Liyun, R.: Identifying web spam with user behavior analysis. In: Proceedings of the 4th international workshop on Adversarial information retrieval on the web, ACM (2008)Google Scholar
  19. 19.
    Yu, H., Liu, Y., Zhang, M., Ru, L., Ma, S.: Web Spam Identification with User Browsing Graph. Information Retrieval Technology, 38–49 (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Pedram Hayati
    • 1
  • Kevin Chai
    • 1
  • Vidyasagar Potdar
    • 1
  • Alex Talevski
    • 1
  1. 1.Anti-Spam Research Lab (ASRL) Digital Ecosystem and Business Intelligence InstituteCurtin UniversityPerthWestern Australia

Personalised recommendations