CRAWL: A Trace Routing Algorithm Based on Hybrid Two-Layer Topology

  • Li-ming ZhengEmail author
  • Wen-feng Long
  • Yu-Jia Liu
  • Wei-dong Sun
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 927)


Data distribution is a key technology for resources convergence and sharing in distributed environment. To better meet the requirement for real time data distribution in the dynamic network, a trace routing algorithm named CRAWL based on the hybrid two-layered topology is put forward. The algorithm contains an overlay topology named CBDLO, upper of which consists of multiple distributed balanced binary trees corresponding to different properties and the lower of which is an unstructured topology. CRAWL forwards the data on the lower unstructured topology in the form of random walk, so that the data can be sent to the corresponding upper topology entry. It also includes a matching algorithm named CDM for the parallel matching data properties on the upper distributed and balanced binary tree and transmitting the matched data to the nodes that are interested in the data. The experimental results show that the algorithm can effectively support large-scale data distribution in a dynamical network, reduce distribution overhead and matching delays.


Data distribution Publish/subscribe Message routing Data matching 


  1. 1.
    Dell-Imagine, R.: JTIDS-an overview of the system design and implementation (Joint Tactical Information Distribution System). In: Position Location and Navigation Symposium, San Diego, California, pp. 212–215 (2013)Google Scholar
  2. 2.
  3. 3.
    Eugster, P.T., Felber, P., Guerraoui, R., et al.: The many faces of publish/subscribe. ACM Comput. Surv. (CSUR) 35(2), 114–131 (2003)CrossRefGoogle Scholar
  4. 4.
    Castro, M., Druschel, P., Kermarrec, A., et al.: SCRIBE: a large-scale and decentralized application-level multicast infrastructure. IEEE J. Sel. Areas Commun. 20(8), 1489–1499 (2012)CrossRefGoogle Scholar
  5. 5.
    Rahimian, F., Girdzijauskas, S., Payberah, A.H., et al.: Vitis: a gossip-based hybrid overlay for internet-scale publish/subscribe enabling rendezvous routing in unstructured overlay networks. In: IEEE International Parallel & Distributed Processing Symposium (IPDPS), pp. 746–757 (2011)Google Scholar
  6. 6.
    Zheng, Z., Wang, Y., Ma, X.: PeerChatter: a peer-to-peer architecture for data distribution over social networks. Inf.-Int. Interdisc. J. 15(1), 259–266 (2011)Google Scholar
  7. 7.
    Pietzuch, P., Hermes, B.J.: A distributed event-based middleware architecture. In: 22nd International Conference on Distributed Computing Systems Workshops, pp. 611–618 (2012)Google Scholar
  8. 8.
    Gupta, A., Sahin, O.D., Agrawal, D., et al.: Meghdoot: content-based publish/subscribe over P2P networks. In: Proceedings of the 5th ACM/IFIP/USENIX international conference on Middleware (Middleware), pp. 254–273 (2004)Google Scholar
  9. 9.
    Grummt, E.: Fine-grained parallel XML filtering for content-based publish/subscribe systems. In: Proceedings of the 5th ACM International Conference on Distributed Event-Based System, pp. 219–228 (2011)Google Scholar
  10. 10.
    Li, M., Ye, F., Kim, M., et al.: A scalable and elastic publish/subscribe service. In: IEEE International Parallel & Distributed Processing Symposium (IPDPS), pp. 1254–1265 (2011)Google Scholar
  11. 11.
    Cao, F., Singh, J.P.: MEDYM: match-early with dynamic multicast for content-based publish-subscribe networks. In: Proceedings of the ACM/IFIP/USENIX International Conference on Middleware (Middleware), pp. 292–313 (2005)Google Scholar
  12. 12.
    Wong, B., Guha, S.: Quasar: a probabilistic publish-subscribe system for social networks. In: Proceedings of the 7th International Workshop on Peer-to-Peer Systems, pp. 2–7 (2008)Google Scholar
  13. 13.
    Aekaterinidis, I., Triantafillou, P.: PastryStrings: a comprehensive content-based publish/subscribe DHT network. In: IEEE 26nd International Conference on Distributed Computing Systems (ICDCS), pp. 23–32 (2006)Google Scholar
  14. 14.
    Baldoni, R., Marchetti, C., Virgillito, A., et al.: Content-based publish-subscribe over structured overlay networks. In: IEEE 25nd International Conference on Distributed Computing Systems (ICDCS), pp. 437–446 (2014)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Li-ming Zheng
    • 1
    Email author
  • Wen-feng Long
    • 1
  • Yu-Jia Liu
    • 1
  • Wei-dong Sun
    • 2
  1. 1.Department of Message CommunicationArmed Police Officer AcademyChengduChina
  2. 2.National Key Laboratory for Parallel and Distributed Processing, School of ComputerNational University of Defense TechnologyChangshaChina

Personalised recommendations