Skip to main content

Information-Directed Routing in Sensor Networks Using Real-Time Reinforcement Learning

  • Chapter
Combinatorial Optimization in Communication Networks

Part of the book series: Combinatorial Optimization ((COOP,volume 18))

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. F. Zhao, J. Shin, and J. Reich, “Information-driven dynamic sensor collaboration,” IEEE Signal Processing Magazine, vol. 19, pp. 61–72, Mar. 2002.

    Article  Google Scholar 

  2. R. Brooks, C. Griffin, and D. Friedlander, “Self-organized distributed sensor network entity tracking,” International Journal of High-Performance Computing Applications, vol. 16, no. 3, 2002.

    Google Scholar 

  3. J. Liu, J. E. Reich, and F. Zhao, “Collaborative in-network processing for target tracking,” EURASIP, Journal on Applied Signal Processing, vol. 2003, pp. 378–391, Mar. 2003.

    Article  Google Scholar 

  4. T. Clausen, G. Hansen, L. Christensen, and G. Behrmann, “The optimized link state routing protocol, evaluation through experiments and simulation,” in IEEE Symposium on Wireless Personal Mobile Communication, 2001.

    Google Scholar 

  5. C. E. Perkins and P. Bhagwat, “Highly dynamic destination-sequenced distance-vector routing (DSDV) for mobile computers,” Computer Communications Review, pp. 234–244, 1994.

    Google Scholar 

  6. C. E. Perkins and E. M. Royer, “Ad-hoc on-demand distance vector routing,” in Proc. 2nd IEEE Workshop on Mobile Computer System and Applications, pp. 90–100, Feb. 1999.

    Google Scholar 

  7. Q. Li, J. Aslam, and D. Rus, “Online power-aware routing in wireless ad hoc networks,” in Proc. MobiCom (Rome, Italy), July 2001.

    Google Scholar 

  8. R. C. Shah and J. M. Rabaey, “Energy aware routing for low energy ad hoc sensor networks,” in Proc. IEEE Wireless Communication and Networking Conference (Orlando, FL), Mar. 2001.

    Google Scholar 

  9. B. Karp and H. T. Kung, “Greedy perimeter stateless routing for wireless networks,” in Proc. of MobiCom (Boston, MA), Aug. 2000.

    Google Scholar 

  10. Y.-B. Ko and N. H. Vaidya, “Geocasting in mobile ad hoc networks: Location-based multicast algorithms,” in Proc. IEEE Workshop on Mobile Computer Systems and Applications (New Orleans), Feb. 1999.

    Google Scholar 

  11. C. Intanagonwiwat, R. Govindan, and D. Estrin, “Directed diffusion: A scalable and robust communication paradigm for sensor networks,” in Proc. MobiCOM 2000 (Boston, MA), Aug. 2000.

    Google Scholar 

  12. S. Chen, “Distributed quality-of-service routing in ad hoc networks,” IEEE Journal on Selected Areas in Communications, vol. 17, no. 8, Aug. 1999.

    Google Scholar 

  13. K. Chen, S. H. Shah and K. Nahrstedt, “Cross-layer design for data accessibility in mobile ad hoc networks,” Wireless Personal Communication, no. 21, pp. 49–76, 2002.

    Article  Google Scholar 

  14. Y. Zhang and M. Fromherz, “Message-initiated constraint-based routing for wireless ad hoc sensor networks,” in Proc. IEEE Consumer Communication and Networking Conference, Jan. 2004.

    Google Scholar 

  15. Y. Zhang, M. Fromherz and L. Kuhn, “Smart routing with learning-based QoS-aware meta-strategies,” in Proc. Quality of Service in the Emerging Networking, Lecture Notes in Computer Science, vol. 3266, pp. 298–307, 2004.

    Google Scholar 

  16. M. Chu, H. Haussecker, and F. Zhao, “Scalable information-driven sensor querying and routing for ad hoc heterogeneous sensor networks,” International Journal of High-Performance Computing Applications, vol. 16, no. 3, 2002.

    Google Scholar 

  17. J. Liu, F. Zhao and D. Petrovic, “Information-directed routing in ad hoc sensor networks,” IEEE Journal on Selected Areas in Communications, Special issue on Self-Organizing Distributed Collaborative Sensor Networks, vol. 23, no. 4, pp. 851–861, 2005.

    Article  Google Scholar 

  18. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York, John Wiley and Sons, Inc., 1991.

    Google Scholar 

  19. Q. Huang, C. Lu, and G.-C. Roman, “Mobicast: Just-in-time multicast for sensor networks under spatiotemporal constraints,” in Information Processing in Sensor Networks, Proc. of IPSN 2003, Apr. 2003.

    Google Scholar 

  20. R. Korf, “Real-time heuristic search,” Artificial Intelligence, vol. 42, pp. 189–211, 1990.

    Article  MATH  Google Scholar 

  21. S. Koenig, “Agent-centered search,” AI Magazine, vol. 22, no. 4, pp. 109–131, 2001.

    MathSciNet  Google Scholar 

  22. R. S. Sutton and A. G. Barto, editors, “Reinforcement learning: an introduction,” Cambridge, MA, MIT Press, 1998.

    Google Scholar 

  23. J. A. Boyan and M. L. Littman, “Packet routing in dynamically changing networks: A reinforcement learning approach,” edited by J. D. Crowan, G. Tesauro, and J. Alspector, in Advances in Neural Information Processing Systems, vol. 6, pp. 671–678, San Francisco, Morgan Kaufmann, 1994.

    Google Scholar 

  24. G. Simon, “Probabilistic wireless network simulator,” in http://www.isis.vanderbilt.edu/projects/nest/prowler/.

    Google Scholar 

  25. E. J. Cockayne and D. G. Schiller, “Computation of Steiner minimal trees,” in Combinatorics (Conference on Combinatorial Mathematics) (D. J. A. Welsh and D. R. Woodall, eds.), (Southend-on-Sea, Essex, England), pp. 53–71, Institute of Math. and Its Applications, 1972.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer Science+Business Media, Inc.

About this chapter

Cite this chapter

Zhang, Y., Liu, J., Zhao, F. (2006). Information-Directed Routing in Sensor Networks Using Real-Time Reinforcement Learning. In: Cheng, M.X., Li, Y., Du, DZ. (eds) Combinatorial Optimization in Communication Networks. Combinatorial Optimization, vol 18. Springer, Boston, MA. https://doi.org/10.1007/0-387-29026-5_11

Download citation

  • DOI: https://doi.org/10.1007/0-387-29026-5_11

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-0-387-29025-6

  • Online ISBN: 978-0-387-29026-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics