Skip to main content

DQN Aided Edge Computing in Satellite-Terrestrial Network

  • Conference paper
  • First Online:
Wireless and Satellite Systems (WiSATS 2019)

Abstract

In order to support a mass of current satellite applications, it becomes a trend to integrate satellite networks with terrestrial networks, called satellite-terrestrial networks. However, traditional network protocols cannot adapt to the dynamic and complex satellite-terrestrial network. Moreover, the computing and communication capabilities of some satellites cannot meet the requirements of supporting various applications. As a result, the paper proposes an edge computing based software-defined satellite-terrestrial network architecture, which can manage network flexibly by logically centralizing network intelligence and control. Furthermore, a networking and edge computing scheme is proposed by formulating a jointly optimization problem, which is solved by using novel deep Q-learning approach. Simulation results show the effectiveness of the proposed scheme.

Supported by the Key Program of the National Natural Science Foundation of China (61431008).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Kaneko, K., Nishiyama, H., Kato, N., Miura, A., Toyoshima, M.: Construction of a flexibility analysis model for flexible high-throughput satellite communication systems with a digital channelizer. IEEE Trans. Veh. Technol. 67(3), 2097–2107 (2018)

    Article  Google Scholar 

  2. Yao, H., Wang, L., Wang, X., Lu, Z., Liu, Y.: The space-terrestrial integrated network (STIN): an overview. IEEE Commun. Mag. 16(99), 2–9 (2018)

    Google Scholar 

  3. Yang, B., Yue, W., Chu, X., Song, G.: Seamless handover in software-defined satellite networking. IEEE Commun. Lett. 20(9), 1768–1771 (2016)

    Article  Google Scholar 

  4. Feng, B., et al.: HetNet: a flexible architecture for heterogeneous satellite-terrestrial networks. IEEE Netw. 31(6), 86–92 (2017)

    Article  Google Scholar 

  5. Li, T., Zhou, H., Luo, H., You, I., Xu, Q.: SAT-FLOW: multi-strategy flow table management for software defined satellite networks. IEEE Access 5, 14952–14965 (2017)

    Article  Google Scholar 

  6. Boero, L., Marchese, M., Patrone, F.: The impact of delay in software-defined integrated terrestrial-satellite networks. China Commun. 15(8), 11–21 (2018)

    Article  Google Scholar 

  7. Liu, J., Shi, Y., Zhao, L., Cao, Y., Sun, W., Kato, N.: Joint placement of controllers and gateways in SDN-enabled 5G-satellite integrated network. IEEE J. Sel. Areas Commun. 36(2), 221–232 (2018)

    Article  Google Scholar 

  8. Huang, H., Guo, S., Wang, K.: Envisioned wireless big data storage for low-earth-orbit satellite-based cloud. IEEE Wirel. Commun. 25(1), 26–31 (2018)

    Article  Google Scholar 

  9. He, T.Y., Zhao, N., Yin, H.: Integrated networking, caching and computing for connected vehicles: a deep reinforcement learning approach. IEEE Trans. Veh. Technol. (2017)

    Google Scholar 

  10. Mnih, V., et al.: Human-level control through deep reinforcement learning. Nature 518(7540), 529 (2015)

    Article  Google Scholar 

  11. Chilimbi, T.M., Suzue, Y., Apacible, J., Kalyanaraman, K.: Project adam: building an efficient and scalable deep learning training system. In: OSDI, vol. 14, pp. 571–582 (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fangmin Xu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Xu, F., Yang, F., Qiu, C., Zhao, C., Li, B. (2019). DQN Aided Edge Computing in Satellite-Terrestrial Network. In: Jia, M., Guo, Q., Meng, W. (eds) Wireless and Satellite Systems. WiSATS 2019. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 280. Springer, Cham. https://doi.org/10.1007/978-3-030-19153-5_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-19153-5_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-19152-8

  • Online ISBN: 978-3-030-19153-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics