Advertisement

Coordinated Placement of Meteorological Workflows and Data with Privacy Conflict Protection

  • Tao Huang
  • Shengjun XueEmail author
  • Yumei Hu
  • Qing Yang
  • Yachong Tian
  • Dan Zeng
Conference paper
  • 16 Downloads
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 322)

Abstract

Cloud computing is cited by various industries for its powerful computing power to solve complex calculations in the industry. The massive data of meteorological department has typical big data characteristics. Therefore, cloud computing has been gradually applied to deal with a large number of meteorological -services. Cloud computing increases the computational speed of meteorological services, but data transmission between nodes also generates additional data transmission time. At the same time, based on cloud computing technology, a large number of computing tasks are cooperatively processed by multiple nodes, so improving the resource utilization of each node is also an important evaluation indicator. In addition, with the increase of data confidentiality, there are some data conflicts between some data, so the conflicting data should be avoided being placed on the same node. To cope with this challenge, the meteorological application is modeled and a collaborative placement method for tasks and data based on Differential Evolution algorithm (CPDE) is proposed. The Non-dominated Sorting Differential Evolution (NSDE) algorithm is used to jointly optimize the average data access time, the average resource utilization of nodes and the data conflict degree. Finally, a large number of experimental evaluations and comparative analyses verify the efficiency of our proposed CPDE method.

Keywords

Meteorological Coordinated placement NSDE Data access time Resource utilization Data conflict 

Notes

Acknowledgment

This research is supported by the Scientific Research Project of Silicon Lake College under Grant No. 2018KY23.

References

  1. 1.
    Li, X., Li, D., Wan, J., Vasilakos, A.V., Lai, C.-F., Wang, S.: A review of industrial wireless networks in the context of industry 4.0. Wireless Netw. 23(1), 23–41 (2015).  https://doi.org/10.1007/s11276-015-1133-7CrossRefGoogle Scholar
  2. 2.
    Lin, B., et al.: A time-driven data placement strategy for a scientific workflow combining edge computing and cloud computing. IEEE Trans. Ind. Inf. 15(7), 4254–4265 (2019)CrossRefGoogle Scholar
  3. 3.
    Tang, J., Tang, X., Yuan, J.: Traffic-optimized data placement for social media. IEEE Trans. Multimedia 20, 1008–1023 (2017)CrossRefGoogle Scholar
  4. 4.
    Li, X., et al.: A novel workflow-level data placement strategy for data-sharing scientific cloud workflows. IEEE Trans. Serv. Comput. 12, 370–383 (2019)CrossRefGoogle Scholar
  5. 5.
    Dong, Y., Yang, Y., Liu, X., Chen, J.: A data placement strategy in scientific cloud workflows. Future Gener. Comput. Syst. 26(8), 1200–1214 (2010)CrossRefGoogle Scholar
  6. 6.
    Deng, K., Kong, L., Song, J., Ren, K., Dong, Y.: A weighted k-means clustering based co-scheduling strategy towards efficient execution of scientific workflows in collaborative cloud environments. In: IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing, DASC 2011, 12–14 December 2011, Sydney, Australia, pp. 547–554 (2011)Google Scholar
  7. 7.
    Kim, H., Kim, Y.: An adaptive data placement strategy in scientific workflows over cloud computing environments. In: NOMS 2018–2018 IEEE/IFIP Network Operations and Management Symposium, pp. 1–5 (2018)Google Scholar
  8. 8.
    Kashlev, A., Lu, S., Ebrahimi, M., Mohan, A.: BDAP: a big data placement strategy for cloud-based scientific workflows. In: 2015 IEEE First International Conference on Big Data Computing Service and Applications, pp. 813–820 (2015)Google Scholar
  9. 9.
    Liao, Z., Yu, B., Liu, K., Wang, J.: Learning-based adaptive data placement for low latency in data center networks. In: IEEE 43rd Conference on Local Computer Networks (2018)Google Scholar
  10. 10.
    Whaiduzzaman, M., Gani, A., Naveed, A. PEFC: performance enhancement framework for cloudlet in mobile cloud computing. In: IEEE-ROMA-2014, pp. 224–229 (2014)Google Scholar
  11. 11.
    Xu, X. et al.: A multi-objective data placement method for IoT applications over big data using NSGA-II. In: IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData), pp. 503–509 (2018)Google Scholar
  12. 12.
    Chen, T., Zhu, Y., Gao, X., Kong, L., Chen, G., Wang, Y.: Improving resource utilization via virtual machine placement in data center networks. Mobile Netw. Appl. 23(2), 227–238 (2017).  https://doi.org/10.1007/s11036-017-0925-7CrossRefGoogle Scholar
  13. 13.
    Cui, L., Zhang, J., Yue, L., Shi, Y., Li, H., Yuan, D.: A genetic algorithm based data replica placement strategy for scientific applications in clouds. IEEE Trans. Serv. Comput. 11(4), 727–739 (2015)CrossRefGoogle Scholar
  14. 14.
    Kang, S., Veeravalli, B., Aung, K.M.M.: A security-aware data placement mechanism for big data cloud storage systems. In: IEEE 2nd International Conference on Big Data Security on Cloud (BigDataSecurity), IEEE International Conference on High Performance and Smart Computing (HPSC) and IEEE International Conference on Intelligent Data and Security (IDS), pp. 327–332 (2016)Google Scholar
  15. 15.
    Wang, R., Yiwen, L., Zhu, K., Hao, J., Wang, P., Cao, Y.: An optimal task placement strategy in geo-distributed data centers involving renewable energy. IEEE Access 6, 61948–61958 (2018)CrossRefGoogle Scholar
  16. 16.
    Liu, L., Song, J., Wang, H.: BRPS: a big data placement strategy for data intensive applications. In: IEEE 16th International Conference on Data Mining Workshops (ICDMW), pp. 813–820 (2016)Google Scholar
  17. 17.
    Shu, J., Liu, X., Jia, X., Yang, K., Deng, R.H.: Anonymous privacy-preserving task matching in crowdsourcing. IEEE Internet Things J. 5(4), 3068–3078 (2018)CrossRefGoogle Scholar
  18. 18.
    Chi, Z., Wang, Y., Huang, Y., Tong, X.: The novel location privacy-preserving CKD for mobile systems. IEEE Access 6, 5678–5687 (2018)CrossRefGoogle Scholar

Copyright information

© ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2020

Authors and Affiliations

  • Tao Huang
    • 1
  • Shengjun Xue
    • 1
    • 2
    Email author
  • Yumei Hu
    • 3
  • Qing Yang
    • 1
  • Yachong Tian
    • 1
  • Dan Zeng
    • 4
  1. 1.School of Computer Science and TechnologySilicon Lake CollegeSuzhouChina
  2. 2.School of Computer and SoftwareNanjing University of Information Science and TechnologyNanjingChina
  3. 3.Shanghai Huanan Environmental Management Limited CompanyShanghaiChina
  4. 4.Library of Wuhan University of TechnologyWuhan University of TechnologyHubeiChina

Personalised recommendations