Skip to main content

Efficient User Preferences-Based Top-k Skyline Using MapReduce

  • Conference paper
  • First Online:
Data Science (ICPCSEE 2018)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 901))

Abstract

As an important variant of skyline query, top-k skyline can find the best k points as the final results. In order to generate the results meeting the needs of users for massive data, we propose an efficient user preferences-based top-k skyline combining partially and totally ordered domains in MapReduce, named \(P/T\_SKY\_MR\). The whole course contains two main phases, partially ordered domains processing and totally ordered domains processing. In partially ordered domains processing, we propose the binary encoding and a pruning strategy to present the precedence relationship about the partially ordered domains and different user preferences. Meanwhile, in totally ordered domains processing, for finding the final results, a defined ranking criterion is also proposed in order to reduce the calculation cost and minimize the response time. A large number of experiments show that our method is effective, flexible and scalable.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Lee, J., You, G., Hwang, S.: Personalized top-k skyline queries in high-dimensional space. Inf. Syst. 34(1), 45–61 (2009)

    Article  Google Scholar 

  2. Cheong Fung, G.P., Lu, W., Yang, J., Du, X., Zhou, X.: Extract interesting skyline points in high dimension. In: Kitagawa, H., Ishikawa, Y., Li, Q., Watanabe, C. (eds.) DASFAA 2010. LNCS, vol. 5982, pp. 94–108. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-12098-5_7

    Chapter  Google Scholar 

  3. Gao, Y., Hu, J., Chen, G., Chen, C.: Finding the most desirable skyline objects. In: Kitagawa, H., Ishikawa, Y., Li, Q., Watanabe, C. (eds.) DASFAA 2010. LNCS, vol. 5982, pp. 116–122. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-12098-5_9

    Chapter  Google Scholar 

  4. Benouaret, K., Benslimane, D., HadjAli, A.: Selecting skyline web services for multiple users preferences. In: ICWS, Hawaii, pp. 635–636 (2012)

    Google Scholar 

  5. Bouadi, T., Cordier, M.-O., Quiniou, R.: Computing skyline incrementally in response to online preference modification. In: Hameurlain, A., Küng, J., Wagner, R., Liddle, S.W., Schewe, K.-D., Zhou, X. (eds.) Transactions on Large-Scale Data- and Knowledge-Centered Systems X. LNCS, vol. 8220, pp. 34–59. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-41221-9_2

    Chapter  Google Scholar 

  6. Nguyen, H.T.H., Cao, J.: Preference-based top-k representative skyline queries on uncertain databases. In: Cao, T., Lim, E.-P., Zhou, Z.-H., Ho, T.-B., Cheung, D., Motoda, H. (eds.) PAKDD 2015. LNCS, vol. 9078, pp. 280–292. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-18032-8_22

    Chapter  Google Scholar 

  7. Li, Y., Qu, W., Li, Z., et al.: Skyline query based on user preference with MapReduce. In: DASC, Dalian, pp. 153–158 (2014)

    Google Scholar 

  8. Jiang, T., Zhang, B., Lin, D.: Incremental evaluation of top-k combinatorial metric skyline query. Knowl.-Based Syst. 74, 89–105 (2015)

    Article  Google Scholar 

  9. Jheng, R.S., Wang, E.T., Chen, A.L.P.: Determining top-k candidates by reverse constrained skyline queries. In: DATA, pp. 101–110 (2015)

    Google Scholar 

  10. Siddique, M.A., Morimoto, Y.: Efficient selection of various k-objects for a keyword query based on MapReduce skyline algorithm. In: Madaan, A., Kikuchi, S., Bhalla, S. (eds.) DNIS 2014. LNCS, vol. 8381, pp. 40–52. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-05693-7_3

    Chapter  Google Scholar 

  11. Song, B., Liu, A., Ding, L.: Efficient top-k skyline computation in MapReduce. In: IEEE WISA, pp. 67–70 (2015)

    Google Scholar 

  12. Siddique, M.A., Tian, H., Morimoto, Y.: Selecting representative objects from large database by using K-skyband and top-k dominating queries in MapReduce environment. In: Luo, X., Yu, J.X., Li, Z. (eds.) ADMA 2014. LNCS, vol. 8933, pp. 560–572. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-14717-8_44

    Chapter  Google Scholar 

  13. Siddique, Md.A., Tian, H., Morimoto, Y.: k-dominant skyline query computation in MapReduce environment. IEICE Trans. Inf. Syst. 98–D(5), 1027–1034 (2015)

    Google Scholar 

  14. Borzsony, S., Kossmann, D., Stocker, K.: The skyline operator. In: 17th International Conference on Data Engineering, pp. 421–430. IEEE (2001)

    Google Scholar 

  15. Lee, J., You, G.W., Sohn, I.C., et al.: Supporting personalized top-k skyline queries using partial compressed skycube. In: Proceedings of the 9th Annual ACM International Workshop on Web Information and Data Management, pp. 65–72. ACM (2007)

    Google Scholar 

Download references

Acknowledgment

This work is supported by National Natural Science Foundation of China (No. 61472169, 61502215), Science Research Normal Fund of Liaoning Province Education Department (No. L2015193), Doctoral Scientific Research Start Foundation of Liaoning Province (No. 201501127), National Key Research and Development Program of China (No. 2016YFC0801406).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Baoyan Song .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ding, L., Zhang, X., Sun, M., Liu, A., Song, B. (2018). Efficient User Preferences-Based Top-k Skyline Using MapReduce. In: Zhou, Q., Gan, Y., Jing, W., Song, X., Wang, Y., Lu, Z. (eds) Data Science. ICPCSEE 2018. Communications in Computer and Information Science, vol 901. Springer, Singapore. https://doi.org/10.1007/978-981-13-2203-7_7

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-2203-7_7

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-2202-0

  • Online ISBN: 978-981-13-2203-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics