Skip to main content
Log in

Query-specific optimal convolutional neural ranker

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

In this paper, we propose a novel learning-to-rank method by developing a convolutional neural network (CNN)-based ranking score estimation function (ranker). We use the query, query-specific preference, and the neighborhood structure to regularize the learning of the CNN ranker parameters. We propose to impose the CNN outputs of a query-preferred data object to be larger than that of a data object which the query tries to avoid. Also we hope the ranking scores of the data objects can be smooth over neighborhoods and the ranking score of the query itself can be large. We construct a joint unified minimization problem by combining these regularization problems to learn the parameters of CNN, and develop an iterative algorithm based on fix-point method. The experiments over the benchmark data sets of image retrieval and ship roll motion prediction show its effectiveness.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Akiyama H, Tsuji M, Aramaki S (2016) Learning evaluation function for decision making of soccer agents using learning to rank. In: Proceedings—2016 joint 8th international conference on soft computing and intelligent systems and 2016 17th international symposium on advanced intelligent systems, SCIS–ISIS 2016, pp 239–242

  2. Burges C, Shaked T, Renshaw E, Lazier A, Deeds M, Hamilton N, Hullender G (2005) Learning to rank using gradient descent. In: Proceedings of the 22nd international conference on Machine learning. ACM, pp 89–96

  3. Cao Z, Qin T, Liu TY, Tsai MF, Li H (2007) Learning to rank: from pairwise approach to listwise approach. In: Proceedings of the 24th international conference on Machine learning. ACM, pp 129–136

  4. Chen Y, Xie W, Gunter CA, Liebovitz D, Mehrotra S, Zhang H, Malin B (2015) Inferring clinical workflow efficiency via electronic medical record utilization. In: AMIA annual symposium proceedings, vol 2015. American Medical Informatics Association, p 416

  5. Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) ImageNet: a large-scale hierarchical image database. In: IEEE conference on computer vision and pattern recognition, CVPR 2009, IEEE, pp 248–255

  6. Duan Y, Liu F, Jiao L, Zhao P, Zhang L (2017) Sar image segmentation based on convolutional-wavelet neural network and markov random field. Pattern Recognit 64:255–267

    Article  Google Scholar 

  7. Fan J, Liang RZ (2016) Stochastic learning of multi-instance dictionary for earth movers distance-based histogram comparison. Neural Comput Appl. doi:10.1007/s00521-016-2603-2

  8. Fei-Fei L, Fergus R, Perona P (2006) One-shot learning of object categories. IEEE Trans Pattern Anal Mach Intell 28(4):594–611

    Article  Google Scholar 

  9. Geng Y, Liang RZ, Li W, Wang J, Liang G, Xu C, Wang JY (2016) Learning convolutional neural network to maximize pos@ top performance measure. arXiv preprint arXiv:1609.08417

  10. Haas R, Hummel B (2017) Learning to rank extract method refactoring suggestions for long methods. Lecture Notes Bus Inf Process 269:45–56

    Article  Google Scholar 

  11. Li L, Yao Y, Tang J, Fan W, Tong H (2016) Quint: on query-specific optimal networks. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 985–994

  12. Li Q, Zhou X, Gu A, Li Z, Liang RZ (2016) Nuclear norm regularized convolutional max pos@top machine. Neural Comput Appl. doi:10.1007/s00521-016-2680-2

  13. Liang RZ, Shi L, Wang H, Meng J, Wang JJY, Sun Q, Gu Y (2016) Optimizing top precision performance measure of content-based image retrieval by learning similarity function. In: 2016 23st International conference on pattern recognition (ICPR). IEEE

  14. Liang RZ, Xie W, Li W, Wang H, Wang JJY, Taylor L (2016) A novel transfer learning method based on common space mapping and weighted domain matching. In: 2016 IEEE 28th international conference on tools with artificial intelligence (ICTAI). IEEE, pp 299–303

  15. Liu Y, Chen X, Peng H, Wang Z (2017) Multi-focus image fusion with a deep convolutional neural network. Inf Fusion 36:191–207

    Article  Google Scholar 

  16. Ma L, Liu X, Gao Y, Zhao Y, Zhao X, Zhou C (2017) A new method of content based medical image retrieval and its applications to ct imaging sign retrieval. J Biomed Inform 66:148–158

    Article  Google Scholar 

  17. Mao H, Liu H, Shi P (2008) Neighbor-constrained active contour without edges. In: IEEE computer society conference on computer vision and pattern recognition workshops, 2008. CVPRW’08, IEEE, pp 1–7

  18. Mao H, Liu H, Shi P (2010) A convex neighbor-constrained active contour model for image segmentation. In: 2010 17th IEEE international conference on image processing (ICIP), IEEE, pp 793–796

  19. Piras L, Giacinto G (2017) Information fusion in content based image retrieval: a comprehensive overview. Inf Fusion 37:50–60

    Article  Google Scholar 

  20. Ren X, Chen K, Yang X, Zhou Y, He J, Sun J (2017) A novel scene text detection algorithm based on convolutional neural network. In: VCIP 2016—30th anniversary of visual communication and image processing, p 7805444. doi:10.1109/VCIP.2016.7805444

  21. Shi B, Chen Y, Zhang P, Smith CD, Liu J, Initiative ADN et al (2017) Nonlinear feature transformation and deep fusion for alzheimer’s disease staging analysis. Pattern Recognit 63:487–498

    Article  Google Scholar 

  22. Tian Q, Li B (2016) Weakly hierarchical lasso based learning to rank in best answer prediction. In: Proceedings of the 2016 IEEE/ACM international conference on advances in social networks analysis and mining, ASONAM 2016, pp 307–314

  23. Wang H, Wang J (2014) An effective image representation method using kernel classification. In: 2014 IEEE 26th international conference on tools with artificial intelligence (ICTAI 2014), pp 853–858

  24. Wu Y, Wang L, Cui F, Zhai H, Dong B, Wang JY (2017) Cross-model convolutional neural network for multiple modality data representation. Neural Comput Appl. doi:10.1007/s00521-016-2824-4

  25. Xia Z, Xiong N, Vasilakos A, Sun X (2017) Epcbir: an efficient and privacy-preserving content-based image retrieval scheme in cloud computing. Inf Sci 387:195–204

    Article  Google Scholar 

  26. Xu J, Xu B, Wang P, Zheng S, Tian G, Zhao J, Xu B (2017) Self-taught convolutional neural networks for short text clustering. Neural Netw 88:22–31

    Article  Google Scholar 

  27. Yang Y, Nie F, Xu D, Luo J, Zhuang Y, Pan Y (2012) A multimedia retrieval framework based on semi-supervised ranking and relevance feedback. IEEE Trans Pattern Anal Mach Intell 34(4):723–742

    Article  Google Scholar 

  28. Yang Z, Awasthi M, Ghosh M, Mi N (2016) A fresh perspective on total cost of ownership models for flash storage in datacenters. In: 8th IEEE international conference on cloud computing technology and science (CloudCom 2016). IEEE

  29. Yang Z, Tai J, Bhimani J, Wang J, Mi N, Sheng B (2016) Grem: Dynamic ssd resource allocation in virtualized storage systems with heterogeneous vms. In: 35th IEEE international performance computing and communications conference (IPCCC 2016). IEEE

  30. Yin JC, Wang NN (2013) Online grey prediction of ship roll motion using variable rbfn. Appl Artif Intell 27(10):941–960

    Article  Google Scholar 

  31. Yin JC, Zou ZJ, Xu F (2013) On-line prediction of ship roll motion during maneuvering using sequential learning rbf neuralnetworks. Ocean Eng 61:139–147

    Article  Google Scholar 

  32. Yin JC, Zou ZJ, Xu F, Wang NN (2014) Online ship roll motion prediction based on grey sequential extreme learning machine. Neurocomputing 129:168–174

    Article  Google Scholar 

  33. Yin Z, Kong D, Shao G, Ning X, Jin W, Wang JY (2016) A-optimal convolutional neural network. Neural Comput Appl. doi:10.1007/s00521-016-2783-9

  34. Zhang H, Cao X, Ho JK, Chow TW (2017) Object-level video advertising: an optimization framework. IEEE Trans Ind Inform 13(2):520–531

    Article  Google Scholar 

  35. Zhang H, Li J, Ji Y, Yue H (2017) Understanding subtitles by character-level sequence-to-sequence learning. IEEE Trans Ind Inform 13(2):616–624

    Article  Google Scholar 

  36. Zhang P, Kong X (2009) Detecting image tampering using feature fusion. In: International Conference on availability, reliability and security, 2009. ARES’09. IEEE, pp 335–340

  37. Zhang P, Shi B, Smith CD, Liu J (2016) Nonlinear metric learning for semi-supervised learning via coherent point drifting. In: 2016 15th IEEE international conference on machine learning and applications (ICMLA). IEEE, pp 314–319

  38. Zhanying L, Jun X, Bo L, Jue W (2015) Prediction of ship roll motion based on optimized chaotic diagonal recurrent neural networks. Int J Multimed Ubiquitous Eng 10(4):231–242

    Article  Google Scholar 

  39. Zheng T, Xie W, Xu L, He X, Zhang Y, You M, Yang G, Chen Y (2017) A machine learning-based framework to identify type 2 diabetes through electronic health records. Int J Med Inform 97:120–127

    Article  Google Scholar 

  40. Zhou D, Weston J, Gretton A, Bousquet O, Schölkopf B (2004) Ranking on data manifolds. In: Advances in neural information processing systems, vol 3, pp 169–176

  41. Zhu L, Shen J, Xie L, Cheng Z (2017) Unsupervised visual hashing with semantic assistant for content-based image retrieval. IEEE Trans Knowl Data Eng 29(2):472–486

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by China Scholarship Council, Grant No. 201406685066.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Feng Liu.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest for the work reported in this paper.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yao, J., Liu, F. & Geng, Y. Query-specific optimal convolutional neural ranker. Neural Comput & Applic 31, 3107–3116 (2019). https://doi.org/10.1007/s00521-017-3257-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-017-3257-4

Keywords

Navigation