Query-specific optimal convolutional neural ranker

Original Article


In this paper, we propose a novel learning-to-rank method by developing a convolutional neural network (CNN)-based ranking score estimation function (ranker). We use the query, query-specific preference, and the neighborhood structure to regularize the learning of the CNN ranker parameters. We propose to impose the CNN outputs of a query-preferred data object to be larger than that of a data object which the query tries to avoid. Also we hope the ranking scores of the data objects can be smooth over neighborhoods and the ranking score of the query itself can be large. We construct a joint unified minimization problem by combining these regularization problems to learn the parameters of CNN, and develop an iterative algorithm based on fix-point method. The experiments over the benchmark data sets of image retrieval and ship roll motion prediction show its effectiveness.


Learning to rank Convolutional neural network Query-specific preference Ship roll motion prediction 



This work was supported by China Scholarship Council, Grant No. 201406685066.

Compliance with ethical standards

Conflict of interest

The authors declare no conflict of interest for the work reported in this paper.


  1. 1.
    Akiyama H, Tsuji M, Aramaki S (2016) Learning evaluation function for decision making of soccer agents using learning to rank. In: Proceedings—2016 joint 8th international conference on soft computing and intelligent systems and 2016 17th international symposium on advanced intelligent systems, SCIS–ISIS 2016, pp 239–242Google Scholar
  2. 2.
    Burges C, Shaked T, Renshaw E, Lazier A, Deeds M, Hamilton N, Hullender G (2005) Learning to rank using gradient descent. In: Proceedings of the 22nd international conference on Machine learning. ACM, pp 89–96Google Scholar
  3. 3.
    Cao Z, Qin T, Liu TY, Tsai MF, Li H (2007) Learning to rank: from pairwise approach to listwise approach. In: Proceedings of the 24th international conference on Machine learning. ACM, pp 129–136Google Scholar
  4. 4.
    Chen Y, Xie W, Gunter CA, Liebovitz D, Mehrotra S, Zhang H, Malin B (2015) Inferring clinical workflow efficiency via electronic medical record utilization. In: AMIA annual symposium proceedings, vol 2015. American Medical Informatics Association, p 416Google Scholar
  5. 5.
    Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) ImageNet: a large-scale hierarchical image database. In: IEEE conference on computer vision and pattern recognition, CVPR 2009, IEEE, pp 248–255Google Scholar
  6. 6.
    Duan Y, Liu F, Jiao L, Zhao P, Zhang L (2017) Sar image segmentation based on convolutional-wavelet neural network and markov random field. Pattern Recognit 64:255–267CrossRefGoogle Scholar
  7. 7.
    Fan J, Liang RZ (2016) Stochastic learning of multi-instance dictionary for earth movers distance-based histogram comparison. Neural Comput Appl. doi: 10.1007/s00521-016-2603-2
  8. 8.
    Fei-Fei L, Fergus R, Perona P (2006) One-shot learning of object categories. IEEE Trans Pattern Anal Mach Intell 28(4):594–611CrossRefGoogle Scholar
  9. 9.
    Geng Y, Liang RZ, Li W, Wang J, Liang G, Xu C, Wang JY (2016) Learning convolutional neural network to maximize pos@ top performance measure. arXiv preprint arXiv:1609.08417
  10. 10.
    Haas R, Hummel B (2017) Learning to rank extract method refactoring suggestions for long methods. Lecture Notes Bus Inf Process 269:45–56CrossRefGoogle Scholar
  11. 11.
    Li L, Yao Y, Tang J, Fan W, Tong H (2016) Quint: on query-specific optimal networks. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 985–994Google Scholar
  12. 12.
    Li Q, Zhou X, Gu A, Li Z, Liang RZ (2016) Nuclear norm regularized convolutional max pos@top machine. Neural Comput Appl. doi: 10.1007/s00521-016-2680-2
  13. 13.
    Liang RZ, Shi L, Wang H, Meng J, Wang JJY, Sun Q, Gu Y (2016) Optimizing top precision performance measure of content-based image retrieval by learning similarity function. In: 2016 23st International conference on pattern recognition (ICPR). IEEEGoogle Scholar
  14. 14.
    Liang RZ, Xie W, Li W, Wang H, Wang JJY, Taylor L (2016) A novel transfer learning method based on common space mapping and weighted domain matching. In: 2016 IEEE 28th international conference on tools with artificial intelligence (ICTAI). IEEE, pp 299–303Google Scholar
  15. 15.
    Liu Y, Chen X, Peng H, Wang Z (2017) Multi-focus image fusion with a deep convolutional neural network. Inf Fusion 36:191–207CrossRefGoogle Scholar
  16. 16.
    Ma L, Liu X, Gao Y, Zhao Y, Zhao X, Zhou C (2017) A new method of content based medical image retrieval and its applications to ct imaging sign retrieval. J Biomed Inform 66:148–158CrossRefGoogle Scholar
  17. 17.
    Mao H, Liu H, Shi P (2008) Neighbor-constrained active contour without edges. In: IEEE computer society conference on computer vision and pattern recognition workshops, 2008. CVPRW’08, IEEE, pp 1–7Google Scholar
  18. 18.
    Mao H, Liu H, Shi P (2010) A convex neighbor-constrained active contour model for image segmentation. In: 2010 17th IEEE international conference on image processing (ICIP), IEEE, pp 793–796Google Scholar
  19. 19.
    Piras L, Giacinto G (2017) Information fusion in content based image retrieval: a comprehensive overview. Inf Fusion 37:50–60CrossRefGoogle Scholar
  20. 20.
    Ren X, Chen K, Yang X, Zhou Y, He J, Sun J (2017) A novel scene text detection algorithm based on convolutional neural network. In: VCIP 2016—30th anniversary of visual communication and image processing, p 7805444. doi: 10.1109/VCIP.2016.7805444
  21. 21.
    Shi B, Chen Y, Zhang P, Smith CD, Liu J, Initiative ADN et al (2017) Nonlinear feature transformation and deep fusion for alzheimer’s disease staging analysis. Pattern Recognit 63:487–498CrossRefGoogle Scholar
  22. 22.
    Tian Q, Li B (2016) Weakly hierarchical lasso based learning to rank in best answer prediction. In: Proceedings of the 2016 IEEE/ACM international conference on advances in social networks analysis and mining, ASONAM 2016, pp 307–314Google Scholar
  23. 23.
    Wang H, Wang J (2014) An effective image representation method using kernel classification. In: 2014 IEEE 26th international conference on tools with artificial intelligence (ICTAI 2014), pp 853–858Google Scholar
  24. 24.
    Wu Y, Wang L, Cui F, Zhai H, Dong B, Wang JY (2017) Cross-model convolutional neural network for multiple modality data representation. Neural Comput Appl. doi: 10.1007/s00521-016-2824-4
  25. 25.
    Xia Z, Xiong N, Vasilakos A, Sun X (2017) Epcbir: an efficient and privacy-preserving content-based image retrieval scheme in cloud computing. Inf Sci 387:195–204CrossRefGoogle Scholar
  26. 26.
    Xu J, Xu B, Wang P, Zheng S, Tian G, Zhao J, Xu B (2017) Self-taught convolutional neural networks for short text clustering. Neural Netw 88:22–31CrossRefGoogle Scholar
  27. 27.
    Yang Y, Nie F, Xu D, Luo J, Zhuang Y, Pan Y (2012) A multimedia retrieval framework based on semi-supervised ranking and relevance feedback. IEEE Trans Pattern Anal Mach Intell 34(4):723–742CrossRefGoogle Scholar
  28. 28.
    Yang Z, Awasthi M, Ghosh M, Mi N (2016) A fresh perspective on total cost of ownership models for flash storage in datacenters. In: 8th IEEE international conference on cloud computing technology and science (CloudCom 2016). IEEEGoogle Scholar
  29. 29.
    Yang Z, Tai J, Bhimani J, Wang J, Mi N, Sheng B (2016) Grem: Dynamic ssd resource allocation in virtualized storage systems with heterogeneous vms. In: 35th IEEE international performance computing and communications conference (IPCCC 2016). IEEEGoogle Scholar
  30. 30.
    Yin JC, Wang NN (2013) Online grey prediction of ship roll motion using variable rbfn. Appl Artif Intell 27(10):941–960CrossRefGoogle Scholar
  31. 31.
    Yin JC, Zou ZJ, Xu F (2013) On-line prediction of ship roll motion during maneuvering using sequential learning rbf neuralnetworks. Ocean Eng 61:139–147CrossRefGoogle Scholar
  32. 32.
    Yin JC, Zou ZJ, Xu F, Wang NN (2014) Online ship roll motion prediction based on grey sequential extreme learning machine. Neurocomputing 129:168–174CrossRefGoogle Scholar
  33. 33.
    Yin Z, Kong D, Shao G, Ning X, Jin W, Wang JY (2016) A-optimal convolutional neural network. Neural Comput Appl. doi: 10.1007/s00521-016-2783-9
  34. 34.
    Zhang H, Cao X, Ho JK, Chow TW (2017) Object-level video advertising: an optimization framework. IEEE Trans Ind Inform 13(2):520–531CrossRefGoogle Scholar
  35. 35.
    Zhang H, Li J, Ji Y, Yue H (2017) Understanding subtitles by character-level sequence-to-sequence learning. IEEE Trans Ind Inform 13(2):616–624CrossRefGoogle Scholar
  36. 36.
    Zhang P, Kong X (2009) Detecting image tampering using feature fusion. In: International Conference on availability, reliability and security, 2009. ARES’09. IEEE, pp 335–340Google Scholar
  37. 37.
    Zhang P, Shi B, Smith CD, Liu J (2016) Nonlinear metric learning for semi-supervised learning via coherent point drifting. In: 2016 15th IEEE international conference on machine learning and applications (ICMLA). IEEE, pp 314–319Google Scholar
  38. 38.
    Zhanying L, Jun X, Bo L, Jue W (2015) Prediction of ship roll motion based on optimized chaotic diagonal recurrent neural networks. Int J Multimed Ubiquitous Eng 10(4):231–242CrossRefGoogle Scholar
  39. 39.
    Zheng T, Xie W, Xu L, He X, Zhang Y, You M, Yang G, Chen Y (2017) A machine learning-based framework to identify type 2 diabetes through electronic health records. Int J Med Inform 97:120–127CrossRefGoogle Scholar
  40. 40.
    Zhou D, Weston J, Gretton A, Bousquet O, Schölkopf B (2004) Ranking on data manifolds. In: Advances in neural information processing systems, vol 3, pp 169–176Google Scholar
  41. 41.
    Zhu L, Shen J, Xie L, Cheng Z (2017) Unsupervised visual hashing with semantic assistant for content-based image retrieval. IEEE Trans Knowl Data Eng 29(2):472–486CrossRefGoogle Scholar

Copyright information

© The Natural Computing Applications Forum 2017

Authors and Affiliations

  1. 1.College of Shipbuilding EngineeringHarbin Engineering UniversityHarbinChina
  2. 2.Department of Naval Architecture, Ocean and Marine EngineeringUniversity of StrathclydeGlasgowUK
  3. 3.Provincial Key Laboratory for Computer Information Processing TechnologySoochow UniversitySuzhouChina

Personalised recommendations