A Deep Self-learning Classification Framework for Incomplete Medical Patents with Multi-label

  • Mengzhen Luo
  • Xiaoyu Shi
  • Qianqian Ji
  • Mingsheng Shang
  • Xianbo HeEmail author
  • Weiguo Tao
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1075)


The classification of medical patents play an important role for pharmaceutical company, since medical patens with well labeled can significantly accelerate the process of new drug research. The previous studies using machine learning methods focus on classification the medical patents with single label. However, the classification of medical patents is a multi-label task, and the available data are always incomplete with losing the part information of patents. In this paper, we propose a deep self-learning classification framework that can deal with the incomplete medical patterns with multi-label issue. It consists of a text processor and patent classifier. For the text processor, a professional medical text thesaurus is built via GloVe method, which can learn more specialized vocabulary. For the patent classifier, we adopt a bidirectional long short term memory (Bi-LSTM) model to construct our patent classifier, which can learn the hidden knowledge from medical patents and associate with appropriate labels to medical patents automatically. Furthermore, an advanced focal loss function is design to further improve the classification accuracy. Experiments on the Thomson Reuters dataset demonstrate that our proposed method outperform the other existing methods in terms of precision and recall, when dealing with incomplete medical patents with multi-label issue. ...


Multi-label classification Medical patents Bi-LSTM Text process Focal loss 



This work was supported by Chongqing research program of technology innovation and application under grant cstc2018jszx-cyztzxX0025 and cstc2017rgzn-zdyfX0020, the National Natural Science Foundation of China under Grant 61602434, the Chongqing research program of key standard technologies innovation of key industries under grant cstc2017zdcy-zdyfX0076, the Youth Innovation Promotion Association CAS, No.2017393 and the Sichuan Science and Technology Department Project 2018GFW0151.


  1. 1.
    Bin, W., Yanni, M., Xiaoqi, P., Guangmei, L., Shengju, D.: Patent protection strategy of technical standards in medical innovation. Chin. J. New Drugs (2018)Google Scholar
  2. 2.
    Korde, V., Mahender, C.: Text classification and classifiers: a survey. Int. J. Artif. Intell. Appl. 3(2), 85 (2012) Google Scholar
  3. 3.
    WIPO: World intellectual property indicators 2018. Geneva: World Intellectual Property Organization (2019).
  4. 4.
    Hongguang, L., Shuanggang, M., Guifeng, L.: A review of research on patent document classification algorithms based on machine learning. Libr. Inf. Stud. 3, 79–86 (2016)Google Scholar
  5. 5.
    Wu, C.H., Ken, Y., Huang, T.: Patent classification system using a new hybrid genetic algorithm support vector machine. Appl. Soft Comput. 10(4), 1164–1177 (2010)CrossRefGoogle Scholar
  6. 6.
    Chen, Y.L., Chang, Y.C.: A three-phase method for patent classification. Inf. Process. Manag. 48(6), 1017–1030 (2012)CrossRefGoogle Scholar
  7. 7.
    Liao, L., Le, F., Zhu, Y.: The application of LDA model in patent text classification. J. Mod. Inf. 37(3), 35–39 (2017)Google Scholar
  8. 8.
    Jie, H., Li, S.: A patent classification model based on convolutional neural networks and rand forest. Sci. Technol. Eng. 18(6), 268–272 (2018)MathSciNetGoogle Scholar
  9. 9.
    Li, S.: DeepPatent: patent classification with convolutional neural networks and word embedding. Scientometrics 117, 721–744 (2018)CrossRefGoogle Scholar
  10. 10.
    Pennington, J., Socher, R., Manning C.D.: Glove: global vectors for word representation. In: EMNLP, pp. 1532–1543(2014)Google Scholar
  11. 11.
    Bengio, Y.: Learning long-term dependencies with gradient descent is difficult. IEEE Trans. Neural Netw. 5, 157–166 (1994)CrossRefGoogle Scholar
  12. 12.
    Zhang, M., Zhou, Z.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 26(8), 1819–1837 (2014)CrossRefGoogle Scholar
  13. 13.
    Lin, T.Y., Goyal, P., Girshick, R.: Focal loss for dense object detection. IEEE Trans. Pattern Anal. Mach. Intell. PP(99), 2999–3007 (2017)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Mengzhen Luo
    • 1
  • Xiaoyu Shi
    • 2
  • Qianqian Ji
    • 2
  • Mingsheng Shang
    • 2
  • Xianbo He
    • 1
    Email author
  • Weiguo Tao
    • 1
    • 2
  1. 1.The Computer School of China West Normal UniversityNanchongChina
  2. 2.Chongqing Key Laboratory of Big Data and Intelligent Computing, Chongqing Institute of Green and Intelligent TechnologyChinese Academy of SciencesChongqingChina

Personalised recommendations