Syntactic Analysis of Power Grid Emergency Pre-plans Based on Transfer Learning

  • He Shi
  • Qun YangEmail author
  • Bo Wang
  • Shaohan Liu
  • Kai Zhou
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11936)


To deal with the emergency pre-plans saved by the power grid dispatch department, so that the dispatcher can quickly retrieve and match similar accidents in the pre-plans, then they can learn from the experience of previous relevant situations, it is necessary to extract the information of the pre-plans and extract its key information. Therefore, deep learning method with strong generalization ability and learning ability and continuous improvement of model can be adopted. However, this method usually requires a large amount of data, but the existing labeling data in the power grid field is limited and the manual method for data labeling is a huge workload. Therefore, in the case of insufficient data, this paper aims to solve how to use deep learning method for effective information extraction? This paper modifies the ULMFiT model and uses it to carry out word vector training, adopting transfer learning method to introduce annotating datasets in the open field and combining with the data in the field of power grid to training model. In this way, the semantic relation of power grid domain is introduced into the syntactic analysis of the pre-plans, and we can further complete the information extraction. Experimental verification is carried out in this paper, the results show that, in the case of insufficient corpus or small amount of annotated data, this method can solve the problem of part of speech analysis errors, it can also improve the accuracy of syntactic analysis, and the experimental verifies the effectiveness of this method.


Transfer learning Word vector Syntactic analysis 


  1. 1.
    Lu, Q., Liu, X.Y.: Knowledge map q&a semantic matching model based on transfer learning. Comput. Appl. 335(7), 22–28 (2018)MathSciNetGoogle Scholar
  2. 2.
    Long, M., Cao, Y., Wang, J.: Learning Transferable Features with Deep Adaptation Networks. arXiv:1408.0872 (2015)
  3. 3.
    Liu, D., Chen, Y., Shen, C.: Study on digital method of power emergency plan. Autom. Power Syst. 33(21) (2009)Google Scholar
  4. 4.
    Wu, W.C., Zhang, B.M., Cao, F.C.: Design and key technology of grid emergency command technical support system. Power Syst. Autom. 15, 1–6 (2008)Google Scholar
  5. 5.
    Zhao, X.S., Xie, B.M., Zhang, H.W.: A power grid fault diagnosis method based on deep learning algorithm. Henan Sci. Technol. 23, 53–54 (2016)Google Scholar
  6. 6.
    Jiang, Q., Shen, L., Zhang, W., He, X.: Research on fault diagnosis method based on deep learning. Comput. Simul. 35(7), 409–413 (2018)Google Scholar
  7. 7.
    Qiu, J., Wang, H.F., Ying, J.L.: Text information mining technology and its application in the life cycle state evaluation of circuit breakers. Power Syst. Autom. 40(6), 107–112 (2016)Google Scholar
  8. 8.
    Zhang, Y.K., Zhang, P.Y., Yan, Y.H.: Language model data enhancement technology based on antagonistic training strategy. Acta Automatica Sinica 44(05), 126–135 (2018)Google Scholar
  9. 9.
    Zhang, Q.L., Du, J.C., Xu, R.F.: Research on irony recognition based on antagonistic learning. J. Peking Univ. (nat. Sci. Edn.) 55(01), 32–39 (2019)Google Scholar
  10. 10.
    Chen, C., Shen, F., Yan, R.Q.: Bearing fault diagnosis based on improved LSSVM migration learning method. J. Instrum. (2017)Google Scholar
  11. 11.
    Gu, T.Y., Guo, J.S., Li, Z.X.: Fault probability prediction of airborne equipment based on interpolation-fit-transfer learning algorithm. Syst. Eng. Electron. Technol. 40(1), 114–118 (2018)Google Scholar
  12. 12.
    Ren, J., Hu, X.F., Li, N.: Transfer learning prediction algorithm based on SDA and SVR hybrid model. Comput. Sci. 45(1) (2018)Google Scholar
  13. 13.
    Miwa, M., Sætre, R., Miyao, Y.: A rich feature vector for protein-protein interaction extraction from multiple corpora. In: Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics (2009)Google Scholar
  14. 14.
    Li, L.S., Guo, R., Huang, D.G.: Extraction of protein interaction based on transfer learning. J. Chin. Inf. Process. 30(2), 160–167 (2016)Google Scholar
  15. 15.
    Oquab, M., Bottou, L., Laptev, I.: Learning and transferring mid-level image representations using convolutional neural networks. In: Computer Vision and Pattern Recognition. IEEE (2014)Google Scholar
  16. 16.
    Razavian, A.S., Azizpour, H., Sullivan, J.: CNN features off-the-shelf: an astounding baseline for recognition. In: Computer Vision & Pattern Recognition Workshops (2014)Google Scholar
  17. 17.
    Yosinski, J., Clune, J., Bengio, Y.: How transferable are features in deep neural networks? Eprint Arxiv 27, 3320–3328 (2014)Google Scholar
  18. 18.
    Wu, Y., Ji, Q.: Constrained deep transfer feature learning and its applications. In: Computer Vision and Pattern Recognition, pp. 5101–5109. IEEE (2016)Google Scholar
  19. 19.
    Tzeng, E., Hoffman, J., Zhang, N.: Deep domain confusion: maximizing for domain invariance. Comput. Sci. (2014)Google Scholar
  20. 20.
    Wang, N.: Conceptual relationship extraction of basic education geography based on transfer learning. Wuhan University of Technology (2017)Google Scholar
  21. 21.
    Pan, C.W.: Research on vector optimization method for pre-training Chinese words in transfer learning. Beijing Jiaotong University (2018)Google Scholar
  22. 22.
    Peters, M.E., et al.: Deep contextualized word representations. NAACL (2018)Google Scholar
  23. 23.
    Howard, J., Ruder, S.: Universal Language Model Fine-tuning for Text Classification (2018)Google Scholar
  24. 24.
    Zhuang, F.Z.: Research progress in transfer learning. J. Softw. 26(1), 26–39 (2015)MathSciNetGoogle Scholar
  25. 25.
    Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)CrossRefGoogle Scholar
  26. 26.
    Tan, C., Sun, F., Kong, T.: A Survey on Deep Transfer Learning (2018)Google Scholar
  27. 27.
    Zhang, J., Qu, D., Li, Z.: Language model of cyclic neural network based on word vector features. Pattern Recogn. Artif. Intell. 28(4), 000299–305 (2015)Google Scholar
  28. 28.
    Hinton, G.E.: Learning distributed representations of concepts. In: Proceedings of the Eighth Annual Conference of the Cognitive Science Society, pp. 1–12. Erlbaum, Hillsdale (1986)Google Scholar
  29. 29.
    Mikolov, T., Chen, K., Corrado, G.: Efficient estimation of word representations in vector space. Comput. Sci. (2013)Google Scholar
  30. 30.
    Mikolov, T., Sutskever, I., Kai, C.: Distributed representations of words and phrases and their compositionality. Adv. Neural. Inf. Process. Syst. 26, 3111–3119 (2013)Google Scholar
  31. 31.
    Rong, X.: word2vec Parameter Learning Explained. Comput. Sci. (2014)Google Scholar
  32. 32.
    Devlin, J., Chang, M.W., Lee, K.: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (2018)Google Scholar
  33. 33.
    Socher, R., Bauer, J., Manning, C.D., Ng, A.Y.: Parsing with compositional vector grammars. In: Proceedings of 51st Annual Meeting of the Association for Conputational Linguistics (Volume 1: Long papers), pp. 455–465 (2013)Google Scholar
  34. 34.
    Klein, D.: Accurate unlexicalized parsing. In: Proceedings of the 41st Meeting of the Association for Computational Linguistics, Sapporo, Japan (2003)Google Scholar
  35. 35.
    Henderson, J.: Discriminative training of a neural network statistical parser. In: Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics, Barcelona, Spain. DBLP (2004)Google Scholar
  36. 36.
    Yao, Y., et al.: Towards automatic construction of diverse, high-quality image dataset. IEEE Trans. Knowl. Data Eng. (2019).
  37. 37.
    Yao, Y., Shen, F., Zhang, J., Liu, L., Tang, Z., Shao, L.: Extracting privileged information for enhancing classifier learning. IEEE Trans. Image Process. 28(1), 436–450 (2019)MathSciNetCrossRefGoogle Scholar
  38. 38.
    Yao, Y., Zhang, J., Shen, F., Hua, X., Xu, J., Tang, Z.: Exploiting web images for dataset construction: a domain robust approach. IEEE Trans. Multimedia 19(8), 1771–1784 (2017)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • He Shi
    • 1
    • 2
  • Qun Yang
    • 1
    • 2
    Email author
  • Bo Wang
    • 3
    • 4
    • 5
  • Shaohan Liu
    • 1
    • 2
  • Kai Zhou
    • 1
    • 2
  1. 1.College of Computer Science and TechnologyNanjing University of Aeronautics and AstronauticsNanjingChina
  2. 2.Collaborative Innovation Center of Novel Software Technology and IndustrializationNanjingChina
  3. 3.NARI Group Corporation (State Grid Electric Power Research Institute)NanjingChina
  4. 4.NARI Technology Co., Ltd.NanjingChina
  5. 5.State Key Laboratory of Smart Gird Protection and ControlNanjingChina

Personalised recommendations