Distant Supervision for Chinese Temporal Tagging

  • Hualong Zhang
  • Liting Liu
  • Shuzhi Cheng
  • Wenxuan ShiEmail author
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 957)


Temporal tagging plays an important role in many tasks such as event extraction and reasoning. Extracting Chinese temporal expressions is challenging because of the diversity of time phrases in Chinese. Usually researchers use rule-based methods or learning-based methods to extract temporal expressions. Rule-based methods can often achieve good results in certain types of text such as news but multi-type text with complex time phrases. Learning-based methods often require large amounts of annotated corpora which are hard to get, and the training data is difficult to extend to other tasks with different text type. In this paper, we consider time expression extraction as a sequence labeling problem and try to solve it by a popular model BiLSTM+CRF. We propose a distant supervision method using CN-DBPedia (an open domain Chinese knowledge graph) and BaiduBaike (one of the largest Chinese encyclopedias) to generate a dataset for model training. Results of our experiments on encyclopedia text and TempEval2 dataset indicate that the method is feasible. While obtaining acceptable tagging performance, our approach does not involve designing manual patterns as rule-based ones do, does not involve the constructing annotated data manually, and has a good adaptation to different types of text.


Chinese temporal tagging Distant supervision Knowledge graph 


  1. 1.
    Yin, B., Jin, B.: A multi-label classification method on chinese temporal expressions based on character embedding. In: International Conference on Information Science and Control Engineering, pp. 51–54. IEEE (2017)Google Scholar
  2. 2.
    Xu, B., et al.: CN-DBpedia: a never-ending Chinese knowledge extraction system. In: Benferhat, S., Tabia, K., Ali, M. (eds.) IEA/AIE 2017. LNCS (LNAI), vol. 10351, pp. 428–438. Springer, Cham (2017). Scholar
  3. 3.
    Walker, C., et al.: ACE 2005 multilingual training corpus. Progress Theor. Phys. Suppl. 110(110), 261–276 (2006)Google Scholar
  4. 4.
    Verhagen, M., et al.: SemEval-2010 task 13: TempEval-2. In: Proceedings of the 5th International Workshop on Semantic Evaluation Association for Computational Linguistics, pp. 57–62 (2010)Google Scholar
  5. 5.
    UzZaman, N., et al.: SemEval-2013 task 1: TempEval-3: evaluating time expressions, events, and temporal relations. In: Second Joint Conference on Lexical and Computational Semantics (* SEM): Proceedings of the Seventh International Workshop on Semantic Evaluation (SemEval 2013), vol. 2 (2013)Google Scholar
  6. 6.
    Strötgen, J., Gertz, M.: Multilingual and cross-domain temporal tagging. Lang. Resour. Eval. 47(2), 269–298 (2013)CrossRefGoogle Scholar
  7. 7.
    Strötgen, J., Gertz, M.: A baseline temporal tagger for all languages. In: Conference on Empirical Methods in Natural Language Processing, pp. 541–547 (2015)Google Scholar
  8. 8.
    Li, H., et al.: Chinese temporal tagging with HeidelTime. In: Conference of the European Chapter of the Association for Computational Linguistics: Short Papers, vol. 2, pp. 133–137 (2014)Google Scholar
  9. 9.
    Angeli, G., Uszkoreit, J.: Language-independent discriminative parsing of temporal expressions. In: Meeting of the Association for Computational Linguistics, pp. 83–92 (2013)Google Scholar
  10. 10.
    Dong, C., Zhang, J., Zong, C., Hattori, M., Di, H.: Character-based LSTM-CRF with radical-level features for Chinese named entity recognition. In: Lin, C.-Y., Xue, N., Zhao, D., Huang, X., Feng, Y. (eds.) ICCPOL/NLPCC-2016. LNCS (LNAI), vol. 10102, pp. 239–250. Springer, Cham (2016). Scholar
  11. 11.
    Chen, T., et al.: Improving sentiment analysis via sentence type classification using BiLSTM-CRF and CNN. Expert Syst. Appl. 72, 221–230 (2017)CrossRefGoogle Scholar
  12. 12.
    Bollacker, K., et al.: Freebase: a collaboratively created graph database for structuring human knowledge. In: SIGMOD Conference, pp. 1247–1250 (2008)Google Scholar
  13. 13.
    Suchanek, F.M., Kasneci, G., Weikum, G.: Yago: a core of semantic knowledge. In: Proceedings of WWW, vol. 272, no. 2, pp. 697–706 ((2007))Google Scholar
  14. 14.
    Auer, S., et al.: DBPedia: a nucleus for a web of open data. In: The Semantic Web, International Semantic Web Conference, Asian Semantic Web Conference, ISWC 2007+ASWC 2007, Busan, Korea, November, pp. 722–735. DBLP (2007)Google Scholar
  15. 15.
    Mintz, M., et al.: Distant supervision for relation extraction without labeled data. In: Joint Conference of the, Meeting of the ACL and the, International Joint Conference on Natural Language Processing of the AFNLP, pp. 1003–1011. Association for Computational Linguistics (2009)Google Scholar
  16. 16.
    Huang, B., et al.: Research on noise reduction in distant supervised personal relation extraction. Comput. Appl. Softw. 34(7), 11–18 (2017)Google Scholar
  17. 17.
    Pustejovsky, J., et al.: The specification language TimeML. Comput. Linguist. 32(3), 445–446 (2005)Google Scholar
  18. 18.
    Huang, Z., Xu, W., Yu, K.: Bidirectional LSTM-CRF models for sequence tagging. In: Computer Science (2015)Google Scholar
  19. 19.
    Lample, G., et al.: Neural architectures for named entity recognition, pp. 260–270 (2016)Google Scholar
  20. 20.
    Bengio, Y., Simard, P., Frasconi, P.: Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Netw. 5(2), 157–166 (2002)CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  • Hualong Zhang
    • 1
  • Liting Liu
    • 1
  • Shuzhi Cheng
    • 1
  • Wenxuan Shi
    • 1
    Email author
  1. 1.Nankai UniversityTianjinChina

Personalised recommendations