Abstract
This paper deals with out-of-vocabulary (OOV) word recognition in the task of 24/7 broadcast stream transcription. Here, the majority of OOVs newly emerging over time are constituted of names of politicians, athletes, major world events, disasters, etc. The absence of these content OOVs, e.g. COVID-19, is detrimental to human understanding of the recognized text and harmful to further NLP processing, such as machine translation, named entity recognition or any type of semantic or dialogue analysis. In production environments, content OOVs are of extreme importance and it is essential that their correct transcription is provided as soon as possible. For this purpose, an approach based on daily updates of the lexicon and language model is proposed. It consists of three consecutive steps: a) the identification of new content OOVs from already existing text sources, b) their controlled addition into the lexicon of the transcription system and c) proper tuning of the language model. Experimental evaluation is performed on an extensive data-set compiled from various Czech broadcast programs. This data was produced by a real transcription platform over the course of 300 days in 2019. Detailed statistics and analysis of new content OOVs emerging within this period are also provided.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bazzi, I., Glass, J. R.: Learning units for domain-independent out-of- vocabulary word modelling. In: Proceedings of INTERSPEECH (2001)
Bisani, M., Ney, H.: Open vocabulary speech recognition with flat hybrid models. In: Proceedings of INTERSPEECH, pp. 725–728 (2005)
Burget, L., et al.: Combination of strongly and weakly constrained recognizers for reliable detection of OOVS. In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 4081–4084 (2008)
Dahl, G.E., Yu, D., Deng, L., Acero, A.: Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition. IEEE Trans. Audio Speech Lang. Process. 20(1), 30–42 (2012)
Gage, P.: A new algorithm for data compression. C Users J. 12(2), 23–38 (1994)
Inaguma, H., Mimura, M., Sakai, S., Kawahara, T.: Improving OOV detection and resolution with external language models in acoustic-to-word ASR. In: Proceedings of IEEE Spoken Language Technology Workshop, pp. 212–218 (2018)
Lin, H., Bilmes, J.A., Vergyri, D., Kirchhoff, K.: OOV detection by joint word/phone lattice alignment. In: Proceedings of ASRU, pp. 478–483 (2007)
Parada, C., Dredze, M., Filimonov, D., Jelinek, F.: Contextual Information Improves OOV Detection in Speech. In: Proceedings of HTL-NAACL, pp. 216–224 (2010)
Rastrow, A., Sethy, A., Ramabhadran, B.: A new method for OOV detection using hybrid word/fragment system. In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 3953–3956 (2009)
Thomas, S., Audhkhasi, K., Tüske, Z., Huang, Y., Picheny, M.: Detection and recovery of OOVs for improved English broadcast news captioning. In: Proceedings of INTERSPEECH, pp. 2973–2977 (2019)
Xiao, Z., Ou, Z., Chu, W., Lin, H.: Hybrid CTC-Attention based end-to-end speech recognition using subword units. In: Proceedings of 11th International Symposium on Chinese Spoken Language Processing (ISCSLP), pp. 146–150 (2018)
Zenkel, T., Sanabria, R., Metze, F., Waibel, A.H.: Subword and crossword units for CTC acoustic models. In: Proceedings of INTERSPEECH, pp. 396–400 (2018)
spaCy Webpage. https://spacy.io/api/annotation. Accessed 15 July 2020
Acknowledgments
This work was supported by the Technology Agency of the Czech Republic (Project No. TH03010018).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Cerva, P., Volna, V., Weingartova, L. (2020). Dealing with Newly Emerging OOVs in Broadcast Programs by Daily Updates of the Lexicon and Language Model. In: Karpov, A., Potapova, R. (eds) Speech and Computer. SPECOM 2020. Lecture Notes in Computer Science(), vol 12335. Springer, Cham. https://doi.org/10.1007/978-3-030-60276-5_10
Download citation
DOI: https://doi.org/10.1007/978-3-030-60276-5_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-60275-8
Online ISBN: 978-3-030-60276-5
eBook Packages: Computer ScienceComputer Science (R0)