Skip to main content

Slovak Language Model from Internet Text Data

  • Chapter

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 6456))

Abstract

Automatic speech recognition system is one of the parts of the multimodal dialogue system. It is necessary to create correct vocabulary and to generate suitable language model for this purpose. The main aim of this article is to describe a process of building statistical models of the Slovak language with large vocabulary trained on the text data gathered mainly from Internet sources. Several smoothing techniques for different sizes of vocabulary have been used in order to obtain an optimal model of the Slovak language. We have also employed pruning technique based on relative entropy for size reduction of a language model to find the maximum threshold of pruning with minimum degradation in recognition accuracy. Tests were performed by the decoder based on the HTK Toolkit.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Chollet, G., Esposito, A., Gentes, A., Horain, P., Karam, W., Li, Z., Pelachaud, C., Perrot, P., Petrovska-Delacrétaz, D., Zhou, D., Zouari, L.: Multimodal Human Machine Interactions in Virtual and Augmented Reality. In: Esposito, A., Hussain, A., Marinaro, M., Martone, R. (eds.) COST Action 2102. LNCS(LNAI), vol. 5398, pp. 1–23. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  2. Jurafsky, D., Martin, J.H.: Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition, 2nd edn., p. 998. Prentice Hall, Englewood Cliffs (2009) ISBN-13 978-0-13-504196-3

    Google Scholar 

  3. Chen, S.F., Goodman, J.: An Empirical Study of Smoothing Techniques for Language Modeling. Technical Report TR-10-98, p. 63 (1998)

    Google Scholar 

  4. Stolcke, A.: Entropy-based Pruning of Backoff Language Models. In: Proc. DARPA Broadcast News Transcription and Understanding Workshop, pp. 270–274 (1998)

    Google Scholar 

  5. Mirilovič, M., Juhár, J., Cižmár, A.: Large Vocabulary Continuous Speech Recognition in Slovak. In: Proc. of International Conference on Applied Electrical Engineering and Informatics, Athens, Greece, pp. 73–77 (2008) ISBN 978-80-553-0066-5

    Google Scholar 

  6. Stolcke, A.: SRILM - An Extensible Language Modeling Toolkit. In: Proc. of the 7th International Conference on Spoken Language Processing, Denver, Colorado, pp. 901–904 (2002)

    Google Scholar 

  7. Cowan, I.A., Moore, D., Dines, J., Gatiza-Perez, D., Flynn, M., Wellner, P., Bourlard, H.: On the Use of Information Retrieval Measures for Speech Recognition Evaluation. In: IDIAP-RR-73, Martigny, Switzerland, p. 15 (2005)

    Google Scholar 

  8. Young, S., Odell, J., Ollason, D., Valtchev, V., Woodland, P., Evermann, G., Hain, T., Kershaw, D., Moore, G.: The HTK Book (v3.4). Cambridge University, Cambridge (2009)

    Google Scholar 

  9. Rusko, M., Trnka, M., Daržagín, S.: MobilDat-SK - A Mobile Telephone Extension to the SpeechDat-E SK Telephone Speech Database in Slovak. In: Proc. of the 11th International Conference Speech and Computer, SPECOM 2006, pp. 485–488 (2006)

    Google Scholar 

  10. Mirilovič, M., Juhár, J., Čižmár, A.: Comparison of Grapheme and Phoneme Based Acoustic Modeling in LVCSR Task in Slovak. In: Proc. of the 7th International Conference on Spoken Language Processing, Denver, Colorado, pp. 901–904 (2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Staš, J., Hládek, D., Pleva, M., Juhár, J. (2011). Slovak Language Model from Internet Text Data. In: Esposito, A., Esposito, A.M., Martone, R., Müller, V.C., Scarpetta, G. (eds) Toward Autonomous, Adaptive, and Context-Aware Multimodal Interfaces. Theoretical and Practical Issues. Lecture Notes in Computer Science, vol 6456. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-18184-9_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-18184-9_29

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-18183-2

  • Online ISBN: 978-3-642-18184-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics