Skip to main content
SpringerLink
Log in

Recognition Systems for Practical Applications

  • Chapter
  • First Online:
Markov Models for Handwriting Recognition

Part of the book series: SpringerBriefs in Computer Science ((BRIEFSCOMPUTER))

  • 980 Accesses

Abstract

Aiming at a comprehensive overview of Markov-model based handwriting recognition this chapter focusses on the description of recognition systems for practical applications. After the theoretical aspects and key developments in the field have been surveyed, integration aspects and concrete evaluations of recognition capabilities are discussed. The chapter starts with a description of the most relevant data-sets. As usual for all experimental science, handwriting recognition research relies on the availability of high-quality sample data for training and evaluation purposes. According to the general shift of research efforts from online to offline handwriting recognition, the majority of systems described in the current literature is dedicated to offline recognition. Reviewing the literature, we identified seven major recognition systems. We concentrated on those systems that are still being maintained and further developed. In this chapter their key features will be described and performance figures will be given.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 16.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.iapr-tc11.org

  2. 2.

    http://www.iapr-tc11.org/mediawiki/index.php/Datasets_List

  3. 3.

    iapr-tc11.org/mediawiki/index.php/IAM_Online_Document_Database_(IAMonDo-database)

  4. 4.

    http://www.anoto.com

  5. 5.

    www-i6.informatik.rwth-aachen.de/rwth-ocr/

  6. 6.

    http://sourceforge.net/projects/esmeralda

References

  1. Guyon I, Schomaker L, Plamondon R, Liberman M, Janet S (1994) UNIPEN project of on-line data exchange and recognizer benchmarks. In: Proceedings of the international conference on pattern recognition, Jerusalem, Israel, pp 29–33

    Google Scholar 

  2. Marti UV, Bunke H (2002) The IAM-database: An English sentence database for offline handwriting recognition. Int J Doc Anal Recogn 5(1):39–46

    Article  MATH  Google Scholar 

  3. Johansson S, Leech G, Goodluck H (1978) Manual of information to accompany the Lancaster-Oslo/Bergen corpus of British English, for use with digital computers. Technical report, Department of English, University of Oslo, Norway

    Google Scholar 

  4. Liwicki M, Bunke H (2005) IAM-OnDB—An on-line English sentence database acquired from handwritten text on a whiteboard. In: Proceedings of the international conference on document analysis and recognition, Seoul, Korea, vol 2, pp 956–961

    Google Scholar 

  5. Indermühle E, Liwicki M, Bunke H (2010) IAMonDo-database: an online handwritten document database with non-uniform contents. In: Proceedings of the international workshop on document analysis systems, Boston, USA, pp 97–104

    Google Scholar 

  6. Francis WN, Kucera H (1964, 1971, 1979) A standard corpus of present-day edited American English, for use with digital computers (Brown). Technical report, Brown University, Providence, Rhode Island, USA

    Google Scholar 

  7. Pechwitz M, Maddouri SS, Märgner V, Ellouze N, Amiri H (2002) IFN/ENIT-database of handwritten arabic words. In: Proceedings of the seventh colloque international Francophone sur l’Ecrit et le document, Hammamet, Tunisia

    Google Scholar 

  8. Augustin E, Carré M, Grosicki E, Brodin JM, Geoffrois E, Preteux F (2006) RIMES evaluation campaign for handwritten mail processing. In: Proceedings of the international workshop on frontiers in handwriting recognition, La Baule, France, pp 231–235

    Google Scholar 

  9. Augustin E, Carré M, Grosicki E, Brodin JM, Geoffrois E, Prêteux F (2008) RIMES evaluation campaign for handwritten mail processing. In: Proceedings of the international conference on frontiers in handwriting recognition, Montréal, Canada

    Google Scholar 

  10. Grosicki E, Carré M, Brodin JM, Geoffrois E (2009) Results of the second RIMES evaluation campaign for handwritten mail processing. In: Proceedings of the international conference on document analysis and recognition, Barcelona, Spain

    Google Scholar 

  11. Natarajan P, Lu Z, Schwartz R, Bazzi I, Makhoul J (2001) Multilingual machine printed OCR. Int J Pattern Recogn Artif Intell 15(1):43–63

    Article  Google Scholar 

  12. Colthurst T, Kimball O, Richardson F, Shu H, Wooters C, Iyer R, Gish H (2000) The 2000 BBN Byblos LVCSR system. In: 2000 speech transcription workshop, Maryland, USA

    Google Scholar 

  13. Natarajan P, Saleem S, Prasad R, MacRostie E, Subramanian K (2008) Multi-lingual offline handwriting recognition using hidden Markov models: A script-independent approach. In: Doermann DS, Jaeger S (eds) Arabic and chinese handwriting recognition: SACH 2006 selected papers, Lecture notes in computer science, vol 4768, Springer, Berlin Heidelberg, pp 231–250

    Google Scholar 

  14. Decerbo M, MacRostie E, Natarajan P (2004) The BBN Byblos Pashto OCR system. In: Proceedings of the first ACM workshop on hardcopy document processing, Washington, DC, USA, pp 29–32

    Google Scholar 

  15. Makhoul JI, Schwartz RM (1999) Language-independent and segmentation-free optical character recognition system and method. U.S. patent no. 5,933,525

    Google Scholar 

  16. Austin S, Schwartz R, Placeway P (1991) The forward-backward search algorithm. In: Proceedings of the international conference on acoustics, speech, and signal processing, Toronto, Canada, pp 697–700

    Google Scholar 

  17. El-Yacoubi A, Gilloux M, Sabourin R, Suen CY (1999) An HMM-based approach for off-line unconstrained handwritten word modeling and recognition. IEEE Trans Pattern Anal Mach Intell 21(8):752–760

    Article  Google Scholar 

  18. Grandidier F, Sabourin R, Suen CY (2003) Integration of contextual information in handwriting recognition systems. In: Proceedings of the international conference on document analysis and recognition, Edinburgh, Scotland, vol 2, pp 1252–1256

    Google Scholar 

  19. Koerich AL, Leydier Y, Sabourin R, Suen CY (2002) A hybrid large vocabulary handwritten word recognition system using neuronal networks with hidden Markov models. In: Proceedings of the international workshop on frontiers in handwriting recognition, Niagara on the Lake, Canada, pp 99–104

    Google Scholar 

  20. Koerich AL, Britto AS, de Oliviera LES, Sabourin R (2006) Fusing high- and low-level features for handwritten word recognition. In: Proceedings of the international workshop on frontiers in handwriting recognition, La Baule, France, pp 151–156

    Google Scholar 

  21. Ko AHR, Sabourin R, de Souza Britto A Jr (2009) Ensemble of HMM classifiers based on the clustering validity index for a handwritten numeral recognizer. Pattern Anal Appl J 12(1):21–35

    Article  MathSciNet  Google Scholar 

  22. Bunke H, Roth M, Schukat-Talamazzini EG (1995) Off-line cursive handwriting recognition using hidden Markov models. Pattern Recogn 9(9):1399–1413

    Article  Google Scholar 

  23. Marti UV, Bunke H (2001) Using a statistical language model to improve the performance of an HMM-based cursive handwriting recognition systems. Int J Pattern Recogn Artif Intell 15(1):65–90

    Article  Google Scholar 

  24. Vinciarelli A, Bengio S, Bunke H (2004) Offline recognition of unconstrained handwritten texts using HMMs and statistical language models. IEEE Trans Pattern Anal Mach Intell 26(6):709–720

    Article  Google Scholar 

  25. Vinciarelli A, Luettin J (2000) Off-line cursive script recognition based on continuous density HMM. In: Proceedings of the international workshop on frontiers in handwriting recognition, Amsterdam, The Netherlands, pp 493–498

    Google Scholar 

  26. Liwicki M, Bunke H (2005) Handwriting recognition of whiteboard notes. In: Proceedings of the twelveth conference of the international graphonomics society, Salerno, Italy, pp 118–122

    Google Scholar 

  27. Liwicki M, Bunke H (2006) HMM-based on-line recognition of handwritten whiteboard notes. In: Proceedings of the international workshop on frontiers in handwriting recognition, La Baule, France

    Google Scholar 

  28. Liwicki M, Bunke H (2007) Combining on-line and off-line systems for handwriting recognition. In: Proceedings of the international conference on document analysis and recognition, Curitiba, Brazil, pp 372–376

    Google Scholar 

  29. Liwicki M, Bunke H, Pittman JA, Knerr S (2011) Combining diverse systems for handwritten text line recognition. Mach Vis Appl 22:39–51

    Article  Google Scholar 

  30. Bertolami R, Uchida S, Zimmermann M, Bunke H (2007) Non-uniform slant correction for handwritten text line recognition. In: Proceedings of the international conference on document analysis and recognition, Curitiba, Brazil, vol 1, pp 18–22

    Google Scholar 

  31. Ney H, Steinbiss V, Haeb-Umbach R, Tran BH, Essen U (1994) An overview of the Philips research system for large-vocabulary continuous-speech recognition. Int J Pattern Recogn Artif Intell 8(1):33–70 (Special issue on speech recognition for different languages)

    Google Scholar 

  32. Rybach D, Gollan C, Heigold G, Hoffmeister B, Lööf J, Schlüter R, Ney H (2009) The RWTH Aachen University open source speech recognition system. In: Proceedings of the annual conference on international speech communication association, Brighton, UK

    Google Scholar 

  33. Dreuw P, Jonas S, Ney H (2008) White-space models for offline Arabic handwriting recognition. In: Proceedings of the international conference on pattern recognition, Tampa, USA

    Google Scholar 

  34. Dreuw P, Rybach D, Heigold G, Ney H (2011) RWTH OCR: A large vocabulary optical character recognition system for arabic scripts. In: Märgner V, El Abed H (eds) Guide to OCR for arabic scripts, Springer, London, UK, chap Part I: Development, in press

    Google Scholar 

  35. Dreuw P, Rybach D, Gollan C, Ney H (2009) Writer adaptive training and writing variant model refinement for offline arabic handwriting recognition. In: Proceedings of the international conference on document analysis and recognition, Barcelona, Spain, pp 21–25

    Google Scholar 

  36. Heigold G, Dreuw P, Hahn S, Schlüter R, Ney H (2010) Margin-based discriminative training for string recognition. IEEE J Selected Topics Signal Process—Statist Learn Meth Speech Lang Process 4(6):917–925

    Article  Google Scholar 

  37. Dreuw P, Heigold G, Ney H (2011) Confidence and margin-based MMI/MPE discriminative training for offline handwriting recognition. Int J Doc Anal Recogn, In press

    Google Scholar 

  38. Gales MJF (1998) Maximum likelihood linear transformations for HMM-based speech recognition. Comput Speech Lang 12(2):75–98

    Article  Google Scholar 

  39. Leggetter CJ, Woodland PC (1995) Maximum likelihood linear regression for speaker adaptation of continuous density hhidden Markov models. Comput Speech Lang 9:171–185

    Article  Google Scholar 

  40. Dreuw P, Ney H (2010) The RWTH-OCR handwriting recognition system for Arabic handwriting. invited talk at DAAD Workshop III—On the way to the information society, Sousse, Tunisia

    Google Scholar 

  41. Christiani N, Shawe-Taylor J (2000) An introduction to support vector machines and other kernel-based learning methods. Cambridge University Press, Cambridge

    Google Scholar 

  42. Fischer A, Stahl V (1999) Database and online adaptation for improved speech recognition in car environments. In: Proceedings of the international conference on acoustics, speech, and signal processing, Phoenix, USA

    Google Scholar 

  43. Plötz T, Fink G (2002) Robust time-synchronous environmental adaptation for continuous speech recognition systems. In: Proceedings of the international conference on spoken language processing, Denver, USA, pp 1409–1412

    Google Scholar 

  44. Zhang ZP, Furu S, Ohtsuki K (2000) On-line incremental speaker adaptation with automatic speaker change detection. In: Proceedings of the international conference on acoustics, speech, and signal processing, Istanbul, Turkey

    Google Scholar 

  45. Caesar T, Gloger JM, Mandler E (1993) Preprocessing and feature extraction for a handwriting recognition system. In: Proceedings of the international conference on document analysis and recognition, Tsukuba Science City, Japan, pp 408–411

    Google Scholar 

  46. Kaltenmeier A, Caesar T, Gloger JM, Mandler E (1993) Sophisticated topology of hidden Markov models for cursive script recognition. In: Proceedings of the international conference on document analysis and recognition, Tsukuba Science City, Japan, pp 139–142

    Google Scholar 

  47. Schambach MP, Rottland J, Alary T (2008) How to convert a Latin handwriting recognition system to Arabic. In: Proceedings of the international conference on frontiers in handwriting recognition, Montréal, Canada

    Google Scholar 

  48. Schambach MP (2005) Fast script word recognition with very large vocabulary. In: Proceedings of the international conference on document analysis and recognition, Seoul, Korea, vol 1, pp 9–13

    Google Scholar 

  49. Märgner V, El-Abed H (2007) ICDAR 2007—Arabic handwriting recognition competition. In: Proceedings of the international conference on document analysis and recognition, Curitiba, Brazil

    Google Scholar 

  50. El-Hajj R, Likforman-Sulem L, Mokbel C (2005) Arabic handwriting recognition using baseline dependant features and hidden Markov modeling. In: Proceedings of the international conferene on document analysis and recognition, Seoul, Korea, vol 2, pp 893–897

    Google Scholar 

  51. Märgner V, El-Abed H (2005) ICDAR 2005—Arabic handwriting recognition competition. In: Proceedings of the international conference on document analysis and recognition, Seoul, Korea

    Google Scholar 

  52. Bianne-Bernard AL, Menasri F, Al-Haji M, Mokbel C, Kermorvant C, Likforman-Sulem L (2011) Dynamic and contextual information in HMM modeling for handwritten word recognition. IEEE Trans Pattern Anal Mach Intell, In press

    Google Scholar 

  53. Al-Hajj Mohamad R, Likforman-Sulem L, Mokbel C (2009) Combining slanted-frame classifiers for improved HMM-based Arabic handwriting recognition. IEEE Trans Pattern Anal Mach Intell 31(7):1165–1177

    Article  Google Scholar 

  54. Al-Hajj R, Mokbel C, Likforman-Sulem L (2007) Combination of HMM-based classifiers for recognition of Arabic handwritten words. In: Proceedings of the international conference on document analysis and recognition, Curitiba, Brazil, vol 2, pp 959–963

    Google Scholar 

  55. Vinciarelli A, Luettin J (2001) A new normalization technique for cursive handwritten words. Pattern Recogn Lett 22(9):1043–1050

    Article  MATH  Google Scholar 

  56. Fink GA (2008) Markov models for pattern recognition—From theory to applications. Springer, Heidelberg

    MATH  Google Scholar 

  57. El-Hajj R, Likforman-Sulem L, Mokbel C (2009) Combining slanted-frame classifiers for improved HMM-based arabic handwriting recognition. IEEE Trans Pattern Anal Mach Intell 31(7):1165–1177

    Article  Google Scholar 

  58. Plötz T, Thurau C, Fink GA (2008) Camera-based whiteboard reading: New approaches to a challenging task. In: Proceedings of the internaional conference on frontiers in handwriting recognition, Montreal, Canada, pp 385–390

    Google Scholar 

  59. Wienecke M, Fink GA, Sagerer G (2005) Toward automatic video-based whiteboard reading. Int J Doc Anal Recogn 7(2–3):188–200

    Article  Google Scholar 

  60. Wienecke M, Fink GA, Sagerer G (2003) Towards automatic video-based whiteboard reading. In: Proceedings of the international conference on document analysis and recognition, IEEE, Edinburgh, Scotland, pp 87–91

    Google Scholar 

  61. Fink GA, Plötz T (2008) Developing pattern recognition systems based on Markov models: The ESMERALDA framework. Pattern Recogn Image Anal 18(2):207–215

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Culture Lab, School of Computing Science, Newcastle University, Grand Assembly Rooms, King’s Walk, Newcastle upon Tyne, NE1 7RU, UK

    Thomas Plötz

  2. Department of Computer Science, Technische Universität Dortmund, Otto-Hahn-Strasse 16, 44227, Dortmund, Germany

    Gernot A. Fink

Authors
  1. Thomas Plötz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gernot A. Fink
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Thomas Plötz .

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Thomas Plötz

About this chapter

Cite this chapter

Plötz, T., Fink, G.A. (2011). Recognition Systems for Practical Applications. In: Markov Models for Handwriting Recognition. SpringerBriefs in Computer Science. Springer, London. https://doi.org/10.1007/978-1-4471-2188-6_5

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-2188-6_5

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-2187-9

  • Online ISBN: 978-1-4471-2188-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation