Automatic Bus Line Number Localization and Recognition on Mobile Phones—A Computer Vision Aid for the Visually Impaired

  • Claudio Guida
  • Dario Comanducci
  • Carlo Colombo
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6979)


In this paper, machine learning and geometric computer vision are combined for the purpose of automatic reading bus line numbers with a smart phone. This can prove very useful to improve the autonomy of visually impaired people in urban scenarios. The problem is a challenging one, since standard geometric image matching methods fail due to the abundance of distractors, occlusions, illumination changes, highlights and specularities, shadows, and perspective distortions. The problem is solved by locating the main geometric entities of the bus façade through a cascade of classifiers, and then refining the matching with robust geometric matching. The method works in real time and, as experimental results show, has a good performance in terms of recognition rate and reliability.


Visual machine learning object recognition geometric methods accessibility software 


  1. 1.
    Chen, X., Yuille, A.: A time-efficient cascade for real-time object detection: with applications for the visually impaired. In: Proc. Conf. Computer Vision and Pattern Recognition (2005)Google Scholar
  2. 2.
    Choudhury, A., Medioni, G.: Color contrast enhancement for visually impaired people. In: Proc. 3rd Computer Vision Applications for the Visually Impaired (2010)Google Scholar
  3. 3.
    Felzenszwalb, P., Huttenlocher, D.: Efficient graph-based image segmentation. International Journal of Computer Vision 59, 167–181 (2004)CrossRefGoogle Scholar
  4. 4.
    Freund, Y., Schapire, R.: A decision-theoretic generalization of on-line learning and an application to boosting. In: Proc. 2nd European Conference on Computational Learning Theory, pp. 23–37 (1995)Google Scholar
  5. 5.
    Gagnon, L., Chapdelaine, C., Byrns, D., Foucher, S., Hritier, M., Gupta, V.: Computer-vision-assisted system for videodescription scripting. In: Proc.  3rd Computer Vision Applications for the Visually Impaired (2010)Google Scholar
  6. 6.
    Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2004)CrossRefzbMATHGoogle Scholar
  7. 7.
    Pradeep, V., Medioni, G., Weiland, J.: Robot vision for the visually impaired. In: Proc. 3rd Computer Vision Applications for the Visually Impaired (2010)Google Scholar
  8. 8.
    Seeger, M., Dance, C.: Binarizing camera images for ocr. In: Proc. 6th International Conference on Document Analysis and Recognition, pp. 54–58 (2001)Google Scholar
  9. 9.
    Trucco, E., Verri, A.: Introductory Techniques for 3-D Computer Vision. Prentice Hall, Englewood Cliffs (1998)Google Scholar
  10. 10.
    Viola, P., Jones, M.: Robust real-time face detection. International Journal of Computer Vision 57(2), 137–154 (2004)CrossRefGoogle Scholar
  11. 11.
    Zhang, Z.: Parameter estimation techniques: A tutorial with application to conic fitting. Image and Vision Computing 15(1), 59–76 (1997)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Claudio Guida
    • 1
  • Dario Comanducci
    • 1
  • Carlo Colombo
    • 1
  1. 1.Dipartimento di Sistemi e InformaticaFirenzeItaly

Personalised recommendations