Class-Semantic Color-Texture Textons for Vegetation Classification

  • Ligang ZhangEmail author
  • Brijesh Verma
  • David Stockwell
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9489)


This paper proposes a new color-texture texton based approach for roadside vegetation classification in natural images. Two individual sets of class-semantic textons are first generated from color and filter bank texture features for each class. The color and texture features of testing pixels are then mapped into one of the generated textons using the nearest distance, resulting in two texton occurrence matrices – one for color and one for texture. The classification is achieved by aggregating color-texture texton occurrences over all pixels in each over-segmented superpixel using a majority voting strategy. Our approach outperforms previous benchmarking approaches and achieves 81% and 74.5% accuracies of classifying seven objects on a cropped region dataset and six objects on an image dataset collected by the Department of Transport and Main Roads, Queensland, Australia.


Object classification Roadside vegetation Image segmentation Texture feature 



This research was supported under Australian Research Council’s Linkage Projects funding scheme (project number LP140100939).


  1. 1.
    Haibing, Z., Shirong, L., Chaoliang, Z.: Outdoor scene understanding using SEVI-BOVW model. In: 2014 International Joint Conference on Neural Networks, pp. 2986–2990 (2014)Google Scholar
  2. 2.
    Kang, Y., Yamaguchi, K., Naito, T., et al.: Multiband image segmentation and object recognition for understanding road scenes. IEEE Trans. Intell. Transp. Syst. 12, 1423–1433 (2011)CrossRefGoogle Scholar
  3. 3.
    Blas, M.R., Agrawal, M., Sundaresan, A., et al.: Fast color/texture segmentation for outdoor robots. In: 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 4078–4085 (2008)Google Scholar
  4. 4.
    Campbell, N.W., Thomas, B.T., Troscianko, T.: Automatic segmentation and classification of outdoor images using neural networks. Int. J. Neural Syst. 08, 137–144 (1997)CrossRefGoogle Scholar
  5. 5.
    Zafarifar, B., de With, P.H.N.: Grass field detection for TV picture quality enhancement. In: 2008 International Conference on Consumer Electronics (ICCE), pp. 1–2 (2008)Google Scholar
  6. 6.
    Schepelmann, A., Hudson, R.E., Merat, F.L., et al.: Visual segmentation of lawn grass for a mobile robotic lawnmower. In: 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 734–739 (2010)Google Scholar
  7. 7.
    Harbas, I., Subasic, M.: Detection of roadside vegetation using features from the visible spectrum. In: 2014 37th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), pp. 1204–1209 (2014)Google Scholar
  8. 8.
    Balali, V., Golparvar-Fard, M.: Segmentation and recognition of roadway assets from car-mounted camera video streams using a scalable non-parametric image parsing method. Autom. Constr. 49(Part A), 27–39 (2015)CrossRefGoogle Scholar
  9. 9.
    Yu, T., Muthukkumarasamy, V., Verma, B., et al.: A texture extraction technique using 2D-DFT and hamming distance. In: 2003 Fifth International Conference on Computational Intelligence and Multimedia Applications (ICCIMA), pp. 120–125 (2003)Google Scholar
  10. 10.
    Bradley, D.M., Unnikrishnan, R., Bagnell, J.: Vegetation detection for driving in complex environments. In: 2007 IEEE International Conference on Robotics and Automation, pp. 503–508 (2007)Google Scholar
  11. 11.
    Nguyen, D.V., Kuhnert, L., Kuhnert, K.D.: Structure overview of vegetation detection. A novel approach for efficient vegetation detection using an active lighting system. Robot. Auton. Syst. 60, 498–508 (2012)CrossRefGoogle Scholar
  12. 12.
    Nguyen, D.V., Kuhnert, L., Thamke, S., et al.: A novel approach for a double-check of passable vegetation detection in autonomous ground vehicles. In: 2012 15th International IEEE Conference on Intelligent Transportation Systems (ITSC), pp. 230–236 (2015)Google Scholar
  13. 13.
    Nguyen, D.V., Kuhnert, L., Jiang, T., et al.: Vegetation detection for outdoor automobile guidance. In: 2011 IEEE International Conference on Industrial Technology, pp. 358–364 (2011)Google Scholar
  14. 14.
    Nguyen, D.V., Kuhnert, L., Kuhnert, K.D.: Spreading algorithm for efficient vegetation detection in cluttered outdoor environments. Robot. Auton. Syst. 60, 1498–1507 (2012)CrossRefGoogle Scholar
  15. 15.
    Winn, J., Criminisi, A., Minka, T.: Object categorization by learned universal visual dictionary. In: 2005 Tenth IEEE International Conference on Computer Vision (ICCV), vol. 1802, pp. 1800–1807 (2005)Google Scholar
  16. 16.
    Shotton, J., Winn, J., Rother, C., et al.: Textonboost for image understanding: multi-class object recognition and segmentation by jointly modeling texture, layout, and context. Int. J. Comput. Vis. 81, 2–23 (2009)CrossRefGoogle Scholar
  17. 17.
    Felzenszwalb, P., Huttenlocher, D.: Efficient graph-based image segmentation. Int. J. Comput. Vis. 59, 167–181 (2004)CrossRefGoogle Scholar
  18. 18.
    Zhang, L., Verma, B., Stockwell, D.: Roadside vegetation classification using color intensity and moments. In: 2015 11th International Conference on Natural Computation, pp. 1250–1255 (2015)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Central Queensland UniversityRockhamptonAustralia
  2. 2.RockhamptonAustralia

Personalised recommendations