Skip to main content
SpringerLink
Log in

A Comparative Study of Machine Learning Classification for Color-based Safety Vest Detection on Construction-Site Images

  • Construction Management
  • Published:
KSCE Journal of Civil Engineering Aims and scope Submit manuscript

Abstract

Detecting the safety vests is an important foundation for various applications in safety management and productivity measurement. The fluorescent yellow-green color and fluorescent orange-red color of safety vests are generally considered as the most distinctive colors which represent workers in construction-site images. The objective of this study is to provide an evaluation of the safety vest detection using color information in construction-site images. The data sets of two colors of safety vests and the background were generated and used in this study. A comparative analysis of combinations of five color spaces (RGB, nRGB, HSV, Lab, and YCbCr) and six classifiers (ANN, C4.5, KNN, LR, NB, and SVM) was conducted. The performance of each combination was assessed in terms of the precision, recall, and F-measure. Moreover, an evaluation of the effects of color space conversion and the absence of luminance components on the detection performance was conducted. The comparison results showed that C4.5 classifier combined with YCbCr and SVM classifier combined with Lab, respectively, outperformed other combinations on each data set of safety vest colors. Furthermore, RGB color space transformation into non-RGB color spaces enhanced the classification performance. The evaluation also showed that the removal of luminance components did not help to improve the performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Ali, S. and Smith, K. A. (2004). “On learning algorithm selection for classification.” Applied Soft Computing, Vol. 6, No. 2, pp. 119–138, DOI: 10.1016/j.asoc.2004.12.002.

    Article  Google Scholar 

  • ANSI/International Safety Equipment Association (ISEA) (2015). American national standard for high-visibility safety apparel and headwear, ANSI/ISEA 107–2015, Washington, DC., United States.

  • Arlot, S. and Celisse, A. (2010). “A survey of cross-valid SS054.ation procedures for model selection.” Statistics Surveys, Vol. 4, pp. 40–79, DOI: 10.1214/09-.SS054.

    Article  MathSciNet  MATH  Google Scholar 

  • Chang, C. C. and Lin, C. J. (2011). “LIBSVM: A library for support vector machines.” ACM Transactions on Intelligent Systems and Technology, Vol. 2, No. 3, DOI: 10.1145/1961189.1961199.

    Google Scholar 

  • Chen, M. Y. (2011). “Bankruptcy prediction in firms with statistical and intelligent techniques and a comparison of evolutionary computation approaches.” Computers and Mathematics with Applications, Vol. 62, No. 12, pp. 4514–2524, DOI: 10.1016/j.camwa.2011.10.030.

    Article  MathSciNet  MATH  Google Scholar 

  • Cheng, H. D., Jiang, X. H., Sun, Y., and Wang, J. (2001). “Color image segmentation: Advances and prospects.” Pattern Recognition, Vol. 34, No. 12, pp. 2259–2281, DOI: 10.1016/S0031-3203(00)00149-7.

    Article  MATH  Google Scholar 

  • Ciatto, S., Houssami, N., Bernardi, D., Caumo, F., Pellegrini, M., Brunelli, S., Tuttobene, P., Bricolo, P., Fantò, C., Valentini, M., Montemezzi, S., and Macaskill, P. (2013). “Integration of 3D digital mammography with tomosynthesis for population breast-cancer screening (STORM): A prospective comparison study.” The Lancet Oncology, Vol. 14, No. 7, pp. 583–589, DOI: 10.1016/S1470-2045(13)70134-7.

    Article  Google Scholar 

  • Delen, D., Walker, G., and Kadam, A. (2005). “Predicting breast cancer survivability: A comparison of three data mining methods.” Artificial Intelligence in Medicine, Vol. 34, No. 2, pp. 113–127, DOI: 10.1016/j.artmed.2004.07.002.

    Article  Google Scholar 

  • Derelioglu, G. and Gürgen, F. (2011). “Knowledge discovery using neural approach for SME’s credit risk analysis problem in Turkey.” Expert Systems with Applications, Vol. 38, No. 8, pp. 9313–9318, DOI: 10.1016/j.eswa.2011.01.012.

    Article  Google Scholar 

  • Dreiseitl, S., Ohno-Machado, L., Kittler, H., Vinterbo, S., Billhardt, H., and Binder, M. (2001). “A comparison of machine learning methods for the diagnosis of pigmented skin lesions.” Journal of Biomedical Informatics, Vol. 34, No. 1, pp. 28–36, DOI: 10.1006/jbin.2001.1004.

    Article  Google Scholar 

  • Duda, R. O., Hart, P. E., and Stork, D. G. (2001). Pattern classification 2nd Edition, John Wiley and Sons.

    MATH  Google Scholar 

  • El Gayar, N., Schwenker, F., and Palm, G. (2006). “A study of the robustness of KNN classifiers trained using soft labels.” Proc. Int. Conf. of the IAPR Workshop on Artificial Neural Networks in Pattern Recognition, Springer, Ulm, Germany, pp. 67–80.

    Chapter  Google Scholar 

  • Fritsch, J., Kuhnl, T., and Geiger, A. (2013). “A new performance measure and evaluation benchmark for road detection algorithms.” Proc. 16th Int. IEEE Conf. on Intelligent Transportation Systems, IEEE, The Hague, Netherlands, pp. 1693–1700.

    Google Scholar 

  • Gong, J. and Caldas, C. H. (2011). “An object recognition, tracking, and contextual reasoning-based video interpretation method for rapid productivity analysis of construction operations.” Automation in Construction, Vol. 20, No. 8, pp. 1211–1226, DOI: 10.1016/j.autcon.2011.05.005.

    Article  Google Scholar 

  • Hastie, T., Tibshirani, R., and Friedman, J. (2009). The elements of statistical learning: Data mining, inference, and prediction, Springer New York, USA.

    Book  MATH  Google Scholar 

  • Holmes, C. C. and Adams, N. M. (2002). “A probabilistic nearest neighbour method for statistical pattern recognition.” Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 64, No. 2, pp. 295–306, DOI: 10.1111/1467-9868.00338.

    Article  MathSciNet  MATH  Google Scholar 

  • Hosmer Jr, D. W., Lemeshow, S., and Sturdivant, R. X. (2013). Applied logistic regression, John Wiley & Sons, NJ, USA.

    Book  MATH  Google Scholar 

  • Jiang, B., Pan, Z., and Qiu, Y. (2017). “Study on the key technologies of a high-speed CMOS camera.” Optik-International Journal for Light and Electron Optics, Vol. 129, pp. 100–107, DOI: 10.1016/j.ijleo.2016.10.056.

    Article  Google Scholar 

  • Kakumanu, P., Makrogiannnis, S., and Bourbakis, N. (2007). “A survey of skin-color modeling and detection methods.” Pattern Recognition, Vol. 40, No. 3, pp. 1106–1122, DOI: 10.1016/j.patcog.2006.06.010.

    Article  MATH  Google Scholar 

  • Khan, R., Hanbury, A., Stöttinger, J., and Bais, A. (2012). “Color based skin classification.” Pattern Recognition Letters, Vol. 33, No. 2, pp. 157–163, DOI: 10.1016/j.patrec.2011.09.032.

    Article  Google Scholar 

  • Kim, D., Kim, D. H., Chang, S., Lee, J. J., and Lee, D. H. (2011). “Stability number prediction for breakwater armor blocks using Support Vector Regression.” KSCE Journal of Civil Engineering, Vol. 15, No. 2, pp. 225–230, DOI: 10.1007/s12205-011-1031-1.

    Article  Google Scholar 

  • Liu, G. H. and Yang, J. Y. (2013). “Content-based image retrieval using color difference histogram.” Pattern Recognition, Vol. 46 No. 1, pp. 188–198, DOI: 10.1016/j.patcog.2012.06.001.

    Article  Google Scholar 

  • MacInnes, J. J., Dickerson, K. C., Chen, N. K., and Adcock, R. A. (2016). “Cognitive neurostimulation: learning to volitionally sustain ventral tegmental area activation.” Neuron, Vol. 89, No. 6, pp. 1331–1342, DOI: 10.1016/j.neuron.2016.02.002.

    Article  Google Scholar 

  • McDonald, D., Price, M. N., Goodrich, J., Nawrocki, E. P., DeSantis, T. Z., Probst, A., Andersen, G. L., Knight, R., and Hugenholtz, P. (2012). “An improved Greengenes taxonomy with explicit ranks for ecological and evolutionary analyses of bacteria and archaea.” The ISME Journal, Vol 6, No. 3, pp. 610–618, DOI: 10.1038/ismej.2011.139.

    Article  Google Scholar 

  • Memarzadeh, M., Golparvar-Fard, M., and Niebles, J. C. (2013). “Automated 2D detection of construction equipment and workers from site video streams using histograms of oriented gradients and colors.” Automation in Construction, Vol. 32, pp. 24–37, DOI: 10.1016/j.autcon.2012.12.002.

    Article  Google Scholar 

  • Mohamed, A. S., Weng, Y., Ipson, S. S., and Jiang, J. (2007). “Face detection based on skin color in image by neural networks.” Proc. Int. Conf. of Intelligent and Advanced Systems, IEEE, Kuala Lumpur, Malaysia, pp. 779–783.

    Google Scholar 

  • Nallaperumal, K., Ravi, S., Babu, C. N. K., Selvakumar, R. K., Fred, A. L., Christopher, S., and Vinsley, S. S. (2007). “Skin detection using color pixel classification with application face detection: A comparative study.” Proc. Int. Conf. on Computational Intelligence and Multimedia Applications, IEEE, Sivakasi, Tamil Nadu, India, pp. 436–441.

    Google Scholar 

  • Park, M. W. and Brilakis, I. (2012). “Construction worker detection in video frames for initializing vision trackers.” Automation in Construction, Vol. 28, pp. 15–25, DOI: 10.1016/j.autcon.2012.06.001.

    Article  Google Scholar 

  • Petri, M., Orbai, A. M., Alarcón, G. S., Gordon, C., Merrill, J. T., Fortin, P. R., Bruce, I. N., Isenberg, D., Wallace, D. J., Nived, O., Sturfelt, G., Ramsey-Goldman, R., Bae, S. C., Hanly, J. G., Sánchez-Guerrero, J., Clarke, A., Aranow, C., Manzi, S., Urowitz, M., Gladman, D., Kalunian, K., Costner, M., Werth, V. P., Zoma, A., Bernatsky, S., Ruiz-Irastorza, G., Khamashta, M. A., Jacobsen, S., Buyon, J. P., Maddison, P., Dooley, M. A., van Vollenhoven, R. F., Ginzler, E., Stoll, T., Peschken, C., Jorizzo, J. L., Callen, J. P., Lim, S. S., Fessler, B. J., Inanc, M., Kamen, D. L., Rahman, A., Steinsson, K., Franks, A. G. Jr., Sigler, L., Hameed, S., Fang, H., Pham, N., Brey, R., Weisman, M. H., McGwin, G. Jr., and Magder, L. S. (2012). “Derivation and validation of the Systemic Lupus International Collaborating Clinics classification criteria for systemic lupus erythematosus.” Arthritis and Rheumatism, Vol. 64, No. 8, pp. 2677–2686, DOI: 10.1002/art.34473.

    Article  Google Scholar 

  • Plataniotis, K. and Venetsanopoulos, A. N. (2013). Color image processing and applications, Springer Science & Business Media, Germany.

    Google Scholar 

  • Power, D. M. (2011). “Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation.” Journal of Machine Learning Technologies, Vol. 2, pp. 37–63.

    Google Scholar 

  • Quinlan, J. R. (2014). C4. 5: Programs for machine learning, Elsevier, NY, USA.

    Google Scholar 

  • Radtke, J. P., Kuru, T. H., Boxler, S., Alt, C. D., Popeneciu, I. V., Huettenbrink, C., Klein, T., Steinemann, S., Bergstraesser, C., Roethke, M., Roth, W., Schlemmer, H., Hohenfellner, M., and Hadaschik, B. A. (2015). “Comparative analysis of transperineal template saturation prostate biopsy versus magnetic resonance imaging targeted biopsy with magnetic resonance imaging-ultrasound fusion guidance.” The Journal of Urology, Vol. 193, No. 1, pp. 87–94, DOI: 10.1016/j.juro.2014.07.098.

    Article  Google Scholar 

  • Rice, W. R. (1989). “Analyzing tables of statistical tests.” Evolution, Vol. 43, No. 1, pp. 223–225, DOI: 10.1111/j.1558-5646.1989.tb04220.x.

    Article  Google Scholar 

  • Rish, I. (2001). “An empirical study of the Naïve Bayes classifier.” Proc. Int. Conf. of the IJCAI 2001 workshop on empirical methods in artificial intelligence, IBM, pp. 41–46.

    Google Scholar 

  • Satio, T. and Rehmsmeier, M. (2015). “The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets.” PloS one, Vol. 10, No. 3, DOI: 10.1371/journal.pone.0118432.

    Google Scholar 

  • Seo, J. S., Han, S. U., Lee, S. H., and Kim, H. K. (2015). “Computer vision techniques for construction safety and health monitoring.” Advanced Engineering Informatics, Vol. 29, No. 2, pp. 239–251, DOI: 10.1016/j.aei.2015.02.001.

    Article  Google Scholar 

  • Shaik, K. B., Ganesan, P., Kalist, V., Sathish, B. S., and Jenitha, J. M. M. (2015). “Comparative study of skin color detection and segmentation in HSV and YCbCr color space.” Procedia Computer Science, Vol. 57, pp. 41–48, DOI: 10.1016/j.procs.2015.07.362.

    Article  Google Scholar 

  • Son, H., Hwang, N., Kim, C., and Kim, C. (2014). “Rapid and automated determination of rusted surface areas of a steel bridge for robotic maintenance systems.” Automation in Construction, Vol. 42, pp. 13–24, DOI: 10.1016/j.autcon.2014.02.016.

    Article  Google Scholar 

  • Son, H., Kim, C., and Kim, C. (2012). “Automated color model–based concrete detection in construction site images by using machine learning algorithms.” Journal of Computing in Civil Engineering, Vol. 26, No. 3, pp. 421–433, DOI: 10.1061/(ASCE)CP.1943-5487.0000141.

    Article  MathSciNet  Google Scholar 

  • Son, H., Kim, C., Hwang, N., Kim, C., and Kang, Y. (2014). “Classification of major construction materials in construction environments using ensemble classifiers.” Advanced Engineering Informatics, Vol. 28, No. 1, pp. 1–10, 2014, DOI: 10.1016/j.aei.2013.10.001.

    Article  Google Scholar 

  • Taha, A. A. and Haunbury, A. (2015). “Metrics for evaluating 3D medical image segmentation: Analysis, selection, and tool.” BMC Medical Imaging, Vol. 15, No. 1, DOI: 10.1186/s12880-015-0068-x.

    Google Scholar 

  • Tarabalka, Y., Fauvel, M., Chanussot, J., and Benediktsson, J. A. (2010). “SVM-and MRF-based method for accurate classification of hyperspectral images.” IEEE Geoscience and Remote Sensing Letters, Vol. 7, No. 4, pp. 736–740, DOI: 10.1109/LGRS.2010.2047711.

    Article  Google Scholar 

  • Wei, Z., Wang, W., Bradfield, J., Li, J., Cardinale, C., Frackelton, E., Kim, C., Mentch, F., van Steen, K., Visscher, P. M., Baldassano, R. N., and Hakonarson, H., (2013). “Large sample size, wide variant spectrum, and advanced machine-learning technique boost risk prediction for inflammatory bowel disease.” The American Journal of Human Genetics, Vol. 92, No. 6, pp. 1008–1012.

    Article  Google Scholar 

  • Witten, I. H., Frank, E., Hall, M. A., and Pal, C. J. (2016). Data Mining: Practical machine learning tools and techniques, Morgan Kaufmann., Ma, USA.

    Google Scholar 

  • Zou, J. and Kim, H. (2007). “Using hue, saturation, and value color space for hydraulic excavator idle time analysis.” Journal of Computing in Civil Engineering, Vol. 21, No. 4, pp. 238–246, DOI: 10.1061/(ASCE)0887-3801(2007)21:4(238).

    Article  Google Scholar 

  • Zou, J., Kim, B., Kim, H., and Al-Hussein, M. (2012). “An automated system for the creation of an urban infrastructure 3D model using image processing techniques.” KSCE Journal of Civil Engineering, Vol. 16, No. 1, pp. 9–17, DOI: 10.1007/s12205-012-1272-7.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dept. of Architectural Engineering, Chung-Aug University, Seoul, 06974, Korea

    Hyeonwoo Seong, Hyojoo Son & Changwan Kim

Authors
  1. Hyeonwoo Seong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hyojoo Son
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Changwan Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Changwan Kim.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Seong, H., Son, H. & Kim, C. A Comparative Study of Machine Learning Classification for Color-based Safety Vest Detection on Construction-Site Images. KSCE J Civ Eng 22, 4254–4262 (2018). https://doi.org/10.1007/s12205-017-1730-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12205-017-1730-3

Keywords

Search

Navigation