Inductive Machine Learning with Image Processing for Objects Detection of a Robotic Arm with Raspberry PI

  • Mao Queen Garzón QuirozEmail author
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 895)


Goals. The present study was designed to build a prototyping and develop algorithms that allow the detection, classification, and movement of objects of a robotic arm of 4 DOF with the following technologies: ArmUno arm structure, Raspberry Pi 3 B+, PiCam 2.1, driver PCA9685 for servomotors, Opencv3, and python. Another goal was to measure the effectiveness of prediction and classification of objects photographed by the robotic arm, using machine learning with the KNN classifier method.

Methodology. The generation of a dataset of 800 photographic images was proposed, in 4 categories: volumetric geometric shapes conformed by 200 images each one of them. With this, processing techniques were applied to the image captured by the camera to detect the object in the image: Grayscale filtering, Gaussian filtering, and threshold.

Then, the characteristics of the object were obtained through the first two invariant moments of HU, and finally, the machine learning method KNN was applied to predict, that the image captured by the robotic arm belongs or not to a certain category. In this way, the robotic arm decides to move the object or not.

Results. According to the plot of the obtained data described in the results section; the level of correct answers increases markedly by using the techniques described above. The prediction and classification using KNN were remarkable, For all the tests carried out The average effectiveness of KNN method was 95.42%. Once the scripts were integrated, the operation of the robotic arm was satisfactory.


Opencv3 Python Machine learning KNN Robotics Raspberry Pi 


  1. 1.
    Sharma, J., et al.: IOP Conference Series: Materials Science and Engineering, vol. 263, p. 052049 (2017)CrossRefGoogle Scholar
  2. 2.
    Anandhalli, M., Baligar, V.P.: A novel approach in real-time vehicle detection and tracking using Raspberry Pi. Alexandria Eng. J. 57, 1597–1607 (2017). ISSN 1110-0168CrossRefGoogle Scholar
  3. 3.
    Vazquez Navarro, D.: Control of a robotic arm using an Omega 2+ module. Thesis, Universitat Politècnica de Catalunya (2018)Google Scholar
  4. 4.
    Rahman, M.F., Patterson, D., Cheok, A., Betz, R.: 30 - motor drives. In: Rashid, M.H. (ed.) Power Electronics Handbook, 4th edn, pp. 945–1021. Butterworth-Heinemann, Oxford (2018). ISBN 978-0-12-811407-0CrossRefGoogle Scholar
  5. 5.
    Perumal, V.S.A., Baskaran, K., Rai, S.K.: Implementation of effective and low-cost building monitoring system (BMS) using Raspberry PI. Energy Proc. 143, 179–185 (2017). ISSN 1876-6102CrossRefGoogle Scholar
  6. 6.
    Soriano, A., Marn, L., Valls, M., Valera, A., Albertos, P.: Low cost platform for automatic control education based on open hardware. IFAC Proc. Vol. 47(3), 9044–9050 (2014). ISSN 1474-6670CrossRefGoogle Scholar
  7. 7.
    Di Piazza, M.C., Pucci, M.: Techniques for efficiency improvement in PWM motor drives. Electr. Power Syst. Res. 136, 270–280 (2016). ISSN 0378-7796CrossRefGoogle Scholar
  8. 8.
    Soriano, A., Marin, L., Valles, M., Valera, A., Albertos, P.: Low cost platform for automatic control education based on open hardware. IFAC Proc. Vol. 47(3), 9044–9050 (2014). ISSN 1474-6670, ISBN 9783902823625CrossRefGoogle Scholar
  9. 9.
    Beyeler, M.: Machine Learning for OpenCV. Intelligent Image Processing with Python, 1st edn. Packt Publishing, Birmingham (2017). ISBN 978-1-78398-028-4Google Scholar
  10. 10.
    Muller, A.C., Guido, S.: Introduction to Machine Learning with Python, Kindle edn. O’Reilly Media, Sebastopol (2017). ISBN 978-1-449-36941-5Google Scholar
  11. 11.
    Monk, S.: Raspberry Pi CookBook, 2nd edn. O’Reilly Media, Sebastopol (2016). ISBN 978-1-491-93910-9Google Scholar
  12. 12.
    Yoon, D.C., Mol, A., Benn, D.K., Benavides, E.: Digital radio-graphic image processing and analysis. Dent. Clin. North Am. 62(3), 341–359 (2018). ISSN 0011-8532, ISBN 9780323610766CrossRefGoogle Scholar
  13. 13.
    Tlach, V., Kuric, I., Kumicakova, D., Rengevic, A.: Possibilities of a robotic end of arm tooling control within the software platform ROS. Proc. Eng. 192, 875–880 (2017). 12th International Scientific Conference of Young Scientists on Sustainable, Modern and Safe Transport. ISSN 1877-7058CrossRefGoogle Scholar
  14. 14.
    Makris, S., et al.: Dual arm robot in cooperation with humans for flexible assembly. CIRP Ann. 66(1), 13–16 (2017). ISSN 0007-8506CrossRefGoogle Scholar
  15. 15.
    Sunny, T.D., Aparna, T., Neethu, P., Venkateswaran, J., Vishnupriya, V., Vyas, P.S.: Robotic arm with brain. Computer interfacing. Proc. Technol. 24, 1089–1096 (2016). International Conference on Emerging Trends in Engineering, Science and Technology, ICETEST 2015. ISSN 2212-0173CrossRefGoogle Scholar
  16. 16.
    Kadir, W.M.H.W., Samin, R.E., Ibrahim, B.S.K.: Internet controlled robotic arm. Proc. Eng. 41, 1065–1071 (2012). International Symposium on Robotics and Intelligent Sensors, IRIS 2012. ISSN 1877-7058CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Universidad Católica de Santiago de GuayaquilGuayaquilEcuador
  2. 2.Facultad de ingeniería industrialUniversidad de GuayaquilGuayaquilEcuador

Personalised recommendations