Skip to main content

Strategies for Selecting Best Approach Direction for a Sweet-Pepper Harvesting Robot

  • Conference paper
  • First Online:
Towards Autonomous Robotic Systems (TAROS 2017)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10454))

Included in the following conference series:

Abstract

An autonomous sweet pepper harvesting robot must perform several tasks to successfully harvest a fruit. Due to the highly unstructured environment in which the robot operates and the presence of occlusions, the current challenges are to improve the detection rate and lower the risk of losing sight of the fruit while approaching the fruit for harvest. Therefore, it is crucial to choose the best approach direction with least occlusion from obstacles.

The value of ideal information regarding the best approach direction was evaluated by comparing it to a method attempting several directions until successful harvesting is performed. A laboratory experiment was conducted on artificial sweet pepper plants using a system based on eye-in-hand configuration comprising a 6DOF robotic manipulator equipped with an RGB camera. The performance is evaluated in laboratorial conditions using both descriptive statistics of the average harvesting times and harvesting success as well as regression models. The results show roughly 40–45% increase in average harvest time when no a-priori information of the correct harvesting direction is available with a nearly linear increase in overall harvesting time for each failed harvesting attempt. The variability of the harvesting times grows with the number of approaches required, causing lower ability to predict them.

Tests show that occlusion of the front of the peppers significantly impacts the harvesting times. The major reason for this is the limited workspace of the robot often making the paths to positions to the side of the peppers significantly longer than to positions in front of the fruit which is more open.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Comba, L., Gay, P., Piccarolo, P., Ricauda Aimonino, D.: Robotics and automation for crop management: trends and perspective. In: International Conference Ragusa SHWA 2010, pp. 471–478 (2010)

    Google Scholar 

  2. Bac, C.W.: Improving obstacle awareness for robotic harvesting of sweet-pepper (2015)

    Google Scholar 

  3. Bac, C.W., Henten, E.J., Hemming, J., Edan, Y.: Harvesting robots for high-value crops: state-of-the-art review and challenges ahead. J. F. Robot. 31, 888–911 (2014)

    Article  Google Scholar 

  4. Edan, Y., Flash, T., Peiper, U.M., Shmulevich, I., Sarig, Y.: Near-minimum-time task planning for fruit-picking robots. IEEE Trans. Robot. Autom. 7, 48–56 (1991)

    Article  Google Scholar 

  5. Harel, B., Kurtser, P., Van Herck, L., Parmet, Y., Edan, Y.: Sweet pepper maturity evaluation via multiple viewpoints color analyses. In: CIGR-AgEng Conference (2016)

    Google Scholar 

  6. Hemming, J., Ruizendaal, J., Hofstee, J.W., van Henten, E.J.: Fruit detectability analysis for different camera positions in sweet-pepper. Sensors 14, 6032–6044 (2014)

    Article  Google Scholar 

  7. Gongal, A., Amatya, S., Karkee, M., Zhang, Q., Lewis, K.: Sensors and systems for fruit detection and localization: a review. Comput. Electron. Agric. 116, 8–19 (2015)

    Article  Google Scholar 

  8. Vitzrabin, E., Edan, Y.: Adaptive thresholding with fusion using a RGBD sensor for red sweet-pepper detection. Biosyst. Eng. 146, 45–56 (2016)

    Article  Google Scholar 

  9. Rosenbaum, D.A., Cohen, R.G., Meulenbroek, R.G.J., Vaughan, J.: Plans for grasping objects. In: Motor Control and Learning, pp. 9–25. Kluwer Academic Publishers, Boston (2006)

    Google Scholar 

  10. Eizicovits, D., Berman, S.: Efficient sensory-grounded grasp pose quality mapping for gripper design and online grasp planning. Rob. Auton. Syst. 62, 1208–1219 (2014). doi:10.1016/j.robot.2014.03.011

    Article  Google Scholar 

  11. Eizicovits, D., van Tuijl, B., Berman, S., Edan, Y.: Integration of perception capabilities in gripper design using graspability maps. Biosyst. Eng. 146, 98–113 (2016). doi:10.1016/j.biosystemseng.2015.12.016

    Article  Google Scholar 

  12. Kapach, K., Barnea, E., Mairon, R., Edan, Y., Ben-Shahar, O.: Computer vision for fruit harvesting robots–state of the art and challenges ahead. Int. J. Comput. Vis. Robot. 3, 4–34 (2012)

    Article  Google Scholar 

  13. Barth, R., Hemming, J., van Henten, E.J.: Design of an eye-in-hand sensing and servo control framework for harvesting robotics in dense vegetation. Biosyst. Eng. 146, 71–84 (2016). doi:10.1016/j.biosystemseng.2015.12.001

    Article  Google Scholar 

  14. Hellström, T., Ringdahl, O.: A software framework for agricultural and forestry robots. Ind. Robot. Int. J. 40, 20–26 (2013). doi:10.1108/01439911311294228

    Article  Google Scholar 

  15. Ringdahl, O., Kurtser, P., Barth, R., Edan, Y.: Operational flow of an autonomous sweet pepper harvesting robot. In: The 5th Israeli Conference on Robotics 2016, Air Force Conference Center Hertzilya, Israel, 13–14 April 2016

    Google Scholar 

  16. Benoit, K.: Linear regression models with logarithmic transformations. London School of Economics, London (2011)

    Google Scholar 

  17. Greenwood, P.E., Nikulin, M.S.: A Guide to Chi-Squared Testing. John Wiley & Sons, New York (1996)

    MATH  Google Scholar 

Download references

Acknowledgments

This research was partially supported by the European Commission (SWEEPER GA no. 66313), by the Helmsley Charitable Trust through the Agricultural, Biological and Cognitive Robotics Center, and by the Rabbi W. Gunther Plaut Chair in Manufacturing Engineering, both at Ben-Gurion University of the Negev. The authors would like to acknowledge Peter Hohnloser at Computing Science department, Umeå University for his significant support and implementation of parts of the software system used in this research.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Polina Kurtser .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Ringdahl, O., Kurtser, P., Edan, Y. (2017). Strategies for Selecting Best Approach Direction for a Sweet-Pepper Harvesting Robot. In: Gao, Y., Fallah, S., Jin, Y., Lekakou, C. (eds) Towards Autonomous Robotic Systems. TAROS 2017. Lecture Notes in Computer Science(), vol 10454. Springer, Cham. https://doi.org/10.1007/978-3-319-64107-2_41

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-64107-2_41

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-64106-5

  • Online ISBN: 978-3-319-64107-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics