Abstract
The automatic handling of pouch-parceled goods is still challenging because the fillings cause almost random variations of the pouch geometry during conveyance. This paper presents a novel vision-based detection and tracking framework for robustly localizing and tracking pouch-parceled goods in real-time. It is exemplarily integrated in a Cover Belt Conveyor (CBC) system to decide whether and when pouches have to be separated. The core concepts include the estimation of the current pouch velocity using sparse optical flow, the detection and tracking of custom markers by means of structural image analysis and supervised classification, the verification of contextual constraints, and, eventually, the execution of a cutting strategy. The presented concepts tackle the general challenges superimposed by pouch packagings and are thus applicable in any other related automation scenarios as well. An average per-frame processing time of less than 20 ms, an averaged detection accuracy of 99.93% and a cutting accuracy less than 8 mm prove the real-time capabilities, robustness and applicability of the approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
SomTec GmbH, “Beutelvereinzelung”, http://www.somtec.de/.
- 2.
RonTech, “SpaceFeeder: Universal Infeed System”, http://www.rontech.ch/.
- 3.
This is practically impossible due to pouch bulgings.
References
Leiking, L.: Method of automated order-picking of pouch-packed goods, Ph.D. dissertation, Technical University of Dortmund, July 2007
Ceresana, Market Study: Polyethylene LDPE, vol. 2, April 2010
European Union (eurostat Pocketbooks), Key Figures on European Business - With Special Feature on SMEs (2011)
Federal Statistical Office of Germany, Produzierendes Gewerbe - Produktion des Verarbeitenden Gewerbes sowie des Bergbaus und der Gewinnung von Steinen und Erden, Statistisches Bundesamt, Fachserie 4, Reihe 3.1 (2015), released 27 Apr 2015
Thomas, I., Davie, W., Weidenhamer, D.: Quarterly retail e-commerce sales, U.S. Department of Commerce, May 2015
Genc, Y., Riedel, S., Souvannavong, F., Akinlar, C., Navab, N.: Marker-less tracking for AR: a learning-based approach. In: Proceedings of the International Symposium on Mixed and Augmented Reality, ISMAR, pp. 295–304, September 2002
Ohbuchi, E., Hanaizumi, H., Hock, L.: Barcode readers using the camera device in mobile phones. In: Proceedings of the 2004 International Conference on Cyberworlds, CW 2004, pp. 260–265 (2004)
Yahyanejad, S., Ström, J.: Removing motion blur from barcode images. In: Confernce on Computer Vision and Pattern Recognition Workshops, CVPRW 2010, pp. 41–46. IEEE Computer Society, June 2010
Shams, R., Sadeghi, P.: Bar code recognition in highly distorted and low resolution images. In: International Conference on Acoustics, Speech and Signal Processing, ICASSP 2007, vol. 1, pp. I-737-I-740. IEEE Computer Society, April 2007
Weichert, F., Böckenkamp, A., Prasse, C., Timm, C., Rudak, B., Hölscher, K., ten Hompel, M.: Towards sensor-actuator coupling in an automated order picking system by detecting sealed seams on pouch packed goods. J. Sens. Actuator Netw. 3(4), 245 (2014)
Schweiger, F., Zeisl, B., Georgel, P., Schroth, G., Steinbach, E., Navab, N.: Maximum detector response markers for SIFT and SURF. In: Vision, Modeling and Visualization Workshop, VMV 2009. Eurographics Association, Braunschweig, pp. 1–10, November 2009
Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (SURF). In: CVI, vol. 110. Elsevier Science Inc., New York (2008)
Bouguet, J.: Pyramidal implementation of the lucas kanade feature tracker, Intel Corp: Microprocessor Research Labs, Tech. Rep. (1999)
Gonzales, R., Woods, R.: Digital Image Processing, 2nd edn. Prentice Hall International (2002)
Ester, M., Kriegel, H., Sander, J., Xu, X.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining, KDD 1996, pp. 226–231. AAAI Press, August 1996
Zuiderveld, K.: Contrast limited adaptive histogram equalization. In: Heckbert, P. (ed.) Graphics Gems IV, pp. 474–485. Academic Press Professional Inc., San Diego (1994)
Schölkopf, B., Burges, C., Smola, A.: Advances in Kernel Methods: Support Vector Learning. MIT Press, Cambridge (1999)
Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Böckenkamp, A., Weichert, F., Prasse, C. (2018). A Robust, Real-Time Capable Framework for Fully Automated Order Picking of Pouch-Parceled Goods. In: Bi, Y., Kapoor, S., Bhatia, R. (eds) Proceedings of SAI Intelligent Systems Conference (IntelliSys) 2016. IntelliSys 2016. Lecture Notes in Networks and Systems, vol 16. Springer, Cham. https://doi.org/10.1007/978-3-319-56991-8_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-56991-8_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-56990-1
Online ISBN: 978-3-319-56991-8
eBook Packages: EngineeringEngineering (R0)