Skip to main content

Development of a Flexible Assembly System Using Industrial Robot with Machine Vision Guidance and Dexterous Multi-finger Gripper

  • Conference paper
  • First Online:
Precision Product-Process Design and Optimization

Abstract

In today’s era of mass customization, assembly automation systems should be designed with necessary production flexibility to cope with the growing product varieties to adapt to diverse customer requirements, yet the production costs should not be significantly different from those of comparable products made by mass production. In order to cope with this product variety-cost trade-off, robotics offers a flexible automation technology for turning assembly systems into efficient and flexible systems. Despite their great potential for high flexibility, there is a range of issues which must be addressed for its successful implementation. This chapter examines some of these key issues and challenges, reviews the results of previous research and describes our ongoing research on development of a flexible assembly system for mechanical products, using an industrial robot with machine vision guidance and dexterous multi-finger gripper. As part of the research work reported in this chapter, a Sexual Genetic Algorithm (SGA)-based approach for generation of optimal assembly sequence, a knowledge-based system for generating the robot task-level plan, a multi-finger robot gripper for flexible assembly based on a tendon-driven mechanism and an impedance control algorithm, and finally a strategy for implementation of robotic assembly under machine vision guidance have been presented.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Abdallah, M.E., R. Platt, B. Hargrave, and F. Permenter. 2012. Position control of tendon-driven fingers with position controlled actuators. In IEEE international conference on robotics and automation, RiverCentre, Saint Paul, Minnesota, USA, 14–18 May 2012.

    Google Scholar 

  • Alatartsev, S., S. Stellmacher, and F. Ortmeier. 2015. Robotic task sequencing problem: A survey. Journal of Intelligent and Robotic Systems: Theory and Applications 80 (2): 279–298.

    Article  Google Scholar 

  • Ambrose, R.O., H. Aldridge, R.S. Askew, R.R. Burridge, W. Bluethmann, M. Diftler, C. Lovchik, D. Magruder, and F. Rehnmark. 2000. Robonaut: NASA’s space humanoid. IEEE Intelligent System, 57–63, July/Aug 2000.

    Google Scholar 

  • Arai, H., and S. Tachi. 1991. Position control of a manipulator with passive joints using dynamic coupling. IEEE Transactions on Robotics and Automation 7 (4), Aug 1991.

    Google Scholar 

  • Backhaus, J., and G. Reinhart. 2013. Efficient application of Task oriented programming for assembly systems. In IEEE/ASME international conference on advanced intelligent mechatronics (AIM), Australia, 750–755.

    Google Scholar 

  • Bekey, G.A., R. Tomovic, and I. Zeljkovic. 1990. Control architecture for the Belgrade/USC hand. New York: Springer.

    Book  Google Scholar 

  • Bonneville, F., C. Perrard, and J.M. Henrioud. 1995. A genetic algorithm to generate and evaluate assembly plans. In Proceedings of INRIA/IEEE symposium on emerging technologies and factory automation, 231–239, Paris, France.

    Google Scholar 

  • Butterfass, J., G. Hirzinger, S. Knoch, and H. Liu. 1998. DLR’s multisensory articulated part I: Hard- and software architecture. IEEE International Conference on Robotics and Automation.

    Google Scholar 

  • Butterfass, J., M. Grebenstein, H. Liu, and G. Hirzinger. 2001. DLR-hand II: Next generation of a dextrous robot hand. In IEEE international conference on robotics and automation, vol. 1, 109–114.

    Google Scholar 

  • Cambon, S., F. Gravot, and R. Alami. 2004. A robot task planner that merges symbolic and geometric reasoning. In European conference on artificial intelligence (ECAI), 1–5, Apr 2004.

    Google Scholar 

  • Cao, P.B., and R.B. Xiao. 2007. Assembly planning using a novel immune approach. International Journal of Advanced Manufacturing Technology 31 (7): 770–782.

    MathSciNet  Google Scholar 

  • Chen, S., and Y.J. Liu. 2001. An adaptive genetic assembly sequence planner. International Journal of Computer Integrated Manufacturing 14 (5): 489–500.

    Article  Google Scholar 

  • Chen, R.S., K.Y. Lu, and P.H. Tai. 2004. Optimizing assembly planning through a three-stage integrated approach. International Journal of Production Economics 88 (3): 243–256.

    Article  Google Scholar 

  • Chen, H., B. Zhang, and G. Zhang. 2015. Robotic assembly. In Handbook of manufacturing engineering and technology, 2347–2400.

    Google Scholar 

  • Cho, J., H. Kim, and J. Sohn. 2010. Implementing automated robot task planning and execution based on description logic KB. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 6472, 217–228.

    Google Scholar 

  • Choi, Y.K., D.M. Lee, and Y.B. Cho. 2009. An approach to multi-criteria assembly sequence planning using genetic algorithms. International Journal of Advanced Manufacturing Technology 42: 180–188.

    Article  Google Scholar 

  • Deb, S.R., and S. Deb. 2010. Robotics technology and flexible automation. New Delhi: Tata McGraw Hill.

    Google Scholar 

  • Diftler, M.A., J.S. Mehling, M.E. Abdallah, N.A. Radford, L.B. Bridgwater, A.M. Sanders, R.S. Askew, D.M. Linn, J.D. Yamokoski, F.A. Permenter, B.K. Hargrave, and R. Platt. 2011. Robonaut 2—the first humanoid robot in space. In 2011 IEEE international conference on robotics and automation, Shanghai, China, 9–13 May 2011.

    Google Scholar 

  • Gao, X.H., M.H. Jin, L. Jiang, Z.W. Xie, P. He, L. Yang, Y.W. Liu, R. Wei, H.G. Cai, H. Liua, J. Butterfass, M. Grebenstein, N. Seitza, and G. Hirzinger. 2003. The HIT/DLR dexterous hand: Work in progress. In IEEE international conference on robotics & automation Taipei, Taiwan, 14–19 Sept 2003.

    Google Scholar 

  • Gao, L., W.R. Qian, X.Y. Li, and J.F. Wang. 2010. Application of memetic algorithm in assembly sequence planning. International Journal of Advanced Manufacturing Technology 49 (9–12): 1175–1184.

    Article  Google Scholar 

  • Gazeau, J.P., S. Zeghloul, M. Arsicualt, J.P. Lallemand. 2001. The LMS hand: Force and position controls in the aim of fine manipulation of objects. In IEEE International conference on robotics and automation, 2642–2648.

    Google Scholar 

  • Giarratano, J., and G. Riley. 2002. Expert systems principles and programming, 3rd ed. Thomson Learning and China Machine Press. ISBN 7-111-10844-2.

    Google Scholar 

  • Goh, K.S., A. Lim, and B. Rodrigues. 2003. Sexual selection for genetic algorithms. Artificial Intelligence Review 19: 123–152.

    Article  Google Scholar 

  • Golnabi, H., and A. Asdapour. 2007. Design and application of industrial machine vision systems. Robotics and Computer-Integrated Manufacturing 23: 630–637.

    Article  Google Scholar 

  • Gonzalez, R.C., and R.E. Woods. 2008. Digital image processing, 3rd ed. Pearson.

    Google Scholar 

  • Haralick, R.M., and L.G. Shapiro. 1992. Computer and robot vision, vol. II, Addison-Wesley.

    Google Scholar 

  • Jacobsen, S.C., J.E. Wood, D.F. Knutti, and K.B. Biggers. 1984. The UTAH/M.I.T. dextrous hand: Work in progress. The International Journal of Robotics Research.

    Article  Google Scholar 

  • Jacobsen, S., E. Iversen, D. Knutti, R. Johnson, and K. Biggers. 1986. Design of the Utah/M.I.T. dextrous hand. In 1986 IEEE international conference on robotics and automation, vol. 3, 1520–1532, Apr 1986.

    Google Scholar 

  • Karthik, G.V.S.K., and S. Deb. 2017. A methodology for assembly sequence optimization by hybrid Cuckoo-Search Genetic Algorithm. Journal of Advanced Manufacturing Systems (in press).

    Google Scholar 

  • Kobari, Y., T. Nammoto, J. Kinugawa, and K. Kosuge. 2013. Vision based compliant motion control for part assembly. In IEEE/RSJ international conference on intelligent robots and systems (IROS), Japan, 293–298, Nov 2013.

    Google Scholar 

  • LiCheng, W., G. Carbone, and M. Ceccarelli. 2009. Designing an underactuated mechanism for a 1 active DOF finger operation. Mechanism and Machine Theory 44: 336–348.

    Article  Google Scholar 

  • Li, X., K. Qin, B. Zeng, L. Gao, and J. Su. 2016. Assembly sequence planning based on an improved harmony search algorithm. International Journal of Advanced Manufacturing Technology 84: 2367–2380.

    Article  Google Scholar 

  • Liu, Hong, P. Meusel, G. Hirzinger, Minghe Jin, Yiwei Liu, and Zongwu Xie. 2008. The modular multisensory DLR-HIT-hand: Hardware and software architecture. IEEE/ASME Transactions on Mechatronics 13 (4).

    Google Scholar 

  • Loucks, C., V. Johnson, P. Boissiere, G. Starr, and J. Steele. 1987. Modeling and control of the Stanford/JPL hand. In International conference on robotics and automation, vol. 4, 573–578, Mar 1987.

    Google Scholar 

  • Lovchik, C.S., and M.A. Diftler. 1999. The robonaut hand: A dexterous robot hand for space. In IEEE international conference on robotics and automation, 907–912.

    Google Scholar 

  • Lv, H.G., and C. Lu. 2010. An assembly sequence planning approach with a discrete particle swarm optimization algorithm. International Journal of Advanced Manufacturing Technology 50 (5–8): 761–770.

    Article  Google Scholar 

  • Marian, R.M., L.H.S. Luong, and K. Abhary. 2006. A genetic algorithm for the optimisation of assembly sequences. Computers & Industrial Engineering 50 (4): 503–527.

    Article  Google Scholar 

  • Mishra, A., and S. Deb. 2016a. An intelligent methodology for assembly tools selection and assembly sequence optimisation. In Proceedings of CAD/CAM, robotics and factories of the Future, India, 323–333, Jan 2016.

    Google Scholar 

  • Mishra, A., and S. Deb. 2016b. A GA based parameter meta-optimization of ACO algorithm for solving assembly sequence optimization. In Proceedings of international conference on computers & industrial engineering CIE 46, Tianjin, China, 29–31 Oct 2016.

    Google Scholar 

  • Mishra, A., and S. Deb. 2016c. Assembly sequence optimization using a Flower Pollination Algorithm-based approach. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-016-1261-7.

    Article  Google Scholar 

  • Mishra, A., and S. Deb. 2017. Robotic assembly sequence planning and optimization by cuckoo search algorithm. In Proceedings of international conference on production research 24th ICPR, Poznan, Poland, July 30–Aug 3 2017.

    Google Scholar 

  • Okada, T. 1986. Computer control of multi-jointed finger system for precise object handling. International Trends in Manufacturing Technology Robot Grippers, 391–417.

    Google Scholar 

  • Osuna, R.V., T. Tallinen, J.L.M. Lastra, and R. Tuokko. 2003. Assembly and task planning in a collaborative web-based environment based on assembly process modeling methodology. In Proceedings of IEEE international symposium on assembly and task planning, 79–84, Jan 2003.

    Google Scholar 

  • Ozawa, R., K. Hashirii, Y. Yoshimura, M. Moriya, and H. Kobayashi. 2014. Design and control of a three-fingered tendon-driven robotic hand with active and passive tendons. Autonomous Robots 36: 67–78.

    Article  Google Scholar 

  • Pal, S., S. Chattopadhyay, and S.R. Deb. 2008. Design and development of a multi-degree of freedom dexterous instrumented Robot Gripper. Sensors and Transducers Journal 87 (1): 63–73.

    Google Scholar 

  • Pena-Cabrera, M. 2005. Machine vision approach for robotic assembly. Assembly Automation 25 (3): 204–217.

    Article  Google Scholar 

  • Ramos, C., and E. Oliveira. 1992. Planning, execution and sensor-based reaction for assembly robotic tasks, Technical paper, Faculdade de Engenharia da Universidade do Porto, Portugal.

    Google Scholar 

  • Sainul, I.A., S. Deb, and A.K. Deb. 2016. A three finger tendon driven robotic hand design and its kinematics model. In International conference on CADCAM, robotics and factories of the future, Kolaghat, India, Jan 2016.

    Google Scholar 

  • Salisbury, K.S., and B. Roth. 1983. Kinematics and force analysis of articulated mechanical hands. Journal of Mechanisms, Transmissions and Actuation in Design 105: 35–41.

    Article  Google Scholar 

  • Solomon, C., and T. Breckon. 2011. Fundamentals of digital image processing. Wiley & Blackwell.

    Google Scholar 

  • Tlegenov, Y., K. Telegenov, and A. Shintemirov. 2014. An open-source 3D printed underactuated robotic gripper. In IEEE/ASME international conference on mechatronic and embedded systems and applications, Senigallia, 10–12 Sept 2014.

    Google Scholar 

  • Townsend, W.T. 2000. MCB—industrial robot feature article-barrett hand grasper. Industrial Robot: An International Journal 27 (3): 181–188.

    Article  Google Scholar 

  • Thomas, U., and F.M. Wahl. 2010. Assembly planning and task planning—two prerequisites for automated robot programming. Robotic Systems for Handling and Assembly, STAR 67: 333–354.

    Article  Google Scholar 

  • Ulrich, N., R. Paul, and R. Bajcsy. 1988. A medium-complexity complaint end effector. In: IEEE international conference on robotics and automation.

    Google Scholar 

  • Wang, Y., J. Ostermann, and Y.Q. Zhang. 2001. Video processing and communications. Prentice Hall.

    Google Scholar 

  • Wang, J.F., J.H. Liu, and Y.F. Zhong. 2005. A novel ant colony algorithm for assembly sequence planning. International Journal of Advanced Manufacturing Technology 25: 1137–1143.

    Article  Google Scholar 

  • Xing, Y.F., and Y.S. Wang. 2012. Assembly sequence planning based on a hybrid particle swarm optimisation and genetic algorithm. International Journal of Production Research 50 (24): 7303–7312.

    Article  Google Scholar 

  • Zhang, B., J. Wang, G. Rossano, C. Martinez, and S. Kock. 2011. Vision-guided robot alignment for scalable, flexible assembly automation. In IEEE international conference on robotics and biomimetics, Thailand, 944–951, Dec 2011.

    Google Scholar 

  • Zhou, W., J.R. Zheng, J.J. Yan, and J.F. Wang. 2011. A novel hybrid algorithm for assembly sequence planning combining bacterial chemotaxis with genetic algorithm. International Journal of Advanced Manufacturing Technology 52 (5–8): 715–724.

    Article  Google Scholar 

Download references

Acknowledgements

The authors gratefully acknowledge the funding support received from Indian Institute of Technology Kharagpur under the Centre for Excellence in Robotics grants.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sankha Deb .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mishra, A., Sainul, I.A., Bhuyan, S., Deb, S., Sen, D., Deb, A.K. (2018). Development of a Flexible Assembly System Using Industrial Robot with Machine Vision Guidance and Dexterous Multi-finger Gripper. In: Pande, S., Dixit, U. (eds) Precision Product-Process Design and Optimization. Lecture Notes on Multidisciplinary Industrial Engineering. Springer, Singapore. https://doi.org/10.1007/978-981-10-8767-7_2

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-8767-7_2

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-8766-0

  • Online ISBN: 978-981-10-8767-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics