Abstract
In this article, a q-learning control strategy is proposed for a system consisting of a UAV lifting a damped pendulum from the ground. This dynamic system is highly nonlinear and thereafter, it represents a challenging task to get a smooth and precise behaviour. Aerial transportation of a pendulum in a stable way is a step forward in the state of art, which permits to study the delivery of different deformable linear objects.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Khan, M.J., Hong, K.S.: Hybrid EEG-fNIRS-based eight-command decoding for BCI: application to quadcopter control. Front. Neurorobotics 11, 6 (2017)
Kinjo, K., Uchibe, E., Doya, K.: Evaluation of linearly solvable Markov decision process with dynamic model learning in a mobile robot navigation task. Front. Neurorobotics 7, 7 (2013)
Estevez, J., Graña, M., Lopez-Guede, J.M.: Online fuzzy modulated adaptive PD control for cooperative aerial transportation of deformable linear objects. Integr. Comput. Aided Eng. 24(1), 41–55 (2017)
Lopez-Guede, J.M., Fernandez-Gauna, B., Graña, M.: State-action value function modeled by ELM in reinforcement learning for hose control problems. Int. J. Uncertainty Fuzziness Knowl. Based Syst. 21(supp02), 99–116 (2013)
Estevez, J., Lopez-Guede, J.M., Graña, M.: Particle swarm optimization quadrotor control for cooperative aerial transportation of deformable linear objects. Cybern. Syst. 47(1–2), 4–16 (2016)
Sun, L., Castagno, J.D., Hedengren, J.D., Beard, R.W.: Parameter estimation for towed cable systems using moving horizon estimation. IEEE Trans. Aerosp. Electron. Syst. 51(2), 1432–1446 (2015)
Goodarzi, F.A., Lee, D., Lee, T.: Geometric control of a quadrotor UAV transporting a payload connected via flexible cable. Int. J. Control Autom. Syst. 13(6), 1486–1498 (2015)
Lee, T.: Geometric controls for a tethered quadrotor UAV. In: 2015 IEEE 54th Annual Conference on Decision and Control (CDC), pp. 2749–2754. IEEE, December 2015
Michael, N., Fink, J., Kumar, V.: Cooperative manipulation and transportation with aerial robots. Auton. Robots 30(1), 73–86 (2011)
Wang, C., Song, B., Huang, P., Tang, C.: Trajectory tracking control for quadrotor robot subject to payload variation and wind gust disturbance. J. Intell. Robot. Syst. 83(2), 315–333 (2016)
Lupashin, S., D’Andrea, R.: Stabilization of a flying vehicle on a taut tether using inertial sensing. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2432–2438. IEEE, November 2013
Williams, P., Lapthorne, P., Trivailo, P.: Circularly-towed lumped mass cable model validation from experimental data. In: AIAA Modeling and Simulation Technologies Conference and Exhibit, p. 6817 (2006)
Choo, Y.I., Casarella, M.J.: A survey of analytical methods for dynamic simulation of cable-body systems. J. Hydronaut. 7(4), 137–144 (1973)
Murray, R.M.: Trajectory generation for a towed cable system using differential flatness. In: IFAC world Congress, pp. 395–400, July 1996
Skop, R.A., Choo, Y.I.: The configuration of a cable towed in a circular path. J. Aircr. 8(11), 856–862 (1971)
Clifton, J.M., Schmidt, L.V., Stuart, T.D.: Dynamic modeling of a trailing wire towed by an orbiting aircraft. J. Guidance Control Dyn. 18(4), 875–881 (1995)
Sun, L.: Dynamic modeling, trajectory generation and tracking for towed cable systems. Ph.D. dissertation (2012)
Chatjigeorgiou, I.K.: A finite differences formulation for the linear and nonlinear dynamics of 2D catenary risers. Ocean Eng. 35(7), 616–636 (2008)
Gobat, J.I., Grosenbaugh, M.A.: Dynamics in the touchdown region of catenary moorings. Int. J. Offshore Polar Eng. 11(04) (2001)
Doroudgar, S.: Static and dynamic modeling and simulation of the umbilical cable in a tethered unmanned aerial system. Doctoral dissertation, Applied Sciences: School of Mechatronic Systems Engineering (2016)
Cruz, P.J., Fierro, R.: Cable-suspended load lifting by a quadrotor UAV: hybrid model, trajectory generation, and control. Auton. Robots 41(8), 1629–1643 (2017)
Estevez, J., Graña, M.: Robust control tuning by PSO of aerial robots hose transportation. In: Ferrández Vicente, J.M., Álvarez-Sánchez, J.R., de la Paz López, F., Toledo-Moreo, F.J., Adeli, H. (eds.) IWINAC 2015. LNCS, vol. 9108, pp. 291–300. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-18833-1_31
Bou-Ammar, H., Voos, H., Ertel, W.: Controller design for quadrotor UAVs using reinforcement learning. In: 2010 IEEE International Conference on Control Applications (CCA), pp. 2130–2135. IEEE, September 2010
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Estévez, J., Loṕez-Guede, J.M. (2019). Control of Transitory Take-Off Regime in the Transportation of a Pendulum by a Quadrotor. In: Ferrández Vicente, J., Álvarez-Sánchez, J., de la Paz López, F., Toledo Moreo, J., Adeli, H. (eds) From Bioinspired Systems and Biomedical Applications to Machine Learning. IWINAC 2019. Lecture Notes in Computer Science(), vol 11487. Springer, Cham. https://doi.org/10.1007/978-3-030-19651-6_12
Download citation
DOI: https://doi.org/10.1007/978-3-030-19651-6_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-19650-9
Online ISBN: 978-3-030-19651-6
eBook Packages: Computer ScienceComputer Science (R0)