Applications of Randomized Algorithms

  • Roberto Tempo
  • Giuseppe Calafiore
  • Fabrizio Dabbene
Part of the Communications and Control Engineering book series (CCE)


Probabilistic design methods and randomized algorithms have been developed for several applications related to systems and control. In this chapter, we first present an overview of some of the main areas where randomized methods have been successfully used. Subsequently, we provide a more detailed description of some selected applications, which include the computation of PageRank in the Google search engine, control design of UAVs (unmanned aerial vehicles), congestion control of high-speed communication networks, robustness of flexible structures and quadratic stability of sampled-data quantized systems.


Unmanned Aerial Vehicle Congestion Control Outgoing Link Active Queue Management PageRank Algorithm 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Abate A, Prandini M, Lygeros J, Sastry S (2008) Probabilistic reachability and safety for controlled discrete time stochastic hybrid systems. Automatica 44:2724–2734 MathSciNetMATHCrossRefGoogle Scholar
  2. 2.
    Abdallah C, Ariola M, Dorato P, Panchenko D (2001) Statistical-learning control of multiple-delay systems with applications to ATM networks. Kybernetica 120:355–365 Google Scholar
  3. 3.
    Abdallah CT, Tanner HG (2007) Complex networked systems: introduction to the special section. IEEE Control Syst Mag 27:30–32 CrossRefGoogle Scholar
  4. 12.
    Alippi C (2002) A probably approximately correct framework to estimate performance degradation in embedded systems. IEEE Trans Comput-Aided Des Integr Circuits Syst 21:749–762 CrossRefGoogle Scholar
  5. 13.
    Alippi C (2002) Randomized algorithms: a system-level, poly-time analysis of robust computation. IEEE Trans Comput 51:740–749 MathSciNetCrossRefGoogle Scholar
  6. 14.
    Alippi C, Catelani M, Fort A, Mugnaini M (2002) SBT soft fault diagnosis in analog electronic circuits: a sensitivity-based approach by randomized algorithms. IEEE Trans Instrum Meas 51:1116–1125 CrossRefGoogle Scholar
  7. 15.
    Allgöwer F, Doyle F (2011) Introduction to the special issue on systems biology. Automatica 47:1095–1096 CrossRefGoogle Scholar
  8. 16.
    Alpcan T, Başar T (2005) A utility-based congestion control scheme for internet-style networks with delay. IEEE Trans Netw 13(6):1261–1274 CrossRefGoogle Scholar
  9. 17.
    Alpcan T, Başar T, Tempo R (2005) Randomized algorithms for stability and robustness analysis of high speed communication networks. IEEE Trans Neural Netw 16:1229–1241 CrossRefGoogle Scholar
  10. 19.
    Anantharam V, Walrand J (1990) Special issue on control methods for communication networks—editorial. Automatica 35:1891 MathSciNetGoogle Scholar
  11. 24.
    Anonymous (1997) Flying qualities of piloted aircraft. Technical Report MIL-HDBK-1797, Department of Defense, USA Google Scholar
  12. 25.
    Antsaklis PJ, Baillieul J (2004) Guest editorial—special issue on networked control systems. IEEE Trans Autom Control 49(9):1421–1422 MathSciNetCrossRefGoogle Scholar
  13. 26.
    Antsaklis PJ, Baillieul J (2007) Special issue on the technology of networked control systems. Proc IEEE 95:5–8 CrossRefGoogle Scholar
  14. 31.
    Avrachenkov K, Litvak N, Nemirovsky D, Osipova N (2007) Monte Carlo methods in PageRank computation: when one iteration is sufficient. SIAM J Numer Anal 45:890–904 MathSciNetMATHCrossRefGoogle Scholar
  15. 32.
    Azuma S-I, Imura J-I (2007) Polynomial-time probabilistic controllability analysis of discrete-time piecewise affine systems. IEEE Trans Autom Control 52:470–482 MathSciNetCrossRefGoogle Scholar
  16. 34.
    Başar T, Olsder GJ (1999) Dynamic noncooperative game theory. SIAM, Philadelphia MATHGoogle Scholar
  17. 38.
    Balas GJ, Doyle JC, Glover K, Packard A, Smith R (1993) μ-analysis and synthesis toolbox. MUSYN Inc and The MathWorks Inc, Natick Google Scholar
  18. 59.
    Blanchini F (1999) Set invariance in control. Automatica 35:1747–1767 MathSciNetMATHCrossRefGoogle Scholar
  19. 60.
    Blanchini F, Miani S (2008) Set-theoretic methods in control. Birkhäuser, Boston MATHGoogle Scholar
  20. 69.
    Boyd S, Ghosh A, Prabhakar B, Shah D (2006) Randomized gossip algorithms. IEEE Trans Inf Theory 52:2508–2530 MathSciNetCrossRefGoogle Scholar
  21. 72.
    Brin S, Page L (1998) The anatomy of a large-scale hypertextual Web search engine. Comput Netw ISDN Syst 30:107–117 CrossRefGoogle Scholar
  22. 73.
    Brockett RW, Liberzon D (2000) Quantized feedback stabilization of linear systems. IEEE Trans Autom Control 45:1279–1289 MathSciNetMATHCrossRefGoogle Scholar
  23. 75.
    Brown WG, Viola L (2010) Convergence rates for arbitrary statistical moments of random quantum circuits. Phys Rev Lett 104:250501/1–4 CrossRefGoogle Scholar
  24. 76.
    Bushnell LG (2001) Special issue on networks and control—editorial. IEEE Control Syst Mag 21:22–23 CrossRefGoogle Scholar
  25. 77.
    Cai K, Ishii H (2011) Quantized consensus and averaging on gossip digraphs. IEEE Trans Autom Control 56:2087–2100 MathSciNetCrossRefGoogle Scholar
  26. 89.
    Calafiore G, Dabbene F (2008) Optimization under uncertainty with applications to design of truss structures. Struct Multidiscip Optim 35(3):189–200 MathSciNetCrossRefGoogle Scholar
  27. 91.
    Calafiore G, Fagiano L (2012) Robust model predictive control via scenario optimization. IEEE Trans Autom Control, in press. doi: 10.1109/TAC.2012.2203054
  28. 92.
    Camacho EF, Bordons C (2003) Model predictive control. Springer, London Google Scholar
  29. 97.
    Chamanbaz M, Keikha E, Venkataramanan V, Al Mamun A, Wang Q-G, Liew T (2011) \(\mathcal{H}_{\infty}\) probabilistic robust control of hard disk drive. In: Proceedings 37th annual conference of IEEE industrial electronics society, pp 3394–3399. CrossRefGoogle Scholar
  30. 98.
    Chamanbaz M, Keikha E, Venkataramanan V, Wang Q-G, Al Mamun A (2012) Probabilistic robust approach for discrete multi-objective control of track-following servo systems in hard disk drives. In: Proceedings 7th IFAC symposium on robust control design Google Scholar
  31. 99.
    Chamanbaz M, Venkataramanan V, Wang Q-G (2012) Robust \(\mathcal{H}_{2}\) track following controller based on probabilistic analytic center cutting plane method. In: Proceedings joint international conference on micromechatronics for information and precision equipment Google Scholar
  32. 109.
    Cogburn R (1986) On products of random stochastic matrices. Contemp Math 50:199–213 MathSciNetCrossRefGoogle Scholar
  33. 125.
    Davis WR (1996) Micro UAV. In: Proceedings 23rd annual AUVSI symposium Google Scholar
  34. 128.
    de Kerchove C, Ninove L, Van Dooren P (2008) Influence of the outlinks of a page on its PageRank. Linear Algebra Appl 429(5–6):1254–1276 MathSciNetMATHCrossRefGoogle Scholar
  35. 151.
    Durham JW, Carli R, Frasca P, Bullo F (2012) Discrete partitioning and coverage control for gossiping robots. IEEE Trans Robot 28(2):364–378 CrossRefGoogle Scholar
  36. 159.
    Elia N, Mitter SK (2001) Stabilization of linear systems with limited information. IEEE Trans Autom Control 46:1384–1400 MathSciNetMATHCrossRefGoogle Scholar
  37. 164.
    Fercoq O, Akian M, Bouhtou M, Gaubert S (2012) Ergodic control and polyhedral approaches to PageRank optimization. IEEE Trans Autom Control 57, provisionally accepted Google Scholar
  38. 168.
    Fujisaki Y, Dabbene F, Tempo R (2003) Probabilistic robust design of LPV control systems. Automatica 39:1323–1337 MathSciNetMATHCrossRefGoogle Scholar
  39. 174.
    Galdos G, Karimi A, Longchamp R (2010) \({ \mathcal{H}_{\infty}} \) controller design for spectral MIMO models by convex optimization. J Process Control 20:1175–1182 CrossRefGoogle Scholar
  40. 179.
    Gietelink OJ, De Schutter B, Verhaegen M (2005) Probabilistic approach for validation of advanced driver assistance systems. Transp Res Rec 1910:20–28 CrossRefGoogle Scholar
  41. 183.
    Gong W, Başar T (2002) Special issue on systems and control methods for communication networks—editorial. IEEE Trans Autom Control 47:877–879 CrossRefGoogle Scholar
  42. 185.
    Guglieri G, Pralio B, Quagliotti F (2006) Flight control system design for a micro aerial vehicle. Aircr Eng Aerosp Technol 78:87–97 CrossRefGoogle Scholar
  43. 188.
    Haber A, Fraanje R, Verhaegen M (2012) Linear computational complexity robust ILC for lifted systems. Automatica 48(6):1102–1110 MathSciNetMATHCrossRefGoogle Scholar
  44. 193.
    Hatanaka T, Takaba K (2008) Computations of probabilistic output admissible set for uncertain constrained systems. Automatica 44(2):479–487 MathSciNetCrossRefGoogle Scholar
  45. 194.
    Hatanaka T, Takaba K (2008) Probabilistic output admissible set for systems with time-varying uncertainties. Syst Control Lett 57(4):315–321 MathSciNetMATHCrossRefGoogle Scholar
  46. 195.
    Hatano Y, Mesbahi M (2005) Agreement over random networks. IEEE Trans Autom Control 50:1867–1872 MathSciNetCrossRefGoogle Scholar
  47. 201.
    Hilbert M, López P (2011) The world’s technological capacity to store, communicate, and compute information. Science 332:60–65 CrossRefGoogle Scholar
  48. 207.
    Horn RA, Johnson CR (1991) Topics in matrix analysis. Cambridge University Press, Cambridge MATHCrossRefGoogle Scholar
  49. 211.
    Ishii H, Başar T, Tempo R (2004) Randomized algorithms for quadratic stability of quantized sampled-data systems. Automatica 40:839–846 MATHCrossRefGoogle Scholar
  50. 212.
    Ishii H, Basar T, Tempo R (2005) Randomized algorithms for synthesis of switching rules for multimodal systems. IEEE Trans Autom Control 50:754–767 MathSciNetCrossRefGoogle Scholar
  51. 213.
    Ishii H, Francis BA (2002) Limited data rate in control systems with networks. Springer, New York MATHGoogle Scholar
  52. 214.
    Ishii H, Tempo R (2009) Probabilistic sorting and stabilization of switched systems. Automatica 45:776–782 MathSciNetMATHCrossRefGoogle Scholar
  53. 215.
    Ishii H, Tempo R (2010) Distributed randomized algorithms for the PageRank computation. IEEE Trans Autom Control 55:1987–2002 MathSciNetCrossRefGoogle Scholar
  54. 216.
    Ishii H, Tempo R, Bai E-W (2012, in press) A web aggregation approach for distributed randomized PageRank algorithms. IEEE Transactions on Automatic Control 57 Google Scholar
  55. 223.
    Kamvar S, Haveliwala T, Golub G (2004) Adaptive methods for the computation of PageRank. Linear Algebra Appl 386:51–65 MathSciNetMATHCrossRefGoogle Scholar
  56. 225.
    Kanev S, Verhaegen M (2006) Robustly asymptotically stable finite-horizon MPC. Automatica 42(12):2189–2194 MathSciNetMATHCrossRefGoogle Scholar
  57. 229.
    Kelly FP, Maulloo AK, Tan DKH (1998) Rate control in communication networks: shadow prices, proportional fairness and stability. J Oper Res Soc 49:237–252 MATHGoogle Scholar
  58. 230.
    Kettani H, Barmish BR (2008) A new Monte Carlo circuit simulation paradigm with specific results for resistive networks. IEEE Trans Circuits Syst I 53:1289–1299 MathSciNetCrossRefGoogle Scholar
  59. 232.
    Khammash M, Tomlin CJ, Vidyasagar M (2008) Guest editorial—special issue on systems biology. IEEE Trans Autom Control and IEEE Trans Circuits Syst I: Regular Papers 4–7 Google Scholar
  60. 242.
    Komurov K, White MA, Ram PT (2010) Use of data-biased random walks on graphs for the retrieval of context-specific networks from genomic data. PLoS Comput Biol 6(8):1–10 MathSciNetCrossRefGoogle Scholar
  61. 250.
    Lagoa CM, Dabbene F, Tempo R (2008) Hard bounds on the probability of performance with application to circuit analysis. IEEE Trans Circuits Syst I 55:3178–3187 MathSciNetCrossRefGoogle Scholar
  62. 252.
    Langville AN, Meyer CD (2006) Google’s PageRank and beyond: the science of search engine rankings. Princeton University Press, Princeton MATHGoogle Scholar
  63. 257.
    Lecchini-Visintini A, Glover W, Lygeros J, Maciejowski JM (2006) Monte Carlo optimization for conflict resolution in air traffic control. IEEE Trans Intell Transp Syst 7:470–482 CrossRefGoogle Scholar
  64. 263.
    Liberzon D, Tempo R (2004) Common Lyapunov functions and gradient algorithms. IEEE Trans Autom Control 49:990–994 MathSciNetCrossRefGoogle Scholar
  65. 266.
    Lorefice L, Pralio B, Tempo R (2009) Randomization-based control design for mini-UAVs. Control Eng Pract 17:974–983 CrossRefGoogle Scholar
  66. 269.
    Lu B, Wu F (2006) Probabilistic robust linear parameter-varying control of an F-16 aircraft. J Guid Control Dyn 29(6):1454–1460 MathSciNetCrossRefGoogle Scholar
  67. 271.
    Ma W, Sznaier M, Lagoa CM (2007) A risk adjusted approach to robust simultaneous fault detection and isolation. Automatica 43(3):499–504 MathSciNetMATHCrossRefGoogle Scholar
  68. 275.
    Marrison CI, Stengel RF (1995) Stochastic robustness synthesis applied to a benchmark control problem. Int J Robust Nonlinear Control 5(1):13–31 MathSciNetMATHCrossRefGoogle Scholar
  69. 288.
    Mitzenmacher M, Upfal E (2005) Probability and computing: randomized algorithms and probabilistic analysis. Cambridge University Press, Cambridge MATHCrossRefGoogle Scholar
  70. 289.
    Mohseni M, Rezakhani AT, Lidar DA (2008) Quantum-process tomography: resource analysis of different strategies. Phys Rev A 77:032322/1–15 Google Scholar
  71. 290.
    Motwani R, Raghavan P (1995) Randomized algorithms. Cambridge University Press, Cambridge MATHGoogle Scholar
  72. 293.
    Mulmuley K (1994) Computational geometry: an introduction through randomization algorithms. Prentice-Hall, Englewood Cliffs Google Scholar
  73. 294.
    Nazin A, Polyak BT (2011) Randomized algorithm to determine the eigenvector of a stochastic matrix with application to the PageRank problem. Autom Remote Control 72(2):342–352 MathSciNetMATHCrossRefGoogle Scholar
  74. 307.
    Notarstefano G, Bullo F (2011) Distributed abstract optimization via constraints consensus: theory and applications. IEEE Trans Autom Control 56(10):2247–2261 MathSciNetCrossRefGoogle Scholar
  75. 316.
    Pallottino L, Scordio VG, Bicchi A, Frazzoli E (2007) Decentralized cooperative policy for conflict resolution in multi-vehicle systems. IEEE Trans Robot 23:1170–1183 CrossRefGoogle Scholar
  76. 317.
    Palopoli L, Pinello C, Bicchi A, Sangiovanni-Vincentelli A (2005) Maximizing the stability radius of a set of systems under real-time scheduling constraints. IEEE Trans Autom Control 50(11):1790–1795 MathSciNetCrossRefGoogle Scholar
  77. 319.
    Papoulis A, Pillai SU (2002) Probability, random variables and stochastic processes. McGraw-Hill, New York Google Scholar
  78. 332.
    Ray LR, Stengel RF (1993) A Monte Carlo approach to the analysis of control system robustness. Automatica 29:229–236 MathSciNetMATHCrossRefGoogle Scholar
  79. 341.
    Santos LF, Viola L (2006) Enhanced convergence and robust performance of randomized dynamical decoupling. Phys Rev Lett 97:150501/1–4 Google Scholar
  80. 342.
    Santos LF, Viola L (2008) Advantages of randomization in coherent quantum dynamical control. New J Phys 10:083009/1–36 Google Scholar
  81. 358.
    Smith MA, Caracoglia L (2011) A Monte Carlo based method for the dynamic “fragility analysis” of tall buildings under turbulent wind loading. Eng Struct 33(2):410–420 CrossRefGoogle Scholar
  82. 366.
    Stengel RF (1980) Some effects of parameter variations on the lateral-directional stability of aircraft. AIAA J Guid Control 3:124–131 CrossRefGoogle Scholar
  83. 368.
    Stevens BL, Lewis FL (2003) Aircraft control and simulation. Wiley, New York Google Scholar
  84. 376.
    Tahbaz-Salehi A, Jadbabaie A (2008) A necessary and sufficient condition for consensus over random networks. IEEE Trans Autom Control AC-53:791–795 MathSciNetCrossRefGoogle Scholar
  85. 378.
    Tanner HG, Piovesan JL (2010) Randomized receding horizon navigation. IEEE Trans Autom Control 55(11):2640–2644 MathSciNetCrossRefGoogle Scholar
  86. 384.
    Tempo R, Ishii H (2007) Monte Carlo and Las Vegas randomized algorithms for systems and control: an introduction. Eur J Control 13:189–203 CrossRefGoogle Scholar
  87. 390.
    Tremba A, Calafiore G, Dabbene F, Gryazina E, Polyak BT, Shcherbakov PS, Tempo R (2008) RACT: randomized algorithms control toolbox for MATLAB. In: Proceedings 17th IFAC world congress, pp 390–395 Google Scholar
  88. 394.
    Ugrinovskii V (2011) Distributed robust filtering with \(\mathcal{H}_{\infty}\) consensus of estimates. Automatica 47(1):1–13 MathSciNetMATHCrossRefGoogle Scholar
  89. 398.
    Valavanis KP (ed) (2007) Advances in unmanned aerial vehicles: state of the art and the road to autonomy. Springer, New York MATHGoogle Scholar
  90. 404.
    Vidyasagar M (1998) Statistical learning theory and randomized algorithms for control. IEEE Control Syst Mag 18:69–85 CrossRefGoogle Scholar
  91. 407.
    Vidyasagar M (2011) Probabilistic methods in cancer biology. Eur J Control 17:483–511 MathSciNetCrossRefGoogle Scholar
  92. 411.
    Wang Q, Stengel RF (2005) Robust nonlinear flight control of a high performance aircraft. IEEE Trans Control Syst Technol 13:15–26 CrossRefGoogle Scholar
  93. 414.
    Wu CW (2006) Synchronization and convergence of linear dynamics in random directed networks. IEEE Trans Autom Control AC-51:1207–1210 CrossRefGoogle Scholar
  94. 419.
    Zaki N, Berengueres J, Efimov D (2012) Detection of protein complexes using a protein ranking algorithm. Proteins, accepted for publication Google Scholar

Copyright information

© Springer-Verlag London 2013

Authors and Affiliations

  • Roberto Tempo
    • 1
  • Giuseppe Calafiore
    • 2
  • Fabrizio Dabbene
    • 1
  1. 1.CNR - IEIITPolitecnico di TorinoTurinItaly
  2. 2.Dip. Automatica e InformaticaPolitecnico di TorinoTurinItaly

Personalised recommendations