Multiple Agent Autonomous Control A Hybrid Systems Architecture

  • Anil Nerode
  • Wolf Kohn
Part of the Progress in Computer Science and Applied Logic book series (PCS, volume 12)


Hybrid systems are systems in which a digital control automaton receives sampled sense data about the state of a continuous plant and, occasionally, issues a change in the control law for a plant controller. The digital control automaton may fail to meet design requirements for local control of plant state trajectory, and need to be replaced on-line. This paper is an overview of our architecture for systems in which there is a plant (or system of plants called plant processes), each plant process has a plant controller with an Agent for its digital control program and plant process controller. That Agent monitors its plant process and its plant process controller and its digital control program, passes and receives messages to and from other Agents for other plant processes, and occasionally computes and installs a new finite digital control automaton for its plant process controller. There is no supervisor. We call this Multiple Agent Hybrid Control. It is to be emphasized that the purpose of the Agent is to construct new finite control automata to replace old ones on the fly whenever performance and controllability and observability criteria are violated, and that the Agents have no central supervisor. The tools used are distributed message passing from Agent to Agent of information about Lagrangians, and the Lagrangian variational-automata method for extracting the digital control automata of Kohn’s declarative control [20]. The underlying hybrid systems model is that of Kohn-Nerode [34].


Hybrid System Digital Control Input Symbol Interagent Constraint Continuous Plant 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Alekseev, V.M., V.M. Tikhomirov, S.V. Fomin [1987], Optimal Control. Consultant’s Bureau, Plenum Press.Google Scholar
  2. [2]
    Apt, K.R. and E-R. Olderog [1991], Verification of Sequential and Concurrent Programs. Springer-Verlag.Google Scholar
  3. [3]
    Aris, R. [1975], The Mathematical Theory of Diffusion and Reaction in Permeable Catalysts, vol. 2. Clarendon Press, Oxford.Google Scholar
  4. [4]
    Aubin, J.P. [1982], Convex Analysis and Optimization. Pitman.Google Scholar
  5. [5]
    Aubin, J.P. and I. Ekeland [1984], Applied Non-Linear Analysis. Wiley.Google Scholar
  6. [6]
    Ben-Aris, M. [1990], Principles of Concurrent Programming. Prentice-Hall.Google Scholar
  7. [7]
    Chandy, K.M. and J. Misra [1988], An Introduction to Parallel Program Design. Addison-Wesley.Google Scholar
  8. [8]
    Coleman, N. [1990], An Emulation-Simulation for Intelligent Controls. Proc. of the Workshop on Software Tools for Distributed Intelligent Control Systems, 37–52. Pacifica, California.Google Scholar
  9. [9]
    Dodhiawala, R.T., V. Jagoenthan and L.S. Baum [1987], Erasmus System Design: Performance Issues. Proc. of the Workshop of Blackboard Implementation Issues, AIII. Seattle, WA.Google Scholar
  10. [10]
    Eilenberg, S. [1974], Automata, Languages, and Machines (vol. A). Academic Press, New York.zbMATHGoogle Scholar
  11. [11]
    Ekeland, I. [1983], Infinite Dimensional Optimization and Convexity. University of Chicago Lecture Notes in Mathematics. University of Chicago Press.Google Scholar
  12. [12]
    Garcia, H. and A. Ray [1990], Nonlinear Reinforcement Schemes for Learning Automata. Proc. 29th IEEE CDC, vol. 4, 2204–2207. Honolulu, Hawaii, Dec. 5-7.Google Scholar
  13. [13]
    Goldstine, J. [1979], A Rational Theory of AFL’s. Lecture Notes in Computer Science, 71, 271–281.MathSciNetCrossRefGoogle Scholar
  14. [14]
    Grossman, R.L. and R.G. Larson [1992], Viewing Hybrid Systems as Products of Control Systems and Automata. Proc. IEEE 31st CDC, vol. 3, 2953–2955. Tucson.Google Scholar
  15. [15]
    Guckenheimer, J., A. Back and M. Myers [1992], A Dynamical Simulation Facility for Hybrid Systems. MSI Tech. Report 92-6, Cornell University.Google Scholar
  16. [16]
    Guckenheimer, J. and A. Nerode [1992], Simulation for Hybrid and Nonlinear Control. Proc. IEEE 31st CDC, vol. 3, 2981–2983.Google Scholar
  17. [17]
    Iseman, R. [1977], Digital Control Systems. Springer-Verlag.Google Scholar
  18. [18]
    Kaplan, M.H. [1976], Modern Spacecraft Dynamics and Control. John Wiley and Sons.Google Scholar
  19. [19]
    Kesten, Y. and A. Pnueli [1992], Timed and Hybrid Statecharts and their Textual Representation, in Formal Techniques in Real Time and Fault Tolerant Systems, Lecture Notes in Computer Science vol. 571. Springer-Verlag.Google Scholar
  20. [20]
    Kohn, W. [1988], A Declarative Theory for Rational Controllers. Proc. 27th IEEE CDC, 130–136.Google Scholar
  21. [21]
    Kohn, W. and T. Skillman [1988], Hierarchical Control Systems for Autonomous Space Robots. Proc. AIAA Conf. on Guidance, Navigation and Control, vol. 1, 382–390.Google Scholar
  22. [22]
    Kohn, W. [1988], Application of Declarative Hierarchical Methodology for the Flight Telerobotic Servicer. Boeing Document G-6630-061. Final Report of NASA-Ames Research Service Request 2072, Job Order T1988.Google Scholar
  23. [23]
    Kohn, W. [1989], The Rational Tree Machine: Technical Description and Mathematical Foundations, IR and D BE-499. Technical Document 905-10107-1, Boeing Computer Services.Google Scholar
  24. [24]
    Kohn, W. [1989], Rational Algebras: A Constructive Approach, IR and D BE-499. Technical Document D-905-10107-2.Google Scholar
  25. [25]
    Kohn, W. [1989], Cruise Missile Mission Planning: A Declarative Control Approach. Boeing Computer Services Technical Report.Google Scholar
  26. [26]
    Kohn, W. [1990], Declarative Multiplexed Rational Controllers. Proc. 5th IEEE Int. Symp. Intelligent Cont, 794–803.Google Scholar
  27. [27]
    Kohn, W. [1990], Declarative Hierarchical Controllers. Proc. DARPA Workshop on Software Tools for Distributed Intelligent Control Systems, Domain Specific Software Initiative, 141–163. Pacifica, CA.Google Scholar
  28. [28]
    Kohn, W. and C. Johnson [1990], An Algebraic Approach to Formal Verification of Embedded Systems. IRD Tech. Rpt. D-180-31989-1. Boeing Computer Services.Google Scholar
  29. [29]
    Kohn, W. [1990], Advanced Architecture and Methods for Knowledge-Based Planning and Declarative Control. Boeing Computer Services Technical Document IRD BCS-021, in ISMIS 91.Google Scholar
  30. [30]
    Kohn, W. and K. Carlsen [1989], Symbolic Design and Analysis in Control. Proc. 1988 Grainger Lecture Series, U. of Illinois, 40–52.Google Scholar
  31. [31]
    Kohn, W. and A. Murphy, Multiple Agent Reactive Shop Control. ISMIS 91.Google Scholar
  32. [32]
    Kohn, W. and A. Nerode [1992], An Autonomous Control Theory: An Overview. Proc. IEEE CACSD92.Google Scholar
  33. [33]
    Kohn. W. and A. Nerode [1992], Multiple Agent Autonomous Control Systems. Proc. 31st IEEE CDC, 2956–2966. Tucson.Google Scholar
  34. [34]
    Kohn, W. and A. Nerode [to appear], Models for Hybrid Systems: Automata, Topologies, Controllability, Observability. Proc. of Lyngby, Denmark Workshop on Hybrid Systems of Nov. 1992 (eds. H. Rischel and A. Ravn), to appear in 1993. Also available as Cornell Mathematical Sciences Institute Technical Report 92-26.Google Scholar
  35. [35]
    Kuich, W. and A. Salomaa [1985], Semirings, Automata, Languages. Springer-Verlag.Google Scholar
  36. [36]
    Hilgert, J., K.H. Hofmann, J. Lawson [1988], Lie Groups, Convex Cones, and Semigroups. Oxford, Clarendon Press.Google Scholar
  37. [37]
    Liu, J.W.S. [1990], Real Time Responsiveness in Distributed Operating Systems and Databases. Proc. DARPA Workshop on Software Tools for Intelligent Control, Domain Specific Software Initiative, 185–192. Pacifica, CA.Google Scholar
  38. [38]
    Lloyd, J.W. [1987], Foundations of Logic Programming, 2nd ed., Springer-Verlag, New York.zbMATHCrossRefGoogle Scholar
  39. [39]
    Maler, O., Z. Manna and A. Pnueli [1992], From Timed to Hybrid Systems. In Proc. Rex Workshop, Real Time in Theory and Practice, eds. J.W. De-Bakker, C. Huizing, W.P. de Roever, G. Rozenberg. Lecture Notes in Computer Science 600, Springer-Verlag.Google Scholar
  40. [40]
    Manna, Z. and A. Pnueli [1992], The Temporal Logic of Reactive and Concurrent Systems. Springer-Verlag.Google Scholar
  41. [41]
    McNaughton, R. [1992], Infinite Games Played on Finite Graphs. Tech. Report 92-14, Dept. of Computer Science, RPI. Troy, New York.Google Scholar
  42. [42]
    Mesarovic, M. and Y. Tashahara [1970], Theory of Hierarchical Multilevel Systems. Academic Press, N.Y.zbMATHGoogle Scholar
  43. [43]
    Mettala, E. [1990], Domain Specific Architectures. Proc. of Workshop on Domain Specific Software Architectures, 193–231. Hidden Valley, CA.Google Scholar
  44. [44]
    Nerode, A. [1990], Modelling Intelligent Control. Proc. DARPA Workshop on Software Tools for Distributed Intelligent Control Systems, Domain Specific Software Initiatives. Pacifica, CA.Google Scholar
  45. [45]
    Nerode, A., A. Yakhnis and V. Yakhnis [1992], Concurrent Programs as Strategies in Games. In Logic for Computer Science, ed. Y. Moschovakis. Springer-Verlag.Google Scholar
  46. [46]
    Nerode, A. and A. Yakhnis [1992], Modelling Hybrid Systems as Games. Proc. 31st IEEE CDC, vol. 3, 2947–2952.Google Scholar
  47. [47]
    Nerode, A., A. Yakhnis and V. Yakhnis [this volume], Distributed Concurrent Programs as Strategies in Games.Google Scholar
  48. [48]
    Nerode, A., J.B. Remmel and A. Yakhnis, Playing Games on Graphs: Extracting Concurrent and Hybrid Control Programs. In preparation.Google Scholar
  49. [49]
    Nii, P.H. [1986], The Blackboard Model of Problem Solving and the Evolution of the Blackboard Architecture. AI Magazine (7), 2, 38–53.Google Scholar
  50. [50]
    Neustadt, L.E. [1976], Optimization. Princeton University Press.Google Scholar
  51. [51]
    Padawitz, P. [1988], Computing in Horn Clause Theories. Springer-Verlag.Google Scholar
  52. [52]
    Sastry, S.S. and M. Bodson [1989], Adaptive Control: Stability, Convergence, and Robustnes. Prentice-Hall.Google Scholar
  53. [53]
    Schoppers, M. [1990], Automatic Synthesis of Perception Driven Discrete Event Control Laws. Proc. 5th IEEE Inter. Symp. on Intelligent Control.Google Scholar
  54. [54]
    Singh, M.G. [1977], Dynamical Hierarchical Control. North-Holland, Amsterdam.zbMATHGoogle Scholar
  55. [55]
    Skillman, T., W. Kohn et al. [1990], Classes of Hierarchical Controllers and their Blackboard Implementations. J. Guidance, Control and Dynamics (13), 176–182.Google Scholar
  56. [56]
    Slotine, J.J.E. and Li Weiping [1991], Applied Nonlinear Control. Prentice-Hall.Google Scholar
  57. [57]
    Sontag, E.D. [1990], Mathematical Control Theory. Springer-Verlag.Google Scholar
  58. [58]
    Warga, J. [1972], Optimal Control of Differential and Functional Equations. Academic Press.Google Scholar
  59. [59]
    Young, L.C. [1980], Optimal Control Theory. Chelsea Publ. Co., N.Y.Google Scholar

Copyright information

© Springer Science+Business Media New York 1993

Authors and Affiliations

  • Anil Nerode
    • 1
  • Wolf Kohn
    • 2
  1. 1.Mathematical Sciences InstituteCornell UniversityIthacaUSA
  2. 2.Intermetrics CorporationBellevueUSA

Personalised recommendations