Skip to main content

On the Controller Synthesis for Markov Decision Process of Conflict Tolerant Specification

  • Conference paper
Advanced Research on Electronic Commerce, Web Application, and Communication (ECWAC 2011)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 143))

  • 1968 Accesses

Abstract

For an embedded control system, different requirements often need be satisfied at same time, and some of them make the system to act conflicted. Conflict tolerant specification is provided to denote this situation. In such a system, there often exist probabilistic and non-deterministic behaviors. We use Markov Decision Process (MDP) to denote these features. We study the controller synthesis for MDP over conflict tolerant specification. We extend PCTL star by adding past operator to denote the conflict tolerant specification succinctly. We use CT-PLTL to denote conflicted actions and PCTL to denote the specification for probability demand. We first synthesize a controller on a base system over CT-PLTL and then use it to prune the corresponding MDP of the system model. We use the resulting sub-MDP as the model to further synthesis a controller over PCTL. The whole controller for MDP is a conjunction of the two controllers obtained.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Metzger, A.: Feature interactions in embedded control systems. Computer Networks 45(5), 625–644 (2004)

    Article  MATH  Google Scholar 

  2. Bouma, L.G., Griffeth, N., Kimbler, K.: Feature Interactions in Telecommunications Systems. Computer Networks 32(4), 383–387 (2000)

    Article  Google Scholar 

  3. D’Souza, D., Gopinathan, M.: Conflict-tolerant features. In: Gupta, A., Malik, S. (eds.) CAV 2008. LNCS, vol. 5123, pp. 227–239. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  4. Divakaran, S., D’Souza, D., Mohan, M.R.: Conflict-Tolerant Specifications in Temporal Logic. In: ISEC 2010, Proceedings of the 3rd India Software Engineering Conference (2010)

    Google Scholar 

  5. Pantelic, V., Postma, S.M., Lawford, M.: Probabilistic supervisory control of probabilistic discrete event systems. IEEE Transactions on Automatic Control 54(8), 2013–2018 (2009)

    Article  MathSciNet  Google Scholar 

  6. Markey, N.: Temporal logic with past is exponentially more succinct. EATCS Bull 79, 122–128 (2003)

    MathSciNet  MATH  Google Scholar 

  7. Baier, C., Größer, M., Leucker, M., Bollig, B., Ciesinski, F.: Controller synthesis for probabilistic systems. In: Proceedings of IFIP TCS 2004, pp. 493–506. Kluwer, Dordrecht (2004)

    Google Scholar 

  8. Reynolds, M.: An Axiomatization of PCTL*. Information and Computation 201(1), 72–119 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  9. Gastin, P., Oddoux, D.: LTL with past and two-way very-weak alternating automata. In: Rovan, B., Vojtáš, P. (eds.) MFCS 2003. LNCS, vol. 2747, pp. 439–448. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  10. Vardi, M.Y., Wolper, P.: Reasonning about infinite computations. Information and Computation 115(1), 1–37 (1994)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zhang, J., Huang, Z., Cao, Z. (2011). On the Controller Synthesis for Markov Decision Process of Conflict Tolerant Specification. In: Shen, G., Huang, X. (eds) Advanced Research on Electronic Commerce, Web Application, and Communication. ECWAC 2011. Communications in Computer and Information Science, vol 143. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-20367-1_45

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-20367-1_45

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-20366-4

  • Online ISBN: 978-3-642-20367-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics