Skip to main content

Markov Decision Processes Applied to the Payment of Dividends of a Reserve Process

  • Conference paper
  • First Online:
Operations Research and Enterprise Systems (ICORES 2017)

Abstract

Markov decision theory is applied to study the distribution of dividends of a discrete reserve process with a fixed barrier. The non-payment of dividends is penalized through a cost function which implies solving an optimal control problem. Two objective functions are proposed: a discounted cost and an average one. In both cases, the same optimal strategy for the payment of dividends is obtained, which ensures a ruin probability that guarantees a sustainable reserve operation for claims distributed with light or heavy tails.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ash, R.B., Doléans-Dade, C.A.: Probability and Measure Theory. Elsevier, London (2000)

    MATH  Google Scholar 

  2. Asmussen, S.: Ruin Probability. World Scientific, Singapore (2010)

    Book  Google Scholar 

  3. Bulinskaya, Y.G., Muromskaya, A.: Discrete-time insurance model with capital injections and reinsurance. Methodol. Comput. Appl. Probab. 17, 899–914 (2014)

    Article  MathSciNet  Google Scholar 

  4. Bäuerle, N., Rieder, U.: Markov Decision Processes with Applications to Finance. Springer, Berlin (2011)

    Book  Google Scholar 

  5. Azcue, P., Muler, N.: Stochastic Optimization in Insurance a Dynamic Programming Approach. Springer, London (2014)

    MATH  Google Scholar 

  6. Breiman, L.: Probability. SIAM, Berkeley (1992)

    Book  Google Scholar 

  7. Cramér, H.: On the Mathematical Theory of Risk. Skandia Jubillee, Stockholm (1930)

    MATH  Google Scholar 

  8. Cruz-Suárez, D., Montes-de-Oca, R., Salem-Silva, F.: Conditions for the uniqueness of optimal policies of discounted Markov decision processes. Math. Methods Oper. Res. 60, 415–436 (2004)

    Article  MathSciNet  Google Scholar 

  9. De-Finetti, B.: Su un’impostaziones alternativa della teoria collectiva del rischio. Trans. XV. Int. Congr. Act. 2, 433–443 (1957)

    Google Scholar 

  10. Diasparra, M.A., Romera, R.: Bounds for the ruin probability of a discrete-time risk process. J. Appl. Probab. 46, 99–112 (2009)

    Article  MathSciNet  Google Scholar 

  11. Dickson, D.C.M.: Insurance Risk and Ruin. Cambridge University Press, Cambridge (2005)

    Book  Google Scholar 

  12. Dickson, D.C.M., Waters, H.R.: Some optimal dividend problems. ASTIN Bull. 34, 49–74 (2004)

    Article  MathSciNet  Google Scholar 

  13. Finch, P.D.: Deterministic costumer impatience in the queueing system GI/M/1. Biometrika 47, 45–52 (1960)

    Article  MathSciNet  Google Scholar 

  14. Georgin, J.P.: Contrôle des chaînes de Markov sur des espaces arbitraires. Ann. Inst. H. Poincaré 14, Sect. B, 255–277 (1978)

    Google Scholar 

  15. Gerber, H.U.: On the probability of ruin in the presence of a linear dividend barrier. Scand. Actuarial J. 1981(2), 105–115 (1981). https://doi.org/10.1080/03461238.1981.10413735

    Article  MathSciNet  MATH  Google Scholar 

  16. Gerber, H.U., Shiu, E.S.W., Smith, N.: Maximizing dividends without bankruptcy. ASTIN Bull. 36, 5–23 (2006)

    Article  MathSciNet  Google Scholar 

  17. Ghosal, A.: Some Aspects on Queueing and Storage System. Springer, New York (1970). https://doi.org/10.1007/978-3-642-88208-1

    Book  MATH  Google Scholar 

  18. Hernández-Lerma, O.: Adaptive Markov Control Processes. Springer, New York (1989). https://doi.org/10.1007/978-1-4419-8714-3

    Book  MATH  Google Scholar 

  19. Hernández-Lerma, O., Lasserre, J.B.: Discrete-time Markov Control Processes: Basic Optimality Criteria. Springer, New York (1996). https://doi.org/10.1007/978-1-4612-0729-0

    Book  MATH  Google Scholar 

  20. Li, S., Lu, Y., Garrido, J.A.: A review of discrete-time risk models. Rev. R. Acad. Cien. Ser. A Mat. 103(2), 321–337 (2009)

    Article  MathSciNet  Google Scholar 

  21. Lindvall, T.: Lectures on the Coupling Method. Wiley, New York (1992)

    MATH  Google Scholar 

  22. Lundberg, F.: Über die theorie der ruckversicherung. Trans. VIth Int. Congr. Act. 1, 877–948 (1909)

    Google Scholar 

  23. Martínez-Morales, M.: Adaptive Premium in an Insurance Risk Process. Doctoral thesis, Texas Tech University, Texas (1991)

    Google Scholar 

  24. Martin-Löf, A.: Lectures on the use of control theory in insurance. Scand. Actuarial J. 1994, 1–25 (1994)

    Article  MathSciNet  Google Scholar 

  25. Montes-de-Oca, R., Saavedra, P., Zacarías-Espinoza, Cruz-Suárez, D.: Optimal policies for payment of dividends through a fixed barrier at discrete time. In: Proceedings of the 6th International Conference on Operations Research and Enterprise Systems (ICORES 2017), pp. 140–149 (2017). https://doi.org/10.5220/0006193701400149

  26. Rolski, T., Schmidli, H., Schmidt, V., Teugels, J.L.: Stochastic Processes for Insurance and Finance. Wiley, Chichester (1999)

    Book  Google Scholar 

  27. Royden, H.L.: Real Analysis. Macmillan, New York (1988)

    MATH  Google Scholar 

  28. Schäl, M.: On discrete-time dynamic programming in insurance: exponential utility and minimizing the ruin probability. Scand. Actuarial J. 2004, 189–210 (2004)

    Article  MathSciNet  Google Scholar 

  29. Schmidli, H.: Stochastic Control in Insurance. Springer, London (2009)

    MATH  Google Scholar 

  30. Wilks, D.S.: Statistical Methods in the Atmospheric Sciences. Academic Press, Burlington (2011)

    Google Scholar 

  31. Yushkevich, A.A.: Blackwell optimality in Borelian continuous-in-action Markov decision processes. SIAM J. Control Optim. 35, 2157–2182 (1997)

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

R. Montes-de-Oca, P. Saavedra, and D. Cruz-Suárez dedicate this article to the memory of their co-worker and co-author of the present work, Gabriel Zacarías-Espinoza, whose sensible death occured on November, 10, 2015.

This work was partially supported by CONACYT (México) and ASCR (Czech Republic) under Grant No. 171396.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Daniel Cruz-Suárez .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Montes-de-Oca, R., Saavedra, P., Zacarías-Espinoza, G., Cruz-Suárez, D. (2018). Markov Decision Processes Applied to the Payment of Dividends of a Reserve Process. In: Parlier, G., Liberatore, F., Demange, M. (eds) Operations Research and Enterprise Systems. ICORES 2017. Communications in Computer and Information Science, vol 884. Springer, Cham. https://doi.org/10.1007/978-3-319-94767-9_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-94767-9_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-94766-2

  • Online ISBN: 978-3-319-94767-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics