Skip to main content
SpringerLink
Log in
Book cover

Stochastic Modelling in Innovative Manufacturing pp 140–154Cite as

An Optimal Selection Problem on a Partially Observable Markov Chain

  • Conference paper

  • 429 Accesses

Part of the book series: Lecture Notes in Economics and Mathematical Systems ((LNE,volume 445))

Abstract

We treat a problem where the decision-maker obtains several observations at each time period. One such problem is the optimal selection problem. This problem is to select a predetermined number of observations in order to maximize the total expected reward of these selected. Under several assumptions, we consider an optimal selection problem for a partially observable Markov chain, and treat several properties concerning a relation between observations and information.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. M. Brown and H. Solomon. Optimal issuing policies under stochastic field lives. Journal of Applied Probability, 10: 761–768, 1973.

    Article  Google Scholar 

  2. T. Nakai. The problem of optimal stopping in a partially observable Markov chain. Journal of Optimization Theory and Applications, 45: 425–442, 1985.

    Article  Google Scholar 

  3. T. Nakai. An optimal selection problem with a random number of applicants per period. Operations Research, 34: 478–485, 1986.

    Article  Google Scholar 

  4. T. Nakai. A sequential stochastic assignment problem in a partially observable Markov chain. Mathematics of Operations Research, 11: 230–240, 1986.

    Article  Google Scholar 

  5. T. Nakai, A stochastic ordering and related sequential decision problems. Journal of Information 6 Optimization Sciences, 11: 49–65, 1990.

    Google Scholar 

  6. T. Nakai. A partially observable decision problem under a shifted likelihood ratio ordering. Mathematical and Computer Modelling, 22: 237–246, 1995.

    Article  Google Scholar 

  7. M. L. Pinedo and S. M. Ross. Scheduling jobs subject to nonhomogeneous Poisson shocks. Management Science, 26: 1250–1257, 1980.

    Article  Google Scholar 

  8. S. M. Ross. Stochastic Processes. John-Wiley and Sons, New York, New York, 1983.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Economic Engineering, Faculty of Economics, Hakozaki 6-19-1, Fukuoka, 812, Japan

    Tōru Nakai

Authors
  1. Tōru Nakai
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Mathematics and Computer Science, University of Salford, Salford M5 4WT, Lancs., UK

    Anthony H. Christer Ph.D.

  2. Department of Industrial and Systems Engineering, Hiroshima University, Higashi-Hiroshima, 739, Japan

    Shunji Osaki Ph.D.

  3. Department of Business Studies, The University of Edinburgh, William Robertson Building 50 George Square, Edinburgh, EH8 9JY, UK

    Lyn C. Thomas Ph.D.

Rights and permissions

Reprints and permissions

Copyright information

© 1997 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Nakai, T. (1997). An Optimal Selection Problem on a Partially Observable Markov Chain. In: Christer, A.H., Osaki, S., Thomas, L.C. (eds) Stochastic Modelling in Innovative Manufacturing. Lecture Notes in Economics and Mathematical Systems, vol 445. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-59105-1_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-59105-1_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-61768-6

  • Online ISBN: 978-3-642-59105-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation