Advertisement

© 2011

Introduction to Modeling and Analysis of Stochastic Systems

  • Enables readers to develop accurate mathematical models of systems that evolve randomly in time

  • Reader able to use the stochastic models developed in the book to design systems to achieve preferred performance targets

  • Includes large number of examples and detailed case studies that provide an easy way to understand the concepts and the methodologies of stochastic modeling

Textbook

Part of the Springer Texts in Statistics book series (STS)

Table of contents

  1. Front Matter
    Pages i-xiii
  2. V. G. Kulkarni
    Pages 1-4
  3. V. G. Kulkarni
    Pages 5-58
  4. V. G. Kulkarni
    Pages 59-83
  5. V. G. Kulkarni
    Pages 85-145
  6. V. G. Kulkarni
    Pages 147-187
  7. V. G. Kulkarni
    Pages 189-245
  8. V. G. Kulkarni
    Pages 247-280
  9. Back Matter
    Pages 281-313

About this book

Introduction

This is an introductory-level text on stochastic modeling. It is suited for undergraduate students in engineering, operations research, statistics, mathematics, actuarial science, business management, computer science, and public policy. It employs a large number of examples to teach the students to use stochastic models of real-life systems to predict their performance, and use this analysis to design better systems. The book is devoted to the study of important classes of stochastic processes: discrete and continuous time Markov processes, Poisson processes, renewal and regenerative processes, semi-Markov processes, queueing models, and diffusion processes. The book systematically studies the short-term and the long-term behavior, cost/reward models, and first passage times. All the material is illustrated with many examples, and case studies. The book provides a concise review of probability in the appendix. The book emphasizes numerical answers to the problems. A collection of MATLAB programs to accompany the this book can be downloaded from http://www.unc.edu/~vkulkarn/Maxim/maxim.zip. A graphical user interface to access the above files can be downloaded from http://www.unc.edu/~vkulkarn/Maxim/maximgui.zip . The second edition incorporates several changes. First its title reflects the changes in content: the chapters on design and control have been removed. The book now contains several case studies that teach the design principles. Two new chapters have been added. The new chapter on Poisson processes gives more attention to this important class of stochastic processes than the first edition did. The new chapter on Brownian motion reflects its increasing importance as an appropriate model for a variety of real-life situations, including finance. V. G. Kulkarni is Professor in the Department of Statistics and Operations Research in the University of North Carolina, Chapel Hill. He has authored a graduate-level text Modeling and Analysis of Stochastic Systems and dozens of articles on stochastic models of queues, computer and communications systems, and production and supply chain systems. He holds a patent on traffic management in telecommunication networks, and has served on the editorial boards of Operations Research Letters, Stochastic Models, and Queueing Systems and Their Applications.

Keywords

Brownian Motion Markov Chains Poisson Processes Renewal Processes Stochastic Models

Authors and affiliations

  1. 1., Dept. of Operations ResearchUniversity of North CarolinaChapel HillUSA

About the authors

V. G. Kulkarni is Professor in the Department of Statistics and Operations Research in the University of North Carolina, Chapel Hill. He has authored a graduate-level text Modeling and Analysis of Stochastic Systems and dozens of articles on stochastic models of queues, computer and communications systems, and production and supply chain systems. He holds a patent on traffic management in telecommunication networks, and has served on the editorial boards of Operations Research Letters, Stochastic Models, and Queueing Systems and Their Applications.

Bibliographic information

Industry Sectors
Finance, Business & Banking
Pharma

Reviews

From the reviews of the second edition:

“The author has added a new chapter on Poisson processes and another one on Brownian motion. The discussion is kept on an elementary level and does not require any knowledge from measure theory or advanced calculus. … the text is suitable for an undergraduate course on probabilistic modeling for students from physics, engineering, operations research, computer science, business administration or some related field that needs advanced modeling techniques.” (H. M. Mai, Zentralblatt MATH, Vol. 1222, 2011)

“Suitable for undergraduates in Mathematics, Statistics, Operations Research, Computer Science, Business Administration, Public Policy, etc. This is a very clear and readable text on Markov chains, Poisson processes, continuous time Markov chains, renewal processes, and queuing processes. … The treatment is very clear, intuitive as well as rigorous, without being pedantic, and full of interesting examples and case studies. … The book should be fun to teach from and learn from.” (Jayanta K. Ghosh, International Statistical Review, Vol. 80 (3), 2012)