A Markov Decision Modeling Approach to a Multi-Objective Maintenance Problem

Abstract

This article discusses a Markov decision modeling approach to the solution of a large-scale multi-objective problem--the maintenance of a statewide network of roads. This approach integrates management objectives for public safety and comfort, and preservation of the considerable investment in highways with State and Federal budgetary policies and engineering considerations. The Markov decision model captures the dynamic and probabilistic aspects of the maintenance problem and considers the influence of environmental factors, the type of roads, traffic densities and various engineering factors influencing road deterioration. The model recommends the best maintenance action for each mile of the network of highways, and specifies the minimum funds required to carry out the maintenance program.