Introduction and Formulation of the Model

Abstract

The theory of discrete time stochastic control systems has received impetus from two directions. First, the area, which is followed here in the matter of terminology and notation, is that of engineering applications; and second is the area of sequential statistical decision theory. Though, in their most general formulations, the models used in the two areas are equivalent, the motivation and emphasis is often quite different.