1 Introduction

The Bipolar method, proposed by Konarzewska-Gubała (1987, 1989), is an MCDA method; here we will call it the classic Bipolar method. The individual phases of this method use elements of the Electre methodology (Roy 1985; Roy and Bouyssou 1993), as well as algorithms of confrontation (Merighi 1980). This method has been described in many earlier papers (Konarzewska-Gubała 1996, 2002; Trzaskalik and Sitarz 2012; Trzaskalik et al. 2013), modified (Górecka 2014) and applied in practice (Dominiak 1997; Konarzewska-Gubała 1996, 2002; Górecka 2017; Tłuczak 2018). A detailed description of the classic Bipolar method, published recently in Trzaskalik et al. (2019), compares it with other multicriteria methods.

A fundamental feature of the classic Bipolar method is that the decision alternatives are not compared directly with each other, but by means of two sets of reference points: objects with desired characteristics, called “good” objects, and objects with undesired characteristics, called “bad” objects. In the first phase of the classic Bipolar method decision alternatives are compared with good and bad objects. In the second phase of the Bipolar method the position of each alternative with respect to the Bipolar reference system is established. In the third stage, the alternatives are classified: first separately, with respect to the good and bad reference sets, then jointly. The alternatives are divided into indexed classes so that each alternative from a lower-indexed class is preferred over any alternative from a higher-indexed class. Within each class, a linear ordering is defined.

Almost simultaneously with the introduction of the classic Bipolar method the issue of a possible extension of this approach to the analysis of multistage, multicriteria decision processes arose (Trzaskalik 1987). That paper formulated the problem of searching for the best solution using an extended Bipolar approach. That attempt, however, had not been entirely successful and research in this direction was discontinued.

The present paper tackles this problem again. It aims at presenting possible applications of an essential fragment of the classic Bipolar approach—which is a single-stage procedure—to control multistage discrete decision processes. This requires that new notions be defined, directly related to the extension being constructed, such as stage alternative, multistage alternative, stage reference sets, or the importance of the criteria in the consecutive process stages. These notions, together with the notation used further in the paper [related to the description of the classic Bipolar method, presented in Trzaskalik et al. (2019)] are introduced in Sect. 2. Section 3 presents evaluation of stage alternatives, which corresponds to the first two stages of the classic Bipolar method. Section 4 contains definitions of indicators determining the position of the multistage alternatives with respect to the multistage reference sets. These indicators allow to divide the multistage alternatives into hierarchical, disjoint classes containing elements with similar characteristics. This section also proposes a method of ranking of the multistage alternatives within the individual classes. Section 5 consists of a numerical illustrative example, while Sect. 6 contains conclusions.

2 Assumptions and notation

The classic Bipolar method is a single-stage method. When considering multistage decision processes we deal with at least two stages. We will discuss multistage processes with a predefined number of T stages.

We will briefly describe the dynamics of the multistage process in question (Bellman 1957; Rapoport 1967; Trzaskalik 1998; Ahmad 2018). At the beginning of each stage t (t = 1, …, T), the process is in one of the feasible states. All the states of the process that can occur at the beginning of the consecutive stages form the sets of feasible states Yt for the consecutive stages t. Furthermore, for each feasible state yt at each stage t one can determine the possible decision xt. The set of all such decisions Xt(yt) is called the set of feasible decisions for the given state yt ∈ Yt. If at the beginning of a stage t the process is in a certain feasible state yt and an feasible decision xt is made, then at the end of this stage, the process will be in a final state yt+1, determined by the transformation called the transition function Ωt. The final state yt+1 of the process for any stage is at the same time an initial state for the next stage. The decision process and all the notions discussed in the next paragraphs are illustrated by the numerical example in Sect. 5.

In the classic Bipolar method, we deal with decision alternatives. In the multistage processes discussed in this paper, we distinguish two kinds of alternatives: stage and multistage ones. At the beginning of each stage the process is in an feasible state and we can make an feasible decision at this stage. The pair (yt, xt) consisting of a state and a decision feasible at this stage will be called a stage alternative at. Using the transition function, we perform the transformation of the process to the initial state of the next stage. This action is repeated until the process terminates. Hence, we can talk about sequences of feasible states and decisions which start with a certain feasible state at the first stage and end in an feasible final state of the process. Such sequences ((y1, x1), …, yT, xT)) will be called multistage alternative a. Obviously, each multistage alternative is at the same time a sequence of stage alternatives, that means a = (a1, …, aT).

Another problem to be solved is that of determining reference sets. We assume that at each stage of the process, two reference sets are defined: one containing “good” objects, the other one, “bad” objects, denoted as Gt and Bt, respectively. We will call them stage reference sets. At each stage, the reference set of good objects is disjoint with the reference set of bad objects. Since the process consists of stages, we assume that the position of a multistage alternative with respect to the reference sets for the entire process will be evaluated on the basis of the positions of the stage alternatives which form this multistage alternative with respect to the stage reference sets.

For this purpose, we will use K stage criteria functions f kt (k = 1, …, K) assuming, for simplicity (as in the original Bipolar method), that larger values are preferred over smaller values (“more is better”). Of course, it is possible to transform the remaining types of criteria to the form used here. Moreover, we assume that at each stage of the process each good reference object dominates each bad reference object. This assumption allows to avoid the situation in which a stage alternative is at the same time overgood (that is, it is evaluated higher than the set of good objects) and underbad (that is, it is evaluated lower than the set of bad objects) (Trzaskalik and Sitarz 2012).

An issue that arises here is that of the importance of the criteria at the consecutive stages. In the classic Bipolar method, all the criteria were obviously essential. In the multistage approach it is possible to have the case in which certain criteria are important in certain stages only, while in other stages other criteria are essential. Criteria which are taken into account at the given stage are called essential for this stage.

The decision maker determines the importance of each criterion by giving the values w kt of the weights. We assume that the weights have been normalized and that the sum of the values of the weights for all the criteria is equal to 1 for the given stage. The weights of a given criterion can vary depending of the stage. The importance of the criteria and their weights are described in the weight matrix. Its rows correspond to the consecutive stages and its columns, to the criteria. If a matrix element is equal to 0, the corresponding criterion is not essential at that stage.

The sorting and ranking procedure proposed below consists of three phases. In the first phase, we analyze the consecutive stage alternatives from the stage sets of feasible alternatives, comparing them with the elements of the stage reference sets. As a result, we obtain outranking stage indicators. In the second phase, we determine the position of a stage alternative with respect to the Bipolar stage reference system, assuming that the concordance level is equal to 0.5. For each stage alternative, we calculate the stage success achievement and stage failure avoidance degrees. In the third phase, we determine the relationships in the set of multistage alternatives, using the values calculated in the second phase. The set of all alternatives is divided into six disjoint classes so that each multistage alternative from a lower-indexed class is evaluated higher than any multistage alternative from a higher-indexed class. Next, we determine a linear ordering in each class.

Let us summarize our notation. We have:

T:

the number of process stages,

t:

the index of the process stage considered (t = 1, …, T),

yt:

a feasible state of the process at the beginning of stage t,

Yt:

the set of feasible states at the beginning of stage t,

xt:

a feasible decision for state yt,

Xt(yt):

the set of feasible decisions at the beginning of stage t for state yt

Ωt:

the transition function for stage t. We have: yt+1 = xt,

at:

a feasible realization for stage t (at = (yt, xt) = (yt, yt+1))—a stage alternative,

At:

the set of stage alternatives for stage t,

a:

a feasible realization of the entire process—a multistage alternative,

$$ {\mathbf{a}} = \left( {{\mathbf{a}}_{1} , \ldots ,{\mathbf{a}}_{T} } \right) = \left( {\left( {{\text{y}}_{1} ,{\text{x}}_{1} } \right), \ldots ,{\text{y}}_{T} ,{\text{x}}_{T} } \right)\big) = \left( {{\text{y}}_{1} , \ldots ,{\text{y}}_{T + 1} } \right) $$
A:

the set of all multistage alternatives,

Gt:

the stage set of good objects,

Bt:

the stage set of bad objects,

Rt = (Gt, Bt):

the stage reference system (Gt ∩ Bt = )

R = (R1, … RT):

the multistage reference system

K:

the number of the all the criteria considered (k = 1, …, K)

C kt :

kth criterion at stage t,

Ct:

the set of essential criteria at stage t

f kt :

the stage criterion function for stage t (f kt : At ∪ RtKk for k = 1, …, K, and Kk is a cardinal, ordinal or binary scale). We have:

$$ \forall {{t}} = 1, \ldots ,{{T}}\;\forall {{k}} \in {\mathbf{C}}_{{t}} \;\forall {\mathbf{g}}_{{t}} \in {\mathbf{G}}_{{t}} \;\forall {\mathbf{b}}_{{t}} \in {\mathbf{B}}_{{t}} \quad f_{t}^{k} \left( {{\mathbf{b}}_{{t}} } \right) < f_{t}^{k} \left( {{\mathbf{g}}_{{t}} } \right) $$
(1)
w kt :

the weight of the relative importance of criterion k in stage t. We have:

$$ \sum\limits_{k = 1}^{K} {w_{t}^{k} = \, 1} $$
(2)

and

$$ \forall_{{{{k}} = 1, \ldots ,{{K}}}} w_{t}^{k} \ge 0. $$
(3)

3 Stage alternatives

3.1 Comparison of stage alternatives with stage reference objects

We compare a selected stage alternative at with an arbitrary stage reference object rt, taking into account criterion C kt which is an essential stage criterion at stage t.

The comparison of the values f kt (at) and f kt (rt) can result in one of the following situations:

$$ f_{t}^{k} \left( {{\mathbf{a}}_{t} } \right) \, > f_{t}^{k} \left( {{\mathbf{r}}_{t} } \right) $$
(4)
$$ f_{t}^{k} \left( {{\mathbf{a}}_{t} } \right) = f_{t}^{k} \left( {{\mathbf{r}}_{t} } \right) $$
(5)
$$ f_{t}^{k} \left( {{\mathbf{a}}_{t} } \right) < f_{t}^{k} \left( {{\mathbf{r}}_{t} } \right) $$
(6)

In the first case, the stage alternative at is evaluated higher with respect to criterion k than the stage reference object rt. In the second case, the evaluations are the same. In the third case, the stage alternative at is evaluated lower with respect to criterion k than the stage reference object rt.

We define 0–1 indicators φ k+t (at, rt), φ k=t (at, rt) i φ kt (at, rt) as follows:

$$ \varphi_{t}^{k + } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) = \left\{ {\begin{array}{*{20}l} {1,} \hfill &\quad {{\text{if}}\,\,f_{t}^{k} \left( {{\mathbf{a}}_{t} } \right) - f_{t}^{k} \left( {{\mathbf{r}}_{t} } \right) > 0} \hfill \\ {0,} \hfill & \quad{\text{otherwise}} \hfill \\ \end{array} } \right. $$
(7)
$$ \varphi_{t}^{k = } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) = \left\{ {\begin{array}{*{20}l} {1,} \hfill & \quad{{\text{if}}\,\,f_{t}^{k} \left( {{\mathbf{a}}_{t} } \right) = f_{t}^{k} \left( {{\mathbf{r}}_{t} } \right)} \hfill \\ {0,} \hfill &\quad {\text{otherwise}} \hfill \\ \end{array} } \right. $$
(8)
$$ \varphi_{t}^{k - } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) = \left\{ {\begin{array}{*{20}l} {1,} \hfill &\quad {{\text{if}}\,\,f_{t}^{k} \left( {{\mathbf{a}}_{t} } \right) - f_{t}^{k} \left( {{\mathbf{r}}_{t} } \right) < 0} \hfill \\ {0,} \hfill &\quad {\text{otherwise}} \hfill \\ \end{array} } \right. $$
(9)

For the pair (at, rt), at ∈ At, rt ∈ Rt, we calculate the stage indicators c +t (at, rt), c +t (at, rt), c +t (at, rt) as follows:

$$ c_{t}^{ + } \left( {{\mathbf{a}}_{t} ,\,{\mathbf{r}}_{t} } \right) = \sum\limits_{k = 1}^{n} {w_{t}^{k} } \varphi_{t}^{k + } \left( {{\mathbf{a}}_{t} ,\,{\mathbf{r}}_{t} } \right) , $$
(10)
$$ c_{t}^{ = } \left( {{\mathbf{a}}_{t} ,\,{\mathbf{r}}_{t} } \right) = \sum\limits_{k = 1}^{n} {w_{t}^{k} } \varphi_{t}^{k = } \left( {{\mathbf{a}}_{t} ,\,{\mathbf{r}}_{t} } \right), $$
(11)
$$ c_{t}^{ - } \left( {{\mathbf{a}}_{t} ,\,{\mathbf{r}}_{t} } \right) = \sum\limits_{k = 1}^{n} {w_{t}^{k} } \varphi_{t}^{k - } \left( {{\mathbf{a}}_{t} ,\,{\mathbf{r}}_{t} } \right). $$
(12)

The value c +t (at, rt) is the sum of the weights of these stage criteria, for which f kt (at) > f kt (rt), that is, at is preferred over rt.

The value c =t (at, rt) is the sum of the weights of these stage criteria, for which ftk(at) = f kt (rt).

The value c t (at, rt) is the sum of the weights of these stage criteria, for which f kt (at) < f kt (rt), that is, rj is preferred over ai.

For the pair (at, rt), at ∈ \( {\mathbf{A}}_{\fancyscript{t}} \), rt ∈ Rt, we calculate the stage outranking indicators d +t (at, rt) of the stage alternative at ∈ \( {\mathbf{A}}_{\fancyscript{t}} \) with respect to the stage reference object rt ∈ Rt.

If

$$ c_{t}^{ + } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) > c_{t}^{ - } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right), $$
(13)

then the stage alternative at ∈ \( {\mathbf{A}}_{\fancyscript{t}} \) outranks the reference object rt ∈ Rt. The outranking stage indicators are defined as follows:

$$ d_{t}^{ + } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{\varvec{t}} } \right) = c_{t}^{ + } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) + c_{t}^{ = } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right), \quad d_{t}^{ - } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) = 0. $$
(14)

If

$$ c_{t}^{ + } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) < c_{t}^{ - } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right), $$
(15)

the reference object rt ∈ Rt outranks the stage alternative at ∈ \( {\mathbf{A}}_{\fancyscript{t}} \). The outranking stage indicators are defined as follows:

$$ d_{t}^{ + } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) \, = \, 0,\quad d_{t}^{ - } \left( {{\mathbf{a}}_{{\mathbf{t}}} ,{\mathbf{r}}_{t} } \right) = c_{t}^{ - } \left( {{\mathbf{a}}_{{\mathbf{t}}} ,{\mathbf{r}}_{t} } \right) + c_{t}^{ = } \left( {{\mathbf{a}},{\mathbf{r}}_{\varvec{t}} } \right). $$
(16)

If

$$ c_{t}^{ + } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) = c_{t}^{ - } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right), $$
(17)

the stage alternative at ∈ \( {\mathbf{A}}_{\fancyscript{t}} \) is evaluated as equally good as the reference object rt ∈ Rt. The outranking stage indicators are then defined as follows:

  • if rt is a good object, then

    $$ d_{t}^{ + } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) = c_{t}^{ + } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) + c_{t}^{ = } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right),\quad d_{t}^{ - } ({\mathbf{a}}_{t} ,{\mathbf{r}}_{t} ) = 0, $$
    (18)
  • if rt is a bad object, then

    $$ d_{t}^{ + } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) \, = 0,\quad d_{t}^{ - } ({\mathbf{a}}_{t} ,{\mathbf{r}}_{t} ) = \, c_{t}^{ + } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) + c_{t}^{ = } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right). $$
    (19)

Using the outranking indicators, we define two stage relationships: stage preference Lt and stage indifference It:

$$ {\mathbf{a}}_{t} \;{\text{L}}_{{t}} \;{\mathbf{r}}_{t} \;{\text{iff}}\;\; c_{t}^{ + } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) \ge c_{t}^{ - } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right), $$
(20)
$$ {\mathbf{r}}_{t} \;{\text{L}}_{{t}} \;{\mathbf{a}}_{t} \;{\text{iff}}\; c_{t}^{ + } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) \le d_{t}^{ - } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right), $$
(21)
$$ {\mathbf{a}}_{t} \;{\text{I}}_{{t}} \;{\mathbf{r}}_{t} \;{\text{iff}}\; c_{t}^{ + } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) = c_{t}^{ - } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right). $$
(22)

3.2 Position of a stage alternative with respect to the Bipolar stage reference system

We will now determine the position of the stage alternative at with respect to the stage reference set of good objects. For a given stage alternative at ∈ \( \varvec{A}_{\fancyscript{t}} \), the auxiliary sets of indices are defined as follows:

$$ {\mathcal{L}}_{{t}} ({\mathbf{a}}_{t} ,{\mathbf{G}}_{{t}} ) = \left\{ {h{:}\,{\mathbf{a}}_{t} {\text{L}}_{t} {\mathbf{g}}_{{{t}}}^{(h)} ,\;{\mathbf{g}}_{t}^{(h)} \in {\mathbf{G}}_{t} } \right\}, $$
(23)
$$ {\mathcal{L}}_{{t}} ({\mathbf{G}}_{{t}} ,{\mathbf{a}}_{t} ) = \left\{ {h{:}\,{\mathbf{g}}_{{{t}}}^{(h)} {\text{L}}_{t} {\mathbf{a}}_{t} ,{\mathbf{g}}_{t}^{(h)} \in {\mathbf{G}}_{t} } \right\}, $$
(24)
$$ I_{{t}} ({\mathbf{a}}_{t} ,{\mathbf{G}}_{{t}} ) = \left\{ {h{:}\,{\mathbf{a}}_{t} {\text{I}}_{t} {\mathbf{g}}_{{{t}}}^{(h)} ,\; {\mathbf{g}}_{t}^{(h)} \in {\mathbf{G}}_{{t}} } \right\}. $$
(25)

The set \( {\mathcal{L}}_{{t}} ({\mathbf{a}}_{t} ,{\mathbf{G}}_{{t}} ) \) contains the indices of these good stage reference objects which are outranked by the stage alternative at.

The set \( {\mathcal{L}}_{{t}} ({\mathbf{G}}_{{t}} ,{\mathbf{a}}_{t} ) \) contains the indices of these good stage reference objects which outrank the stage alternative at.

The set \( I_{{t}} ({\mathbf{a}}_{t} ,{\mathbf{G}}_{{t}} ) \) contains the indices of these good stage reference objects which are regarded as equally good with respect to the stage alternative at.

The position of the stage alternative at with respect to the stage reference system is described by two values: d +G (at) and d G (at). The value d +G (at) characterizes the outranking of the given stage alternative with respect to the stage reference system, while d G (at) characterizes the outranking of the stage reference system with respect to the given stage alternative at. The values d +G (at) and d G (at) are defined in such a way that at least one of them is equal to 0.

We will consider the following cases:

Case S1

$$ {\mathcal{L}}_{{t}} ({\mathbf{a}}_{t} ,{\mathbf{G}}_{{t}} ) \cup I_{{t}} ({\mathbf{a}}_{t} ,{\mathbf{G}}_{{t}} ) \ne \emptyset . $$
(26)

There exists at least one stage reference object outranked by at or equally good as at. This situation is favorable for the decision maker. In this case, d +G (at) is positive, while the second indicator d G (at) is then 0.

We calculate the value of the stage success achievement degree for the stage alternative at as follows:

$$ d_{{\mathbf{G}}}^{ + } \left( {{\mathbf{a}}_{t} } \right) = { \hbox{max} }\left\{ {d_{t}^{ + } \left( {{\mathbf{a}}_{{{t}}} ,{\mathbf{g}}_{t}^{(h)} } \right){:}\, h \in {\mathcal{L}}_{{t}} ({\mathbf{a}}_{t} ,{\mathbf{G}}_{{t}} ) \cup I_{{t}} ({\mathbf{a}}_{t} ,{\mathbf{G}}_{{t}} )} \right\},\quad d_{{\mathbf{G}}}^{ - } \left( {{\mathbf{a}}_{t} } \right) \, = \, 0. $$
(27)

Case S2

$$ {\mathcal{L}}_{t} ({\mathbf{a}}_{t} ,{\mathbf{G}}_{{t}} ) \cup I_{{t}} \left( {{\mathbf{a}}_{t} ,{\mathbf{G}}_{t} } \right) = \emptyset \wedge {\mathcal{L}}_{t} \left( {{\mathbf{G}}_{t} ,{\mathbf{a}}_{t} } \right) \ne \emptyset . $$
(28)

No good stage reference object is outranked by the given stage alternative at, nor is any such object evaluated as equally good as this alternative. There exists, however, at least one good stage reference object which outranks the stage alternative at. This situation is not favorable for the decision maker—it can be described as “average”—at the same time, this is the most frequent occurrence. The indicator d +G (at) is then equal to 0, while the indicator d G (at), describing the outranking of at by the reference system of good objects, is positive.

We calculate the value of the stage success achievement degree for the stage alternative at as follows:

$$ d_{{\mathbf{G}}}^{ + } \left( {{\mathbf{a}}_{t} } \right) = 0,\quad d_{{\mathbf{G}}}^{ - } \left( {{\mathbf{a}}_{t} } \right) = { \hbox{min} }\left\{ {d_{t}^{ + } \left( {{\mathbf{a}}_{t} ,{\mathbf{g}}_{t}^{(h)} } \right){:}\; h \in {\mathcal{L}}_{t} ({\mathbf{a}}_{t} ,{\mathbf{G}}_{{t}} ) \cup I_{{t}} ({\mathbf{a}}_{t} ,{\mathbf{G}}_{{t}} )} \right\}. $$
(29)

We will now determine the position of the stage alternative at with respect to the stage reference set of bad objects. For a given stage alternative at ∈ \( {\mathbf{A}}_{\fancyscript{t}} \) the auxiliary sets of indices are defined as follows:

$$ {\mathcal{L}}_{{t}} ({\mathbf{a}}_{t} ,{\mathbf{B}}_{{t}} ) = \left\{ {h{:}\,{\mathbf{a}}_{t} {\text{L}}_{t} {\mathbf{b}}^{(h)} ,\;{\mathbf{b}}_{t}^{(h)} \in {\mathbf{B}}_{t} } \right\}, $$
(30)
$$ {\mathcal{L}}_{{t}} ({\mathbf{B}}_{{t}} ,{\mathbf{a}}_{t} ) = \left\{ {h{:}\,{\mathbf{b}}_{t}^{(h)} {\text{L}}_{t} {\mathbf{a}}_{t} ,{\mathbf{b}}_{t}^{(h)} \in {\mathbf{B}}_{{t}} } \right\}, $$
(31)
$$ I_{{t}} ({\mathbf{B}}_{{t}} ,{\mathbf{a}}_{t} ) = \left\{ {h{:}\,{\mathbf{b}}_{t}^{(h)} {\text{I}}_{t} {\mathbf{a}}_{t} ,{\mathbf{b}}_{t}^{(h)} \in {\mathbf{B}}_{{t}} } \right\}. $$
(32)

The set \( {\mathcal{L}}_{{t}} ({\mathbf{a}}_{t} ,{\mathbf{B}}_{{t}} ) \) contains the indices of these bad stage reference objects that are outranked by the stage alternative at.

The set \( {\mathcal{L}}_{{t}} ({\mathbf{B}}_{{t}} ,{\mathbf{a}}_{t} ) \) contains the indices of these bad stage reference objects that outrank the stage alternative at.

The set \( I_{{t}} ({\mathbf{B}}_{t} ,{\mathbf{a}}_{{t}} ) \) contains the indices of these bad stage reference objects that are evaluated as equally good with respect to the stage alternative at.

The position of the stage alternative at with respect to the stage reference system is described by two values: d +B (at) and d B (at).

The value d +B (at) describes how the given stage alternative outranks the bad stage reference set, while d B (at). describes how the bad stage reference set outranks the given stage alternative at.

To determine the position of alternative at with respect to set Bt, we consider:

Case F1

$$ {\mathcal{L}}_{{t}} ({\mathbf{B}}_{{t}} ,{\mathbf{a}}_{t} ) \cup I_{{t}} ({\mathbf{B}}_{{t}} ,{\mathbf{a}}_{t} ) = \emptyset \wedge {\mathcal{L}}_{{t}} ({\mathbf{a}}_{t} ,{\mathbf{B}}_{t} ) \ne \emptyset . $$
(33)

No bad stage reference object outranks the given stage alternative at, nor is equally good as the stage alternative at. This situation is favorable for the decision maker. The indicator d +B (at), describing the outranking of the stage alternative at over the bad stage reference set, is then positive. The value d B (at) is then 0.

We calculate the value of the stage failure avoidance degree for the stage alternative at as follows:

$$ d_{{\mathbf{B}}}^{ + } \left( {{\mathbf{a}}_{t} } \right) = { \hbox{min} }\left\{ {d_{t}^{ + } \left( {{\mathbf{a}}_{t} ,{\mathbf{b}}_{t}^{(h)} } \right){:}\,h \in {\mathcal{L}}_{t} ({\mathbf{a}}_{t} ,{\mathbf{B}}_{t} )} \right\},\quad d_{{\mathbf{B}}}^{ - } \left( {{\mathbf{a}}_{t} } \right) = 0. $$
(34)

Case F2

$$ {\mathcal{L}}_{{t}} ({\mathbf{B}}_{{t}} ,{\mathbf{a}}_{t} ) \cup I_{{t}} ({\mathbf{B}}_{{t}} ,{\mathbf{a}}_{t} ) \ne \emptyset . $$
(35)

There exists at least one bad stage reference object which dominates the given multistage alternative at or is evaluated as equally good as this alternative. This situation is not favorable for the decision maker. The indicator d +B (at) is then equal to 0, while the indicator d G (at), describing the domination of the set of bad reference objects over at, is positive.

We calculate the value of the stage failure avoidance degree for the stage alternative at as follows:

$$ d_{{\mathbf{B}}}^{ + } \left( {{\mathbf{a}}_{t} } \right) = 0,\quad d_{{\mathbf{B}}}^{ - } \left( {{\mathbf{a}}_{t} } \right) = { \hbox{max} }\left\{ {d_{t}^{ - } \left( {{\mathbf{a}}_{t} ,{\mathbf{b}}_{t}^{(h)} } \right){:}\; h \in {\mathcal{L}}_{{t}} \left( {{\mathbf{B}}_{t} ,{\mathbf{a}}_{t} } \right) \cup I_{{t}} \left( {{\mathbf{B}}_{t} ,{\mathbf{a}}_{t} } \right)} \right\}. $$
(36)

4 Relationships in the set of multistage alternatives

With the stage success achievement indicators determined, for each multistage alternative a, we define the multistage success achievement degree:

$${d}_{{\mathbf{G}}}^{ + } \left( {\mathbf{a}} \right) = \frac{1}{T}\sum\limits_{t = 1}^{T} {{d}_{{\mathbf{G}}}^{ + } } \left( {{\mathbf{a}}_{t} } \right), $$
(37)
$${d}_{{\mathbf{G}}}^{ - } \left( {\mathbf{a}} \right) = \frac{1}{T}\sum\limits_{t = 1}^{T} {{d}_{{\mathbf{G}}}^{ - } } \left( {{\mathbf{a}}_{t} } \right). $$
(38)

We define these indicators as arithmetic means of the stage indicators. They admit values from the interval [0, 1].

With the stage failure avoidance indicators determined, for each multistage alternative a, we define the multistage failure avoidance degree:

$$ {d}_{{\mathbf{B}}}^{ + } \left( {\mathbf{a}} \right) = \frac{1}{T}\sum\limits_{t = 1}^{T} {{d}_{{\mathbf{B}}}^{ + } } \left( {{\mathbf{a}}_{t} } \right) , $$
(39)
$$ {d}_{{\mathbf{B}}}^{ - } \left( {\mathbf{a}} \right) = \frac{1}{T}\sum\limits_{t = 1}^{T} {{d}_{{\mathbf{B}}}^{ - } } \left( {{\mathbf{a}}_{t} } \right) . $$
(40)

Analogously to the previous indicators, we define these indicators as arithmetic means of the stage indicators. They too admit values from the interval [0, 1].

4.1 Sorting multistage alternatives

The values of the multistage indicators allow to classify the multistage alternatives. For a given multistage alternative a, we consider the components of the vector:

$$ {{d(}}{\mathbf{a}} )= \left[ {{{d}}_{{\mathbf{G}}}^{ + } ({\mathbf{a}}),\;{{d}}_{{\mathbf{G}}}^{ - } ({\mathbf{a}}),\;{{d}}_{{\mathbf{B}}}^{ + } ({\mathbf{a}}),\;{{d}}_{{\mathbf{B}}}^{ - } ({\mathbf{a}})} \right]. $$
(41)

First, we consider the class A1 of multistage alternatives, defined as follows:

$$ {\mathbf{A}}^{1} = \left\{ {{\mathbf{a}} \in {\mathbf{A}}{:}\;\;\; {{d}}_{{\mathbf{G}}}^{ + } ({\mathbf{a}}) > 0,\quad {{d}}_{{\mathbf{G}}}^{ - } ({\mathbf{a}}) = 0,\quad {{d}}_{{\mathbf{B}}}^{ + } ({\mathbf{a}} )> 0,\quad {{d}}_{{\mathbf{B}}}^{ - } ({\mathbf{a}}) = 0} \right\}. $$
(42)

This class includes multistage alternatives with the following property: at each stage, their components—stage alternatives—outrank the sets of good stage objects. In other words, at each stage, for each stage alternative from the given multistage alternative, there exists at least one good reference object, which is outranked by this particular multistage alternative. As a result, we have d G (a) = 0. At the same time, at each stage, the stage alternatives from the given multistage alternative at outrank the stage bad reference sets, hence we have d B (a) = 0. Therefore, the multistage alternatives satisfying condition (42) constitute the class of the best alternatives.

The class A2 is defined as follows:

$$ {\mathbf{A}}^{2} = \left\{ {{\mathbf{a}} \in {\mathbf{A}}{:}\;\; {{d}}_{{\mathbf{G}}}^{ + } ({\mathbf{a}} )> 0,\quad {{d}}_{{\mathbf{G}}}^{ - } ({\mathbf{a}}) > 0,\quad {{d}}_{{\mathbf{B}}}^{ + } ({\mathbf{a}}) > 0,\quad {{d}}_{{\mathbf{B}}}^{ - } ({\mathbf{a}}) = 0} \right\}. $$
(43)

At some stages, the stage alternatives from each alternative from A2 outrank the stage set of good reference objects, but at one stage at least, it is the good reference set that outranks a stage alternative from the given multistage alternative. As a result, the multistage alternatives from A2 are evaluated lower than the ones from A1. At the same time, all the stage alternatives from the multistage alternatives from A2 outrank all the bad stage reference sets, hence we have d B (a) = 0.

The next class, A3, includes the following multistage alternatives:

$$ {\mathbf{A}}^{3} = \left\{ {{\mathbf{a}} \in {\mathbf{A}}{:} \;\;{{d}}_{{\mathbf{G}}}^{ + } ({\mathbf{a}}) > 0,\quad {{d}}_{{\mathbf{G}}}^{ - } ({\mathbf{a}}) > 0,\quad {{d}}_{{\mathbf{B}}}^{ + } ({\mathbf{a}}) > 0,\quad {{d}}_{{\mathbf{B}}}^{ - } ({\mathbf{a}}) > 0} \right\}. $$
(44)

As in the case of A2, some stage alternatives from the multistage alternatives belonging to A3 outrank the good stage reference sets, while at other stages, the good stage reference sets outrank the stage alternatives. A similar situation occurs when we compare the stage alternatives which constitute the multistage alternatives from A3 with the bad reference sets: some of them outrank these sets, some are outranked. For this reason, the multistage alternatives from A3 are evaluated lower than those from A2.

Class A4 of multistage alternatives is defined as follows:

$$ {\mathbf{A}}^{4} = \left\{ {{\mathbf{a}} \in {\mathbf{A}}{:} \;\;{{d}}_{{\mathbf{G}}}^{ + } ({\mathbf{a}}) = 0,\quad {{d}}_{{\mathbf{G}}}^{ - } ({\mathbf{a}}) > 0,\quad {{d}}_{{\mathbf{B}}}^{ + } ({\mathbf{a}} )> 0,\quad {{d}}_{{\mathbf{B}}}^{ - } ({\mathbf{a}}) = 0} \right\}. $$
(45)

At all stages, all the stage alternatives from the multistage alternatives from class A4 are outranked by the sets of good objects, hence d +G (a) = 0. This also means that each multistage alternative from A4 is evaluated lower than any multistage alternative from A3. At the same time, at all stages, the stage alternatives of all the multistage alternatives from A4 outrank the sets of bad objects, hence d B (a) = 0.

The fifth class A5 consists of these multistage alternative, for which:

$$ {\mathbf{A}}^{5} = \left\{ {{\mathbf{a}} \in {\mathbf{A}}{:} \;\;{{d}}_{{\mathbf{G}}}^{ + } ({\mathbf{a}} )= 0,\quad {{d}}_{{\mathbf{G}}}^{ - } ({\mathbf{a}}) > 0,\quad {{d}}_{{\mathbf{B}}}^{ + } ({\mathbf{a}} )> 0,\quad {{d}}_{{\mathbf{B}}}^{ - } ({\mathbf{a}} )> 0} \right\} $$
(46)

As in the case of A4, all the stage alternatives of the multistage alternatives from A5 are outranked by the good reference sets. At the same time, among the stage alternatives of the multistage alternatives from A4 there are some that outrank the bad stage reference sets, as well as some that are outranked by these sets. As a result, the multistage alternatives from A5 are evaluated as worse than those from A4.

The last class considered is A6, defined as follows:

$$ {\mathbf{A}}^{6} = \left\{ {{\mathbf{a}} \in {\mathbf{A}}{:} \;\;\;{{d}}_{{\mathbf{G}}}^{ + } ({\mathbf{a}}) = 0,\quad {{d}}_{{\mathbf{G}}}^{ - } ({\mathbf{a}}) > 0,\quad {{d}}_{{\mathbf{B}}}^{ + } ({\mathbf{a}}) = 0, \quad {{d}}_{{\mathbf{B}}}^{ - } ({\mathbf{a}} )> 0} \right\}. $$
(47)

All the stage alternatives of the multistage alternatives from A6 are outranked by the good reference sets, hence d +G (a) = 0. At the same time, these stage alternatives are outranked, in all stages, by the bad reference sets, hence d +B (a) = 0. This means that all the multistage alternatives from A6 are evaluated lower than those from A5.

Using d +G (a), d G (a), d +B (a) and d B (a), we could distinguish another ten classes as follows:

$$ {\mathbf{A}}^{7} = \left\{ {{\mathbf{a}} \in {\mathbf{A}}{:} \;\;{{d}}_{{\mathbf{G}}}^{ + } ({\mathbf{a}}) > 0,\quad {{d}}_{{\mathbf{G}}}^{ - } ({\mathbf{a}}) = 0,\quad {{d}}_{{\mathbf{B}}}^{ + } ({\mathbf{a}}) > 0,\quad {{d}}_{{\mathbf{B}}}^{ - } ({\mathbf{a}} )> 0} \right\} $$
(48)
$$ {\mathbf{A}}^{8} = \left\{ {{\mathbf{a}} \in {\mathbf{A}}{:}\;\;{{d}}_{{\mathbf{G}}}^{ + } ({\mathbf{a}} )> 0,\quad {{d}}_{{\mathbf{G}}}^{ - } ({\mathbf{a}}) > 0,\quad {{d}}_{{\mathbf{B}}}^{ + } ({\mathbf{a}}) = 0,\quad {{d}}_{{\mathbf{B}}}^{ - } ({\mathbf{a}}) > 0} \right\} $$
(49)
$$ {\mathbf{A}}^{9} = \left\{ {{\mathbf{a}} \in {\mathbf{A}}{:}\;\;{{d}}_{{\mathbf{G}}}^{ + } ({\mathbf{a}}) > 0,\quad {{d}}_{{\mathbf{G}}}^{ - } ({\mathbf{a}}) = 0,\quad {{d}}_{{\mathbf{B}}}^{ + } ({\mathbf{a}} )= 0,\quad {{d}}_{{\mathbf{B}}}^{ - } ({\mathbf{a}} )> 0} \right\} $$
(50)
$$ {\mathbf{A}}^{10} = \left\{ {{\mathbf{a}} \in {\mathbf{A}}{:}\;\;{{d}}_{{\mathbf{G}}}^{ + } ({\mathbf{a}}) > 0,\quad {{d}}_{{\mathbf{G}}}^{ - } ({\mathbf{a}}) = 0,\quad {{d}}_{{\mathbf{B}}}^{ + } ({\mathbf{a}}) = 0,\quad {{d}}_{{\mathbf{B}}}^{ - } ({\mathbf{a}} )= 0} \right\} $$
(51)
$$ {\mathbf{A}}^{11} = \left\{ {{\mathbf{a}} \in {\mathbf{A}}{:}\;\;{{d}}_{{\mathbf{G}}}^{ + } ({\mathbf{a}} )> 0, \quad {{d}}_{{\mathbf{G}}}^{ - } ({\mathbf{a}}) > 0,\quad {{d}}_{{\mathbf{B}}}^{ + } ({\mathbf{a}}) = 0,\quad {{d}}_{{\mathbf{B}}}^{ - } ({\mathbf{a}} )= 0} \right\} $$
(52)
$$ {\mathbf{A}}^{12} = \left\{ {{\mathbf{a}} \in {\mathbf{A}}{:}\;\;{{d}}_{{\mathbf{G}}}^{ + } ({\mathbf{a}}) = 0,\quad {{d}}_{{\mathbf{G}}}^{ - } ({\mathbf{a}} )> 0,\quad {{d}}_{{\mathbf{B}}}^{ + } ({\mathbf{a}} )= 0,\quad {{d}}_{{\mathbf{B}}}^{ - } ({\mathbf{a}} )= 0} \right\} $$
(53)
$$ {\mathbf{A}}^{13} = \left\{ {{\mathbf{a}} \in {\mathbf{A}}{:}\;\;{{d}}_{{\mathbf{G}}}^{ + } ({\mathbf{a}} )= 0,\quad {{d}}_{{\mathbf{G}}}^{ - } ({\mathbf{a}} )= 0,\quad {{d}}_{{\mathbf{B}}}^{ + } ({\mathbf{a}} )> 0,\quad {{d}}_{{\mathbf{B}}}^{ - } ({\mathbf{a}} )= 0} \right\} $$
(54)
$$ {\mathbf{A}}^{14} = \left\{ {{\mathbf{a}} \in {\mathbf{A}}{:} \;\;{{d}}_{{\mathbf{G}}}^{ + } ({\mathbf{a}} )= 0,\quad {{d}}_{{\mathbf{G}}}^{ - } ({\mathbf{a}}) = 0,\quad {{d}}_{{\mathbf{B}}}^{ + } ({\mathbf{a}} )> 0,\quad {{d}}_{{\mathbf{B}}}^{ - } ({\mathbf{a}} )> 0} \right\} $$
(55)
$$ {\mathbf{A}}^{15} = \left\{ {{\mathbf{a}} \in {\mathbf{A}}{:}\;\;{{d}}_{{\mathbf{G}}}^{ + } ({\mathbf{a}} )= 0,\quad {{d}}_{{\mathbf{G}}}^{ - } ({\mathbf{a}} )= 0,\quad {{d}}_{{\mathbf{B}}}^{ + } ({\mathbf{a}} )= 0,\quad {{d}}_{{\mathbf{B}}}^{ - } ({\mathbf{a}} )> 0} \right\} $$
(56)
$$ {\mathbf{A}}^{16} = \left\{ {{\mathbf{a}} \in {\mathbf{A}}{:}\;\;{{d}}_{{\mathbf{G}}}^{ + } ({\mathbf{a}}) = 0,\quad {{d}}_{{\mathbf{G}}}^{ - } ({\mathbf{a}}) = 0,\quad {{d}}_{{\mathbf{B}}}^{ + } ({\mathbf{a}} )= 0,\quad {{d}}_{{\mathbf{B}}}^{ - } ({\mathbf{a}} )= 0} \right\} $$
(57)

In this way, all the possibilities of creating such classes have been exhausted, hence:

$$ {\mathbf{A}}^{1} \cup {\mathbf{A}}^{2} \cup \cdots \cup {\mathbf{A}}^{16} = {\mathbf{A}}. $$
(58)

Because of the construction of these classes, we have:

$$ {\mathbf{A}}^{1} \cap {\mathbf{A}}^{2} \cap \cdots \cap {\mathbf{A}}^{16} = \emptyset . $$
(59)

At the same time, our assumptions easily lead to the conclusion that:

$$ {\mathbf{A}}^{\text{i}} = \emptyset $$
(60)

for i = 7, …, 16.

Class A7, defined by formula (48), is empty. Multistage alternatives from this class have to satisfy the conditions: d +G (a) > 0 and d G (a) = 0. It follows that, at all stages, the stage alternatives (their components) are outranked by the good stage reference objects. Since at the same time d +B (a) > 0 and d B (a) > 0, this means that at least in one stage, bad reference objects outrank stage alternatives. Furthermore, it follows that at least in one stage, stage alternatives are at the same time overgood and underbad. But this, because of the assumption in formula (1), is not possible, which is proven in Trzaskalik and Sitarz (2012).

For a similar reason, class A8, defined by formula (49), is also empty. In this case, the multistage alternatives from this class have to satisfy the following conditions: d +B (a) = 0 and d B (a) > 0. It follows that, at all stages, the stage alternatives (their components) are outranked by bad reference objects. Since at the same time, d +G (a) > 0 and d G (a) > 0, this means that at least in one step, the stage alternatives outrank the reference objects. Again, it follows that at least in one stage, stage alternatives would be both overgood and underbad, which is not possible.

The class A9 defined by (50) is empty, because the multistage alternatives from this set would have to satisfy the conditions: d +G (a) > 0 and d G (a) = 0 as well as d +B (a) = 0 and d B (a) > 0. From this it follows that at all stages we would have also d +G (at) > 0 and d G (at) = 0 as well as d +B (at) = 0 and d B (at) > 0. This would mean, however, that all the stage alternatives constituting the given multistage alternative are at the same time overgood and underbad, which is not possible.

The classes A10, A11 and A12 defined by (51), (52) and (53) are empty because the multistage alternatives which would belong to them would have to satisfy the following conditions: d +B (a) = 0 and d B (a) = 0. This is not possible, since at each stage one of the outranking indicators d +B (at, rt) or d B (at, rt) (formulas 34 and 36) is positive, therefore—from (39) and (40)—at least one of the numbers d +B (a) and d B (a) has to be positive.

The classes A13, A14, A15 and A16 defined by (54)–(57) are empty because the multistage alternatives from them would have to satisfy the conditions: d +G (a) = 0 and d G (a) = 0. This is not possible, since at each stage, one of the outranking indicators d +G (at) = 0 or d G (at) = 0 (formulas (27) and (29)) is positive, hence—from (37) and (38)—at least one of the numbers d +G (a) and d G (a) must be positive.

Therefore, the multistage alternatives can be sorted into the six classes A1, …, A6 and

$$ {\mathbf{A}}^{1 } \cup {\mathbf{A}}^{2} \cup {\mathbf{A}}^{3} \cup {\mathbf{A}}^{4} \cup {\mathbf{A}}^{5} \cup {\mathbf{A}}^{6} = {\mathbf{A}}. $$
(61)

We have shown above that our construction of the above classes implies that if k < l, then each multistage alternative from class Ak should be preferred over any multistage alternative from class Al.

4.2 Ranking the multistage alternatives

We will now discuss the ranking of the multistage alternatives within each class. Note that two multistage indicators, d +G (a) and d +B (a), describe the outranking of the stage reference sets Gt and Bt by the multistage alternative a. Positive values of these indicators are favorable for the decision maker. Multistage indicators d G (a) and d B (a), on the other hand, describe the outranking of the multistage alternative a by the reference sets Gt and Bt. Positive values of these indicators are unfavorable for the decision maker.

Let:

$$ {{d}}\left( {{\mathbf{a}}^{(i)} } \right) = {{d}}_{\mathbf{G}}^{ + } \left( {{\mathbf{a}}^{(i)} } \right){-}{{d}}_{\mathbf{G}}^{ - } \left( {{\mathbf{a}}^{(i)} } \right) + {{d}}_{\mathbf{B}}^{ + } \left( {{\mathbf{a}}^{(i)} } \right){-}{{d}}_{\mathbf{B}}^{ - } \left( {{\mathbf{a}}^{(i)} } \right). $$
(62)

Within the classes the ordering of the alternatives is defined as follows:

$$ \begin{aligned} & {\mathbf{a}}^{(i)} \;{\text{is}}\;{\text{preferred}}\;{\text{to}}\;{\mathbf{a}}^{(j)} ,\;{\text{iff}} \\ & {{d}}\left( {{\mathbf{a}}^{(i)} } \right) > {{d}}\left( {{\mathbf{a}}^{{({\text{j}})}} } \right) \\ \end{aligned} $$
(63)
$$ \begin{aligned} & {\mathbf{a}}^{(i)} \;{\text{is}}\;{\text{equivalent}}\;{\text{to}}\;{\mathbf{a}}^{(j)} ,\;{\text{iff}} \\ & {{d}}\left( {{\mathbf{a}}^{(i)} } \right) = {{d}}\left( {{\mathbf{a}}^{(j)} } \right) \\ \end{aligned} $$
(64)

The best multistage alternative a** is defined as a multistage alternative which belongs to the non-empty class with the lowest index m and satisfies the relationship

$$ {\forall_{{{\mathbf{a}}^{\prime} \in {\mathbf{A}}}}}^{m} {{d}}\left( {{\mathbf{a}}^{**} } \right) \ge {{d}}\left( {{\mathbf{a}}^{\prime}} \right). $$
(65)

5 Numerical illustration

We consider a three-stage decision process. The sets of feasible states and decisions are as follows:

$$ {\mathbf{Y}}_{\text{t}} = \{ 0,1\} \;{\text{for}}\;t = 1, \ldots ,4,\quad {\mathbf{X}}_{t} (0 )= \{ 0, \, 1\} ,\;{\mathbf{X}}_{t} (1 )= \{ 0, \, 1\} \;\,\,\,{\text{for}}\;{\text{t}} = 1,2,3. $$

The structure of the process discussed is shown in Fig. 1.

Fig. 1
figure 1

The structure of the process discussed

We have four stage alternatives at each stage t = 1, 2, 3 of the process:

$$ \begin{array}{*{20}c} {{\mathbf{A}}_{t} = \left\{ {{\mathbf{a}}_{t}^{(0)} ,{\mathbf{a}}_{t}^{(1)} ,{\mathbf{a}}_{t}^{(2)} ,{\mathbf{a}}_{t}^{(3)} } \right\}} \\ {{\mathbf{a}}_{t}^{(0)} = (0,0),\;\; \;\;{\mathbf{a}}_{t}^{(1)} = (0,1)\quad {\mathbf{a}}_{t}^{(2)} = (1, \, 0)\;\;\;\;{\mathbf{a}}_{t}^{(3)} = (1, \, 1).} \\ \end{array} $$

At each stage we have two reference sets:

$$ {\mathbf{G}}_{t} = \left\{ {{\mathbf{g}}_{t}^{(0)} ,{\mathbf{g}}_{t}^{(1)} } \right\}\,\,\;\;{\text{and}}\,\,\;\;{\mathbf{B}}_{t} = \left\{ {{\mathbf{b}}_{t}^{(0)} ,{\mathbf{b}}_{t}^{(1)} } \right\}. $$

In the first stage, the essential criteria are: C 11 , C 21 , C 31 , C 41 , C 51 , in the second stage, C 12 , C 32 , C 42 , C 62 , C 82 , and in the third stage, C 33 , C 53 , C 63 , C 73 , C 83 . The matrix of stage criteria weights is given in Table 1.

Table 1 Values of the stage criteria weights

The results of the comparisons of stage alternatives at ∈ At with the elements of the reference sets are given in Table 2.

Table 2 Results of the comparisons of the stage alternatives with the elements of the reference sets

Using our numerical data, we compare the stage alternative a (0)1 with the good object g (0)1 . In stage 1, the essential criteria are: C 11 , C 21 , C 31 , C 41 , C 51 , and their weights:

$$ {{w}}_{1}^{1} = 0.17, \;\;{{w}}_{1}^{2} = 0.23, \;\;{{w}}_{1}^{3} = 0.23,\;\;{{w}}_{1}^{4} = 0.12,\;\;{{w}}_{1}^{5} = 0.25. $$

From the comparisons in Table 2 we obtain, according to formulas (7)–(9):

$$ \begin{aligned} & f_{1}^{1} \left( {{\mathbf{a}}_{1}^{(0)} } \right) < f_{1}^{1} \left( {{\mathbf{g}}^{(0)} } \right) \\ & \quad \Rightarrow\varphi_{1}^{1 + } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}^{(0)} } \right) = 0,\;\;\varphi_{1}^{1 - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}^{\left( 0 \right) } } \right) = 1,\;\;\varphi_{1}^{1 = } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}^{(0)} } \right) = 0 \\ & f_{1}^{2} \left( {{\mathbf{a}}_{1}^{(0)} } \right) = f_{1}^{2} \left( {{\mathbf{g}}^{(0)} } \right) \\ & \quad \Rightarrow\varphi_{1}^{2 + } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}^{(0)} } \right) = 0,\;\;\varphi_{1}^{2 - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}^{\left( 0 \right) } } \right) = 0,\;\;\varphi_{1}^{2 = } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}^{(0)} } \right) = 1 \\ & f_{1}^{3} \left( {{\mathbf{a}}_{1}^{(0)} } \right) < f_{1}^{3} \left( {{\mathbf{g}}^{(0)} } \right) \\ & \quad \Rightarrow\varphi_{1}^{3 + } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}^{(0)} } \right) = 0,\;\;\varphi_{1}^{3 - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}^{\left( 0 \right) } } \right) = 1,\;\;\varphi_{1}^{3 = } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}^{(0)} } \right) = 0 \\ & f_{1}^{4} \left( {{\mathbf{a}}_{1}^{(0)} } \right) > f_{1}^{4} \left( {{\mathbf{g}}^{(0)} } \right) \\ & \quad \Rightarrow\varphi_{1}^{4 + } \left( {{\mathbf{a}}_{{\mathbf{1}}}^{(0)} ,{\mathbf{g}}^{(0)} } \right) = 1,\;\;\varphi_{1}^{4 - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}^{\left( 0 \right) } } \right) = 0,\;\;\varphi_{1}^{4 = } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}^{(0)} } \right) = 0 \\ & f_{1}^{5} \left( {{\mathbf{a}}_{1}^{(0)} } \right) = f_{1}^{5} \left( {{\mathbf{g}}^{(0)} } \right) \\ & \quad \Rightarrow\varphi_{1}^{5 + } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}^{(0)} } \right) = 0,\;\;\varphi_{1}^{5 - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}^{(0)} } \right) = 0,\quad\varphi_{1}^{5 = } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}^{(0)} } \right) = 1 \\ \end{aligned} $$

From (10)–(12) we calculate:

$$ \begin{aligned} & {\text{ c}}_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}_{1}^{(0)} } \right) = {0 \cdot 0.17 + 0 \cdot 0.23 + 0 \cdot 0.23+ 1 \cdot 0.12 + 0 \cdot 0.25}{ \;=\; }0.12, \\ & c_{1}^{ = } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}_{1}^{(0)} } \right) = 0 \cdot 0.17 + 1 \cdot 0.23 + 0\cdot 0.23 + 0\cdot 0.12 + 1 \cdot 0.25 \;=\;0.48, \\ & c_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}_{1}^{(0)} } \right) = 1 \cdot 0.17 + 0 \cdot 0.23 + 1 \cdot 0.23 + 0\cdot 0.12 + 0 \cdot 0.25 \;= \;0.40. \\ \end{aligned} $$

Since c +1 (a (0)1 , g (0)1 ) < c 1 (a (0)1 , g (0)1 ), that is, condition (15) is satisfied, from (16) we obtain:

$$ {{d}}_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}_{1}^{(0)} } \right) = 0,\quad {{d}}_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\text{g}}_{1}^{(0)} } \right) = c_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}_{1}^{(0)} } \right) + c_{1}^{ = } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}_{1}^{(0)} } \right) = 0.88. $$

From the comparisons in Table 2 according to formulas (7)–(9) we obtain:

$$ \begin{aligned} & f_{1}^{1} \left( {{\mathbf{a}}_{1}^{(0)} } \right) > f_{1}^{1} \left( {{\mathbf{b}}^{(0)} } \right) \\ & \quad \Rightarrow\varphi_{1}^{1 + } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}^{(0)} } \right) = 1,\;\;\varphi_{1}^{1 - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}^{\left( 0 \right) } } \right) = 0, \quad\varphi_{1}^{1 = } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}^{(0)} } \right) = 0. \\ & f_{1}^{2} \left( {{\mathbf{a}}_{1}^{(0)} } \right) > f_{1}^{2} \left( {{\mathbf{b}}^{(0)} } \right) \\ & \quad \Rightarrow\varphi_{1}^{2 + } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}^{(0)} } \right) = 1,\;\;\varphi_{1}^{2 - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}^{\left( 0 \right) } } \right) = 0,\quad\varphi_{1}^{2 = } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}^{(0)} } \right) = 0. \\ & f_{1}^{3} \left( {{\mathbf{a}}_{1}^{(0)} } \right) = f_{1}^{3} \left( {{\mathbf{b}}^{(0)} } \right) \\ & \quad \Rightarrow\varphi_{1}^{3 + } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}^{(0)} } \right) = 0,\;\;\varphi_{1}^{3 - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}^{\left( 0 \right) } } \right) = 0,\quad\varphi_{1}^{3 = } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}^{(0)} } \right) = 1. \\ & f_{1}^{4} \left( {{\mathbf{a}}_{1}^{(0)} } \right) < f_{1}^{4} \left( {{\mathbf{b}}^{(0)} } \right) \\ & \quad \Rightarrow\varphi_{1}^{4 + } \left( {{\mathbf{a}}_{{\mathbf{1}}}^{(0)} ,{\mathbf{b}}^{(0)} } \right) = 0,\;\;\varphi_{1}^{4 - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}^{\left( 0 \right) } } \right) = 1,\quad\varphi_{1}^{4 = } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}^{(0)} } \right) = 0. \\ & f_{1}^{5} \left( {{\mathbf{a}}_{1}^{(0)} } \right) < f_{1}^{5} \left( {{\mathbf{b}}^{(0)} } \right) \\ & \quad \Rightarrow\varphi_{1}^{5 + } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}^{(0)} } \right) = 0, \;\;\varphi_{1}^{5 - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}^{(0)} } \right) = 1,\quad\varphi_{1}^{5 = } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}^{(0)} } \right) = 0. \\ \end{aligned} $$

From (10)–(12) we calculate:

$$ \begin{aligned} & c_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}_{1}^{(0)} } \right) { = } {1 \cdot 0.17 + 1 \cdot 0.23 + 0 \cdot 0.23+ 0 \cdot 0.12 + 0 \cdot 0.25}= 0.40, \\ & c_{1}^{ = } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}_{1}^{(0)} } \right) = 0 \cdot 0.17 + 0 \cdot 0.23 + 1\cdot 0.23 + 0\cdot 0.12 + 0\cdot 0.25 = 0.23, \\ & c_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}_{1}^{(0)} } \right) = 0 \cdot 0.17 + 0 \cdot 0.23 + 0 \cdot 0.23 + 1\cdot 0.12 + 1 \cdot 0.25 = 0.37. \\ \end{aligned} $$

Since c +1 (a (0)1 , b (0)1 ) > c 1 (a (0)1 , b (0)1 ), that is, condition (13) is satisfied, from (14) we obtain:

$$ {{d}}_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}_{1}^{(0)} } \right) = c_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}_{1}^{(0)} } \right) + c_{1}^{ = } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}_{1}^{(0)} } \right) = 0.63,\quad {{d}}_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}_{1}^{(0)} } \right) = 0. $$

Performing further calculations analogously, we obtain the remaining indicators describing the comparisons of the stage alternatives for stage 1 with the elements of the reference system. Below is the complete set of these values:

$$ \begin{array}{*{20}l} {{{d}}_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}_{1}^{(0)} } \right) = 0} \hfill & {{{d}}_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}_{1}^{(0)} } \right) = 0.88} \hfill & {{{d}}_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}_{1}^{(0)} } \right) = 0.63} \hfill & {{{d}}_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}_{1}^{(0)} } \right) = 0} \hfill \\ {{{d}}_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}_{1}^{(1)} } \right) = 0} \hfill & {{{d}}_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{g}}_{1}^{(1)} } \right) = 1} \hfill & {{{d}}_1^{ + } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}_{1}^{(1)} } \right) = 0.88} \hfill & {{{d}}_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(0)} ,{\mathbf{b}}_{1}^{(1)} } \right) = 0} \hfill \\ {{{d}}_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(1)} ,{\mathbf{g}}_{1}^{(0)} } \right) = 0} \hfill & {{{d}}_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(1)} ,{\mathbf{g}}_{1}^{(0)} } \right) = 0.77} \hfill & { {{d}}_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(1)} ,{\mathbf{b}}_{1}^{(0)} } \right) = 0.77} \hfill & {{{d}}_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(1)} ,{\mathbf{b}}_{1}^{(0)} } \right) = 0} \hfill \\ {{{d}}_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(1)} ,{\mathbf{g}}_{1}^{(1)} } \right) = 0.65} \hfill & {{{d}}_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(1)} ,{\mathbf{g}}_{1}^{(1)} } \right) = 0} \hfill & {{{d}}_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(1)} ,{\mathbf{b}}_{1}^{(1)} } \right) = 1} \hfill & {{{d}}_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(1)} ,{\mathbf{b}}_{1}^{(1)} } \right) = 0} \hfill \\ {{{d}}_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(2)} ,{\mathbf{g}}_{1}^{(0)} } \right) = 0} \hfill & {{{d}}_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(2)} ,{\mathbf{g}}_{1}^{(0)} } \right) = 1} \hfill & {{{d}}_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(2)} ,{\mathbf{b}}_{1}^{(0)} } \right) = 0} \hfill & {{{d}}_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(2)} ,{\mathbf{b}}_{1}^{(0)} } \right) = 0.61} \hfill \\ {{{d}}_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(2)} ,{\mathbf{g}}_{1}^{(1)} } \right) = 0} \hfill & {{{d}}_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(2)} ,{\mathbf{g}}_{1}^{(1)} } \right) = 0.75} \hfill & {{{d}}_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(2)} ,{\mathbf{b}}_{1}^{(1)} } \right) = 0} \hfill & {{{d}}_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(2)} ,{\mathbf{b}}_{1}^{(1)} } \right) = 0.64} \hfill \\ {{{d}}_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(3)} ,{\mathbf{g}}_{1}^{(0)} } \right) = 0} \hfill & {{{d}}_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(3)} ,{\mathbf{g}}_{1}^{(0)} } \right) = 0.88} \hfill & {{{d}}_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(3)} ,{\mathbf{b}}_{1}^{(0)} } \right) = 0.75} \hfill & {{{d}}_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(3)} ,{\mathbf{b}}_{1}^{(0)} } \right) = 0} \hfill \\ { {{d}}_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(3)} ,{\mathbf{g}}_{1}^{(1)} } \right) = 0} \hfill & {{{d}}_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(3)} ,{\mathbf{g}}_{1}^{(1)} } \right) = 0.52} \hfill & {{{d}}_{1}^{ + } \left( {{\mathbf{a}}_{1}^{(3)} ,{\mathbf{b}}_{1}^{(1)} } \right) = 0.52} \hfill & {{{d}}_{1}^{ - } \left( {{\mathbf{a}}_{1}^{(3)} ,{\mathbf{b}}_{1}^{(1)} } \right) = 0} \hfill \\ \end{array} $$

From comparisons performed for stage 2, we obtain:

$$ \begin{array}{*{20}l} {{{d}}_{2}^{ + } \left( {{\mathbf{a}}_{2}^{(0)} ,{\mathbf{g}}_{2}^{(0)} } \right) = 0} \hfill & {{{d}}_{2}^{ - } \left( {{\mathbf{a}}_{2}^{(0)} ,{\mathbf{g}}_{2}^{(0)} } \right) = 0.88} \hfill & {{{d}}_{2}^{ + } \left( {{\mathbf{a}}_{2}^{(0)} ,{\mathbf{b}}_{2}^{(0)} } \right) = 0.72} \hfill & {{{d}}_{2}^{ - } \left( {{\mathbf{a}}_{2}^{(0)} ,{\mathbf{b}}_{2}^{(0)} } \right) = 0} \hfill \\ {{{d}}_{2}^{ + } \left( {{\mathbf{a}}_{2}^{(0)} ,{\mathbf{g}}_{2}^{(1)} } \right) = 0} \hfill & {{{d}}_{2}^{ - } \left( {{\mathbf{a}}_{2}^{(0)} ,{\mathbf{g}}_{2}^{(1)} } \right) = 1} \hfill & {{{d}}_{2}^{ + } \left( {{\mathbf{a}}_{2}^{(0)} ,{\mathbf{b}}_{2}^{(1)} } \right) = 0.63} \hfill & {{{d}}_{2}^{ - } \left( {{\mathbf{a}}_{2}^{(0)} ,{\mathbf{b}}_{2}^{(1)} } \right) = 0} \hfill \\ {{{d}}_{2}^{ + } \left( {{\mathbf{a}}_{2}^{(1)} ,{\mathbf{g}}_{2}^{(0)} } \right) = 0} \hfill & {{{d}}_{2}^{ - } \left( {{\mathbf{a}}_{2}^{(1)} ,{\mathbf{g}}_{2}^{(0)} } \right) = 1} \hfill & {{{d}}_{2}^{ + } \left( {{\mathbf{a}}_{2}^{(1)} ,{\mathbf{b}}_{2}^{(0)} } \right) = 0} \hfill & {{{d}}_{2}^{ - } \left( {{\mathbf{a}}_{2}^{(1)} ,{\mathbf{b}}_{2}^{(0)} } \right) = 1} \hfill \\ {{{d}}_{2}^{ + } \left( {{\mathbf{a}}_{2}^{(1)} ,{\mathbf{g}}_{2}^{(1)} } \right) = 0} \hfill & {{{d}}_{2}^{ - } \left( {{\mathbf{a}}_{2}^{(1)} ,{\mathbf{g}}_{2}^{(1)} } \right) = 1} \hfill & {{{d}}_{2}^{ + } \left( {{\mathbf{a}}_{2}^{(1)} ,{\mathbf{b}}_{2}^{(1)} } \right) = 0.83} \hfill & {{{d}}_{2}^{ - } \left( {{\mathbf{a}}_{2}^{(1)} ,{\mathbf{b}}_{2}^{(1)} } \right) = 0} \hfill \\ {{{d}}_{2}^{ + } \left( {{\mathbf{a}}_{2}^{(2)} ,{\mathbf{g}}_{2}^{(0)} } \right) = 0} \hfill & {{{d}}_{2}^{ - } \left( {{\mathbf{a}}_{2}^{(2)} ,{\mathbf{g}}_{2}^{(0)} } \right) = 0.88} \hfill & {{{d}}_{2}^{ + } \left( {{\mathbf{a}}_{2}^{(2)} ,{\mathbf{b}}_{2}^{(0)} } \right) = 0.72} \hfill & {{{d}}_{2}^{ - } \left( {{\mathbf{a}}_{2}^{(2)} ,{\mathbf{b}}_{2}^{(0)} } \right) = 0} \hfill \\ {{{d}}_{2}^{ + } \left( {{\mathbf{a}}_{2}^{(2)} ,{\mathbf{g}}_{2}^{(1)} } \right) = 0.51} \hfill & {{{d}}_{2}^{ - } \left( {{\mathbf{a}}_{2}^{(2)} ,{\mathbf{g}}_{2}^{(1)} } \right) = 0} \hfill & {{{d}}_{2}^{ + } \left( {{\mathbf{a}}_{2}^{(2)} ,{\mathbf{b}}_{2}^{(1)} } \right) = 0.77} \hfill & {{{d}}_{2}^{ - } \left( {{\mathbf{a}}_{2}^{(2)} ,{\mathbf{b}}_{2}^{(1)} } \right) = 0} \hfill \\ {{{d}}_{2}^{ + } \left( {{\mathbf{a}}_{2}^{(3)} ,{\mathbf{g}}_{2}^{(0)} } \right) = 0} \hfill & {{{d}}_{2}^{ - } \left( {{\mathbf{a}}_{2}^{(3)} ,{\mathbf{g}}_{2}^{(0)} } \right) = 0.72} \hfill & {{{d}}_{2}^{ + } \left( {{\mathbf{a}}_{2}^{(3)} ,{\mathbf{b}}_{2}^{(0)} } \right) = 0.80} \hfill & {{{d}}_{2}^{ - } \left( {{\mathbf{a}}_{2}^{(3)} ,{\mathbf{b}}_{2}^{(0)} } \right) = 0} \hfill \\ {{{d}}_{2}^{ + } \left( {{\mathbf{a}}_{2}^{(3)} ,{\mathbf{g}}_{2}^{(1)} } \right) = 0} \hfill & {{{d}}_{2}^{ - } \left( {{\mathbf{a}}_{2}^{(3)} ,{\mathbf{g}}_{2}^{(1)} } \right) = 0.72} \hfill & {{{d}}_{2}^{ + } \left( {{\mathbf{a}}_{2}^{(3)} ,{\mathbf{b}}_{2}^{(1)} } \right) = 0} \hfill & {{{d}}_{2}^{ - } \left( {{\mathbf{a}}_{2}^{(3)} ,{\mathbf{b}}_{2}^{(1)} } \right) = 0.63} \hfill \\ \end{array} $$

From comparisons performed for stage 3, we obtain:

$$ \begin{array}{*{20}l} {{{d}}_{3}^{ + } \left( {{\mathbf{a}}_{3}^{(0)} ,{\mathbf{g}}_{3}^{(0)} } \right) = 0} \hfill & {{{d}}_{3}^{ - } \left( {{\mathbf{a}}_{3}^{(0)} ,{\mathbf{g}}_{3}^{(0)} } \right) = 0.73} \hfill & { {{d}}_{3}^{ + } \left( {{\mathbf{a}}_{3}^{(0)} ,{\mathbf{b}}_{3}^{(0)} } \right) = 0.59} \hfill & {{{d}}_{3}^{ - } \left( {{\mathbf{a}}_{3}^{(0)} ,{\mathbf{b}}_{3}^{(0)} } \right) = 0} \hfill \\ {{{d}}_{3}^{ + } \left( {{\mathbf{a}}_{3}^{(0)} ,{\mathbf{g}}_{3}^{(1)} } \right) = 0.77} \hfill & {{{d}}_{3}^{ - } \left( {{\mathbf{a}}_{3}^{(0)} ,{\mathbf{g}}_{3}^{(1)} } \right) = 0} \hfill & {{{d}}_{3}^{ + } \left( {{\mathbf{a}}_{3}^{(0)} ,{\mathbf{b}}_{3}^{(1)} } \right) = 0.73} \hfill & {{{d}}_{3}^{ - } \left( {{\mathbf{a}}_{3}^{(0)} ,{\mathbf{b}}_{3}^{(1)} } \right) = 0} \hfill \\ {{{d}}_{3}^{ + } \left( {{\mathbf{a}}_{3}^{(1)} ,{\mathbf{g}}_{3}^{(0)} } \right) = 0} \hfill & {{{d}}_{3}^{ - } \left( {{\mathbf{a}}_{3}^{(1)} ,{\mathbf{g}}_{3}^{(0)} } \right) = 1} \hfill & {{{d}}_{3}^{ + } \left( {{\mathbf{a}}_{3}^{(1)} ,{\mathbf{b}}_{3}^{(0)} } \right) = 0} \hfill & {{{d}}_{3}^{ - } \left( {{\mathbf{a}}_{3}^{(1)} ,{\mathbf{b}}_{3}^{(0)} } \right) = 0.73} \hfill \\ {{{d}}_{3}^{ + } \left( {{\mathbf{a}}_{3}^{(1)} ,{\mathbf{g}}_{3}^{(1)} } \right) = 0} \hfill & {{{d}}_{3}^{ - } \left( {{\mathbf{a}}_{3}^{(1)} ,{\mathbf{g}}_{3}^{(1)} } \right) = 0.61} \hfill & {{{d}}_{3}^{ + } \left( {{\mathbf{a}}_{3}^{(1)} ,{\mathbf{b}}_{3}^{(1)} } \right) = 0.77} \hfill & {{{d}}_{3}^{ - } \left( {{\mathbf{a}}_{3}^{(1)} ,{\mathbf{b}}_{3}^{(1)} } \right) = 0} \hfill \\ {{{d}}_{3}^{ + } \left( {{\mathbf{a}}_{3}^{(2)} ,{\mathbf{g}}_{3}^{(0)} } \right) = 0} \hfill & {{{d}}_{3}^{ - } \left( {{\mathbf{a}}_{3}^{(2)} ,{\mathbf{g}}_{3}^{(0)} } \right) = 0.75} \hfill & {{{d}}_{3}^{ + } \left( {{\mathbf{a}}_{3}^{(2)} ,{\mathbf{b}}_{3}^{(0)} } \right) = 0} \hfill & {{{d}}_{3}^{ - } \left( {{\mathbf{a}}_{3}^{(2)} ,{\mathbf{b}}_{3}^{(0)} } \right) = 0.77} \hfill \\ {{{d}}_{3}^{ + } \left( {{\mathbf{a}}_{3}^{(2)} ,{\mathbf{g}}_{3}^{(1)} } \right) = 0} \hfill & {{{d}}_{3}^{ - } \left( {{\mathbf{a}}_{3}^{(2)} ,{\mathbf{g}}_{3}^{(1)} } \right) = 0.75} \hfill & {{{d}}_{3}^{ + } \left( {{\mathbf{a}}_{3}^{(2)} ,{\mathbf{b}}_{3}^{(1)} } \right) = 0} \hfill & {{{d}}_{3}^{ - } \left( {{\mathbf{a}}_{3}^{(2)} ,{\mathbf{b}}_{3}^{(1)} } \right) = 0.64} \hfill \\ {{{d}}_{3}^{ + } \left( {{\mathbf{a}}_{3}^{(3)} ,{\mathbf{g}}_{3}^{(0)} } \right) = 0} \hfill & {{{d}}_{3}^{ - } \left( {{\mathbf{a}}_{3}^{(3)} ,{\mathbf{g}}_{3}^{(0)} } \right) = 0.77} \hfill & {{{d}}_{3}^{ + } \left( {{\mathbf{a}}_{3}^{(3)} ,{\mathbf{b}}_{3}^{(0)} } \right) = 0.75} \hfill & {{{d}}_{3}^{ - } \left( {{\mathbf{a}}_{3}^{(3)} ,{\mathbf{b}}_{3}^{(0)} } \right) = 0} \hfill \\ {{{d}}_{3}^{ + } \left( {{\mathbf{a}}_{3}^{(3)} ,{\mathbf{g}}_{3}^{(1)} } \right) = 0} \hfill & {{{d}}_{3}^{ - } \left( {{\mathbf{a}}_{3}^{(3)} ,{\mathbf{g}}_{3}^{(1)} } \right) = 0.75} \hfill & {{{d}}_{3}^{ + } \left( {{\mathbf{a}}_{3}^{(3)} ,{\mathbf{b}}_{3}^{(1)} } \right) = 1} \hfill & {{{d}}_{3}^{ - } \left( {{\mathbf{a}}_{3}^{(3)} ,{\mathbf{b}}_{3}^{(1)} } \right) = 0} \hfill \\ \end{array} $$

A comparison of the stage alternative a (0)1 with the set G1 shows that we deal here with Case S2. Using formula (29), we calculate:

$$ {{d}}_{{\mathbf{G}}}^{ + } \left( {{\mathbf{a}}_{1}^{(0)} } \right) = 0,\quad {{d}}_{{\mathbf{G}}}^{ - } \left( {{\mathbf{a}}_{1}^{(0)} } \right) = 0.88. $$

A comparison of the stage alternative a (0)1 with the set B1 shows that we deal here with Case F1. Using formula (34), we obtain:

$$ {{d}}_{{\mathbf{B}}}^{ + } \left( {{\mathbf{a}}_{1}^{(0)} } \right) = 0.63,\quad {{d}}_{{\mathbf{B}}}^{ - } \left( {{\mathbf{a}}_{1}^{(0)} } \right) = 0. $$

Further stage indicators are calculated in the same way. The results of the calculations are shown in Table 3.

Table 3 Stage indicators

For each multistage alternative a(0), …, a(15), the multistage values d +G (a), d G (a), d +B (a), d B (a), the index of the class to which alternative a is assigned, and the position of alternative a in the Bipolar ranking are calculated. The results are given in Table 4.

Table 4 Bipolar sorting and Bipolar ranking

Multistage alternative a(4) is assigned to class A1; two alternatives, a(12) and a(0), are assigned to class A2; five: a(5), a(6), a(7), a(8), a(13), to class A3; seven: a(1), a(2), a(3), a(9), a(11), a(14), a(15), to class A5; and one, a(10), to class A6. The multistage alternatives are ranked as follows: a(4), a(12), a(0), a(5), a(7) a(13), a(8), a(6), a(15), a(1), a(3), a(14), a(9), a(11), a(2), a(10).

The enumerative method of finding the best multistage alternative, presented in this paper, may be compared to pure random sampling of the decision space to illustrate the benefits of the method against intuitive approaches.

Let us assume that in the example considered, we will be choosing a multistage alternative at random, and we will repeat that choice many times. We will assume (which is obvious in the case considered) that the choice of each of the sixteen multistage alternatives is now equally probable. Due to the small size of our numerical example and our knowledge of the numerical data, we will use the average number of class Aavr and the average values of the indices d +G (at), d G (at), d +B (at), d B (at). These average values will be denoted, respectively, as

$$ {{d}}_{{\mathbf{G}}}^{{ + {{avr}}}} ,\;{{d}}_{{\mathbf{G}}}^{{ - {{avr}}}} ,\;{{d}}_{{\mathbf{B}}}^{{ + {{avr}}}} ,\;{{d}}_{{\mathbf{B}}}^{{ - {{avr}}}} . $$

Using numerical data from Table 4, we obtain:

$$ A^{avr} = 4.0. $$

Interpreting the result obtained, we can note, first, that by performing many random selection attempts of a multistage alternative, we will receive, in average, multistage alternatives from class 4. This is a value near the arithmetic mean of class numbers from 1 through 6, which is 3½. At the same time, it should be noted that in this numerical example none of the multistage alternatives belongs to this class. This situation is not in line with our initial expectations, since it would seem that there should be many multistage alternatives for which good stage reference objects outrank stage alternatives and for which stage alternatives outrank bad stage objects. Our example indicates that this assumption is not justified and that the number of multistage alternatives from each class depends on the structure of the reference system. At the same time, the value of Aavr constitutes a certain overall characteristic feature of the reference system. There is no doubt, however, that the use of the enumerative method of finding the best alternative, which allows to generate the best existing multistage alternative (in our case, one from class A1) gives much better results than a single random selection.

Let us now look at the average values d +avrG , d avrG , d +avrB and d avrB . In our example, we obtain the following values:

$$ \begin{aligned} {{d}}_{{\mathbf{G}}}^{{ + {\text{avr}}}} & = 0.161,\quad {{d}}_{{\mathbf{G}}}^{{ - {{avr}}}} = 0.572, \\ {{d}}_{{\mathbf{B}}}^{{ + {{avr}}}} & = 0.388,\quad {{d}}_{{\mathbf{B}}}^{{ - {{avr}}}} = 0.314. \\ \end{aligned} $$

We have:

$$ {{d}}_{{\mathbf{G}}}^{{ + {{avr}}}} < {{d}}_{{\mathbf{G}}}^{{ - {{avr}}}} $$
(66)
$$ {{d}}_{{\mathbf{B}}}^{{ + {{avr}}}} > {{d}}_{{\mathbf{B}}}^{{ - {{avr}}}} $$
(67)

Inequality (66) indicates that good stage reference objects outrank stage alternatives and the difference

$$ {{d}}_{{\mathbf{G}}}^{avr} = {{d}}_{{\mathbf{G}}}^{{ + {{avr}}}} - {{d}}_{{\mathbf{G}}}^{{ - {{avr}}}} = - 0.411 $$

characterizes the degree of this outranking. Inequality (67) indicates that stage alternatives outrank bad stage reference objects, and the difference

$$ {{d}}_{{\mathbf{B}}}^{avr} = {{d}}_{{\mathbf{B}}}^{{ + {{avr}}}} - {{d}}_{{\mathbf{B}}}^{{ - {{avr}}}} = 0.074 $$

characterizes the degree of this outranking.

Note that dGavr < 0 and dBavr > 0, which confirms our expectations as regards the signs of these values.

Using dGavr and dBavr we can calculate the value

$$ {{d}}_{\mathbf{R}}^{avr} = {{d}}_{{\mathbf{G}}} ^{avr}+ {{d}}_{{\mathbf{B}}}^{avr} = - 0.411 + 0.074 = - 0.337 $$

which is another characteristic feature of the entire reference system. A negative value of this index indicates that multistage alternatives outrank bad stage reference objects more than they outrank good reference objects, and the value \({{d}}_{\mathbf{R}}^{avr} \) is a measure of that. This value is also an information for the decision maker that characterizes the reference system he/she has created.

6 Concluding remarks

In our example we have found exactly one multistage alternative belonging to class A1. This means that at each stage at least one of the stage alternatives of the multistage alternative a(4) outranks at least one reference object. Moreover, each of them outranks all the bad stage objects. The next multistage alternatives belong to class A2, evaluated as a much worse one. It is worth noting that a ranking taking into account the indicator d(a) alone—that is, disregarding the assignment of the stage alternatives to the classes—would be different. In that case, the first two positions in both rankings would be taken by a(4) and a(12), while the third position would belong to a(5), an alternative from class A3, which would outrank a(0), an alternative from class A2. This shows that the division into classes has an essential influence on the ranking.

Worth noting are also Eqs. (18) and (19). According to the original version of the description of the Bipolar method, when c +t (at, rt) = c t (at, rt), the following equations should be used:

$$ d_{t}^{ + } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) = c_{t}^{ + } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) + c_{t}^{ = } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right),\quad d_{t}^{ - } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) = c^{ - } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right) + c^{ = } \left( {{\mathbf{a}}_{t} ,{\mathbf{r}}_{t} } \right). $$

In the dynamic approach, such a definition would make it difficult to construct classes A1 through A6, which would not be disjoint. In such a situation the arguments for the outranking of one of the objects by another are equally convincing for one as for the other one. We propose then formula (18), if the stage alternative is compared with a good reference object, and formula (19), if it is compared with a bad one.

The present paper originates a new research direction. Hence, at the beginning we have made certain simplifying assumptions, which should be eliminated in the future. They include: setting the equivalence threshold at 0 (cf. formulas (6)–(8)) and the concordance threshold at 0.5, as well as not using the veto coefficients. These are elements of the Electre methodology, used in the classic Bipolar method. Further research will aim at eliminating these limitations. In the general case it may happen that certain stage alternatives are not comparable with the stage reference sets. In such situations, certain multistage alternatives will also be non-comparable. One of the future directions of the extension of the method is the preparation of a general case description. Another direction is to design software for numerical simulations. A further research direction would be to replace the enumerative method presented in this paper (which may be difficul to apply to larger-size problems) by methods based on multicriteria dynamic programming and genetic algorithms.

As regards the possible applications of the dynamic Bipolar procedure, it seems that this procedure can be applied to create a long-term development strategy, in particular for Foresight processes and when using the sustainable development approach.