1 Introduction

In this paper, we present a novel application of a fuzzy rules-based algorithm for the quantification of consumer expectations. Individuals’ expectations are the subjective beliefs they hold about uncertain future economic outcomes (Pesaran and Weale 2006). Inflation expectations are a pivotal variable for central banks: modern monetary theory asserts that successful expectations management results in more effective monetary policy. Standard measures that approximate expectations—especially when consumers are involved—have been subject to criticism. Hence, we are motivated to discuss a methodological innovation that avoids the majority of objections against standard methods.

We use monthly data regarding consumer expectations from Business and Consumer Surveys in nine EU member states from 2002 to mid-2019. The survey is qualitative: consumers express their directional opinions about price evolution. Thus, we apply a fuzzy rules-based system to quantify these data. The Wang–Mendel method, which is based on space partition, and the subtractive clustering method are applied to discover learning rules concerning inflation history and the structure of consumers’ responses as expressed in the surveys.

Our research procedure comprises a fuzzy rules-based results comparison with the outcomes of a standard quantification procedure. We juxtapose our results with two time series that we generated with the application of two versions of the standard probabilistic quantification method. Our method outperforms them both in terms of correlations with balance statistics that express unbiased consumer opinions. The results are more favourable for economies with a higher degree of inflation fluctuations, as more volatility gives more room for the learning algorithm. This finding holds when we apply an alternative benchmark.

The remainder of this paper is organised as follows: Sect. 2 presents the economic background of the problem we address. Section 3 describes the application of the fuzzy rules-based system to this problem. Section 4 provides empirical examination results with a robustness check and economic interpretation. Finally, the last section concludes the article.

2 Problem statements and assumptions

Expectations are not directly observable economic variable, and economists search for approximations of expectations, often deriving them from economic models solved under the assumption of the expectations formation process. However, as this assumption could be questioned because economists are unsure of how expectations are actually formed, direct proxies of expectations are preferred. Expected inflation is embedded in the term structure of interest rates. Consequently, the observation of financial asset prices can serve as a proxy for expectations. Alternatively, the direct proxies of expectations are survey-based. Surveys conducted among professionals, business people, and consumers are the only measure for estimating consumers’ expectations. In this study, we focus on the way in which consumers’ surveys results are transformed into proxies of expectations in an attempt to identify an innovative method for quantifying consumers’ expectations that avoids the objections that are typically raised towards standard methods and respects limitations regarding individuals’ abilities to acquire and process economic information.

2.1 Survey

Central banks refrain from examining consumers’ inflation expectations in a quantitative manner. The results of quantitative surveys are volatile, register high dispersion, and do not reflect the actual economic situation. The Czech National Bank explained its choice to abandon quantitative surveys by stating that recently, the values of this indicator [expectations proxy] have been highly volatile and have failed to give a clear picture of inflation expectations (Czech National Bank 2007). This perspective reflects the usefulness of quantitative surveys. The low degree of economic knowledge and awareness of ongoing and future situations leave room for presumptions; consumers’ declarations about the future are typically vague. Qualitative surveys designed to assess economic agents’ sentiments are broadly applied by national entities to estimate consumer expectations. EU member states are obliged to run surveys with a common methodology, such as Business and Consumers Surveys (BCS), under the auspices of the European Commission (European Commision 2020). BCS contain the following question about perceived inflation (Q5):

How do you think that consumer prices have developed over the last 12 months? They have...: risen a lot, risen moderately, risen slightly, stayed about the same, fallen, don’t know.

Because inflation perception could be used to proxy expected inflation rates (as a scaling factor), we present both questions. The most relevant question for consumer expectations is Q6:

In comparison with the past 12 months, how do you expect that consumer prices will develop in the next 12 months? They will...: increase more rapidly, increase at the same rate, increase at a slower rate, stay about the same, fall, don’t know.

Business and Consumers Surveys are conducted monthly in EU member states and official candidate states. Similar surveys are employed in numerous countries beyond the EU to investigate consumer expectations.

2.2 Standard quantification methods

The aggregate results of the Business and Consumers Surveys—the percentages of responses to the survey’s questions—are publicised and may be used to obtain a direct, quantitative proxy of inflation expectations. Such proxies are typically valued even if some examinations are based directly on survey responses (Acedański and Włodarczyk 2016). There are two acknowledged and commonly applied methods of expectations quantification: probabilistic methods and regression methods (Table 1). The set-ups and reliability of both methods have been criticised. Nonetheless, there is no other broadly accepted alternative for quantification.

Table 1 Expectations quantification methods

Economic and econometric objections towards these methods are broadly discussed in the literature. Objections rooted in economics take issue with the low reliability of the results. Lahiri and Zhao (2015) provided findings that suggest the lack of correlation of the results of quantitative surveys and quantified surveys, referring to the University of Michigan’s Survey of Consumers, which provides both qualitative and quantitative results. The other study suggests a more realistic version of the probability method, which is assumptions-free, and acknowledges that consumers are governed by the official central bank inflation targeting policy in discriminating between moderate and extreme inflation tendencies (Lolić and Sorić 2018). Unrealistic assumptions are the most criticised element of the existing methods. An earlier study by Henzel and Wollmershäuser (2005) provided a modification that relaxed the unbiasedness assumption regarding time series in question for Carlson and Parkin’s procedure.

Existing methods of quantification hardly compromise economic and econometric requirements. The set of assumption needed for quantification is rarely reflected in time series properties. Numerous extensions complicate econometric procedures while moving the economic background of the method towards the economic reality. Even if time-varying parameters set-ups better reflect consumers’ economic behaviour, they are not typically applied in empirical examinations and fail to meet econometric proprieties.

The results of surveys could be used to find a fuzzy rules-based method of quantification that outperforms existing quantification procedures. We use the structure of responses to the survey’s questions to propose a method of quantification that does not replicate the shortcomings of the standard quantification methods that we discussed above.

Fig. 1
figure 1

Fuzzy Control System scheme

3 Fuzzy system approach to expectation quantification

Fuzzy control incorporates ambiguous human logic into computer programs. It suits problems that cannot be easily represented by mathematical models and systems for which there are very weak standards models. Fuzzy systems are also well suited to economic intuition regarding the ways in which consumers form and express their expectations. Regardless of the theoretical premises assuming their ability to be rational in Muth’s sense (Muth 1961), they are far from rationality. Their assessment of future inflation can be described in terms of uncertainty, not risk. The ambiguity of human logic perfectly matches their behaviour. Additionally, the important advantage of fuzzy systems’ application is their lack of assumptions regarding the time series properties. Such assumptions are often volatile and make econometric methods hard to apply in reality.

3.1 Fuzzy control system

Fuzzy control was initiated by Mamdani and Assilian (1975) in 1974 stimulated by the Zadeh’s two seminal papers (Zadeh 1973, 1996), in which Zadeh presented modelling based on fuzzy rules IF-THEN (Nguyen et al. 2019). Regardless of the fuzzy control system (FLC) type, the operation diagram is as shown in Figure 1. In the case under examination, although the general rules for changing the results of the type surveys are known f.e. IF the number of responses that the prices have risen a lot is large AND the number of responses that the prices have fallen is small THEN the expected inflation is high. Such rules are too general, and the meaning of the word ‘small’ will vary significantly depending on the country and even the time. Thus, we must consider the learning system. The generation of regulations will be based on the perception of inflation by the respondents checked by the question Q5 described in Sect. 2.1. Due to the small available learning sample, the use of methods using neural networks or genetic methods is inadvisable. Two standards will be used in this study: the Wang–Mendel method (WM Wang and Mendel 1992) and subtractive clustering (SBC Chiu 1996), which is an extension of Yager and Filev’s mountain method (Yager and Filev 1994). The WM method can be described by the following steps:

  1. 1.

    Set a fuzzy partition of the input variable space. Each domain interval k, \(k=1 \ldots m\), is divided into \(2n +1\) regions (n is a natural number), where the centre of each corresponding membership function lies in the centre of the region, and the extrema lie at the centre of the neighbouring regions.

  2. 2.

    Generate a preliminary linguistic rule set. For each input–output pair, a rule is generated by:

    • Compute the matching degree of pair to different fuzzy regions using a conjunction operator.

    • Assign the pair to the fuzzy region with the highest membership degree.

    • Generate a rule.

    • Assign an importance degree to each rule.

  3. 3.

    Remove conflicting rules.

  4. 4.

    Create a final rule base with the rules of highest importance

The interest in this method resides in its simplicity and its straightforward approach, which at the same time has proven capabilities to provide reasonably good performance.

Table 2 Descriptive statistics of inflation in study period

SBC (Chiu 1996) considers each data point as a potential cluster centre by determining the potential of a data point as a function of its distances to all the other data points. A data point has a high potential value if that data point has many nearby neighbours. The highest potential is chosen as the cluster centre, and the potential of each data point is updated. The process of determining new clusters and updating potentials is repeated until the remaining potential of all data points falls below some fraction of the potential of the first cluster centre.

3.2 Expectation quantification

Let \(x=[x_{PP}, x_P, x_E, x_M, x_{MM},x_{inf}]\) be the vector of training data, where the first five are percentages of answers to Q5 (How do you think that consumer prices have developed over the last 12 months? They have...), as follows:

\(x_{PP}\):

risen a lot;

\(x_P\):

risen moderately;

\(x_E\):

risen slightly;

\(x_M\):

stayed about the same;

\(x_{MM}\):

fallen;

and \(x_{inf}\) is measure of inflation—we apply: current inflation, and alternatively inflation delayed by two periods. Next, we set the range, minimum and maximum value, for all variables, although by definition, variables are the percentage of responses to a survey question, their value is in the range of 0–1. In practice, there is never such unanimity that any values assume 1 or values very close to it. The range of expectations is even more difficult to determine. Next, the method of rule-based function generation is chosen as well as additional parameters such as the number of labels (fuzzy sets) for each variable. Then, in the learning phase, rules are generated using the WM method and SBC algorithms. Afterwards, the expectation is quantified based on answers to question Q6 By comparison with the past 12 months, how do you expect that consumer prices will develop in the next 12 months? They will..., the answers for which have a similar structure as those for question Q5. Question Q5 and its structure of responses are used in an analogous way, as occurring when regression methods are applied: it constitutes the pattern for finding (learning) regarding expected inflation.

4 Empirical study

4.1 Data and methods

Our sample covers nine non-euro area EU member states: Bulgaria, Croatia, Czechia, Denmark, Hungary, Poland, Romania, Sweden, and the UKFootnote 1. We chose these countries in consideration of sample diversification: the sample includes transitioning and advanced economies, countries that have recently experienced high and volatile inflation rates, and economies with a high degree of economic stabilisation. Our sample has a common monetary policy framework and is covered by BCS. This sample makes it possible to test a new approach for cases in which standard methods return unreliable results. Standard procedures return weak or statistically insignificant correlations for Danish consumers’ expectations and their balance statistics.

The whole sample covers monthly data from January 2002–June 2019 (210 observations). We start our sample in 2002 because prior to this year, divergences in our sample regarding monetary policy were much more significant. This is a large sample, when the macro-data are considered. However, we are aware that in the case of generating automatic decision-making rules, it is not a large amount of data, and some methods (e.g. those based on neural networks) cannot be used. To illustrate the nature of the sample, descriptive statistics on inflation from the period under examination in specific countries are presented in Table 2.

Countries from our sample exhibit differences in inflation levels and volatility. Developed economies performed better in terms of inflation stabilisation. Bulgaria and Romania represent the other extreme. As the success of fuzzy system-based rules application for expectations quantification depends—to some extent—on inflation volatility, we refer to inflation properties while interpreting the results.

For the learning set, next to current inflation, we place inflation delayed by two periods because it is the last published inflation known to consumers. In the empirical study, we set expectations using fuzzy systems in the following cases:

  • WM_inf: rules generated by WM methods used as learning set: answers for Q5 and current inflation;

  • WM_inf2: rules generated by WM methods used as learning set: answers for Q5 and inflation delayed by two periods;

  • SBC_inf: rules generated by SBC methods used as learning set: answers for Q5 and current inflation;

  • SBC_inf2: rules generated by SBC methods used as learning set: answers for Q5 and inflation delayed by two periods—inflation known in the current period from official publication sources;

We test the WM methods on different labels number: 3 and 5. Due to the large differences in the characteristics of the data of each country, the range of data necessary for the application of the WM method was determined for each country separately. Ranges for particular countries are presented in “Appendix A” and set using the following rules:

  • range 1: by min and max value from survey data and inflation data

  • range 2: by min and max value from survey data and inflation data including heuristics resulting from data from Q5 and inflation is extended by 5-10 pp. or by 1-3 pp. dependent on the stability of inflation in the country and rounding to integer values.

To examine the performance of the system, in the absence of any actual expectation values, the Pearson correlation coefficient (eq.(1)) was calculated with the balance statistics from question Q6. Balance statistics (eq. (2)) represent the raw and aggregate representation of consumers’ opinions about expected inflation rates. They cannot be interpreted in terms of inflation expectations. However, balance statistics are unbiased by any assumption relating to consumers’ opinions about inflation in the forthcoming periods.

$$\begin{aligned} R= & {} \frac{\sum _{i=1}^{n}(x_i-\bar{x})(y_i-\bar{y})}{\sqrt{\sum _{i=1}^{n}(x_i -\bar{x})}\sqrt{\sum _{i=1}^{n}(y_i-\bar{y})}} \end{aligned}$$
(1)
$$\begin{aligned} BS= & {} \left( x_{PP} + \frac{1}{2}x_{P}\right) - \left( \frac{1}{2}x_{M} + x_{MM}\right) \end{aligned}$$
(2)

where \(x_{PP}\) represents the percentage of the ‘most positive answer’ (e.g. for Q5: ‘prices have risen a lot’ and for Q6: ‘prices will increase more rapidly’), \(x_P\) the percentage of ‘positive’ option, \(x_M\)—the percentage of respondents having chosen the option ‘negative’, and \(x_{MM}\)—the option ‘very negative’.

The higher the correlation coefficient, the better. It is not possible to verify directly whether fuzzy system-based rules outperform any other quantified proxy of expectations. We do this indirectly by using a benchmark method and identifying the correlation between the balance statistics of expectations and our benchmark. We distinguish two benchmarks: subjectified (\(CP_{sub}\)) and objectified (\(CP_{obj\_inf}\)) (Carlson and Parkin 1975) benchmarks. They are the most commonly applied quantification procedures for empirical examinations and central banks analyses. We distinguish:

  • subjectified (\(CP_{sub}\)) version of quantification—set using a two-step procedure: Q5 structure of answers and a representation of ‘normal’ inflation are used to quantify the perceived inflation rate. The quantified perception of inflation is a scaling factor used to proxy expectations together with Q6 answers

  • objectified (\(CP_{obj\_inf}\)) version—using the official inflation statistics as a scaling factor.

Eventually, we juxtapose the correlation examination results and compare associations registered for fuzzy system-based rules and standard quantification procedures.

Table 3 Correlation of inflation expectation and balance statistics

4.2 Results

Table 3 presents the results of the correlation. The bold cell indicates that the result is higher than both benchmarks, whereas the italic cell indicates that it is higher than one benchmark and underline font means statistically insignificant correlations. The benchmark correlation is presented in “Appendix B”. In 65% of cases, we received a result with a higher correlation from at least one of the standard benchmarks. This percentage increases to 75% if we only consider results from range 2. Obviously, the SBC method performs much better than the WM method. In 83% of the cases, the correlation was higher than the benchmark. If the optimal settings are chosen, (the SBC and range 2 methods), in 18 out of 18 cases (in 89% of cases), the fuzzy rule-based method returns better results. Once we search for a rationale of the results, we refer to inflation volatility: countries with higher and more volatile inflation give more room for our learning mechanism to capture the behaviour of expectations. However, the mechanics of fuzzy rules-based systems needs to be compromised in consideration of the economic reality of consumers. Hungary proved to be a special case here—having relatively volatile inflation, this economy registers a lower correlation of fuzzy system-based results in comparison with a standard benchmark. To some extent, we can present an alternative explanation for the Hungarian case: the Hungarian economy underwent a number of structural changes regarding monetary policy conduct, as well as institutional and political pressure. This could affect consumers’ abilities to assess the situation. If the structure of respondents’ answers to the survey was affected by economic shocks, the learning system had no chance to capture the rule properly. Results for the remaining economies did not diverge from our economic intuition, including the UK case. The UK inflation was kept stable, and Brexit offered a beyond-the-scale economic shock. However, fuzzy rules-based systems performed quite well here—the strength of the correlation was not impressive, but it was outperformed the benchmark for the majority of cases. Quite the opposite situation occurred in the most stable economy in the sample—Sweden. The overall economic stability of Sweden could be reflected in the stable structure of responses to the survey’s questions, which constrained the learning mechanism.

4.2.1 Robustness check

We offer a multi-benchmark procedure as a robustness check of our results. Instead of the application of procedures chosen arbitrarily according to the criterion that they are ‘the most commonly applied’ (\(CP_{sub}\)) and (\(CP_{obj\_inf}\)), we offer a time series quantified with the application of a different variation of a standard probabilistic method. Our procedure for choosing the benchmark consists in:

  • quantification of expectations according to 35 different variations for each economy. We applied five different distributions and seven scaling factors for each distribution,

  • identification of the best, individualised for each economy method according to two valuation criteria: (i) the strongest correlation with balance statistics and (ii) the best forecast accuracy according to Theil’s coefficient of inequality.

We avoid a detailed explanation of the procedure as it relates to benchmarks, not to fuzzy rule-based systems (and due to the limited length of this paper). Optimal methods correlations with balance statistics together with the best fuzzy system solution (Table 4) show that fuzzy system-based methods outperform standard procedures in all cases except Hungary. (For Hungary, we have comparable results of correlation.) We find these results to be a promising premise for the application of fuzzy systems in the field of expectations quantification.

Table 4 Summary of the best methods in the fuzzy and non-fuzzy approach

4.3 Discussion

As the results confirm, the fuzzy control approach is a promising method for estimating inflation expectations, and the best results are in places in which alternative methods are strongly needed. The key choice when creating a system is the choice of method for generating rules. WM methods had too small data sample to cover well partition, what have been reflected in the results, in particular when we would like to use more than 3 fuzzy sets describing each variable. SBC methods generated for the country on average from 2 (CZ, SE) to 9 (RO) clusters for each variables. It seems to us that optimisation of hyperparameters should improve them even further. As in any fuzzy modelling, knowledge of the problem was a critical factor, because the results are highly dependent on changes in the range of individual variables. Range 2, which includes min and max as well as expert heuristics, displays better results.

A caveat regarding surveys’ disadvantages should be also made. Literature discusses framing effect (Berk 1999; van der Klaauw et al. 2011), and a relation of surveys’ responses to actual economic choices of responders (Manski 2004; Armantier et al. 2015). Fuzzy rule-based system application does not remove the objections towards surveys, what we have in mind while discussing our results.

5 Conclusion

In this paper, we present a novel application of fuzzy rule-based systems for detecting numerical values of consumers’ expectations. Inflation expectations constitute a pivotal variable for central banks’ policy conduct and are not directly observable. Thus, limitations regarding their approximation constrain their applicability for policy analysis. The algorithms applied in this study overcome the majority of objections that are presented towards standard methods of quantification. Except their obvious advantage—as there is no need to make assumptions about time series properties—and their alignment to consumers’ reduced economic literacy, fuzzy rule-based systems returned promising results when compared with standard quantification procedures. We also see room for further developments and applications of this novel application of fuzzy systems.