1 Introduction

Regulations aim to modify the behavior of economic agents. Their purpose may be to correct market failures, or they may aim at achieving some distributive goal. Going back to Pigou (1938), for example, regulations were assumed to increase social efficiency by alleviating market failures. In contrast to this public interest theory of regulations, Stigler (1971), Posner (1974) and Peltzman (1976) have put forward public choice theories of regulations. The latter theories hold that regulations favor special interests and are not in the public interest. The debate on the impact of government regulations is by no means a new topic either to policy makers or among scholars. Especially for empirical research, the issue historically has been how to quantify regulations in a meaningful manner. Recent developments in measuring regulations have increased the empirical research in the area.Footnote 1

Much emphasis, both theoretical and empirical, has been put on the regulations in product and factor markets and how they impact the labor market e.g. Salvanes (1997), Blanchard and Giavazzi (2003), Bassanini and Duval (2006) and Feldmann (2012). Also as Kessing (2006) shows theoretically that regulation such as employment protection has important implications for product market competition. More recent research has focused on how regulations—and entry regulations in particular—influence entrepreneurship, innovation, investment, productivity and the economy at large.Footnote 2 Regulations in general are shown to influence economic growth and productivity, e.g. by Dawson (2007), Loayza et al. (2004), Arnold et al. (2011), Bourlès et al. (2013), and Cette et al. (2016).Footnote 3 They show that reallocation of resources towards the most productive firms is stronger in countries where the regulatory burdens are lighter and that anticompetitive upstream regulations have curbed productivity growth, especially in countries that are innovation-driven and close to the productivity frontier.

There is a large amount of empirical evidence on product market regulations and various economic outcomes, other than productivity, labor markets and overall economic performance. Others have looked at the relationship between regulations and investments. For example, Alesina et al. (2005) find that strict government regulation on entry deters investment for OECD countries, and Escribá-Pérez and Murgui-García (2016) find that barriers to entrepreneurship and to trade and investment decrease the productivity of capital, which in turn effects regional investments negatively.Footnote 4 Amable et al. (2009) look at product market regulations and innovation at different distances to the technological frontier. Griffith et al. (2010) find that the EU Single Market Program resulted in increased innovation.Footnote 5 Djankov et al. (2002) record the entry costs associated with starting a business in 85 countries and find that entry regulations in particular are detrimental to entrepreneurship, a result also found by Klapper et al. (2006). The empirical findings in the area conclude that entry regulation across countries affects opportunity-driven and formal entrepreneurial outcomes negatively (Klapper et al. 2006). Furthermore, tax regulations, for example, impose administrative burdens on entrepreneurs, which reduce the entry rate (Braunerhjelm and Eklund 2014).

There is also evidence found in favor for enhanced performance and increased trade. Melitz and Ottaviano (2008) build a model where market size and trade liberalization affect product market competition. Lileeva and Trefler (2010) find that improved access to foreign markets in Canada resulted in greater product innovation and technology adaptation, in addition to increased productivity and export activities. Some, such as MacDonald (1994), find that both productivity and productivity growth is positively affected by trade liberalization.

Nicoletti and Scarpetta (2003) conclude that one likely mechanism trough which regulations influence productivity is through competition. Regulations may both promote and impede competition, which in turn will influence the macro- and micro-level outcomes.Footnote 6 The question of how overall product market regulations and the different sub-components of regulation affect economic competition—measured as the persistence of profits above the norm—is an important research topic. According to Geroski and Jacquemin (1988), differences in the strength of antitrust policies and country-specific regulatory systems could be one explanation of the variation in the speed of profit convergence across countries. This article contributes to the literature by examining the link between product market regulations and the persistence of profit. Despite a relatively large body of literature on the persistence of profits few studies examine the determinants of profit persistence and even fewer do so in a cross-country context. We extend the literature by both looking at the determinants of profit persistence and doing so for a large number of OECD countries.

The profit persistence literature goes back to a seminal contribution by Mueller (1977). A central finding in the literature is that profits above or below the norm tend to persist over time, thus rejecting the hypothesis of perfectly competitive markets (e.g. Mueller 1977; Mueller and Cubbin 2005). Therefore, profits above the norm tend to persist.

To our knowledge, the issue of whether product market regulations affect profit dynamics has been largely neglected in the literature. Griffith et al. (2010) provide empirical evidence on the reduction of regulation and its association with increased product market competition, measured as average profitability, increased innovation intensity and productivity growth for manufacturing sectors across 9 European Union countries. Many have provided evidence that competition is beneficial through increased innovation, efficiency, investments and employment, e.g. Bouis and Duval (2011), Conway et al. (2005, 2006) and Nicoletti and Scarpetta (2003), but regulation and its impact on profit dynamics has not received much attention.

We use an unbalanced panel covering 30 countries over 15 years (1998–2013) and approximately 19,000 unique firms and 157,800 firm-year observations. Firm data have been collected from Compustat S&P. As a measure of regulatory quality, we use the OECD product market regulation data including three sub-components: Barriers to entrepreneurship, state control and barriers to trade and investments. We find that the overall product market regulations do affect competition. In particular, we find that the impact of regulation on the long run permanent rents are robust with the exception of the sub-component barriers to entrepreneurship. We do not find any significant effect on short run persistence. Some caution is warranted when interpreting the results since 16 years might not be sufficiently long time period to fully capture profit dynamics. However, any profits that persist above the norm for any length of time suggest a systematic misallocation of resources. Our findings provide empirical evidence of the extent of indirect costs associated with product market regulations.

2 Product market regulations and persistence of profits

Entry of firms can be broadly characterized into two types. The first type of entry arises from imitative behavior, where firms enter to gain a share of the profits and innovation is not necessarily a crucial part of entry. Entry in the first case would suggest that with little or no entry, barriers to competition should return profits back to the normal levels. The second type of entry emerges from purely innovative actions and can be described more as Schumpeterian competition. In this case, innovation-driven entry induces (temporary) monopoly profits because they can, even in the extreme case, result in opening of completely new markets (see Mueller 2003 for discussion).

Therefore, above normal profits can persist in the short run. However, with little or no barriers to entry the above normal profits will be eroded through imitative or innovative competition. These two types of market entry indicate that above normal profits can emerge in the short run from either lack of competition or entrepreneurial monopoly rents, but profits should be reduced after some time in the absence of barriers to entry. If entry barriers do exist competition will be lower than optimal.

Product market regulations can potentially disrupt or impede product market competition. Regulations impose a cost to incumbents as well as potential entrants. If the cost of entry is too high, the market will exhibit a lower than optimal number of firms, i.e., too low competition. The regulations can have an impact on the productivity growth within a firm, on the productivity growth between firms due to the reallocation of resources or on the entry and exit of firms.Footnote 7

2.1 Persistence of profits

Mueller (1977) suggests that profits \( \left( {\pi_{it} } \right) \) for firm i at time t can be decomposed into three components:

$$ \pi_{it} = c + p_{i} + s_{it} $$
(1)

where \( c \) is the competitive return common to all firms, \( p_{i} \) is the permanent rent specific to firm i, and \( s_{it} \) is the firm-specific short run transitory rent at time t. The competitive return, c, is equal to profits in a fully competitive market. In case of presence of permanent rents, \( p_{i} \) will be positive. The existence and magnitude of these permanent non-transitory rents as well as short run rents can be empirically examined using profit rates.Footnote 8

As mentioned, the persistence of profits literature goes back to the seminal contribution by Mueller (1977, 1986), where the convergence process of profits was examined for a sample of firms in the United States. After Mueller’s contribution, multiple of studies have been made for individual economies, continuing with the United States by Waring (1996) among others but also for the United Kingdom, e.g. by Goddard and Wilson (1999), Japan by Odagiri and Yamawaki (1986) and for Turkey by Yurtoglu (2004). Some cross-country studies have also been introduced by Glen et al. (2001) for a sample of emerging economies, and Hirsch and Gschwandtner (2013) and Goddard et al. (2005) for a sample of European economies. However, to our knowledge, there are no studies of the impact of PMR on profit persistence.

The persistence of profits is commonly estimated as a first order autoregressive process:

$$ \pi_{it} = \alpha_{i} + \lambda_{i} \pi_{it - 1} + \mu_{it} $$
(2)

where \( \pi_{it} \) is profits (measured as the demeaned return on assets),Footnote 9 \( \pi_{it - 1} \) is the profit of the previous period and \( \mu_{it} \) is the conventional error term. The coefficient \( \lambda_{i} \) measures the speed of adjustment, i.e., how fast the short run profits erode. The closer to zero the estimate is, the quicker short run rents erode and the less persistent profits are. Therefore, profits are dependent on their past values, typically with a mean reverting process. Research usually finds that short run profit persistence is 0.50 or less and that permanent rents tend to exist, with many firms with non-zero values of \( p_{i} \).

3 Data, variables and the empirical estimation

We use an unbalanced panel with firm-level accounting data from Compustat Global Database combined with country-level indicators of product market regulations collected from the OECD Product Market Regulation Database.Footnote 10 The data covers 30 countries across the time period of 1998–2013 on an annual frequency. There are close to 157,800 observations for 19,000 unique firms and the list of included countries is provided in “Appendix”. The countries in the sample are selected so that we can have a representation of countries within the OECD with both small and large economies with sufficient data coverage. The accounting data covers all listed companies in a given country.

Our dependent variable, profit, is measured as demeaned return on assets, which is the approach used in the literature.Footnote 11 We add one lagged value of our dependent variable as an explanatory variable, as it measures the convergence of profits to the norm. As robustness check, we also incorporated up to three lags, but the results are robust (not reported).

As regulatory indicators we include product market regulation and its sub-components; State Control, Barriers to Entrepreneurship and Barriers to Trade and Investment (see Wölfl et al. 2009, 2010). The underlying idea of the product market regulation (PMR) indicator is to turn qualitative data of laws and regulations and formal rules that can affect competition into a quantitative indicator (Wölfl et al. 2010). State control includes different measures of public ownership in a country or state’s involvement in business operations. Heavy involvement of the state can create artificial barriers to entry or general misallocation of resources. Barriers to entrepreneurship include measures of the complexity of regulatory procedures and administrative burdens on start-ups, as well as regulatory protection of incumbents. If entrants find the cost of entering the market too high, both the cost of producing in addition to the cost of complying with regulations, the number of firms in an industry might stay at a too low of a level. Barriers to trade and investment incorporates explicit barriers to trade and investment and other barriers to trade and investment.

The data is based on surveys conducted by the OECD every fifth year (1998, 2003, 2008 and 2013).Footnote 12 We interpolate the values between the survey years to be able to utilize a panel.Footnote 13 The main idea behind the database is to proxy policy regimes and market conditions that are potentially anti-competitive. The variables are on a scale from 0 to 6, with a higher number indicating more restrictive policies towards competition. See Wölfl et al. (2009) for details of the indicator and for more detailed description of the indicators and data collection methods can be obtained from Koske et al. (2015).

Further, we include a set of control variables that affect the profit dynamics of a firm at the firm and industry level. All the variables are obtained from the Compustat Global Database. The firm size is the taken as log of total net sales. In the presence of economies of scale, the relationship between firm size and profits will be positive. Previous empirical evidence seems to show that economies of scale can be found in some industries when not found in others (e.g. Yurtoglu 2004; Gschwandtner 2005) but nevertheless can potentially be important when measuring profitability. We add the variable market share, which is measured as firm’s market share of industry sales at the 2-digit SIC level. The relationship between market share and profitability is often found to be positive (e.g. Shepherd 1972; Mullin et al. 1995), but if the market share is measuring diversification, the relationship can be negative (e.g. Lang and Stulz 1994). We also include firms’ tangible assets (tangibles). Using the value of its physical assets as a share of total assets controls for firms’ asset structure. This is done to test whether tangible assets can bring about higher profits. Conversely, Galbreath and Galvin (2008) emphasize that since tangible assets can be observed and imitated by rivals, they cannot be the source of permanent competitive advantage.

To control for country-level time-varying variables that might influence the persistence of profit, we add the openness of an economy and total factor productivity (TPF) growth. In general, firms in an economy are prone to be influenced by nationwide changes, i.e., macro shocks, of both technology and trade. The openness of an economy is defined as the sum of exports and an import divided by total gross domestic product and is obtained from World Bank database. The amount of trade can affect domestic firms that do not compete in the international market themselves, but compete with open international markets. International firms can penetrate the domestic market and therefore increase competition. The openness of an economy can influence foremost the firms that are integrated in the foreign market. The TFP growth is obtained from the Conference Board Total Economy Database. It represents the technological changes an economy is experiencing. As firms adapt, they are influenced by not only the productivity of the surrounding environment, but also the productivity enhancements arising from technology.

Table 1 illustrates the whole data set. Detailed descriptive statistics for each country is provided in “Appendix”.

Table 1 Summary statistics

We estimate a first order autoregressive model that follows from Eq. 2. We add to the model a number of explanatory variables, including the interaction terms. Due to correlation between the regressors and the error terms the lagged dependent variable may cause biased and inconsistent estimates, when using OLS, fixed or random effect models. Even though the fixed effects estimation controls for the firm specific effects, it fails to capture correlation between the error term and the regressors imposed by the autoregressive process, so-called Nickell-bias still remains (Nickell 1981). To address this, we utilize a two-step generalized method of moments (GMM) estimator developed by Arellano and Bond (1991), or more commonly known as the difference GMM estimator. The method is designed for data with a large cross-section but with a short time series dimension and a lagged dependent variable as an explanatory variable. The firm-specific time invariant effects are removed by differencing transformation. Instruments are constructed within the dataset. The endogenous variables are instrumented by their lagged levels and the exogenous ones by themselves (Roodman 2009). Our model is described as:

$$ \pi_{ijt} = \lambda \pi_{ijt - 1} + \alpha_{m} {\mathbf{X}}_{jt} + \delta_{m} {\mathbf{X}}_{mjt} *\pi_{ijt - 1} + \gamma_{m} {\mathbf{W}}_{ijt} + \varepsilon_{it} $$
(3)

The subscripts denote firm i in country j at time t. We have profit \( (\pi_{ijt} ) \) as our dependent variable, and we add the lagged value of profit \( (\pi_{ijt - 1} ) \) to represent the autoregressive process as described. \( {\mathbf{X}}_{jt} \) is a vector of the regulatory variables in country j at time t. The difference GMM does not produce the same type of long run persistence parameter as \( \alpha \) captures in Eq. 2. The estimated \( \alpha_{m} \)’s can however be interpreted as indicating the direction of change in the long run profit persistence. We also add an interaction term between \( \pi_{ijt - 1} \) and our PMR indicators. This interaction term captures the effect of the regulation on the short run persistence of profit and thus the \( \delta_{m} \)’s imply the change in the short run profit persistence arising from the regulatory variables.

By estimating a difference GMM, we are able to control for a set of observable covariates, as presented above and control for the unobserved time-invariant heterogeneity of firms while also correcting for the bias. We also apply different model specifications as robustness checks to validate our results.

4 Results

In Table 2 below, estimations of Eq. 3 are reported. The four different PMR-variables are added in separate estimations since they are highly correlated, as shown in the “Appendix Table 4”.

Table 2 Results with difference GMM

We are interested in two effects on profits: (1) long run effects on permanent rents, which are captured by the PMR variables directly; (2) the persistence of profits in the short run, which is captured by the interaction terms.

Results show that the interaction terms between the PMR-variables and profit are statistically insignificant in all four cases. Thus, PMR does not seem to matter for the short run profit persistence. It can be the case that the regulatory setting is designed in a competitive manner in the short run, i.e., they do not hinder—or enhance—the convergence process of profits. Or product market regulations simply do not matter in the short run transitory rents. As mentioned, it may also be that the time series is not long enough to fully capture profit dynamics.However, the results show that the overall product market have a significant relationship with the long run profit levels. When looking at the sub-indicators, the results are statistically significant for all the indicators except for the domain barriers to entrepreneurship. The impact seems to be large in magnitude and the strongest impact is found for barriers to trade and investments. Thus, we conclude that the regulations mainly contribute to long run permanent rents.

As for the controls, we find a negative relationship between profits and firm size, which implies diseconomies of scale. We find a positive relationship between market share and profits suggesting a link between long run profits and monopoly/market power. Also, share of tangibles assets and profits are also found to have a positive relationship. However, the country-level covariates, openness and TFP growth do not have a significant effect on the long run profit persistence.

As a robustness check we also estimate a fixed effects estimator and also test for the impact of timing by lagging all our explanatory variables, The relevant results are reported in the “Appendix as Tables 5 and 6”. We also estimate a hierarchical model—or so-called mixed effects model—where we can control for the different levels our data. These results are not reported. The results for the regulation variables are largely the same in particular with regard to the long run permanent rents.Footnote 14

5 Summary and policy implications

This paper contributes to the existing literature by examining the relationship between product market regulations (PMR) and the profit persistence of firms by combining firm- and country-level information for a set of 30 OECD countries across 1998–2013. Despite a large literature on both regulations as well as profit persistence no other studies have to our knowledge attempted to link the two literatures together. Thus, we advance the literature by: (1) examining the determinants of profit persistence, in particular the impact of PMR, (2) making use of both firm level information as well as cross-country variation.

We examine both the short run persistence of profits and the long run permanent rents. Our results show that product market regulations have no significant effect on the short run profit persistence. However, product market regulations significantly increase the long run permanent rents In addition to the overall PMR we also examine the effect of three subcomponents: barriers to trade and investments, state control and barriers to entrepreneurship. The domain barriers to entrepreneurship is the only indicator which does not have any significant effect on long run profits. The other sub-components and the overall product market regulations are found to have a statistically and economically significant effect.

We conclude that product market regulations have a significant negative effect on long run competitiveness and are associated with a economically significant misallocation of resources. The findings are consistent with previous studies establishing a link between regulations and productivity growth. Regulators should be aware of the potential cost product market regulations impose on the competition of an economy, especially in regard to regulations arising from state control and trade and investment regulations. Our results have clear policy implications. Regulatory reforms that promote liberalization in product markets will decrease permanent rents and decrease the time needed for profits to converge to the norm. In other words, product regulations reduce competition.