1 Introduction

Economists often use productivity estimates as proxies for unobserved management, either to control for omitted variable bias or to measure management at the firm level. For instance, Nickell (1996) estimates the effect of competition on firm productivity and assumes that productivity estimates serve as proxies for management quality, among other things. As management is usually unobserved, the correlation between management and productivity estimatesFootnote 1 is assumed. Using the management data produced by Bloom and Van Reenen (2007) we are able to test this assumption empirically. We ask whether two popular productivity estimates, firm fixed effects and inefficiency scores, correlate with observed management practices. Also, we ask whether the assumptions underlying their use, neutrality and monotonicity, are valid.

The use of inefficiency estimates as proxies for management goes back at least to Farrell (1957). His model treats the production function as a best-practice frontier and the difference between actual production and best practice as inefficiency. For given inputs and outputs he attributes estimates of technical inefficiency to bad management (p. 261):

[…] the technical efficiency of a firm or plant indicates the undisputed gain that can be achieved by simply ‘gingering up’ the management […].

Farrell’s model sets management apart from the conventional inputs of capital and labor in the sense that inefficiency indicates the potential for management to increase output for given conventional inputs, implying that management is a technology. Put differently, unlike conventional inputs, management alone cannot produce. Nuthall (2009, p. 413) expresses this as follows: “… the key factor in the management of land, labor and capital is the management ability applied.” On the other hand, Mundlak (1961)’s concern is about omitted variable bias when the management input is unobserved. His model uses firm fixed effects as proxies for management. The model requires panel data and the assumption that management is time-invariant. We empirically test whether the two proxies, inefficiency and fixed effects, correlate with observed management. Both proxies assume that management is a productivity shifter and that better management always increases productivity. Put differently, management affects productivity neutrally and the relation between management and productivity is monotonic. Together these assumptions suggest that management is a technology rather than an input.Footnote 2 To empirically test these two assumptions we apply semiparametric technology models where the influence of management can be non-neutral as well as non-monotonic.

A semiparametric model is more general than the parametric linear model Bloom and Van Reenen (2007) use to correlate management with total factor productivity. Their model takes a log-linearized Cobb-Douglas form with management z added in an ad hoc fashion: Iny i  = α0 + zα + Inxβ. They find that management positively correlates with total factor productivity (TFP), α is statistically significant. The parametric linear model helps them validate their survey measure but our investigation of the goodness of productivity as a proxy for management requires a more flexible model. For instance, the use of TFP as a proxy for management requires that TFP increases in management everywhere and not just at the mean. Also, with the parametric linear model, whether management z is a technology depends on the interpretation of the estimated coefficient α. Inconsistent with the management as technology interpretation, management alone can produce positive output. The semiparametric models we apply (Robinson 1988; Li et al. 2002) make the technology explicitly management specific: f z (x), i.e., the production function parameters vary with management. Semiparametric models strike a balance between a standard parametric structure for the conventional inputs and a nonparametric structure for management. The nonparametric part makes the model fully flexible in regard to the effect of management on production and thereby accommodates our theoretical ignorance about how management affects the technology. As the model does not impose the assumptions of neutrality and monotonicity we can test them. Finally, the model allows us to express characteristics of the production function like returns to scale as functions of management.

We find that the correlation between fixed effects or inefficiency scores and management is positive but weak: the largest correlation coefficient is 0.35. Also, we find that management explains at most 5% of the variance in the proxies. Firms and policy makers use productivity or inefficiency estimates to assess potential performance improvements through better management. The scope for such improvements might be much lower than suggested by the face values of the proxies. Despite the effect of management on productivity not being strictly neutral, the neutral component gives a relationship between total factor productivity and management that is mostly increasing. Thus, productivity estimates are suitable for ranking firms on management practices but not for quantifying unobserved management practices.

This paper is organized as follows. Section 2 introduces the empirical models that we apply. Section 3 introduces the data. Section 4 gives the results and Section 5 concludes.

2 Empirical models

First, we introduce two popular productivity estimates that are also used as proxies for unobserved management. Generally, when management is unobserved it is approximated by A, a neutral shift variable outside the production function f(·):

$$y{\mathrm{ = }}Af\left( x \right),$$
(1)

where y is output and x is conventional input, e.g., capital and labor. We omit firm and time indices where they are not necessary. In this model, management is a neutral technology-shifter and more management is always better. Neutrality implies, that management is fully separable from the conventional inputs. It does not interact with them, no matter what functional form we choose for f(·). Separability allows us to estimate management when it is unobserved. There are different ways to obtain A. One way is to capture A with firm fixed effects as in Mundlak (1961). We replace A with firm fixed effects αi and append a classical error term v to obtain a standard fixed effects model:

$$y_{it}{\mathrm{ = }}\alpha _i{\mathrm{ + }}f\left( {x_{it}} \right){\mathrm{ + }}v_{it},$$
(2)

where i identifies firms and t identifies time. Estimation requires panel data. The fixed effects are proxies for management to the extent that management is time-invariant. They also capture all other unobserved, time-invariant factors. In an alternative model, A represents production inefficiency (a random variable). If A is both firm- and year-specific, we can write it as

$$A_{it}{\mathrm{ = }}A_0\frac{{A_{it}}}{{A_0}} \equiv A_0e^{ - u_{it}},\quad \quad u_{it} \ge 0,$$
(3)

where

$$A_0 \equiv \mathop {{\max }}\limits_{i,t} \left\{ {A_{it}} \right\},\quad \quad \frac{{A_{it}}}{{A_0}} \equiv e^{ - u_{it}} \le 1.$$
(4)

Note that this model can also be estimated in a cross-section. Plugging (3) into (1), taking logarithms, and appending a classical error term v, we obtain the standard stochastic frontier (SF) production model (Aigner et al. 1977; Meeusen and van den Broeck 1977), viz.,

$$\ln y_{it}{\mathrm{ = }}\alpha _0{\mathrm{ + }}\ln f\left( {x_{it}} \right){\mathrm{ + }}v_{it} - u_{it},$$
(5)

where

$$\alpha _{\mathrm{0}}{\mathrm{ = }}\ln A_0.$$
(6)

The interpretation of this model is that \(\ln y_{it}^ \ast = \alpha _0 + \ln f\left( {x_{it}} \right) + v_{it}\) is the best-practice stochastic frontier technology and inefficiency is the difference \(\ln y_{it}^ \ast - \ln y_{it}\). Only fully efficient firms operate on the frontier. An inefficient firm produces \(100 \ {({\rm exp}(u_{it}) - 1)}\) percent less output compared to an efficient firm using the same amount of inputs. This interpretation assumes that it is feasible for any firm to improve its management to the highest level, i.e., attain the best management A0. To separate the combined error term ε = vu, we require assumptions on the distribution of the individual errors. The standard assumptions are

$$v_{it} \sim N\left( {{\mathrm{0,}}\sigma _v^2} \right){\mathrm{,}}$$
(7)
$$u_{it} \sim N^{\mathrm{ + }}\left( {{\mathrm{0,}}\sigma _u^2} \right){\mathrm{.}}$$

Identification of u is possible when we assume that the distribution of v is symmetric, e.g., normal, but the distribution of u is asymmetric, e.g., half-normal (Jondrow et al. 1982).

As we observe management we can ask whether estimates of fixed effects and inefficiency are good proxies for management by correlating them with management: we regress the productivity estimates on management using the OLS estimator. To better compare inefficiency and fixed effects we estimate inefficiency to be time-invariant and adjust for the intercept. Thus, α i from (2) is equivalent to α0u i from (5) if u is time-invariant. We control for country and industry fixed effects by mean transforming the variables before estimation, i.e., measurement is in terms of deviations from country-industry means. For the fixed effects model in (2) and the stochastic frontier model in (5) the functional form is translog.

Above, we showed that when management is unobserved, productivity estimates can serve as proxies. As we observe management we can include it into models of production in a way that allows us to test the assumptions of monotonicity and neutrality. First, we extend the stochastic frontier model to include management directly. One way to include management in (5) is to relax the mean zero assumption for u and allow exogenous influences on u using a truncated normal distribution.Footnote 3 We make both the mean and the variance of the inefficiency distribution functions of management by modifying the assumptions in (7) as follows:

$$v_{it} \sim N\left( {{\mathrm{0,}}\sigma _v^{\mathrm{2}}} \right){\mathrm{,}}$$
(8)
$$u_{it} \sim N^ + {\mathrm{(}}\mu _{it}{\mathrm{,}}\sigma _{it}^{\mathrm{2}}{\mathrm{),}}$$
$$\mu _{it} = z_{it}\delta ,$$
$$\sigma _{it}^2 = \exp \left( {z_{it}\gamma } \right),$$
$$\sigma _v^2 = \exp \left( {z_{it}\lambda } \right).$$

From the estimates of this model we can calculate the marginal effects of management on the mean, ∂u/∂z, and the variance ∂σ2/∂z of the inefficiency distribution. The intuition for the variance of u is that it captures production uncertainty, e.g. better management correlates with lower production uncertainty. Note that as we have a single z variable −∂u/z = ∂lny/∂z. Wang (2002) shows that the parametrization in (8) allows the effects of z to be non-monotonic, i.e., management can increase or decrease inefficiency. This is useful, because it allows us to test the monotonicity assumption implied by the proxies.Footnote 4

The stochastic frontier model shifts the production frontier with u, which in turn can be a function of management if management is observed. A more straightforward way to shift the production function with management is to allow management to affect the technology in a fully flexible way. To represent this flexibility we write

$$y = f^z\left( x \right)$$
(9)

where the superscript z indicates that the production function is different for different values of management. To motivate this flexible model, we return to (1) and make A(·) a function of z. We can write the model as

$$\ln y_{it} = \ln A\left( {z_{it}} \right) + \ln f\left( {x_{it}} \right) + v_{it}$$
(10)

where v it is the noise term. This is the semiparametric partially linear (PL) model proposed by Robinson (1988) where A is completely unspecified (nonparametric) but the x variables are specified as usual in a log-linearized form. Here x and z are treated differently in the sense that the functional form for x is parametric but it is nonparametric for z. Nested in (10) is the standard form \(\ln y_i = \alpha _0 + z{\prime}\alpha + \ln x{\prime}\beta \) where f(·) is Cobb–Douglas and A a linear function of z. Li et al. (2002) generalized the PL model and allowed all parameters to be functions of the z variable:Footnote 5

$$\ln y_{it} = \alpha \left( {z_{it}} \right) + \ln x{\prime}\beta \left( {z_{it}} \right) + v_{it}.$$
(11)

In this semiparametric smooth coefficient (SPSC) model z affects productivity both neutrally and non-neutrally. The neutral effect is captured by α(z it ) and the non-neutral effects are captured via the inputs β(z it ). We think of these different effects as channels through which management operates. The PL model in (10) constrains the effects via the inputs to zero. Again, equations (10) and (11) are not linear in parameters since both α and β are nonparametric functions of z, which are not necessarily linear. The combination of being parametric in x and nonparametric in z makes the function semiparametric. Importantly, this difference captures the economic difference between the conventional inputs of capital and labor and the non-conventional management input.

Technically, these semiparametric models strike a balance between precision and robustness (Robinson 1988). Although fully parametric models are very precise they suffer from possible functional form mis-specification. Nonparametric models are robust but inefficient as they suffer from the curse of dimensionality problem. However, for SPSC models with a single z variable, like ours, the curse of dimensionality is not important (Li et al. 2002). Also, the parametric structure makes the semiparametric model less sensitive to outliers than the fully nonparametric model. Appendix A gives details on the estimation of the SPSC model, including outlier detection, and the construction of bootstrapped confidence intervals. For details on the estimation of the PL model see Robinson (1988). An important benefit of the semiparametric models is that they allow us to test the assumptions of neutrality and monotonicity for the influence of management. We test neutrality by testing the Null of the PL model, which restricts the management influence to be neutral, against the SPSC model, which allows for non-neutral effects. Li and Racine (2010) propose the test statistic we use. To test the assumption of monotonicity we visually analyze graphs that plot management-dependent total factor productivity estimates against management for different models. Finally, by testing the Null of a parametric linear model including management against the PL model, using the test by Hsiao et al. (2007) we can also assess whether the neutral effect of management is linear or not.

3 Data

In their seminal paper Bloom and Van Reenen (2007) introduce a survey tool to consistently measure firm-level management practices across countries and industries. Our data is from Bloom and Van Reenen (2010).Footnote 6 The data is for medium-sized manufacturing firms, for a number of countries, and for the years 2002 to 2010.Footnote 7 The number of firm-year observations is 6349. The panel is highly unbalanced. The average number of observations by firm is 2.4. The firms were surveyed on their management practices using a practice evaluation tool developed in collaboration with a leading management consulting firm. The tool defines and scores 18 separate management practices. Each practice was scored using several questions. The responses were scored from 1 (worst) to 5 (best). Our management variable is the unweighted average across the 18 practices; like Bloom and Van Reenen (2007) we treat it as effectively continuous. Bloom and Van Reenen (2007, p. 1386) state that their measure of management practice captures “organizational capital” rather than employees’ raw ability or skills. Therefore, the data should capture the quality of management not managers. All individual questions and example responses are listed in Bloom and Van Reenen (2006). The questions are also reproduced in Appendix B. We only include privately owned firms. We drop the ownership categories “government” and “other”. We include the 725 observations that have no value for the ownership variable. The management data is matched with standard accounting data at the firm level. Output Y is measured as sales in current US dollars. Capital input K is tangible fixed assets in current US dollars and labor input L is number of employees. Table 1 provides summary statistics for our full sample. As the semiparametric models are sensitive to outliers we apply an outlier screen for these models only (see Appendix A for details).

Table 1 Summary statistics

4 Results

4.1 Do productivity estimates correlate with observed management?

To investigate whether estimates of fixed effects and inefficiency are good proxies for unobserved management we regress their estimates against observed management (and a constant). Figure 1 plots lines of best linear fit including 95% prediction intervals and the raw data. The correlations in the two panels have opposite signs, because fixed effects represent efficiency whereas the stochastic frontier models estimate inefficiency. The two proxies themselves are highly correlated. The correlation coefficient between the estimates of fixed effects and time-invariant inefficiency is −0.89.

Fig. 1
figure 1

Proxies against observed management. Notes: These plots show the lines of linear best fit, the 95% prediction intervals, and the data for the regressions of fixed effects or time-invariant inefficiency against management and a constant

The OLS coefficient estimates for management are 0.34 and −0.18 for fixed effects and inefficiency scores, respectively. For both regressions the coefficients are significant at a 1% level. To compare the magnitudes of the responses, a one point increase in the management index (which is roughly two standard deviations) implies an increase in productivity as measured by fixed effects of roughly 50% of a standard deviation but only 39% of a standard deviation for the inefficiency scores. A further test for the goodness of the proxies is that the residuals from the second stage regressions should not correlate with management. At standard levels of statistical significance, this is true for the fixed effects but not the inefficiency score residuals. However, there is no economically significant correlation between management and the residuals for either proxy.

Despite these positive correlations, management explains little of the variance in the proxies. The R-squares are 0.057 and 0.035 for the fixed effects and inefficiency models, respectively. Remember that our hypothesis is that the proxies are management, implying that the R-squares equal 1. These low R-squares are consistent with the fact that adding the management variable to a Cobb–Douglas specification of a conventional production function only increases R-squared from 0.665 to 0.672 (remember that our data is transformed around industry and country means).

When comparing fixed effects and inefficiency scores as proxies for management the former perform better but require panel data. Absolutely, fixed effects and inefficiency scores are both poor proxies for management as management explains only a small fraction of the proxies’ variation. This is no surprise as the proxies also capture many other unobserved factors of production.

4.2 Is the influence of management neutral and monotonic?

Above we investigated whether productivity estimates correlate with observed management. In this section, to test whether total factor productivity is always increasing in management and whether management affects productivity neutrally or non-neutrally, we apply production models where the total factor productivity estimates (or the entire technology) are functions of management.

To begin, we use a version of the stochastic frontier model where the mean and the variance of the inefficiency distribution are functions of management. This model assumes neutrality but allows us to investigate monotonicity. Figure 2, plots the marginal effects of management on the mean and variance of the inefficiency distribution against the level of management. The marginal effects are negative but increasing, i.e., better management monotonically decreases the mean and variance of the inefficiency distribution. At the mean the marginal effect on E(u) is −0.17, similar to the effect for the second stage regression we found above. This result is evidence that when we use estimates of u as proxies for unobserved management, we can be confident that lower inefficiency always correlates with better management. As an aside, better management also reduces production uncertainty, i.e., for higher levels of management there is less variation in inefficiency. A possible explanation is that better management makes firms more resilient to changes in their environments.

Fig. 2
figure 2

Management as a determinant of the distribution of inefficiency. Notes: The graphs give the marginal effects of management on the mean and variance of the distribution of inefficiency

Next, we use two semiparametric models where management shifts the technology not via the inefficiency term but directly via the coefficients. The semiparametric smooth coefficient (SPSC) model allows all coefficients to be nonparametric functions of management. The nested PL model allows only the intercept to be a fully flexible function of management. In both models the parametric part has a Cobb–Douglas form. Again, we control for country and industry fixed effects by mean transforming the variables before estimation, i.e., measurement is in terms of deviations from country-industry means.

We use both semiparametric models to further investigate monotonicity. Unlike a linear parametric model the semiparametric models allow the relation between management and productivity to be different at every point. We test the assumption of monotonicity by plotting the intercept (TFP) estimates from the SPSC and PL models against the management variable in Fig. 3. The solid line is for the SPSC model with the dashed lines giving the bootstrapped 95% confidence interval.Footnote 8 The confidence interval at the upper end is fairly wide due to a sparsity of observations. Nevertheless, as SPSC is locally weighted it explains the data away from the mean better than parametric models. The specification test proposed by Li and Racine (2010) rejects the Null of the linear parametric model in favor of the SPSC model (the p-value is zero to the fourth decimal placeFootnote 9). That is, the coefficients are not constant over z. We see that TFP is increasing in management everywhere. The assumption that better management always increases productivity seems valid. But what if we restrict management’s effect to the intercept, as models that use productivity estimates to measure management do? The dotted line gives the intercept estimates for the PL model. The line fluctuates, which is evidence that TFP is not increasing in management everywhere. However, when testing the Null of a parametric model where management enters linearly against the PL model we cannot reject the linear model. The p-value is 0.11. The comparison with the SPSC model’s intercept suggests that the fluctuations are probably not an artifact of the data. We believe that the non-monotonic relation between the PL model’s intercept and management suggests that the neutral management channel is not fully independent of the capital and labor channels (discussed below).

Fig. 3
figure 3

This graph plots estimated intercept coefficients against management practice for the SPSC (solid) and PL (dotted) models. For the SPSC model it adds the 95% bootstrapped confidence intervals (dashed lines)

To explore the non-neutral effects of management we plot the SPSC model’s coefficient estimates for capital and labor in Fig. 4. The two upper panels give the distributions for the two coefficients. Assuming competitive input and output markets these input elasticities reflect revenue shares. Both distributions are fairly wide and probably multi-modal. In the lower panels we plot the same coefficients against management together with their 95% confidence intervals as well as equivalent linear parametric (OLS) estimates. We see that firms with low capital and high labor shares have poor management practices. The opposite is true for firms with high capital and low labor shares. It seems is that the optimal management quality depends on the labor intensity of the firm. Firms with a low labor intensity might employ skilled workers, which require better management practices. Over most of the range of management the constant parametric coefficient estimate falls within the SPSC estimates’ confidence intervals. Nevertheless, as already reported above the test of Li and Racine (2010) rejects the linear parametric model in favor of the SPSC model. As the parametric model is nested in the SPSC model this is evidence that the parametric model is mis-specified (Li et al. 2002, p. 417). A formal test for neutrality is to apply the same specification test to the Null of the PL model.Footnote 10 For our data, the PL model is rejected in favor of the SPSC model with a p-value zero to the fourth decimal place. We conclude that management has important non-neutral effects. Although the question of whether management is a technology or an input is not the focus of this paper, our results suggest that it is a bit of both. The fact that total factor productivity is increasing in management supports the view that management is akin to a technology. On the other hand, the finding that management correlates with capital and labor shares suggests that different types of firms have different management practices. To the extent that these differences reflect optimization behavior, management is an input.

Fig. 4
figure 4

This graph plots the coefficient estimate for capital and labor from the SPSC model. The upper panels plot the densities of the coefficient estimates. The lower panels plot the coefficient estimates, together their 95% confidence intervals and their equivalent parametric estimates, against management

As in the SPSC model all coefficients are functions of management, we can correlate characteristics of the production technology, like returns to scale, with management. Figure 5 plots estimates of returns to scale based on the SPSC model, together with their 95% bootstrapped confidence intervals, against management. For comparison, we also plot the returns to scale estimates from a parametric model (omitting management). The constant parametric estimates fall within the SPSC model’s confidence intervals. However, the point estimates differ between the two models, especially for firms with poor management practices. Firms with poor management practices are too small. Above a certain level of management, scale is optimal for a wide range of management practices, but it is not clear which way causality runs.

Fig. 5
figure 5

This graph plots returns to scale for the SPSC model against management including the 95% bootstrapped confidence interval. The dashed line gives the returns to scale for a fully parametric Cobb–Douglas model (omitting management)

5 Conclusion

Management is an important, but usually unobserved factor in production. Theoretically, management is important, because it is a key mechanism through which owners and regulators try to influence the performance of firms. Economists often use total factor productivity estimates as proxies for management. We take advantage of the management data produced by Bloom and Van Reenen (2007) to assess the empirical usefulness of productivity estimates as proxies for management. First, we correlate two popular proxies, fixed effects and inefficiency scores, with observed management. Second, we use flexible models of production to test whether management influences productivity as assumed by the proxies: neutrally and monotonically.

We find that the correlations between the proxies and management are positive but weak. Also, observed management practices explain only a small fraction, no more than 5%, of the variances of fixed effects and inefficiency scores. This result is no surprise as fixed effects and inefficiency scores are essentially residuals, which capture all factors that are time-invariant or follow an asymmetric distribution, respectively. Overall, fixed effects seem better management proxies than inefficiency scores but require panel data. Of course, our analysis assumes that Bloom and Van Reenen (2007)’s management measure is a good proxy itself. There might be dimensions of management quality omitted by their survey measure.

When measuring management by proxies the correlation is of interest but so are the assumptions of neutrality and monotonicity. Testing these assumptions requires models that do not impose them. To test neutrality, we contrast the results from two semiparametric models: one that allows non-neutral effects and another that imposes neutrality. We find that the effect of management is not strictly neutral. Besides total factor productivity, management shifts capital and labor elasticities, too. A formal test also rejects the neutral model in favor of the non-neutral model. We investigate monotonicity by plotting management-dependent total factor productivity estimates from different models. Across, these models TFP estimates are mostly increasing monotonically in management. Last, as management shifts TFP and correlates with the labor-capital ratio it seems that management has characteristics of a technology and an input.

Despite rejecting strict neutrality and also finding some evidence against monotonicity, we believe that overall our evidence supports the use of productivity estimates as proxies for management for some objectives. When the objective is to rank firms by their management abilities the use of the proxies is fine. However, the proxies do not quantify management practices well. For instance, many regulators base price caps on estimates of inefficiency (“benchmarking”). The scope for performance improvement via better management is probably only a fraction of the face value of inefficiency estimates.