In many extensions of the Standard Model (SM), massive Color-Octet Vector Boson (COVB) is necessarily engaged at the TeV scale, for example, in the top-color [1], warped (RS) or universal extra dimensions [2, 3], technicolor [4] and chiral color models [5]. In all these cases, the COVB could have large impacts on the interaction of top quarks, which are being copiously produced at the CERN Large Hadron Collider (LHC). With a large sample of \(t\bar{t}\) data, the CDF collaboration at the Tevatron has recently reported an observation of a large Forward–Backward asymmetry (A FB) in \(t\bar{t}\) production, \(A_{\mathrm{FB}}^{\mathrm{tot}}= 0.158\pm0.075\), compared with the SM prediction 0.058±0.009 [68]. The disagreement is more profound in the region of large \(t\bar{t}\) invariant mass, where CDF reported \(A_{\mathrm{FB}} ({m_{t\bar{t}}>450~\mathrm{GeV}})=0.475\pm 0.114\), and the SM gives 0.088±0.013 [9]. This leads to a more than 3.4σ deviation from the SM prediction [9]. Similarly, the DO/  collaboration [10] has also reported the total A FB to be \(A_{\mathrm{FB}}^{\mathrm{tot}}=0.196\pm 0.065\) using 5.4 fb−1 of data. Furthermore, DO/  has also measured the charge asymmetry of the leptons from top decay, \(A_{\mathrm{FB}}^{l} = 0.152\pm 0.04\). These results have generated extensive theoretical studies on this observable in various models beyond the SM. Among these, models with massive COVB are in particular attractive, cf., Ref. [11] and references therein. There have also been substantial efforts in searching for the signal of COVB at the Tevatron and LHC, which can shows up as a clear resonant peak in the \(t\bar{t}\) invariant mass distribution [1215]. While current experimental limits depend on the detailed choices of couplings [1618], they nevertheless indicate that COVB with mass below 1 TeV is severely constrained.

It is well known that QCD effects play an important role in \(t\bar{t}\) production. The NLO QCD corrections to SM \(t\bar{t}\) production, which significantly enhance the \(t\bar{t}\) total cross sections, have been calculated for a long time [1921]. In the SM, A FB is related to higher order QCD radiation effects, which first appear at \(\mathcal{O}(\alpha_{s}^{3})\) [6]. Complete NLO corrections to this observable are not available currently, but calculation based on soft gluon resummation indicates that higher order QCD effects are small [22]. Recently electroweak corrections to A FB have also been calculated and are found to slightly increase the asymmetry [23]. In the case of massive COVB, its QCD gauge interaction is uniquely determined by its color content, resembling a SM gluon. Therefore, it is reasonable to expect that higher order QCD effects will also have significant impacts on processes mediated by massive COVB, at least at an energy scale comparable to the mass of COVB. This has motivated the model dependent calculation of COVB production by gluon fusion [24] and the model independent (using dimension-six operators) calculation of \(t\bar{t}\) production mediated by COVB [25]. However, a complete NLO analysis of the QCD effects to models with massive COVB in the resonant \(t\bar{t}\) region is still absent.Footnote 1 In this letter, we present the model independent complete NLO QCD corrections to top quark pair production mediated by a general massive COVB, and show the detailed numerical analysis of top quark pair production, including invariant mass distribution and A FB at the NLO level. We also show that the NLO corrections significantly stabilize the renormalization and factorization scale dependence, as compared to the LO results.

Below, we briefly outline our approach to systematically calculating the NLO QCD effects to processes of COVB production. We consider a model independent massive COVB originated from a broken SU(3) gauge group. The effective Lagrangian for color-octet vector G μ in unitary gauge can be written as

$$ \mathcal{L}_G=-\frac{1}{2}\operatorname{Tr}G_{\mu\nu}G^{\mu\nu} + M^2_G \operatorname{Tr}G_\mu G^{\mu}, $$
(1)

where a=1,…,8 are the broken SU(3) “color” indices, and μ=0,…,3 are the Lorentz indices. \(G_{\mu\nu}\equiv G^{a}_{\mu\nu }T^{a}=(\partial_{\mu}G^{a}_{\nu}- \partial_{\nu}G^{a}_{\mu})T^{a}\) is the field strength tensor, where T a is the conventional Gell-Mann matrix with the normalization \(\operatorname{Tr}[T^{a}T^{b}]=\frac{1}{2}\delta^{ab}\). The mass of the COVB is denoted by M G. The QCD color interaction between COVB and SM gluon A μ can be easily implemented by changing the ordinary derivative into covariant derivative:

$$ \partial_\mu G^a_\nu \to D_\mu G^a_\nu=\partial_\mu G^a_\nu + g_1 f^{abc} A^b_\mu G^c_\nu, $$
(2)

where g 1 is the coupling constant of QCD. The Lagrangian in Eq. (1), after the replacement in Eq. (2), is already invariant under the conventional \({\rm SU(3)}_{c}\) transformation. If desired, NLO QCD calculation can be done with the Feynman rule derived from the above Lagrangian, where unitary gauge is chosen for the broken SU(3) gauge symmetry. However, it is well known that loop calculation in unitary gauge is inconvenient because of the violent ultra-violet (UV) behavior of the propagator. Instead, we choose to carry out the calculation in conventional ’t Hooft–Feynman gauge for the broken gauge group. To this end, we separate the longitudinal component (the would-be Goldstone boson) of the COVB from Eq. (1), by modifying the mass term in Eq. (1) as follows,

$$ G_\mu(x) \to \tilde{G}_\mu(x) =U(x)^\dagger \biggl( \frac {i}{g_2}\partial_\mu+G_\mu(x) \biggr) U(x), $$
(3)

where we have introduced the π field (the would-be Goldstone field) via \(U(x) = e^{i\pi^{a}(x) T^{a}/f}\), and the symmetry breaking scale f=M G/g 2, with g 2 being the coupling constant of the broken SU(3) gauge symmetry. It is easy to check that the mass term is now invariant under the gauge transformation:

(4)
(5)

where V(x) is a finite gauge transformation \(V(x)= \exp(i\alpha ^{a}_{2}(x)T^{a})\). Similar to unitary gauge, the interaction between G μ, π and QCD gluon is obtained by changing the ordinary derivative into covariant derivative, as in Eq. (2). Using Eqs. (2) and (3), the classical Lagrangian for COVB turns into

$$ \tilde{\mathcal{L}}_G = \biggl(-\frac{1}{2} \operatorname{Tr}G_{\mu\nu }G^{\mu\nu} + M^2_G \mathrm{Tr}\,\tilde{G}_\mu \tilde{G}^{\mu} \biggr) \bigg\vert_{\partial_\mu\to D_\mu}. $$
(6)

Note that the classical Lagrangian \(\tilde{\mathcal{L}}_{G}\) is non-renormalizable, i.e., when expanding U(x), it contains operators of dimension larger than 4, whose coefficients are suppressed by at least one power of f. Since we are only interested in low energy QCD effects of COVB rather than its UV-completion, these higher dimensional operators can be safely neglected. Expanding the mass term in Eq. (6), we find that there is a kinetic mixing between the COVB and the would-be Goldstone boson: \(M_{G}\pi^{a}(x) \partial_{\mu}G^{a}_{\mu}(x)\). This mixing can be canceled by introducing a gauge fixing term:

$$ F_2 = - \frac{1}{2}\bigl( \partial^\mu G^a_\mu(x) + M_G \pi^a(x) \bigr)^2, $$
(7)

which is similar to the gauge fixing term for the QCD Lagrangian in ’t Hooft–Feynman gauge:

$$ F_1 = - \frac{1}{2}\bigl( \partial^\mu A^a_\mu(x)\bigr)^2. $$
(8)

The corresponding ghost Lagrangian is given by

$$ \mathcal{L}_g = \bar{u}^i(x) \frac{\delta F_{i}}{\delta \theta_j(x)} u^j(x), $$
(9)

where i=1 for the QCD ghost, and i=2 for the broken SU(3) ghost. θ i(x) are the infinitesimal gauge transformation parameters for the corresponding gauge group. The complete Lagrangian for the gauge sector now can be written as

$$ \mathcal{L} = \tilde{\mathcal{L}}_G + \mathcal{L}_{\mathrm{QCD}} + F_1 + F_2 + \mathcal{L}_g, $$
(10)

where \(\mathcal{L}_{\mathrm{QCD}}\) is the classical QCD Lagrangian. All the Feynman rules determined by gauge symmetry can then be derived from Eq. (10), and couplings between COVB and SM fermions can be introduced through vector or axial-vector current interaction. We have checked that this set of Feynman rules are in agreement with those derived in Ref. [27] for the case of RS model [2].

Before continuing, we should define the precise meaning of the NLO QCD corrections in this paper. At LO, there are three parts of contributions to the \(t\bar{t}\) cross section in models with massive COVB: the squared SM amplitudes, the interference between the new physics (NP) amplitudes and the SM amplitudes, and the squared NP amplitudes. The NLO QCD corrections in this paper refer to the \(\mathcal {O}(\alpha_{s})\) corrections to these three parts, respectively. All the relevant Feynman rules can be derived from the effective Lagrangian given in Eq. (10). The results obtained in this way reflect the model independent corrections from QCD interaction. As a final comment, we note that our NLO QCD corrections are the non-Abelian analogy of the QED corrections to W ± boson production at hadron collision [28], and the neglected contributions in our calculation are similar to the genuine weak corrections there [28], which can be mostly absorbed into a redefinition of boson and fermion couplings at LO.

Extending the approach shown in our paper [27], we calculate the one-loop renormalized helicity amplitudes, with the unstable particle treated in the complex mass scheme [29]. The loop integrals with complex arguments appearing in the one-loop amplitudes are evaluated with ONELOOP [30]. The real emission matrix elements are generated by a modified version of MADGRAPH [31]. Soft and (or) collinear singularities of the real corrections are dealt with by the dipole method [32] implemented in the MADDIPOLE package [33]. Throughout our calculation, the pole mass of top quark is chosen as m t=173.1 GeV, and α s(M Z)=0.118. LO cross sections are obtained with the CTEQ6L parton distribution function (PDF) [34] with one-loop running of α s, while NLO cross sections are obtained with the CTEQ6M PDF with two-loop running of α s. In the numerical calculation below we present the results for a benchmark axial-gluon model [35] resulting from a simultaneous fit of \(t\bar{t}\) total cross section, A FB, and dijet resonance searches. In this model, The coupling between the massive COVB and quarks are chosen as

$$ \begin{array} {@{}l} v_q(m_t) = 0, \qquad a_q(m_t) = 2.2, \\[1.5mm] v_t(m_t) = 0, \qquad a_t(m_t) = -3.2, \end{array} $$
(11)

where g 1 v q(t) and g 1 a q(t) are the vector and axial coupling of the light quark (top quark) to the COVB, defined at the scale m t. The evolution for v q,t(μ) under the change of scale is given by \(g_{1}(\mu)v(\mu)_{q,t}=g_{1}(\mu_{0})v(\mu_{0})_{q,t}(\alpha_{s}(\mu)/ \alpha _{s}(\mu_{0}))^{15/(2\beta_{0})}\) [27], where β 0=23/3 is the first QCD beta-function coefficient for N c=3 and n f=5, and the evolution equation for a q,t(μ) has the same form. Unless specified otherwise, the mass of the COVB is chosen as 2 TeV. We note that while such choice of parameters is at the margin of currently allowed parameter space [3638], the qualitative behavior of the NLO QCD effects are quite general and can be applied in more realistic models. For the calculation of accurate numerical results for other parameter choices, the corresponding results can be directly obtained from our Fortran code.

We define the NP cross section, σ NP, as the difference between \(t\bar{t}\) cross section in a model with a massive COVB and the SM:

$$ \sigma_{\mathrm{NP}} = \sigma_{\mathrm{SM}+\mathrm{NP}} - \sigma_{\mathrm{SM}}, $$
(12)

where the SM cross sections, including both \(q\bar{q}\)- and gg-channels, are calculated with the program MCFM [8].

In Fig. 1, we plot the NP contribution to the cross section at the LHC with \(\sqrt{s}=7~\mathrm{TeV}\), as a function of M G. The bands reflect the scale uncertainties estimated by varying the renormalization (μ r) and factorization (μ f) scales around their default values by a factor of 2 with μ r=μ f. We present the results in two benchmark schemes, namely the fixed scale scheme (FSS), i.e. the scales are fixed to be m t, and the dynamical scale scheme (DSS), i.e. the scales are set to be the invariant mass of top quark pair \(m_{t\bar{t}}\). We find that the NLO QCD effects are large and small in the FSS and the DSS, respectively, for our choice of parameters and the naive estimate of the NLO effects by simple rescaling of the LO results with the SM NLO K-factor is not appropriate. It is also clear that the inclusion of NLO QCD effects strongly reduces the theoretical uncertainty of the NLO cross section in the both scheme, compared with the LO ones.

Fig. 1
figure 1

σ NP, defined in Eq. (12), as functions of M G for FSS (left) and DSS (right). The black (red) bands are the LO (NLO) uncertainties, estimated by varying the scales around their default values by a factor of two within each scheme. The blue dashed lines are the naive estimates of the NLO effects by simple rescaling of the LO results with the SM K-factor. The couplings are chosen as in Eq. (11) (Color figure online)

Figure 2 gives the LO and NLO invariant mass distributions of the top quark pair at the LHC with \(\sqrt{s}=7~\mathrm{TeV}\), including contribution from SM LO and NLO top quark pair production. It can be seen that the NLO results in the DSS has relatively small corrections compared with the LO one, while the NLO QCD corrections in the FSS significantly change the shape of the LO curve, leading to the reduction of the width of the resonance. This is due to the fact that the NLO width can be expressed analytically as

$$ \frac{\varGamma_{\mathrm{NLO}}(\mu)}{\varGamma_{\mathrm{LO}}(\mu)}= \biggl[1+\frac{\alpha_s(\mu)}{\pi} \biggl( \frac{167}{12}-\pi^2 - \frac{15}{4}\ln\frac{M^2_G}{\mu^2} \biggr) \biggr]. $$
(13)

From Eq. (13), it is obvious that the width of COVB is significantly reduced at NLO in FSS, while the large logarithmic contributions are absent in DSS. The predictions in the two schemes at NLO are close to each other, while at LO they show large difference, as shown in the lower panel of Fig. 2. The difference between the two schemes reflects the uncertainties of the theoretical prediction. Hence, the NLO result leads to a smaller theoretical uncertainties in \(m_{t \bar{t}}\) distribution, which could improve the accuracy of extracting the theory parameters of NP models from comparing to experimental data. We also note that similar conclusion holds in other cases, e.g., KK gluon in RS model.

Fig. 2
figure 2

LO (dashed lines) and NLO (solid lines) invariant mass distribution of the top quark pair at the LHC with \(\sqrt{s}=7~\mathrm{TeV}\) are shown in the upper panel. In the bottom panel the differences between two different schemes at the LO and NLO are shown. In both panels, red curves and black curves correspond to FSS and DSS, respectively. The couplings are chosen as in Eq. (11) (Color figure online)

From the calculations of the total cross section and the invariant mass distribution, we see that the perturbation expansion may break down when FSS is chosen because the COVB resonance mass is usually about an order of magnitude larger than the top quark mass, leading to very large logarithms in the perturbation series. In contrast, the scale in DSS is related to the dynamics of the process and thus is a more reasonable choice.

Figure 3 shows the LO and NLO contributions to the A FB as a function of the mass of the COVB at the Tevatron with \(\sqrt {s}=1.96~\mathrm{TeV}\) in the center of mass frame of \(t\bar{t}\) pair. The results are given for both the total asymmetry (bottom bands) and the asymmetry in the large invariant mass region (upper bands), \(m_{t\bar {t}}>450~\mathrm{GeV}\), respectively. The bands in Fig. 3 reflect the scale uncertainties of the theoretical predictions, which are obtained by simultaneously varying μ r and μ f in the numerator and denominator of A FB around m t by a factor of 2 with μ r=μ f=μ. Here we choose the FSS, because the SM results \(A_{\mathrm{FB}}^{\mathrm{tot}}=0.158\pm0.075\) is also obtained at the scale μ=m t. In both cases, the most significant effects of the NLO corrections are the reduction of scale dependences. It is worth pointing out that the numerator of A FB is dominated by NP contributions, while the denominator is dominated by SM \(t\bar{t}\) cross section. Therefore at LO the large scale dependence in the numerator, which is mainly from scale dependence of NP coupling v q,t(μ) and a q,t(μ), cannot be canceled by the corresponding scale dependence in the denominator. The predictions for A FB at μ=m t are depicted in Fig. 3 as dashed lines. It can be seen that the NP contributions at NLO only reduce A FB by 3–4 %.

Fig. 3
figure 3

NP contributions to the A FB in the \(t\bar{t}\) center of mass frame as a function of the mass of the COVB at the Tevatron with \(\sqrt{s}=1.96~\mathrm{TeV}\). In the upper lines only the A FB in the large invariant mass region, \(m_{t\bar{t}}>450~\mathrm{GeV}\), are plotted, while in the bottom total A FB are shown. The bands reflect scale dependence, estimated by varying the scales around their central values by a factor of 2. The predictions for μ=m t are depicted in dashed lines. The couplings are chosen as in Eq. (11)

Figures 1, 2, and 3 show the cross sections as functions of M G, invariant mass distribution and the A FB as a function of M G for a COVB with axial couplings, respectively. For the A FB, it would also be interesting to illustrate the results for a COVB with both vectorial and axial couplings. For this purpose, we consider another set of couplings for a COVB with M G=3 TeV as follows:

$$ \begin{array}{@{}l} v_q(m_t) = -1, \qquad a_q(m_t) = -3,\\[1mm] v_t(m_t) = -3, \qquad a_t(m_t) = -1. \end{array} $$
(14)

The results for this set of couplings are shown in Fig. 4. Again we can see that the NP contributions at NLO only reduce A FB by a small amount for default scale choice (μ=m t).

Fig. 4
figure 4

NP contributions to the A FB in the \(t\bar{t}\) center of mass frame as a function of the mass of the COVB at the Tevatron with \(\sqrt{s}=1.96~\mathrm{TeV}\). In the upper lines only the A FB in the large invariant mass region, \(m_{t\bar{t}}>450~\mathrm{GeV}\), are plotted, while in the bottom total A FB are shown. The bands reflect scale dependence, estimated by varying the scales around their central values by a factor of 2. The predictions for μ=m t are depicted in dashed lines. The couplings are chosen as in Eq. (14)

As a further application of our results, we plot in Fig. 5 the NP cross section, σ NP, for a specific RS model considered in search for resonance decaying into top quark pairs by ATLAS collaboration [39], where the left-handed and right-handed couplings (modulo g s) between KK gluon and light quarks are chosen as

$$ c_{L,q}(M_G)=c_{R,q}(M_G)=-0.2, $$
(15)

and similarly the couplings between KK gluon and top quark are chosen as

$$ c_{L,t}(M_G)=1,\qquad c_{R,t}(M_G)=4. $$
(16)

Also plotted in Fig. 5 are the experimental exclusion limit extracted from the same paper. Our exact theoretical predictions are given for three different scale choices, μ=m t, μ=M G and \(\mu=m_{t\bar{t}}\), at both LO and NLO. It can be seen that the NLO QCD effects are moderate in the \(\mu=m_{t\bar{t}}\) case, while they are large in both the μ=m t and μ=M G cases. We also plot in Fig. 5 the LO results (the black solid line) with only the contributions from NP squared amplitudes, i.e., without the interference with the SM amplitudes. It is clear that considering the NP squared amplitudes contributions alone obviously underestimates the NP cross sections, and including the interference contributions is necessary for reliable predictions. We note that while the mass limit for KK gluon is very different at LO for the three kinds of scale choice, their differences are significantly reduced at NLO. Hence, the NLO results can be used for precise extraction of mass limit for KK gluon.

Fig. 5
figure 5

LO and NLO predictions for σ NP in a specific RS model [39]. The expected and observed limits on cross section are extracted from the Ref. [39]

Finally, we give the numerical results of the NP cross section for the same set of parameters as in Fig. 5, with M G fixed to be 1.5 TeV. The results are presented for three different scale choices, i.e. μ=m t, μ=M G and \(\mu=m_{t\bar{t}}\) with μ r=μ f=μ. The LO (NLO) results are calculated with CTEQ6L (CTEQ6M) in Table 1 and with MSTW2008LO (MSTW2008NLO) in Table 2, respectively. In the LO calculations, we only estimate the theoretical uncertainties by varying the renormalization and factorization scales around their central values by a factor of 2. In the NLO calculations, we also consider the PDF uncertainties, and the first error is scale uncertainty and the second is PDF uncertainty. It can be seen from Tables 1 and 2 that scale uncertainties are reduced from LO to NLO in all three scale choices, and the differences between different scale choices are also reduced when going from LO to NLO. Moreover, the predictions of total cross sections for CTEQ and MSTW PDFs are obviously different at LO, but consistent within the PDF uncertainties at NLO.

Table 1 The NP cross sections for top quark pair production mediated by KK gluon at the LHC (\(\sqrt{s}=7~\mathrm{TeV}\)) at the LO (CTEQ6L) and NLO (CTEQ6M). Theoretical uncertainties are estimated by varying the renormalization and factorization scales around their central values by a factor of 2
Table 2 The NP cross sections for top quark pair production mediated by KK gluon at the LHC (\(\sqrt{s}=7~\mathrm{TeV}\)) at the LO (MSTW2008LO) and NLO (MSTW2008NLO). Theoretical uncertainties are estimated by varying the renormalization and factorization scales around their central values by a factor of 2

In conclusion, we have presented a theoretical framework for systematically calculating NLO QCD effects to various experimental observables in models with massive COVB in a model independent way. Specifically, we show the numerical results for the NLO QCD corrections to total cross sections, invariant mass distribution and A FB of top quark pairs produced by mediating a massive COVB. Our results show that, for our choice of parameters, the NLO corrections of the NP cross section are much larger in the FSS than in the DSS, but the NLO QCD calculations in the dynamical scale scheme is more reasonable than the fixed scheme, and the naive estimate of the NLO effects by simple rescaling of the LO results with the SM NLO K-factor is not appropriate. Moreover, for invariant mass distribution, we find that the NLO QCD corrections change the width of the resonant particle in the DSS slightly, and the differences in the results using FSS and DSS are reduced after including NLO QCD effects.