Annals of Combinatorics

, Volume 22, Issue 4, pp 885–905

A Generalized SXP Rule Proved by Bijections and Involutions

Open Access
Article

Abstract

This paper proves a combinatorial rule expressing the product $$s_\tau (s_{\lambda /\mu } \circ p_r)$$ of a Schur function and the plethysm of a skew Schur function with a power-sum symmetric function as an integral linear combination of Schur functions. This generalizes the SXP rule for the plethysm $$s_\lambda \circ p_r$$. Each step in the proof uses either an explicit bijection or a sign-reversing involution. The proof is inspired by an earlier proof of the SXP rule due to Remmel and Shimozono (Discrete Math. 193:257–266, 1998). The connections with two later combinatorial rules for special cases of this plethysm are discussed. Two open problems are raised. The paper is intended to be readable by non-experts.

Keywords

Abacus Power-sum symmetric function Schur function SXP Tableau

Mathematics Subject Classification

05E05 Secondary 05E10

1 Introduction

Let $$f \circ g$$ denote the plethysm of the symmetric functions f and g. While it remains a hard problem to express an arbitrary plethysm as an integral linear combination of Schur functions, many results are known in special cases. In particular, the SXP rule, first proved in [9, page 351] and later, in a different way, in [2, pages 135–140], gives a surprisingly simple formula for the plethysm $$s_\lambda \circ p_r$$, where $$s_\lambda$$ is the Schur function for the partition $$\lambda$$ of $$n \in \mathbb {N}$$ and $$p_r$$ is the power-sum symmetric function for $$r \in \mathbb {N}$$. It states that
\begin{aligned} s_\lambda \circ p_r = \sum _{{\pmb {\nu }}}{{\mathrm{sgn}}}_r ({\pmb {\nu }}^\star ) c^\lambda _{{\pmb {\nu }}}s_{{\pmb {\nu }}^\star }, \end{aligned}
(1)
where the sum is over all r-multipartitions $${\pmb {\nu }}= {\bigl ( \nu (0), \ldots , \nu (r-1) \bigr )}$$ of n, $${\pmb {\nu }}^\star$$ is the partition with empty r-core and r-quotient $${\pmb {\nu }}$$, $${{\mathrm{sgn}}}_r ({\pmb {\nu }}^\star ) \in \{+1,-1\}$$ is as defined in Sect. 2 below, and $$c^\lambda _{\pmb {\nu }}= c^\lambda _{(\nu (0),\ldots ,\nu (r-1))}$$ is a generalized Littlewood–Richardson coefficient, as defined at the end of Sect. 3.

In this note, we prove a generalization of the SXP rule. The following definition is required: we say that a pair of r-multipartitions $$({\pmb {\nu }}, {\pmb {\tau }})$$, denoted $${\pmb {\nu }}/{\pmb {\tau }}$$, is a skew r-multipartition of n if $$\nu (i)/\tau (i)$$ is a skew partition for each $$i \in \{0,\ldots , r-1\}$$, and $$n = \sum _{i=0}^{r-1} \bigl ( |\nu (i)| - |\tau (i)| \bigr )$$.

Theorem 1.1

Let $$r \in \mathbb {N}$$, let $$\tau$$ be a partition with r-quotient $${\pmb {\tau }}$$, and let $$\lambda / \mu$$ be a skew partition of n. Then
\begin{aligned} s_\tau (s_{\lambda / \mu } \circ p_r) = \sum _{{\pmb {\nu }}}{{\mathrm{sgn}}}_r \bigl (({\pmb {\nu }}/{\pmb {\tau }}, \tau )^\star \bigr ) c^\lambda _{{\pmb {\nu }}/{\pmb {\tau }}\,:\,\mu } s_{({\pmb {\nu }}/{\pmb {\tau }}, \tau )^\star }, \end{aligned}
where the sum is over all r-multipartitions $${\pmb {\nu }}$$, such that $${\pmb {\nu }}/ {\pmb {\tau }}$$ is a skew r-multipartition of n, $$({\pmb {\nu }}/{\pmb {\tau }},\tau )^\star$$ is the partition, defined formally in Definition 2.1, obtained from $$\tau$$ by adding r-hooks in the way specified by $${\pmb {\nu }}/ {\pmb {\tau }}$$, and $${\pmb {\nu }}/{\pmb {\tau }}: \mu$$ is the skew $$(r+1)$$-multipartition obtained from $${\pmb {\nu }}/{\pmb {\tau }}$$ by appending $$\mu$$.

Each step in the proof uses either an explicit bijection or a sign-reversing involution on suitable sets of tableaux. The critical step uses a special case of a rule for multiplying a Schur function by the plethysm $$h_\alpha \,\circ \, p_r$$, where $$h_\alpha$$ is the complete symmetric function for a composition $$\alpha$$. This rule was first proved in [3, page 29] and is stated here as Proposition 2.3. A reader familiar with the basic results on symmetric functions and willing to assume this rule should find the proof largely self-contained. In particular, we do not assume the Littlewood–Richardson rule. We show, in Sect. 6.1, that two versions of the Littlewood–Richardson rule follow from Theorem 1.1 by setting $$r=1$$ and taking either $$\tau$$ or $$\mu$$ to be the empty partition. The penultimate step in our proof is (12), which restates Theorem 1.1 in a form free from explicit Littlewood–Richardson coefficients. In Sect. 6.2, we discuss the connections with other combinatorial rules for plethysms of the type in Theorem 1.1, including the domino tableaux rule for $$s_\tau (s_\lambda \circ p_2)$$ proved in .

An earlier proof of both the Littlewood–Richardson rule and the SXP rule, as stated in (1), was given by Remmel and Shimozono in , using an involution on semistandard skew tableaux defined by Lascoux and Schützenberger in . The proof given here uses the generalization of this involution to tuples of semistandard tableaux of skew shape. We include full details to make the paper self-contained, while admitting that this generalization is implicit in  and , since, as illustrated after Example 3.3, a tuple of skew tableaux may be identified (in a slightly artificial way) with a single skew tableau. The significant departure from the proof in  is that we replace monomial symmetric functions with complete symmetric functions. This dualization requires different ideas. It appears to offer some simplifications, as well as leading to a more general result.

The plethysm operation $$\circ$$ is defined in [12, §2.3], or, with minor changes in notation, in [14, I.8], [18, A2.6]. For plethysms of the form $$f \circ p_r$$, the definition can be given in a simple way: write f as a formal infinite sum of monomials in the variables $$x_1, x_2, \ldots$$ and substitute $$x_i^r$$ for each $$x_i$$ to obtain $$f \circ p_r$$. For example, $$s_{(2)} \circ p_2 = x_1^4 + x_2^4 + x_3^4 + \cdots + x_1^2x_2^2 + x_1^2x_3^2 + x_2^2x_3^2 + \cdots = s_{(4)} - s_{(3,1)} + s_{(2,2)}$$. By [12, page 167, P1], $$f \circ p_r = p_r \circ f$$; several of the formulae that we use are stated in the literature in this equivalent form.

Outline

The necessary background results on quotients of skew partitions and ribbon tableaux are given in Sect. 2, where we also recall the plethystic Murnaghan–Nakayama rule and the Jacobi–Trudi formula. In Sect. 3, we give a generalization of the Lascoux–Schützenberger involution and define the generalized Littlewood–Richardson coefficients appearing in Theorem 1.1. The proof of Theorem 1.1 is then given in Sect. 4. An example is given in Sect. 5. Further examples and connections with other combinatorial rules are given in Sect. 6. In particular, we deduce the Littlewood–Richardson rule as stated in [5, Definition 16.1] and, originally, in [10, Theorem III]. In the appendix, we prove a ‘shape–content’ involution that implies the version of the Littlewood–Richardson rule proved in . We also prove a technical result motivating Conjecture 6.7.

2 Prerequisites on r-Quotients, Ribbons, and Tableaux

We assume that the reader is familiar with partitions, skew partitions, and border strips, as defined in [18, Chapter 7]. Fix $$r \in \mathbb {N}$$ throughout this section. We represent partitions using an r-runner abacus, as defined in [6, page 78], on which the number of beads is always a multiple of r; the r-quotient of a partition is then unambiguously defined by [6, 2.7.29] (see Sect. 6.2 for a remark on this convention). The further unnumbered definitions below are taken from [3, page 28], [4, §3], and [17, §3], and are included to make this note self-contained.

Signs and Quotients of Skew Partitions

Let $$n \in \mathbb {N}_0$$ and let $$\nu /\tau$$ be a skew partition of rn. We say that $$\nu / \tau$$ is r-decomposable if there exist partitions
\begin{aligned} \tau = \sigma ^{(0)} \subset \sigma ^{(1)} \subset \cdots \subset \sigma ^{(n)} = \nu , \end{aligned}
such that $$\sigma ^{(j)}/\sigma ^{(j-1)}$$ is a border strip of size r (also called an r-border strip) for each $$j \in \{1,\ldots ,n\}$$. In this case, we define the r-sign of $$\nu /\tau$$ by
\begin{aligned} {{\mathrm{sgn}}}_r(\nu /\tau ) = \prod _{j=1}^n (-1)^{{{\mathrm{ht}}}(\sigma ^{(j)}/\sigma ^{(j-1)})}. \end{aligned}
Here, $${{\mathrm{ht}}}(\sigma ^{(j)}/\sigma ^{(j-1)})$$ is the height of the border strip $$\sigma ^{(j)}/\sigma ^{(j-1)}$$, defined to be one less than the number of rows of $$\sigma ^{(j)}$$ that it meets. By [6, 2.7.26] or [20, Proposition 3], this definition is independent of the choice of the $$\sigma ^{(j)}$$. If $$\nu /\tau$$ is not r-decomposable, we set $${{\mathrm{sgn}}}_r(\nu /\tau ) = 0$$.

If $$\nu / \tau$$ is r-decomposable, then it is possible to obtain an abacus for $$\nu$$ by starting with an abacus for $$\tau$$ and making n single-step downward bead moves; that is, moves of a bead in a position $$\beta$$ to position $$\beta + r$$. It follows that, if $${\bigl ( \nu (0), \ldots , \nu (r-1) \bigr )}$$ is the r-quotient of $$\nu$$ and $$\bigl ( \tau (0), \ldots , \tau (r-1) \bigr )$$ is the r-quotient of $$\tau$$, then $$\nu (i) / \tau (i)$$ is a skew partition for each i. We define the r-quotient of $$\nu / \tau$$, denoted $${\pmb {\nu }}/{\pmb {\tau }}$$, to be the skew r-multipartition $$\bigl ( \nu (0) / \tau (0), \ldots , \nu (r-1) / \tau (r-1) \bigr )$$. Conversely, the pair $$({\pmb {\nu }}/{\pmb {\tau }}, \tau )$$ determines $$\nu$$.

Definition 2.1

Let $$\tau$$ be a partition with r-quotient $${\pmb {\tau }}= \bigl ( \tau (0), \ldots , \tau (r-1) \bigr )$$. Let $${\pmb {\nu }}/ {\pmb {\tau }}$$ be a skew r-multipartition of n. We define $$({\pmb {\nu }}/{\pmb {\tau }}, \tau )^\star$$ to be the unique partition $$\nu$$, such that $$\nu /\tau$$ is a skew partition of rn with r-quotient $${\pmb {\nu }}/{\pmb {\tau }}$$.

Working with abaci with 6 beads, we have $$\bigl ( \bigl ( (1), \varnothing , (2,1) / (1) \bigr ), (3,2) \bigr )^\star = (6,5,2,1)$$, as shown in Fig. 1, $$\bigl ( \bigl ( (1), \varnothing , (2,1) / (1) \bigr ), (3) \bigr )^\star = (6,2,2,2)$$ and $$\bigl ( \bigl ( (1), (2), (1) / (1) \bigr ),$$ $$(3,2) \bigr )^\star = (4,4,4,1,1)$$. Here, we use the convention that a skew partition $$\nu / \varnothing$$ is written simply as $$\nu$$.

Ribbons

Let $$\nu / \sigma$$ be a border strip in the partition $$\nu$$. If row a is the least numbered row of $$\nu$$ meeting $$\nu / \sigma$$, then we say that $$\nu / \sigma$$ has row number a and write $$R(\nu / \sigma ) = a$$. Let $$r \in \mathbb {N}$$ and $$q \in \mathbb {N}_0$$. A skew partition $$\nu / \tau$$ of rq is a horizontal r-ribbon strip if there exist partitions:
\begin{aligned} \tau = \sigma ^{(0)} \subset \sigma ^{(1)} \subset \cdots \subset \sigma ^{(q)} = \nu , \end{aligned}
(2)
such that $$\sigma ^{(j)}/\sigma ^{(j-1)}$$ is an r-border strip for each $$j \in \{1,\ldots ,q\}$$ and
\begin{aligned} R(\sigma ^{(1)} / \sigma ^{(0)}) \ge \cdots \ge R(\sigma ^{(q)} / \sigma ^{(q-1)}). \end{aligned}
(3)
For examples, see Fig. 1 above and Fig. 3 in Sect. 5. Fig. 1 The skew partition (6, 5, 2, 1) / (3, 2) is a horizontal 3-ribbon strip of size 9, with $$\sigma ^{(1)} = (3,2,2,1)$$ and $$\sigma ^{(2)} = (4,4,2,1)$$. The border strip $$\sigma ^{(i)}/\sigma ^{(i-1)}$$ is marked i; the row numbers are 3, 1, and 1, in increasing order of i. The corresponding bead moves on an abacus representing (3, 2) are shown; note that these satisfy the condition in Lemma 2.2(ii). The 3-quotient of (6, 5, 2, 1) / (3, 2) is $$\bigl ( (1), \varnothing , (2,1) / (1) \bigr )$$, and so, $$\bigl ( \bigl ( (1), \varnothing , (2,1) / (1) \bigr ), (3,2) \bigr )^\star = (6,5,2,1)$$

The following lemma, which is used implicitly in , is needed in the proof of Theorem 1.1. Informally, (iii) says that the border strips forming a horizontal r-ribbon strip are uniquely determined by its shape. Note also that (iv) explains the sense in which horizontal r-ribbon strips are ‘horizontal’.

Lemma 2.2

Let $$q \in \mathbb {N}_0$$ and let $$\nu / \tau$$ be a skew partition of rq. The following are equivalent:
1. (i)

$$\nu / \tau$$ is a horizontal r-ribbon strip;

2. (ii)
if A is an abacus representing $$\tau$$, then, for each $$i \in \{0,1,\ldots ,r-1\}$$, there exists $$c \in \mathbb {N}_0$$ and unique positions $$\beta _1, \ldots , \beta _{c}$$ and $$\gamma _1, \ldots , \gamma _{c}$$ on runner i of A with
\begin{aligned} \beta _ 1< \gamma _1< \cdots< \beta _{c} < \gamma _{c}, \end{aligned}
such that moving the bead in position $$\beta _j$$ down to the space in position $$\gamma _j$$, for each $$j \in \{1,\ldots ,c\}$$ and $$i \in \{0,1,\ldots ,r-1\}$$, gives an abacus representing $$\nu$$;

3. (iii)

there exist unique partitions $$\sigma ^{(0)}, \ldots , \sigma ^{(q)}$$ satisfying (2) and (3);

4. (iv)

each skew partition $$\nu (i)/\tau (i)$$ in the r-quotient of $$\nu /\tau$$ has at most one box in each column of its Young diagram.

Proof

Let A be an abacus representing $$\tau$$. If $$\beta$$ is a position in A containing a bead, then the row number of the r-border strip corresponding to a single-step downward move of this bead is one more than the number of beads in the positions $$\{ \beta +r+j : j \in \mathbb {N}\}$$ of A. Thus, a sequence of single-step downward bead moves, moving beads in positions $$\beta _1, \ldots , \beta _{c}$$ in that order, adds r-border strips in decreasing order of their row number, as required by (3), if and only if $$\beta _1 \le \cdots \le \beta _c$$. It follows that (i) and (ii) are equivalent. It is easily seen that (ii) is equivalent to (iii) and (iv). $$\square$$

Ribbon Tableaux

Let $$n \in \mathbb {N}_0$$. Let $$\nu /\tau$$ be a skew partition of rn and let $$\alpha$$ be a composition of n with exactly $$\ell$$ parts. An r-ribbon tableau of shape $$\nu /\tau$$ and weight $$\alpha$$ is a sequence of partitions:
\begin{aligned} \tau = \rho ^{(0)} \subset \rho ^{(1)} \subset \cdots \subset \rho ^{(\ell )} = \nu , \end{aligned}
(4)
such that $$\rho ^{(j)}/\rho ^{(j-1)}$$ is a horizontal r-ribbon strip of size $$r\alpha _j$$ for each $$j \in \{1,\ldots ,\ell \}$$. We say that $$\rho ^{(j)}/\rho ^{(j-1)}$$ has label j. We denote the set of all r-ribbon tableaux of shape $$\nu /\tau$$ and weight $$\alpha$$ by $$\text {r-}\mathrm {RT}(\nu /\tau ,\alpha )$$. For example, see Sect. 5.

A Plethystic Murnaghan–Nakayama Rule

In the second step of the proof of Theorem 1.1, we need the following combinatorial rule. Recall that $$h_\alpha$$ denotes the complete symmetric function for the composition $$\alpha$$.

Proposition 2.3

Let $$n \in \mathbb {N}_0$$. If $$\alpha$$ is a composition of n and $$\tau$$ is a partition, then
\begin{aligned} s_\tau (h_\alpha \circ p_r) = \sum _{\nu } \bigl | \text {r-}\mathrm {RT}(\nu /\tau ,\alpha ) \bigr | {{\mathrm{sgn}}}_r(\nu /\tau ) s_\nu , \end{aligned}
where the sum is over all partitions $$\nu$$, such that $$\nu /\tau$$ is a skew partition of rn.

This rule was first proved in [3, page 29], using Muir’s rule . For an involutive proof of Muir’s rule, see [11, Theorem 6.1]. The special case when $$\tau = \varnothing$$ and $$\alpha$$ has a single part is proved in [14, I.8.7]. In this case, the result also follows from the algorithm of Chen, Garsia and Remmel as presented in [2, page 130]. The special case when $$\alpha$$ has a single part was proved by the author in  using a sign-reversing involution. The general case then follows easily by induction, using that $$h_{(\alpha _1,\ldots ,\alpha _\ell )} \circ p_r = (h_{\alpha _1} \circ p_r) \cdots (h_{\alpha _\ell } \circ p_r)$$.

The Jacobi–Trudi Formula

Let $$\ell \in \mathbb {N}$$. The symmetric group $${{\mathrm{Sym}}}_\ell$$ acts on $$\mathbb {Z}^\ell$$ by place permutation. Given $$\alpha \in \mathbb {Z}^\ell$$ and $$g \in {{\mathrm{Sym}}}_\ell$$, we define $$g \cdot \alpha = g (\alpha + \rho ) - \rho$$, where $$\rho = (\ell -1,\ldots ,1,0)$$. For later use, we note that, if $$k \in \{1,\ldots ,\ell -1\}$$, then
\begin{aligned} (k,k+1) \cdot \alpha = (\alpha _1, \ldots , \alpha _{k+1}-1,\alpha _k+1,\ldots , \alpha _\ell ), \end{aligned}
(5)
where the entries in the middle are in positions k and $$k+1$$.
The Jacobi–Trudi formula states that, if $$\lambda$$ is a partition with exactly $$\ell$$ parts and $$\lambda / \mu$$ is a skew partition, then
\begin{aligned} s_{\lambda /\mu } = \sum _{g \in {{\mathrm{Sym}}}_\ell } {{\mathrm{sgn}}}(g) h_{g \cdot \lambda - \mu }, \end{aligned}
where if $$\alpha$$ has a strictly negative entry, then we set $$h_\alpha = 0$$. A proof of the formula is given in [18, page 342] by a beautiful involution on certain tuples of paths in $$\mathbb {Z}^2$$.

3 A Generalized Lascoux–Schützenberger Involution

We begin by presenting the coplactic maps in [13, §5.5]. For further background, see . Let w be a word with entries in $$\mathbb {N}$$ and let $$k \in \mathbb {N}$$. Following the exposition in , we replace each k in w with a right-parenthesis ‘)’ and each $$k+1$$ with a left-parenthesis ‘(’. An entry k or $$k+1$$ is k-paired if its parenthesis has a pair, according to the usual rules of bracketing, and otherwise k-unpaired. Equivalently, reading w from left to right, an entry k is k-unpaired if and only if it sets a new record for the excess of ks over $$(k+1)$$s; dually, reading from right to left, an entry $$k+1$$ is k-unpaired if and only if it sets a new record for the excess of $$(k+1)$$s over ks. We may omit the ‘k-’ if it will be clear from the context.

For example, if $$w = 342$$ 2 243312311, then the 2-unpaired entries are shown in bold and the corresponding parenthesised word is (4)) )4((1)(11.

Lemma 3.1

Let w be a word with entries in $$\mathbb {N}$$. Let $$k \in \mathbb {N}$$. The subword of w formed from its k-unpaired entries is $$k^c (k+1)^d$$ for some c, $$d \in \mathbb {N}_0$$. Changing this subword to $$k^{c'}\,(k+1)^{d'}$$, where $$c'$$, $$d'\ \in \mathbb {N}_0$$ and $$c'+d'=c+d$$, while keeping all other positions the same gives a new word which has k-unpaired entries in exactly the same positions as w.$$\square$$

Proof

It is clear that any k to the right of the rightmost unpaired $$k+1$$ in w is paired. Dually, any $$k+1$$ to the left of the leftmost unpaired k in w is paired. Hence, the subword of w formed from its unpaired entries has the claimed form. When $$d \ge 1$$, changing the unpaired subword from $$k^c (k+1)^d$$ to $$k^{c+1}(k+1)^{d-1}$$ replaces the first unpaired $$k+1$$, in position i say, with a k; since every $$k+1$$ to the left of position i is paired, the new k is unpaired. The dual result holds when $$c \ge 1$$; together, these imply the lemma. $$\square$$

Definition 3.2

Let w be a word with entries from $$\mathbb {N}$$. Suppose that the k-unpaired subword of w is $$k^c(k+1)^d$$. If $$d > 0$$, let $$E_k(w)$$ be defined by changing the subword to $$k^{c+1}(k+1)^{d-1}$$, and if $$c > 0$$, let $$F_k(w)$$ be defined by changing the subword to $$k^{c-1}(k+1)^{d+1}$$. Let $$S_k(w)$$ be defined by changing the subword to $$k^d(k+1)^c$$.

We now extend these maps to tuples of skew tableaux. Let $$\mathrm {cont}(t)$$ denote the content of a skew tableau t, and let $$\mathrm {w}(t)$$ denote its word, obtained by reading the rows of t from left to right, starting at the highest numbered row. Let $$m \in \mathbb {N}$$ and let $${\pmb {\sigma }}/{\pmb {\tau }}= \bigl (\sigma (1)/\tau (1), \ldots , \sigma (m)/\tau (m)\bigr )$$ be a skew m-multipartition of $$n \in \mathbb {N}$$. Let $$\ell \in \mathbb {N}$$ and let $$\alpha \in \mathbb {Z}^\ell$$. Let $$\mathbf {SSYT}({\pmb {\sigma }}/{\pmb {\tau }},\alpha )$$ denote the set of all m-tuples $$\bigl ( t(1),\ldots ,t(m)\bigr )$$ of semistandard skew tableaux, such that t(i) has shape $$\sigma (i)/\tau (i)$$ for each $$i \in \{1,\ldots ,m\}$$ and
\begin{aligned} \mathrm {cont}\bigl (t(1)\bigr ) + \cdots + \mathrm {cont}\bigl (t(m)\bigr ) = \alpha . \end{aligned}
(6)
Thus, if $$\alpha$$ fails to be a composition, because it has a negative entry, then $$\mathbf {SSYT}({\pmb {\sigma }}/{\pmb {\tau }},\alpha ) = \varnothing$$. We call the elements of $$\mathbf {SSYT}({\pmb {\sigma }}/{\pmb {\tau }}, \alpha )$$ semistandard skew m-multitableaux of shape $${\pmb {\sigma }}/{\pmb {\tau }}$$, or m-multitableaux for short. The word of an m-multitableau $$\bigl (t(1),\ldots ,t(m)\bigr )$$ $$\in \mathbf {SSYT}({\pmb {\sigma }}/{\pmb {\tau }},\alpha )$$ is the concatenation $$\mathrm {w}\bigl (t(1)\bigr ) \cdots \mathrm {w}\bigl (t(m)\bigr )$$. For $$k \in \mathbb {N}$$, we say that an entry of an m-multitableau $$\mathbf {t}$$ is k-paired if the corresponding entry of $$\mathrm {w}(\mathbf {t})$$ is k-paired. Note that, for fixed $${\pmb {\sigma }}/{\pmb {\tau }}$$, a word w of length n and content $$\alpha$$ uniquely determines an m-multitableau (not necessarily semistandard) of shape $${\pmb {\sigma }}/{\pmb {\tau }}$$ satisfying (6); we denote this multitableau by $$\mathrm {T}(w)$$. The skew m-multipartition $${\pmb {\sigma }}/{\pmb {\tau }}$$ will always be clear from the context. Abusing notation slightly, we set $$E_k(\mathbf {t}) = \mathrm {T}\bigl ( E_k(\mathrm {w}(\mathbf {t}))\bigr )$$, $$F_k(\mathbf {t}) = \mathrm {T}\bigl ( F_k(\mathrm {w}(\mathbf {t}))\bigr )$$ (in each case, when either is defined) and $$S_k(\mathbf {t}) = \mathrm {T}\bigl ( S_k(\mathrm {w}(\mathbf {t}))\bigr )$$.

Example 3.3

Consider the semistandard skew 3-multitableau:
The shape of $$\mathbf {t}$$ is $$\bigl ( (3,2), (3,2,1) /(1), (2) \bigr )$$ and the 2-unpaired entries are shown in bold. By Definition 3.2$$E_2(\mathbf {t})$$ is obtained from $$\mathbf {t}$$ by changing the leftmost unpaired 3 to a 2, and $$F_2(\mathbf {t})$$ is obtained from $$\mathbf {t}$$ by changing the rightmost unpaired 2 to a 3. It follows that
As mentioned in the introduction, one may identify a skew m-multitableau with a single skew tableau of larger shape. For example, the semistandard skew 3-multitableau $$\mathbf {t}$$ above corresponds to
This identification may be used to reduce the next two results to Proposition 4 and the argument in §3 of . We avoid it in this paper, since it has an artificial flavour and loses combinatorial data: for instance, the skew tableau above may also be identified with two different semistandard skew 2-multitableaux.

Lemma 3.4

Let $$m \in \mathbb {N}$$, let $${\pmb {\sigma }}/{\pmb {\tau }}$$ be a skew m-multipartition of $$n \in \mathbb {N}_0$$, and let $$\alpha$$ be a composition with exactly $$\ell$$ parts. Fix $$k \in \{1,\ldots ,\ell -1\}$$. Let $$\mathbf {SSYT}_k({\pmb {\sigma }}/{\pmb {\tau }},\alpha )$$ and $$\mathbf {SSYT}_{k+1}({\pmb {\sigma }}/{\pmb {\tau }},\alpha )$$ be the sets of m-multitableaux in $$\mathbf {SSYT}({\pmb {\sigma }}/{\pmb {\tau }},\alpha )$$ that have a k-unpaired k or a k-unpaired $$k+1$$, respectively. Let
\begin{aligned} \varepsilon (k) = (0,\ldots , 1, -1,\ldots ,0) \in \mathbb {Z}^\ell , \end{aligned}
where the two non-zero entries are in positions k and $$k+1$$. The maps
\begin{aligned} E_k&: \mathbf {SSYT}_{k+1}({\pmb {\sigma }}/{\pmb {\tau }},\alpha ) \rightarrow \mathbf {SSYT}_k\bigl ( {\pmb {\sigma }}/{\pmb {\tau }},\alpha +\varepsilon (k) \bigr ) \\ F_k&: \mathbf {SSYT}_k({\pmb {\sigma }}/{\pmb {\tau }},\alpha ) \rightarrow \mathbf {SSYT}_{k+1}\bigl ( {\pmb {\sigma }}/{\pmb {\tau }},\alpha -\varepsilon (k) \bigr ) \\ S_k&: \mathbf {SSYT}_k({\pmb {\sigma }}/{\pmb {\tau }},\alpha ) \rightarrow \mathbf {SSYT}_{k+1}\bigl ( {\pmb {\sigma }}/{\pmb {\tau }},(k,k+1)\alpha \bigr ) \end{aligned}
are bijections and $$S_kE_k : \mathbf {SSYT}_{k+1}({\pmb {\sigma }}/{\pmb {\tau }},\alpha ) \rightarrow \mathbf {SSYT}_{k+1}({\pmb {\sigma }}/{\pmb {\tau }}, (k,k+1) \cdot \alpha )$$ is an involution.

Proof

Let $$\mathbf {t} = \bigl (t(1),\ldots ,t(m)\bigr ) \in \mathbf {SSYT}({\pmb {\sigma }}/{\pmb {\tau }},\alpha )$$. The main work comes in showing that $$E_k(\mathbf {t})$$, $$F_k(\mathbf {t})$$ are semistandard (when defined). Suppose that $$E_k(\mathbf {t}) = \bigl (t'(1),\ldots ,t'(m)\bigr )$$ and that the first unpaired $$k+1$$ in $$\mathrm {w}(\mathbf {t})$$ corresponds to the entry in row a and column b of tableau t(j). Thus, $$t'(j)$$ is obtained from t(j) by changing this entry to an unpaired k and $$t'(i) = t(i)$$ if $$i\not =j$$.

Let $$t = t(j)$$, let $$t' = t'(j)$$, and write $$u_{(a,b)}$$ for the entry of a tableau u in row a and column b. If $$t'$$ fails to be semistandard, then $$a > 1$$, $$(a-1,b)$$ is a box in t, and $$t'_{(a-1,b)} = k$$. Hence, $$t_{(a-1,b)} = k$$. This k is to the right of the unpaired $$k+1$$ in $$\mathrm {w}(t)$$, so by Lemma 3.1, it is paired, necessarily with a $$k+1$$ in row a and some column $$b' > b$$ of t. Since
\begin{aligned} k = t_{(a-1,b)} \le t_{(a-1,b')} < t_{(a,b')} = k+1, \end{aligned}
we have $$t_{(a-1,b')} = k$$. Thus, $$t_{(a,e)} = k+1$$ and $$t_{(a-1,e)} = k$$ for every $$e \in \{b,\ldots , b'\}$$. Since $$t_{(a-1,b)}$$ is paired with $$t_{(a,b')}$$ under the k-pairing, we see that $$t_{(a-1,b+j)}$$ is paired with $$t_{(a,b'-j)}$$ for each $$j \in \{0,\ldots , b'-b\}$$. In particular, the $$k+1$$ in position (ab) of t is paired, a contradiction. Hence, $$E_k( \mathbf {t})$$ is semistandard. The proof is similar for $$F_k$$ in the case when $$\mathbf {t}$$ has an unpaired k.

It is now routine to check that $$E_kF_k$$ and $$F_kE_k$$ are the identity maps on their respective domains, so $$E_k$$ and $$F_k$$ are bijective. If the unpaired subword of $$\mathrm {w}(\mathbf {t})$$ is $$k^c (k+1)^d$$, then $$S_k(\mathbf {t}) = E_k^{d-c}(\mathbf {t})$$ if $$d \ge c$$ and $$S_k(\mathbf {t}) = F_k^{c-d}(\mathbf {t})$$ if $$c \ge d$$. Hence, $$S_k$$ is an involution. A similar argument shows that $$S_k E_k$$ is an involution. By (5) at the end of Sect. 2, the image of $$S_kE_k$$ is as claimed. $$\square$$

We are ready to define our key involution. We say that a semistandard skew multitableau $$\mathbf {t}$$ is latticed if $$\mathrm {w}(\mathbf {t})$$ has no k-unpaired $$(k+1)$$s, for any k. Let $$\lambda$$ be a partition of $$n \in \mathbb {N}_0$$ with exactly $$\ell$$ parts, let $${\pmb {\sigma }}/{\pmb {\tau }}$$ be a skew m-multipartition of n, and let
\begin{aligned} \mathcal {T} = \bigcup _{g \in {{\mathrm{Sym}}}_\ell } \mathbf {SSYT}({\pmb {\sigma }}/{\pmb {\tau }}, g \cdot \lambda ). \end{aligned}
(7)
Observe that, if $$g\not = \mathrm {id}_{{{\mathrm{Sym}}}_\ell }$$, then $$g \cdot \lambda$$ is not a partition, and so no element of $$\mathbf {SSYT}({\pmb {\sigma }}/{\pmb {\tau }}, g \cdot \lambda )$$ is latticed. Therefore, the set
\begin{aligned} \mathbf {SSYTL}({\pmb {\sigma }}/{\pmb {\tau }}, \lambda ) = \bigl \{ \mathbf {t} \in \mathbf {SSYT}({\pmb {\sigma }}/{\pmb {\tau }}, \lambda ) : \mathbf {t}\text { is latticed} \bigr \} \end{aligned}
is precisely the latticed elements of $$\mathcal {T}$$. Let $$\mathbf {t} \in \mathcal {T}$$. If $$\mathbf {t}$$ is latticed, then define $$G(\mathbf {t}) = \mathbf {t}$$. Otherwise, consider the k-unpaired $$(k+1)$$s in $$\mathrm {w}(\mathbf {t})$$ for each $$k \in \mathbb {N}$$. If the rightmost such entry is a k-unpaired $$k+1$$, then define $$G(\mathbf {t}) = S_kE_k(\mathbf {t})$$.

For instance, in Example 3.3, we have $$k=2$$ and $$G(\mathbf {t}) = S_2E_2(\mathbf {t})$$.

Proposition 3.5

Let $$m \in \mathbb {N}$$, let $${\pmb {\sigma }}/{\pmb {\tau }}$$ be a skew m-multipartition of $$n \in \mathbb {N}_0$$, and let $$\lambda$$ be a partition of n. Let $$\mathcal {T}$$ be as defined in (7). The map $$G : \mathcal {T} \rightarrow \mathcal {T}$$ is an involution fixing precisely the skew m-multitableaux in $$\mathbf {SSYTL}({\pmb {\sigma }}/{\pmb {\tau }},\lambda )$$. If $$\mathbf {t} \in \mathbf {SSYT}({\pmb {\sigma }}/{\pmb {\tau }}, g\cdot \lambda )$$ and $$G(\mathbf {t}) \not = \mathbf {t}$$, then $$G(\mathbf {t}) \in \mathbf {SSYT}({\pmb {\sigma }}/{\pmb {\tau }}, (k,k+1)g \cdot \lambda )$$ for some $$k \in \{1,\ldots , \ell -1\}$$.

Proof

This follows immediately from Lemma 3.4. $$\square$$

This is a convenient place to define our generalized Littlewood–Richardson coefficients. In Sect. 6.1, we show that these coefficients specialize to the original definition.

Definition 3.6

The Littlewood–Richardson coefficient corresponding to a partition $$\lambda$$ of n and a skew m-multipartition $${\pmb {\sigma }}/{\pmb {\tau }}$$ of n is
\begin{aligned} c^{\lambda }_{{\pmb {\sigma }}/{\pmb {\tau }}} = |\mathbf {SSYTL}({\pmb {\sigma }}/{\pmb {\tau }},\lambda )|. \end{aligned}

4 Proof of Theorem 1.1

Suppose that $$\lambda$$ has exactly $$\ell$$ parts. The outline of the proof is as follows:
\begin{aligned}&s_\tau (s_{\lambda / \mu } \circ p_r) \end{aligned}
(8)
\begin{aligned}&\quad = \sum _{g \in {{\mathrm{Sym}}}_\ell } \!{{\mathrm{sgn}}}(g) s_\tau (h_{g \cdot \lambda - \mu } \circ p_r) \end{aligned}
(9)
\begin{aligned}&\quad = \sum _{g \in {{\mathrm{Sym}}}_\ell } \!{{\mathrm{sgn}}}(g) \sum _{\nu } \bigl | \text {r-}\mathrm {RT}(\nu /\tau , g \cdot \lambda - \mu ) \, \bigr | {{\mathrm{sgn}}}_r(\nu /\tau ) s_\nu \end{aligned}
(10)
\begin{aligned}&\quad = \sum _{g \in {{\mathrm{Sym}}}_\ell } \!{{\mathrm{sgn}}}(g) \sum _{{\pmb {\nu }}} \bigl | \mathbf {SSYT}({\pmb {\nu }}/{\pmb {\tau }}, g \cdot \lambda - \mu ) \, \bigr | {{\mathrm{sgn}}}_r\bigl ( ({\pmb {\nu }}/{\pmb {\tau }}, \tau )^\star \bigr ) s_{({\pmb {\nu }}/{\pmb {\tau }}, \tau )^\star } \end{aligned}
(11)
\begin{aligned}&\quad = \sum _{{\pmb {\nu }}} \bigl | \mathbf {SSYTL}\bigl ( {\pmb {\nu }}/{\pmb {\tau }}: \mu , \lambda \bigr ) \bigr | {{\mathrm{sgn}}}_r\bigl ( ({\pmb {\nu }}/{\pmb {\tau }}, \tau )^\star \bigr ) s_{({\pmb {\nu }}/{\pmb {\tau }}, \tau )^\star } \end{aligned}
(12)
\begin{aligned}&\quad = \sum _{{\pmb {\nu }}} c^\lambda _{{\pmb {\nu }}/{\pmb {\tau }}\,: \,\mu } {{\mathrm{sgn}}}_r\bigl ( ({\pmb {\nu }}/{\pmb {\tau }}, \tau )^\star \bigr ) s_{({\pmb {\nu }}/{\pmb {\tau }}, \tau )^\star }, \end{aligned}
(13)
where the sum in (10) is over all partitions $$\nu$$, such that $$\nu /\tau$$ is a skew partition of rn, the sums in (11) and (12) are over all r-multipartitions $${\pmb {\nu }}$$, such that $${\pmb {\nu }}/ {\pmb {\tau }}$$ is a skew r-multipartition of n, and in (12) and (13), $${\pmb {\nu }}/{\pmb {\tau }}: \mu$$ is the skew $$(r+1)$$-multipartition $$\bigl (\nu (0)/\tau (0),\ldots ,\nu (r-1)/\tau (r-1), \mu \bigr )$$ obtained from $${\pmb {\nu }}/{\pmb {\tau }}$$ by appending $$\mu$$.

We now give an explicit bijection or involution establishing each step. For an illustrative example, see Sect. 5 below.

Proof of (9). Apply the Jacobi–Trudi formula for skew Schur functions, as stated in Sect. 2. $$\square$$

Proof of (10). Apply Proposition 2.3 to each $$s_\tau (h_{g \cdot \lambda - \mu } \circ p_r)$$. $$\square$$

Proof of (11). Let T be an r-ribbon tableau of shape $$\nu /\tau$$ and weight $$\alpha$$ as in (4), so T corresponds to the sequence of partitions:
\begin{aligned} \tau = \rho ^{(0)} \subset \rho ^{(1)} \subset \cdots \subset \rho ^{(\ell )} = \nu , \end{aligned}
where $$\rho ^{(j)}/\rho ^{(j-1)}$$ is a horizontal r-ribbon strip of size $$r\alpha _j$$ for each $$j \in \{1,\ldots ,\ell \}$$. Let $$\nu /\tau$$ have r-quotient $${\pmb {\nu }}/{\pmb {\tau }}= \bigl (\nu (0)/\tau (0), \ldots , \nu (r-1)/\tau (r-1)\bigr )$$, so $$({\pmb {\nu }}/{\pmb {\tau }}, \tau )^\star = \nu$$. Take an abacus A representing $$\tau$$ with a multiple of r beads. The sequence above defines a sequence of single-step downward bead moves leading from A to an abacus B representing $$\nu$$. For each bead moved on runner i, put the label of the corresponding horizontal r-ribbon strip in the corresponding box of the Young diagram of $$\nu (i)/\tau (i)$$. By Lemma 2.2(iv), this defines a semistandard skew tableau t(i) of shape $$\nu (i)/\tau (i)$$ for each $$i \in \{0,\ldots ,r-1\}$$. Conversely, given $$\bigl ( t(0), \ldots , t(r-1)\bigr ) \in \mathbf {SSYT}({\pmb {\nu }}/{\pmb {\tau }}, \alpha )$$, one obtains a sequence of single-step downward bead moves satisfying the condition in Lemma 2.2(ii), and, hence, an r-ribbon tableau of shape $$\nu /\tau$$ and content $$\alpha$$. Thus, the map sending T to $$\bigl ( t(0), \ldots , t(r-1)\bigr )$$ is a bijection from $$\text {r-}\mathrm {RT}(\nu /\tau , g \cdot \lambda - \mu )$$ to $$\mathbf {SSYT}({\pmb {\nu }}/{\pmb {\tau }}, g \cdot \lambda - \mu )$$, as required. $$\square$$
Proof of (12). Fix a skew r-multipartition $${\pmb {\nu }}/{\pmb {\tau }}$$ of n. Let
\begin{aligned} \mathcal {T} = \bigcup _{g \in {{\mathrm{Sym}}}_\ell } \mathbf {SSYT}({\pmb {\nu }}/{\pmb {\tau }}: \mu , g \cdot \lambda ). \end{aligned}
Let G be the involution on $$\mathcal {T}$$ defined in Sect. 3. Let $$u(\mu )$$ be the semistandard $$\mu$$-tableau having all its entries in its jth row equal to j for each relevant j. Note that $$u(\mu )$$ is the unique latticed semistandard $$\mu$$-tableau. Thus, if
\begin{aligned} \mathcal {T}_\mu = \bigl \{ \bigl (t(0), \ldots , t(r-1), v \bigr ) \in \mathcal {T} : v = u(\mu )\bigr \}, \end{aligned}
(14)
then $$\mathbf {SSYTL}({\pmb {\nu }}/{\pmb {\tau }}: \mu , \lambda ) \subseteq \mathcal {T}_\mu$$. Let $$\mathbf {t} \in \mathcal {T}_\mu$$. The final $$|\mu |$$ positions of $$\mathrm {w}(\mathbf {t})$$ correspond to the entries of $$u(\mu )$$. Every entry $$k + 1$$ in these positions is k-paired. If an entry k in one of these positions is k-unpaired, then there is no k-unpaired $$k+1$$ to its left, so every $$k+1$$ in $$\mathrm {w}(\mathbf {t})$$ is k-paired. It follows that the final semistandard tableau in $$G(\mathbf {t})$$ is $$u(\mu )$$ and so G restricts to an involution on $$\mathcal {T}_\mu$$. By Proposition 3.5, the fixed-point set of G, acting on either $$\mathcal {T}$$ or $$\mathcal {T}_\mu$$, is $$\mathbf {SSYTL}({\pmb {\nu }}/{\pmb {\tau }}: \mu , \lambda )$$.
The part of the sum in (11) corresponding to the skew r-multipartition $${\pmb {\nu }}/{\pmb {\tau }}$$ is as follows:
\begin{aligned} \sum _{g \in {{\mathrm{Sym}}}_\ell }\, \sum _{\mathbf {t}\in \mathrm {SSYT}({\pmb {\nu }}/{\pmb {\tau }}, g \cdot \lambda - \mu )} {{\mathrm{sgn}}}(g){{\mathrm{sgn}}}_r\bigl ( ({\pmb {\nu }}/{\pmb {\tau }}, \tau )^\star \bigr ) s_{ ({\pmb {\nu }}/{\pmb {\tau }}, \tau )^\star }. \end{aligned}
The set of r-multitableaux $$\mathbf {t}$$ in this sum is $$\mathcal {S} = \bigcup _{g \in {{\mathrm{Sym}}}_\ell } \mathbf {SSYT}({\pmb {\nu }}/{\pmb {\tau }}, g \cdot \lambda -\mu )$$. There is an obvious bijection $$A : \mathcal {S} \rightarrow \mathcal {T}_\mu$$ given by appending $$u(\mu )$$ to a skew r-multitableau in $$\mathcal {S}$$. By the remarks above, $$A^{-1} G A$$ is an involution on $$\mathcal {S}$$. Since $${{\mathrm{sgn}}}(g) = - {{\mathrm{sgn}}}\bigl ( (k,k+1)g \bigr )$$, it follows from Proposition 3.5 that the contributions to (11) from r-multitableaux $$\mathbf {t} \in \mathcal {S}$$, such that $$A(\mathbf {t}) \not \in \mathbf {SSYTL}({\pmb {\nu }}/{\pmb {\tau }}: \mu , \lambda )$$ cancel in pairs, leaving exactly the r-multitableaux $$\mathbf {t}$$, such that $$A(\mathbf {t}) \in \mathbf {SSYTL}({\pmb {\nu }}/{\pmb {\tau }}: \mu , \lambda )$$. This proves (12). $$\square$$

Proof of (13). This is true by our definition of the Littlewood–Richardson coefficient $$c^\lambda _{{\pmb {\nu }}/{\pmb {\tau }}\,:\,\mu }$$. $$\square$$

5 Example

We illustrate (11) and (12) in the proof of Theorem 1.1. Let $$r=3$$, let $$\lambda = (3,3)$$, $$\mu = \varnothing$$ and $$\tau = (3,2)$$. Take $$\nu = (6,5,5,5,2)$$. From the abaci shown in Fig. 2, we see that $${\pmb {\nu }}/{\pmb {\tau }}= \bigl ( (1), (2), (2,2) / (1) \bigr )$$. We have $$(1,2)\cdot \lambda = (2,4)$$. The horizontal 3-ribbon tableaux of shape (6, 5, 5, 5, 2) and weights (3, 3) and (2, 4) are shown in Fig. 3. Applying the bijection Fig. 2 Abaci for (3, 2) and (6, 5, 5, 5, 2) Fig. 3 The four 3-ribbon tableau in 3-$$\mathrm {RT}\bigl ( (6,5,5,5,2)/(3,2),(3,3) \bigr )$$ and the corresponding 3-ribbon tableaux in 3-$$\mathrm {RT}\bigl ( (6,5,5,5,2)/(3,2), (2,4)\bigr )$$ under the G involution. The first tableaux in the top line is latticed, and so it is fixed by G. In each case, the ribbon with label i is marked i, and its unique partition into 3-border strips, as in (2), is shown by heavy lines
\begin{aligned} \text {3-}\mathrm {RT}\bigl ( (6,5,5,5,2)/(3,2), (3,3) \bigr ) \rightarrow \mathbf {SSYT}\bigl ( \bigl ( (1), (2), (2,2) / (1) \bigr ), (3,3) \bigr ) \end{aligned}
in the proof of (11), we obtain the 3-multitableauxin the order corresponding to the top line in Fig. 3. Here, $$\mathbf {t}_1$$ is latticed and $$\mathbf {t}_2$$, $$\mathbf {t}_3$$, $$\mathbf {t}_4$$ are not. Applying the involution G in Sect. 3 to $$\mathbf {t}_2$$, $$\mathbf {t}_3$$, $$\mathbf {t}_4$$, as in the proof of (12), we obtain the 3-multitableaux:
in the order corresponding to the bottom line in Fig. 3. As expected, these are the images of the three horizontal 3-ribbon tableaux of shape (6, 5, 5, 5, 2) and weight (2, 4) under the bijection:
\begin{aligned} \text {3-}\mathrm {RT}\bigl ( (6,5,5,5,2)/(3,2), (2,4) \bigr ) \rightarrow \mathbf {SSYT}\bigl ( \bigl ( (1), (2), (2,1) / (1) \bigr ), (2,4) \bigr ). \end{aligned}
Therefore, all but one of the seven summands in (11) is cancelled by G. Since $${{\mathrm{sgn}}}_3\bigl ( (6,5,5,5,2) / (3,2) \bigr ) = 1$$, we have $$\langle s_{(3,2)}(s_{(3,3)} \circ p_3), s_{(6,5,5,5,2)} \rangle = 1$$.
We now obtain $$\langle s_{(3,2)}(s_{(4,3)/(1)} \circ p_3), s_{(6,5,5,5,2)} \rangle$$ using the full generality of Theorem 1.1. Following the proof of (12), we append to each of the four 3-multitableaux in $$\mathbf {SSYT}\bigl ( \bigl ( (1), (2), (2,1) / (1) \bigr ), (3,3) \bigr )$$ before applying G. This gives three latticed 4-multitableaux:
all fixed by G, and one unlatticed 4-multitableau, obtained by appending  to $$\mathbf {t}_4$$; its image under G is given by
There are now five summands in (11), of which two are cancelled by G, and so, $$\langle s_{(3,2)}(s_{(4,3)/(1)} \circ p_3), s_{(6,5,5,5,2)} \rangle = 3$$. Alternatively, we can get the same result using (a very special case of) the Littlewood–Richardson rule to write $$s_{(4,3) / (1)} = s_{(4,2)} + s_{(3,3)}$$. From above, we have $$\langle s_{(3,2)}(s_{(3,3)} \circ p_3), s_{(6,5,5,5,2)} \rangle = 1$$, and since $$h_{(2,4)} = h_{(4,2)}$$, we have
\begin{aligned} \langle s_{(3,2)}(h_{(4,2)} \circ p_3), s_{(6,5,5,5,2)} \rangle = \bigl | \text {3-RT}\bigl ( (6,5,5,5,2), (2,4) \bigr ) \bigr | = 3. \end{aligned}
Since $$\bigl | \text {3-RT}\bigl ( (6,5,5,5,2), (1,5) \bigr ) \bigr | = 1$$, we get $$\langle s_{(3,2)}(s_{(4,3)/ (1)} \circ p_3), s_{(6,5,5,5,2)} \rangle = (4-3)+(3-1) = 3$$, as before. This extra cancellation suggests that the general form of the SXP rule in Theorem 1.1 may have some computational advantages.

6 Connections with Other Combinatorial Rules

6.1 Non-plethystic Rules

Let $$\mathrm {SSYT}(\nu /\tau , \lambda )$$ be the set of semistandard skew tableaux of shape $$\nu /\tau$$ and content $$\lambda$$. We say that a skew tableau t is latticed if the corresponding skew 1-multitableau (t) is latticed. Let $$\mathrm {SSYTL}(\nu /\tau ,\lambda )$$ be the set of latticed semistandard tableaux of shape $$\nu /\tau$$ and content $$\lambda$$.

Let $$\lambda / \mu$$ be a skew partition of $$n \in \mathbb {N}_0$$. Setting $$r=1$$ in Theorem 1.1, we obtain
\begin{aligned} s_\tau s_{\lambda / \mu } = \sum _\nu c^{\lambda }_{(\nu /\tau \,, \mu )} s_\nu , \end{aligned}
(16)
where the sum is over all partitions $$\nu$$, such that $$\nu /\tau$$ is a skew partition of n. For the remainder of this subsection, we usually rely on the context to make such summations clear. Specializing (16) further by setting $$\mu = \varnothing$$, we get
\begin{aligned} s_\tau s_\lambda = \sum _\nu c^{\lambda }_{(\nu /\tau )} s_\nu . \end{aligned}
(17)
By definition, $$c^{\lambda }_{(\nu /\tau )} = |\mathrm {SSYTL}(\nu /\tau ,\lambda )|$$. Thus, (17) is the original Littlewood–Richardson rule, as proved in [10, Theorem III].
Specializing (16) in a different way by setting $$\tau = \varnothing$$, and then, changing notation for consistency with (17), we get
\begin{aligned} s_{\nu /\tau } = \sum _{\lambda } c^\nu _{(\lambda ,\tau )} s_\lambda . \end{aligned}
(18)
By (17) and (18), we have
\begin{aligned} \begin{aligned} \langle s_\tau s_\lambda , s_\nu \rangle =c^{\lambda }_{(\nu /\tau )}&=|\mathrm {SSYTL}(\nu /\tau , \lambda )|\\&= |\mathbf {SSYTL}\bigl ( (\lambda , \tau ), \nu \bigr )| = c^\nu _{(\lambda ,\tau )} = \langle s_\lambda , s_{\nu /\tau } \rangle , \end{aligned} \end{aligned}
(19)
where the middle equality follows from Proposition 7.1 in the appendix. This gives a combinatorial proof of the fundamental adjointness relation for Schur functions. By (16) and this relation, we have $$\langle s_{\lambda /\mu }, s_{\nu /\tau } \rangle = c^{\lambda }_{(\nu /\tau ,\mu )}$$. If $$\mathbf {t}$$ is a latticed skew 2-multitableau of shape $$(\nu /\tau , \mu )$$, then, as seen in (14), $$\mathbf {t} = (t,u(\mu ))$$ for some $$\nu /\tau$$-tableau t. Thus
\begin{aligned} \langle s_{\nu /\tau }, s_{\lambda /\mu } \rangle = c^{\lambda }_{(\nu /\tau ,\mu )} = \bigl | \bigl \{ t \in \mathrm {SSYT}(\nu /\tau , \lambda - \mu ) : \bigl ( t,u(\mu ) \bigr )\text { is latticed} \bigr \} \bigr |. \end{aligned}
(20)
This is equivalent to the skew-skew Littlewood–Richardson rule proved in [17, §4]. The non-obvious equalities $$|\mathrm {SSYTL}(\nu /\tau ,\lambda )| = |\mathrm {SSYTL}(\nu /\lambda ,\tau )|$$ and $$\bigl |\mathbf {SSYTL}\bigl ( (\lambda ,\tau ), \nu \bigr )\bigr | = \bigl |\mathbf {SSYTL}\bigl ( (\tau ,\lambda ), \nu \bigr )\bigr |$$ are also corollaries of (19).

As a final exercise, we show that our definition of generalized Littlewood–Richardson coefficients is consistent with the algebraic generalization of (16) to arbitrary products of Schur functions.

Lemma 6.1

Let $$m \in \mathbb {N}$$. If $${\pmb {\nu }}/{\pmb {\tau }}$$ is a skew m-multipartition of $$n \in \mathbb {N}_0$$ and $$\lambda$$ is a partition of n, then
\begin{aligned} s_{\nu (1)/\tau (1)} \ldots s_{\nu (m)/\tau (m)} = \sum _{\lambda } c^{\lambda }_{{\pmb {\nu }}/{\pmb {\tau }}} s_\lambda , \end{aligned}
where the sum is over all partitions $$\lambda$$ of n.

Proof

By induction, the fundamental adjointness relation, and (20), we have
\begin{aligned}&\langle s_{\nu (1)/\tau (1)} s_{\nu (2)/\tau (2)} \cdots s_{\nu (m)/\tau (m)}, s_\lambda \rangle \\&\quad = \left\langle \sum _{\gamma } s_{\nu (1)/\tau (1)} c_{((\nu (2)/\tau (2), \ldots , \nu (m)/\tau (m))}^{\gamma } s_\gamma , s_\lambda \right\rangle \\&\quad = \sum _{\gamma } \left\langle s_{\nu (1)/\tau (1)}, s_{\lambda /\gamma } \right\rangle c_{((\nu (2)/\tau (2), \ldots , \nu (m)/\tau (m))}^{\gamma } \\&\quad = \sum _{\gamma } c_{(\nu (1)/\tau (1),\gamma )}^{\lambda } \, c_{((\nu (2)/\tau (2), \ldots , \nu (m)/\tau (m))}^{\gamma }, \end{aligned}
where the sums are over all partitions $$\gamma$$ of $$n-(|\nu (1)|-|\tau (1)|)$$. The right-hand side counts the number of pairs of semistandard skew multitableaux $$\bigl ( \bigl ( t, u(\gamma ) \bigr ), \mathbf {t}\bigr )$$, such that $$t \in \mathrm {SSYTL}(\nu (1)/\tau (1), \lambda -\gamma )$$ and
\begin{aligned} \mathbf {t} \in \mathbf {SSYTL}\bigl ( \bigl (\nu (2)/\tau (2),\ldots ,\nu (m)/\tau (m)\bigr ),\gamma \bigr ). \end{aligned}
Such pairs are in bijection with $$\mathbf {SSYTL}\bigl ( \bigl ( \nu (1)/\tau (1),\ldots ,\nu (m)/\tau (m)\bigr ),\lambda \bigr )$$ by the map sending $$\bigl ( \bigl ( t, u(\gamma ) \bigr ), \mathbf {t}\bigr )$$ to the concatenation $$(t : \mathbf {t})$$. The lemma follows.

$$\square$$

6.2 Plethystic Rules

By Theorem 1.1 and the fundamental adjointness relation, we have $$\langle s_{\lambda } \circ p_r, s_{\nu /\tau } \rangle = {{\mathrm{sgn}}}_r({\pmb {\nu }}/{\pmb {\tau }}) c^\lambda _{{\pmb {\nu }}/{\pmb {\tau }}}$$. Hence, by Lemma 6.1:
\begin{aligned} \langle s_{\lambda } \circ p_r, s_{\nu /\tau } \rangle = {\left\{ \begin{array}{ll} \langle s_\lambda , s_{\nu (0)/\tau (0)} \cdots s_{\nu (r-1)/\tau (r-1)} \rangle &{} \quad \text {if }\nu /\tau \text { is }r\text {-decomposable,}\\ 0 &{} \quad \text {otherwise.}\end{array}\right. } \end{aligned}
(21)
This adjointness relation was first proved in : for a more recent proof, see [3, after (39)]. It is, perhaps, a little surprising that (21) implies that the absolute value of the coefficient of $$s_{({\pmb {\nu }}/{\pmb {\tau }},\tau )^\star }$$ in $$s_\tau (s_\lambda \circ p_r)$$, namely $$c_{{\pmb {\nu }}/{\pmb {\tau }}}^\lambda = |\mathbf {SSYTL}({\pmb {\nu }}/{\pmb {\tau }}, \lambda )|$$, is the same for all r! permutations of the r-quotient $${\pmb {\nu }}/{\pmb {\tau }}$$.

Note that we obtain only a numerical equality: even cyclic permutations of skew r-multitableaux do not, in general, preserve the lattice property. For example, changing the abaci in Fig. 2 in Sect. 5, so that 7 beads are used to represent (3, 2) and (6, 5, 5, 5, 2) induces a rightward cyclic shift of the skew tableaux forming the skew 3-multitableaux $$\mathbf {t}_1, \mathbf {t}_2, \mathbf {t}_3, \mathbf {t}_4$$. After one or two such shifts, the unique latticed skew 3-multitableaux are the shifts of $$\mathbf {t}_3$$ and $$\mathbf {t}_2$$, respectively; $$\mathbf {t}_4$$ remains unlatticed after any number of shifts. The identification of $$\mathbf {t}_1$$ as the unique skew 3-multitableau contributing to the coefficient of $$s_{(6,5,5,5,2)}$$ in $$s_{(3,2)}(s_{(3,3)} \circ p_3)$$ is, therefore, canonical, but not entirely natural.

The author is aware of two combinatorial rules in the literature for special cases of the product $$s_\tau (s_\lambda \circ p_r)$$ that avoid this undesirable feature of the SXP rule. To state the first, which is due to Carré and Leclerc, we need a definition from . Let T be an r-ribbon tableau of shape $$\nu /\tau$$ and weight $$\lambda$$. Represent T, as in Fig. 3, by a tableau of shape $$\nu /\tau$$ in which the boxes of the $$\alpha _j$$ disjoint r-border strips forming the horizontal r-ribbon in T labelled j all contain j. The column word of T is the word of length n obtained by reading the columns of this tableau from bottom to top, starting at the leftmost (lowest numbered) column, and recording the label of each r-border strip when it is first seen, in its leftmost column.

Theorem 6.2

[1, Corollary 4.3]. Let $$r \in \mathbb {N}$$ and let $$n \in \mathbb {N}_0$$. Let $$\nu / \tau$$ be a skew partition of rn and let $$\lambda$$ be a partition of n. Up to the sign $${{\mathrm{sgn}}}_2(\nu /\tau )$$, the multiplicity $$\langle s_\tau (s_\lambda \circ p_2), s_\nu \rangle$$ is equal to the number of 2-ribbon tableaux T of shape $$\nu /\tau$$ and weight $$\lambda$$ whose column word is latticed.

For example, there are two 2-ribbon tableaux of shape (5, 5, 2, 2) / (3, 1) and content (3, 1, 1) having a latticed column word (see Fig. 4 above), and so, $$\langle s_{(3,1)}(s_{(3,1,1)} \circ p_2), s_{(5,5,2,2)} \rangle = 2$$. These correspond to the skew 2-multitableaux of shape $$\bigl ( (3,1)/(2), (2,1) \bigr )$$
respectively. Only the second is latticed in the multitableau sense. Fig. 4 Two 2-ribbon tableaux of shape (5, 5, 2, 2) / (3, 1) and content (3, 1, 1) whose column words, namely 13121 and 32111, are latticed

In Theorem 6.3 of , Evseev, Paget, and the author applied character theoretic arguments to the case $$\lambda = (a,1^b)$$, considering arbitrary $$r \in \mathbb {N}$$. To state this result in our setting, we introduce the following definition.

Definition 6.3

The row-number tableau of an r-ribbon tableau T is the row-standard tableau $$\mathrm {RNT}(T)$$ defined by putting an entry i in its row a for each r-border strip of row number a in the r-ribbon strip of T labelled i.

If T has weight $$\lambda$$, then the content of $$\mathrm {RNT}(T)$$ is $$\lambda$$. The shape of $$\mathrm {RNT}(T)$$ is, in general, a composition, possibly with some zero parts. The row-number tableaux of the four 3-ribbon tableaux in 3-$$\mathrm {RT}\bigl ( (6,5,5,5,2)/(3,2),(3,3) \bigr )$$, shown in the top line of Fig. 3 in Sect. 5, are as follows:
The definition of latticed extends to row-number tableaux in the obvious way. The second row-number tableau above, with word 212211, is the only one that is latticed.

Corollary 6.4

(see [4, Theorem 6.3]). Let $$r \in \mathbb {N}$$, let $$a \in \mathbb {N}$$, and let $$b \in \mathbb {N}_0$$. Let $$\nu /\tau$$ be a skew partition of $$r(a+b)$$. Then, $$\langle s_\tau (s_{(a,1^b)} \circ p_r), s_\nu \rangle$$ is equal, up to the sign $${{\mathrm{sgn}}}_r(\nu /\tau )$$, to the number of r-ribbon tableaux of shape $$\nu /\tau$$ and weight $$(a,1^b)$$ whose row-number tableau is latticed. The column word of such an r-ribbon tableau is $$(b+1)b \cdots 21\cdots 1$$, where the number of 1s is a.

Proof

By Theorem 6.3 in , up to the sign $${{\mathrm{sgn}}}_r(\nu /\tau )$$, the multiplicity $$\langle s_\tau (s_{(a,1^b)} \circ p_r), s_\nu \rangle$$ is the number of $$(a,1^b)$$-like border-strip r-diagrams of shape $$\nu /\tau$$, as defined in [4, Definition 6.2]. The required translation from the character theory to symmetric functions is outlined in [4, §7]. To relate these objects to r-ribbon tableaux, we define a skew partition $$\rho /\tau$$ to be a vertical r-ribbon strip if $$\rho '/\tau '$$ is a horizontal r-ribbon strip.

Let T be an r-ribbon tableau of shape $$\nu /\tau$$ and weight $$(a,1^b)$$. There is a unique partition $$\rho$$, such that $$\rho /\tau$$ is the horizontal a-ribbon strip in T and $$\nu /\rho$$ is a vertical b-ribbon strip, formed from the border strips labelled 2, ..., $$b+1$$. Suppose that $$\mathrm {RNT}(T)$$ is latticed. Then, the row numbers of these border strips are increasing. Moreover, the rightmost border strip in either of the ribbons $$\rho /\tau$$ and $$\nu /\rho$$ lies in the Young diagram of $$\rho /\tau$$, and the skew partition formed from this border strip and $$\nu /\rho$$ is a vertical $$(b+1)$$-ribbon strip. Therefore, T corresponds to an $$(a,1^b)$$-like border-strip r-diagram of shape $$\nu /\tau$$, and the column word of T is as claimed. Conversely, each such r-ribbon tableau arises in this way. $$\square$$

The second claim in Corollary 6.4 implies that if T is an r-ribbon tableau of weight $$(a,1^b)$$ whose row-number tableau $$\mathrm {RNT}(T)$$ is latticed, then the word of $$\mathrm {RNT}(T)$$ agrees with the column word of T. Hence, the combinatorial rules for $$\langle s_\tau (s_{(a,1^b)} \circ p_2), s_\nu \rangle$$ obtained by taking $$\lambda = (a,1^b)$$ in [1, Corollary 4.3] or $$r=2$$ in Corollary 6.4 count the same sets of r-ribbon tableaux. For example, in Fig. 4, we have $$a=3$$ and $$b=2$$; the first 2-ribbon tableau has a horizontal 2-ribbon strip of shape (5, 3, 1, 1) / (3, 1), a vertical 2-ribbon strip of shape (5, 5, 2, 2) / (5, 3, 1, 1), and the augmented vertical 2-ribbon strip has shape (5, 5, 2, 2) / (3, 3, 1, 1).

For general weights, we have the following result.

Proposition 6.5

Let $$r \in \mathbb {N}$$. Let T be an r-ribbon tableau. If the column word of T is latticed, then the row-number tableau of T is latticed.

The proof is given in the appendix. The converse of Proposition 6.5 is false. For example, $$\langle s_{(2,2)} \circ p_3, s_{(3,3,3,3)} \rangle = 1$$. The two 3-ribbon tableaux in $$\text {r-}\mathrm {RT}\bigl ( (3,3,3,3), (2,2) \bigr )$$ are shown below. Both have a latticed row-number tableau, with word 2211. The column words are 2112 and 2121, respectively; only the second is latticed.

In both Theorem 6.2 and Corollary 6.4, there is a lattice condition that refers directly to certain sets of r-ribbon tableaux, without making use of r-quotients. In the following problem, which the author believes is open under its intended interpretation (except when $$r = 2$$ or $$\lambda = (a,1^b)$$ for some $$a \in \mathbb {N}$$ and $$b \in \mathbb {N}_0$$), we say that such conditions are global.

Problem 6.6

Find a combinatorial rule, simultaneously generalizing Theorem 6.2 and Corollary 6.4, that expresses $$\langle s_\tau (s_\lambda \circ p_r), s_\nu \rangle$$ as the product of $${{\mathrm{sgn}}}_r(\nu /\tau )$$ and the size of a set of r-ribbon tableaux of shape $$\nu /\tau$$ satisfying a global lattice condition.

The obvious generalizations of Theorem 6.2 and Corollary 6.4 fail even to give correct upper and lower bounds on the multiplicity in Problem 6.6. Counterexamples are shown in the table. The second column gives the number of r-ribbon tableaux of the relevant shape and weight and the final two columns count those r-ribbon tableaux whose column word is latticed (CWL), and whose row-number tableau is latticed (RNTL), respectively.

plethysm $$\langle s_\tau (s_\lambda \circ p_r), s_\nu \rangle$$

|r-$$\mathrm {RT}(\nu /\tau ,\lambda )|$$

CWL

RNTL

$$\langle s_{(3,3)} \circ p_3, s_{(6,6,6)} \rangle = 1$$

6

0

2

$$\langle s_{(2,2,2)} \circ p_4, s_{(7,4,4,4,4,1)} \rangle = -1$$

9

0

0

$$\langle s_{(1)}(s_{(3,3)} \circ p_3), s_{(6,6,6,1)} \rangle = 1$$

6

0

0

$$\langle s_{(1)}(s_{(2,2)} \circ p_4), s_{(5,4,4,4)} \rangle = 1$$

2

2

2

Despite this, there are some signs that row-number tableaux are a useful object in more general settings than Corollary 6.4. In particular, the following conjecture holds when $$r \le 4$$ and $$n \le 10$$ and when $$r \le 6$$ and $$n \le 6$$. Haskell  source code to verify this claim is available from the author. When $$r=2$$, it holds by Theorem 6.2 and Proposition 6.5, replacing (ab) with a general partition $$\lambda$$; by row 2 of the table above, this more general conjecture is false when $$r=4$$. By Corollary 6.4, the conjecture holds, with equality, when $$b=1$$.

Conjecture 6.7

Let $$r \in \mathbb {N}$$, let $$n \in \mathbb {N}_0$$, let $$\nu$$ be a partition of rn and let (ab) be a partition of n. The number of r-ribbon tableaux $$\,T$$ of shape $$\nu$$ and weight (ab), such that the row-number tableau $$\mathrm {RNT}(T)$$ is latticed, is an upper bound for the absolute value of $$\langle s_{(a,b)} \circ p_r, s_\nu \rangle$$.

References

1. 1.
Carré, C., Leclerc, B.: Splitting the square of a Schur function into its symmetric and antisymmetric parts. J. Algebr. Combin. 4(3), 201–231 (1995)
2. 2.
Chen, Y.M., Garsia, A.M., Remmel, J.: Algorithms for plethysm. In: Greene, C. (ed.) Combinatorics and Algebra (Boulder, Colo., 1983), Contemp. Math., vol. 34, pp. 109–153. Amer. Math. Soc., Providence (1984)Google Scholar
3. 3.
Désarménien, J., Leclerc, B., Thibon, J.-Y.: Hall–Littlewood functions and Kostka–Foulkes polynomials in representation theory. Sém. Lothar. Combin. 32, 32 (1994)
4. 4.
Evseev, A., Paget, R., Wildon, M.: Character deflations and a generalization of the Murnaghan–Nakayama rule. J. Group Theory 17(6), 1035–1070 (2014)
5. 5.
James, G.D.: The Representation Theory of the Symmetric Groups Lecture Notes in Mathematics, vol. 682, Springer, Berlin (1978)Google Scholar
6. 6.
James, G., Kerber, A.: The Representation Theory of the Symmetric Group. Encyclopedia of Mathematics and its Applications, Vol. 16. Addison-Wesley Publishing Co., Reading. (1981)Google Scholar
7. 7.
Kerber, A., Sänger, F., Wagner, B.: Quotienten und Kerne von Young-Diagrammen, Brettspiele und Plethysmen gewöhnlicher irreduzibler Darstellungen symmetrischer Gruppen. Mitt. Math. Sem. Giessen 149, 131–175 (1981)
8. 8.
Lascoux, A., Schützenberger, M.-P.: Le monoïde plaxique. In: Noncommutative Structures in Algebra and Geometric Combinatorics (Naples, 1978), Quad. “Ricerca Sci.”, vol. 109, pp. 129–156. CNR, Rome (1981)Google Scholar
9. 9.
Littlewood, D.E.: Modular representations of symmetric groups. Proc. R. Soc. Lond. Ser. A 209, 333–353 (1951)
10. 10.
Littlewood, D.E., Richardson, A.R.: Group characters and algebra. Phil. Trans. R. Soc. Lond. Ser. A 233, 99–141 (1934)
11. 11.
Loehr, N.A.: Abacus proofs of Schur function identities. SIAM J. Discrete Math. 24(4), 1356–1370 (2010)
12. 12.
Loehr, N.A., Remmel, J.B.: A computational and combinatorial exposé of plethystic calculus. J. Algebr. Combin. 33(2), 163–198 (2011)
13. 13.
Lothaire, M.: Algebraic Combinatorics on Words. Encyclopedia of Mathematics and its Applications, Vol. 90. Cambridge University Press, Cambridge (2002)
14. 14.
Macdonald, I.G.: Symmetric Functions and Hall Polynomials, Second Edition. Oxford University Press, New York (1995)
15. 15.
Muir, T.: On the quotient of a simple alternant by the difference-product of the variables. Proc. R. Soc. Edinb. 14, 433–445 (1888)
16. 16.
Peyton Jones, S., et al.: The Haskell 98 language and libraries: the revised report. J. Funct. Program. 13(1), 0–255 (2003). http://www.haskell.org/definition/
17. 17.
Remmel, J.B., Shimozono, M.: A simple proof of the Littlewood-Richardson rule and applications. Discrete Math. 193(1-3), 257–266 (1998)
18. 18.
Stanley, R.P.: Enumerative Combinatorics, vol. 2. Cambridge Studies in Advanced Mathematics, Vol. 62, Cambridge University Press, Cambridge (1999)
19. 19.
Stembridge, J.R.: A concise proof of the Littlewood–Richardson rule. Electron. J. Combin.. 9(1), Note 5 (2002)
20. 20.
Wildon, M.: A combinatorial proof of a plethystic Murnaghan–Nakayama rule. SIAM J. Discrete Math. 30(3), 1526–1533 (2016)