Abstract
Discrete diffusion semigroups have proven to be highly effective tools for machine learning and data analysis due to the interplay between diffusion processes (of inferences), and their naturally associated geometries. Inspired by the harmonic analysis machinery that E. Stein developed for symmetric diffusion semigroups acting on \(L_p\) spaces, we show that a correspondence between the rate of diffusion approximation and a Besov-type version of smoothness exists in the general continuous case, even without a local kernel representation. Specifically, let \(\left\{ A_t\right\} _{t\ge 0}\) be a symmetric diffusion semigroup on \(L_p(X)\), for X a complete positive \(\sigma \)-finite measure space. We first establish that for \(1<p<\infty \) the semigroup \(\left\{ A_t\right\} _{t\ge 0}\) acting on \(L_p(X)\) is strongly continuous and holomorphic. We then show that for \(f\in L_p(X)\) and \(0<\alpha <1\), the following are equivalent:
-
(1)
\(\left\| \left( A_{t}-I\right) f\right\| _{L_p(X)}\le ct^\alpha \), for \(0 < t\le 1\);
-
(2)
\(|\langle f,h \rangle |\le c\int ^1_0 s^\alpha \left\| A_{s}h\right\| _{L_{p'}(X)}\frac{ds}{s}\), for all \(h\in L_{p'}(X)\); and
-
(3)
\(\Vert {\mathcal {A}}A_tf\Vert _{L_p(X)} \le c t^{\alpha -1}\), for \(0 < t\le 1\), where \({\mathcal {A}}\) is the infinitesimal generator.
We also present some extensions, including results for the \(p=\infty \) case.
Similar content being viewed by others
References
Belkin, M., Niyogi, P.: Laplacian eigenmaps and spectral techniques for embedding and clustering. In: Dietterich, T.G., Becker, S., Ghahramani, Z. (eds.) Advances in Neural Information Processing Systems, vol. 14. MIT Press, Cambridge (2002)
Belkin, M., Niyogi, P.: Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput. 15, 1373–1396 (2003)
Bérard, P., Besson, G., Gallot, S.: Embedding Riemannian manifolds by their heat kernel. Geom. Funct. Anal. 4(4), 373–398 (1994)
Butzer, P.L., Berens, H.: Semi-Groups of Operators and Approximation. Springer, Berlin (1967)
Coifman, R.R., Lafon, S., Lee, A.B., Maggioni, M., Nadler, B., Warner, F., Zucker, S.W.: Geometric diffusions as a tool for harmonic analysis and structure definition of data: diffusion maps. PNAS 102(21), 7426–7431 (2005)
Coifman, R.R., Lafon, S., Lee, A.B., Maggioni, M., Nadler, B., Warner, F., Zucker, S.W.: Geometric diffusions as a tool for harmonic analysis and structure definition of data: multiscale methods. PNAS 102(21), 7432–7437 (2005)
Coifman, R.R., Leeb, W.E.: Earth Mover’s distance and equivalent metrics for spaces with semigroups, Technical Report YALEU/DCS/TR-1481, July 22, 2013. http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.365.1991
Cowling, M.G.: Harmonic analysis on semigroups. Ann. Math. Second Ser. 117(2), 267–283 (1983)
Goldberg, M.J., Kim, S.: Some remarks on diffusion distances, J. Appl. Math., vol. 2010, Article ID 464815, (2010). https://doi.org/10.1155/2010/464815
Goldberg, M.J., Kim, S.: A natural diffusion distance and equivalence of local convergence and local equicontinuity for a general symmetric diffusion semigroup. Abstract Appl. Anal. 2018, Article ID 6281504 (2018). https://doi.org/10.1155/2018/6281504
Goldberg, M.J., Kim, S.: Equivalence of \(L_p\) diffusion approximation and a function’s diffusion smoothness. Semigroup Forum (2019). https://doi.org/10.1007/s00233-019-10030-3
Goldberg, M.J., Kim, S.: An explicit characterization of the domain of the infinitesimal generator of a symmetric diffusion semigroup on \(L_p\) of a complete positive sigma-finite measure space, in preparation
Jones, P.W., Maggioni, M., Schul, R.: Manifold parametrizations by eigenfunctions of the Laplacian and heat kernels. PNAS 105(6), 1803–1808 (2008)
Lafon, S.: “Diffusion maps and geometric harmonics”, Ph.D. dissertation, Yale University, (May 2004)
Leeb, W., Coifman, R.R.: Hölder-Lipschitz norms and their duals on spaces with semigroups, with applications to Earth Mover’s distance. J. Fourier Anal. Appl. 22(4), 910–953 (2016). https://doi.org/10.1007/s00041-015-9439-5
Marshall, N.F., Coifman, R.R.: Manifold learning with bi-stochastic kernels, ArXiv e-prints, (February 2018)
Nadler, B., Lafon, S., Coifman, R.R., Kevrekidis, I.G.: Diffusion maps, spectral clustering and reaction coordinates of dynamical systems. Appl. Comput. Harmon. Anal. 21(1), 113–127 (2006)
Rudin, W.: Real and Complex Analysis, 3rd edn. McGraw-Hill, New York (1987)
Stein, E. M.: Topics in harmonic analysis related to the Littlewood-Paley theory. Annals of Mathematical Studies, Vol. 63, Princeton University Press, Princeton, NJ, 1985 (corrected 3rd printing)
Acknowledgements
The authors would like to thank the anonymous referee for a thorough, prompt, and courteous review. We appreciate the many constructive suggestions which greatly improved the paper’s organization and flow.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix
Appendix
In this section, we give some examples of symmetric diffusion semigroups that are not given by kernels. As before, X is a complete positive \(\sigma \)-finite measure space.
To begin our construction, for \(1\le p\le \infty \), let \(P:L_p(X)\rightarrow L_p(X)\) be a bounded operator with the following properties:
-
(1)
\(\left\| P f\right\| _{L_p(X)} \le \left\| f\right\| _{L_p(X)}\), for \(1\le p\le \infty \);
-
(2)
\(P 1 = 1\);
-
(3)
\(P f\ge 0\) if \(f\ge 0\);
-
(4)
P is a self-adjoint operator on \(L_2(X)\); and
-
(5)
\(P^2 = P\).
Let \(Q=I-P\). Note that \(Q^2=Q\) and that \(QP=PQ=0\). Now fix a non-negative real number a. Finally, define the uniformly continuous semigroup \(\left\{ A_t:L_p(X)\rightarrow L_p(X), 1\le p \le \infty \right\} _{t\ge 0}\) by
Using that \(Q^2=Q\), we easily see that
Using the assumption that \(P 1 = 1\), we immediately see that \(A_t 1=\left( 1- e^{-at}\right) P1+e^{-at}1=1\). Also, since \(1- e^{-at}\ge 0\), and \(f\ge 0\) implies \(P f\ge 0\) by assumption, we have that \(A_t f = \left( 1- e^{-at}\right) Pf+e^{-at}f \ge 0\) for \(f\ge 0\). Since P is assumed to be a self-adjoint operator on \(L_2(X)\), \(A_t\) is self-adjoint as well. Clearly, since \(Q=I-P\) is a bounded operator on every \(L_p(X)\), \(1\le p\le \infty \), \(A_t=e^{-atQ}\) is a uniformly continuous, hence strongly continuous, semigroup on every \(L_p(X)\). Finally, since \(1- e^{-at}\ge 0\) and \(\left\| P f\right\| _{L_p(X)} \le \left\| f\right\| _{L_p(X)}\) by assumption,
Hence, \(A_t\) satisfies all the requirements to be a symmetric diffusion semigroup.
We will now consider some examples of an operator P as above so that the associated symmetric diffusion semigroup \(A_t\) does not have a kernel representation.
Example 1
For \(X={\mathbf {R}}^n\), let \(Pf(x)=\frac{1}{2}(f(x)+f(-x))= Ef(x)\), the even part of f. It is immediate to verify that the five required properties for P hold and that \(A_t f = Pf + e^{-at}\left( I-P\right) f=Ef+e^{-at}Of\), where Of is the odd part of f. \(A_t\) does not have a kernel representation. This is the example mentioned in the Introduction.
Example 2
Let \(X={\mathbf {R}}^2\). For a function f defined on \({\mathbf {R}}^2\) and \(x\in {\mathbf {R}}^2\), define \(Pf(x)=\frac{1}{2\pi }\int _0^{2\pi }f(|x|,\theta )\,d\theta \), where \(f(|x|,\theta )\) is the function f with polar coordinate arguments. So Pf(x) is the average of the values of f on the circle of radius |x|, center at the origin. Note that \(P1=1\) and that \(P f\ge 0\) if \(f\ge 0\). It is easily seen that \(P^2=P\), P is self-adjoint on \(L_2({\mathbf {R}}^2)\), and that (by Jensen’s inequality) \(\left\| P f\right\| _{L_p({\mathbf {R}}^2)} \le \left\| f\right\| _{L_p({\mathbf {R}}^2)}\) (the case \(p=\infty \) being obvious). Note that \(A_t=\left( 1- e^{-at}\right) P+e^{-at}I\) does not have a kernel representation: P integrates over one-dimensional curves in two-dimensional space, while \(If=f\) is point evaluation.
Example 3
The previous example can be extended to other changes of variables in \({\mathbf {R}}^n\), with Pf defined by the normalized integral of the product of f and the change of variables Jacobian, over k of the new variables.
Rights and permissions
About this article
Cite this article
Coifman, R.R., Goldberg, M.J. Some Extensions of E. Stein’s Work on Littlewood–Paley Theory Applied to Symmetric Diffusion Semigroups. J Geom Anal 31, 6781–6795 (2021). https://doi.org/10.1007/s12220-020-00428-9
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12220-020-00428-9