TY - JOUR
T1 - Fractional diffusion maps
AU - Antil, Harbir
AU - Berry, Tyrus
AU - Harlim, John
N1 - Funding Information:
H.A. is partially supported by NSF grants DMS-1818772 and DMS-1913004 , the Air Force Office of Scientific Research under Award No.: FA9550-19-1-0036 , and the Department of Navy, Naval Postgraduate School under Award No.: N00244-20-1-0005 . T.B. is partially supported by NSF grants DMS-1723175 , DMS-2006808 , and DMS-1854204 . J.H. was partially supported by the ONR Grant N00014-16-1-2888 , NSF Grants DMS-1619661 and DMS-1854299 .
Publisher Copyright:
© 2021 Elsevier Inc.
PY - 2021/9
Y1 - 2021/9
N2 - In this paper, we extend the diffusion maps algorithm on a family of heat kernels that are either local (having exponential decay) or nonlocal (having polynomial decay), arising in various applications. For example, these kernels have been used as a regularizer in various supervised learning tasks for denoising images. Importantly, these heat kernels give rise to operators that include (but are not restricted to) the generators of the classical Laplacian associated to Brownian processes as well as the fractional Laplacian associated with β-stable Lévy processes. For local kernels, while the method is a version of the diffusion maps algorithm, we show that the applications with non-Gaussian local heat kernels approximate temporally rescaled Laplace-Beltrami operators. For the non-local heat kernels, we modify the diffusion maps algorithm to estimate fractional Laplacian operators. Here, the graph distance is used to approximate the geodesic distance with appropriate error bounds. While this approximation becomes numerically expensive as the number of data points increases, it produces an accurate operator estimation that is robust to the choice of the kernel bandwidth parameter value. In contrast, the local kernels are numerically more efficient but more sensitive to the choice of kernel bandwidth parameter value. In an application to estimate non-smooth regression functions, we find that using the nonlocal kernel as a regularizer produces a more robust and accurate estimate than using local kernels. For manifolds with boundary, we find that the proposed fractional diffusion maps framework implemented with non-local kernels approximates the regional fractional Laplacian.
AB - In this paper, we extend the diffusion maps algorithm on a family of heat kernels that are either local (having exponential decay) or nonlocal (having polynomial decay), arising in various applications. For example, these kernels have been used as a regularizer in various supervised learning tasks for denoising images. Importantly, these heat kernels give rise to operators that include (but are not restricted to) the generators of the classical Laplacian associated to Brownian processes as well as the fractional Laplacian associated with β-stable Lévy processes. For local kernels, while the method is a version of the diffusion maps algorithm, we show that the applications with non-Gaussian local heat kernels approximate temporally rescaled Laplace-Beltrami operators. For the non-local heat kernels, we modify the diffusion maps algorithm to estimate fractional Laplacian operators. Here, the graph distance is used to approximate the geodesic distance with appropriate error bounds. While this approximation becomes numerically expensive as the number of data points increases, it produces an accurate operator estimation that is robust to the choice of the kernel bandwidth parameter value. In contrast, the local kernels are numerically more efficient but more sensitive to the choice of kernel bandwidth parameter value. In an application to estimate non-smooth regression functions, we find that using the nonlocal kernel as a regularizer produces a more robust and accurate estimate than using local kernels. For manifolds with boundary, we find that the proposed fractional diffusion maps framework implemented with non-local kernels approximates the regional fractional Laplacian.
UR - http://www.scopus.com/inward/record.url?scp=85103288841&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85103288841&partnerID=8YFLogxK
U2 - 10.1016/j.acha.2021.03.005
DO - 10.1016/j.acha.2021.03.005
M3 - Article
AN - SCOPUS:85103288841
SN - 1063-5203
VL - 54
SP - 145
EP - 175
JO - Applied and Computational Harmonic Analysis
JF - Applied and Computational Harmonic Analysis
ER -