Consistent Semi-Supervised Graph Regularization for High Dimensional Data
Xiaoyi Mai, Romain Couillet.
Year: 2021, Volume: 22, Issue: 94, Pages: 1−48
Abstract
Semi-supervised Laplacian regularization, a standard graph-based approach for learning from both labelled and unlabelled data, was recently demonstrated to have an insignificant high dimensional learning efficiency with respect to unlabelled data, causing it to be outperformed by its unsupervised counterpart, spectral clustering, given sufficient unlabelled data. Following a detailed discussion on the origin of this inconsistency problem, a novel regularization approach involving centering operation is proposed as solution, supported by both theoretical analysis and empirical results.