Ensembles of Random Projections for Nonlinear Dimensionality Reduction

Abstract

Dimensionality reduction methods are widely used in informationprocessing systems to better understand the underlying structuresof datasets, and to improve the efficiency of algorithms for bigdata applications. Methods such as linear random projections haveproven to be simple and highly efficient in this regard, however,there is limited theoretical and experimental analysis for nonlinearrandom projections. In this study, we review the theoretical frameworkfor random projections and nonlinear rectified random projections,and introduce ensemble of nonlinear maximum random projections.We empirically evaluate the embedding performance on 3commonly used natural datasets and compare with linear randomprojections and traditional techniques such as PCA, highlightingthe superior generalization performance and stable embedding ofthe proposed method.