Principal Component Analysis and Its Derivation From Singular Value Decomposition

Abstract

Generally, today data analysts and researchers are often faced with a daunting task of reducing high dimensional datasets as large volume of data can be easily generated given the explosive activities of the internet. The most widely used tools for data reduction is the principal component analysis. Merely in some cases, the singular value decomposition method is applied. The study examined the application and theoretical framework of these methods in terms of its linear algebra foundation. The study discovered that the SVD method is a more robust and general method for a change of basis and low rank approximations. But.in terms of application, the PCA method is easy to interpret as illustrated in the work.