A probability argument in favor of ignoring small singular values

Abstract

If the matrix of a square linear system is nonsingular but has very small singular values, then tiny perturbations of the right-hand side may cause drastic changes in the solution. We show that the probability for this to happen is very close to zero if sufficiently many singular values of the matrix are bounded away from zero.