Minimization of functions having lipschitz continuous first partial derivatives

Abstract

A general convergence theorem for the gradient methodis proved under hypotheses which are given below. It is thenshown that the usual steepest descent and modified steepestdescent algorithms converge under the some hypotheses. Themodified steepest descent algorithm allows for the possibilityof variable stepsize. © 1966 by Pacific Journal of Mathematics.