Limiting Distributions of Least Squares Estimates of Unstable Autoregressive Processes

Abstract

An autoregressive process yn = β1y n-1 + ⋯ + βpy n-p + εn is said to be unstable if the characteristic polynomial φ(z) = 1 - β1z - ⋯ - βpz p has all roots on or outside the unit circle. The limiting distribution of the least squares estimate of (β1, ⋯, βp) is derived and characterized as a functional of stochastic integrals under a 2 + δ moment assumption on εn. Up to the present, distributional results were available only with substantial restrictions on the possible roots which did not suggest the form of the distribution for the general case. To establish the limiting distribution, a result concerning the weak convergence of a sequence of random variables to a stochastic integral, which is of independent interest, is also developed.