Two-stage least squares method for parameter estimation of ARMA models is presented. First, the true ARMA model is fitted by a high order AR model by using the recursive least squares method. Secondly, based on the fitted AR model parameters, the ARMA model parameter estimates are obtained via solving a set of contradictory algebriaic equations by using the least squares method. A simulation example shows its effectiveness.