Bias reduction of a conditional maximum likelihood estimator for a Gaussian second-order moving average model
Volume 8, Issue 4 (2021), pp. 435–463
Pub. online: 4 August 2021
Type: Research Article
Open Access
Received
8 December 2020
8 December 2020
Revised
8 July 2021
8 July 2021
Accepted
8 July 2021
8 July 2021
Published
4 August 2021
4 August 2021
Abstract
In this study, we consider a bias reduction of the conditional maximum likelihood estimators for the unknown parameters of a Gaussian second-order moving average (MA(2)) model. In many cases, we use the maximum likelihood estimator because the estimator is consistent. However, when the sample size n is small, the error is large because it has a bias of $O({n^{-1}})$. Furthermore, the exact form of the maximum likelihood estimator for moving average models is slightly complicated even for Gaussian models. We sometimes rely on simpler maximum likelihood estimation methods. As one of the methods, we focus on the conditional maximum likelihood estimator and examine the bias of the conditional maximum likelihood estimator for a Gaussian MA(2) model. Moreover, we propose new estimators for the unknown parameters of the Gaussian MA(2) model based on the bias of the conditional maximum likelihood estimators. By performing simulations, we investigate properties of this bias, as well as the asymptotic variance of the conditional maximum likelihood estimators for the unknown parameters. Finally, we confirm the validity of the new estimators through this simulation study.
References
Bao, Y.: A general result on the estimation bias of ARMA models. J. Stat. Plan. Inference 197, 107–125 (2018). MR3799026. https://doi.org/10.1016/j.jspi.2018.01.001
Bao, Y., Ullah, A.: The second-order bias and mean squared error of estimators in time-series models. J. Econom. 140, 650–669 (2007). MR2408921. https://doi.org/10.1016/j.jeconom.2006.07.007
Bao, Y., Ullah, A.: Expectation of quadratic forms in normal and nonnormal variables with applications. J. Stat. Plan. Inference 140, 1193–1205 (2010). MR2581122. https://doi.org/10.1016/j.jspi.2009.11.002
Barndorff-Nielsen, O.E., Cox, D.R.: Inference and Asymptotics. Chapman & Hall/CRC (1994). MR1317097. https://doi.org/10.1007/978-1-4899-3210-5
Brockwell, P.J., Davis, R.A.: Time Series: Theory and Methods. Springer (1991). MR2839251
Cheang, W.K., Reinsel, G.C.: Bias reduction of autoregressive estimates in time series regression model through restricted maximum likelihood. J. Am. Stat. Assoc. 95, 1173–1184 (2000). MR1804241. https://doi.org/10.2307/2669758
Cordeiro, G.M., Klein, R.: Bias correction in ARMA models. Stat. Probab. Lett. 19, 169–176 (1994). MR1278646. https://doi.org/10.1016/0167-7152(94)90100-7
Giummolé, F., Vidoni, P.: Improved prediction limits for a general class of Gaussian models. J. Time Ser. Anal. 31, 483–493 (2010). MR2732602. https://doi.org/10.1111/j.1467-9892.2010.00680.x
Hamilton, J.D.: Time Series Analysis. Princeton University Press (1994). MR1278033
Hillmer, S.C., Tiao, G.C.: Likelihood function of stationary multiple autoregressive moving average models. J. Am. Stat. Assoc. 74(367), 652–660 (1979). MR0548261
Kurosawa, T., Noguchi, K., Honda, F.: Bias reduction of the maximum likelihood estimator for a conditional Gaussian MA(1) model. Commun. Stat., Theory Methods 31(17), 8588–8602 (2017). MR3680779. https://doi.org/10.1080/03610926.2016.1185119
Tanaka, K.: Asymptotic expansions associated with the AR(1) model with unknown mean. Econometrica 51, 1221–1231 (1983). MR0710228. https://doi.org/10.2307/1912060
Tanaka, K.: An asymptotic expansion associated with the maximum likelihood estimators in ARMA models. J. R. Stat. Soc. B 46, 58–67 (1984). MR0745216
The Federal Reserve Bank of St. Louis. http://research.stlouisfed.org/
Wilson, G.T.: The estimation of parameters in multivariate time series models. J. R. Stat. Soc. 35(367), 76–85 (1973). MR0339421