Monte-Carlo study of some robust estimators: The simple linear regression case

Abstract

In this study, Least Trimmed Squares (LTS), Theil’s Pair-wise Median (Theil) and Bayesian estimation methods (BAYES) are compared relative to the OLSE via Monte-Carlo Simulation. Variance, Bias, Mean Square Error (MSE) and Relative Mean Square Error (RMSE) were calculated to evaluate the estimators’ performance. The Simple Linear Regression model is explored for the conditions in which the error term is assumed to be drawn from three error distributions: unit normal, lognormal and Cauchy. Theil’s non-parametric estimation procedure was found to have the strongest and most reliable performance. The subsequent-best results are acquired from LTS approach Though it was observed that the Bayesian estimators are affected by deviation of the dataset from normality, yet it is established from the results that the Bayesian estimators performed optimally more than all other competitors, even under non normal situations (especially under the standard lognormal distribution) in some cases, except whenever the error is drawn from a heavy tail distribution (Lognormal and Cauchy)..OLSE is most effective reliable as long as the normality assumptions preserve