INVESTIGATING THE IMPACT OF MULTICOLLINEARITY ON LINEAR REGRESSION ESTIMATES
Adewoye Kunle Bayo1*,Ayinla Bayo Rafiu2, Aminu Titilope Funmilayo3, and Onikola Isaac Oluyemi4
1,3,4Department of Statistics, The Federal Polytechnic, Offa, Kwara State, Nigeria,
2Department of Statistics, University of Ilorin, Ilorin, Kwara State, Nigeria
1*This email address is being protected from spambots. You need JavaScript enabled to view it., 2This email address is being protected from spambots. You need JavaScript enabled to view it., 3This email address is being protected from spambots. You need JavaScript enabled to view it., 4This email address is being protected from spambots. You need JavaScript enabled to view it.
ABSTRACT
The study was to investigate the impact of multicollinearity on linear regression estimates. The study was guided by the following specific objectives, (i) to examine the asymptotic properties of estimators and (ii) to compare lasso, ridge, elastic net with Ordinary Least Squares (OLS). The study employed Monte-Carlo simulation to generate set of highly collinear and induced multicollinearity variables with sample sizes of 25, 50, 100, 150, 200, 250, 1000 as a source of data in this research work and the data was analyzed with lasso, ridge, elastic net and ordinary least squares using statistical package. The study findings revealed that absolute bias of ordinary least squares was consistent at all sample sizes as revealed by past researched on multicollinearity as well while lasso type estimators fluctuated alternately. Also revealed that, mean square error of ridge regression outperformed other estimators with minimum variance at small sample size and OLS was the best at large sample size. The study recommended that OLS was asymptotically consistent at a specified sample sizes on this research work and ridge regression was efficient at small and moderate sample size.
Keywords: Lasso & Elastic, Multicollinearity, Ridge.
Published On: 23 February 2021
