Detecting Multicollinearity in Regression Analysis

Noora Shrestha^1,

¹Department of Mathematics and Statistics, P. K. Campus, Tribhuvan University, Kathmandu, Nepal

Cite this paper:
Noora Shrestha. Detecting Multicollinearity in Regression Analysis. American Journal of Applied Mathematics and Statistics. 2020; 8(2):39-42. doi: 10.12691/ajams-8-2-1

Abstract

Multicollinearity occurs when the multiple linear regression analysis includes several variables that are significantly correlated not only with the dependent variable but also to each other. Multicollinearity makes some of the significant variables under study to be statistically insignificant. This paper discusses on the three primary techniques for detecting the multicollinearity using the questionnaire survey data on customer satisfaction. The first two techniques are the correlation coefficients and the variance inflation factor, while the third method is eigenvalue method. It is observed that the product attractiveness is more rational cause for the customer satisfaction than other predictors. Furthermore, advanced regression procedures such as principal components regression, weighted regression, and ridge regression method can be used to determine the presence of multicollinearity.

Keywords:
multicollinearity regression analysis variance inflation factor eigenvalue customer satisfaction

This work is licensed under a Creative Commons Attribution 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

References:

[1]	Young, D.S., Handbook of regression methods, CRC Press, Boca Raton, FL, 2017, 109-136.
[2]	Frank, E.H. Jr., Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis, Springer, New York, 2001, 121-142.
[3]	Hosmer, D.W., Lemeshow, S. and Sturdivant, R.X., Applied Logistic Regression, John Wiley & Sons, New Jersey, 2013.
[4]	Pedhajur, E.J., Multiple regression in behavioral research: explanation and prediction (3rd edition), Thomson Learning, Wadsworth, USA, 1997.
[5]	Keith, T.Z., Multiple regression and beyond: An introduction to multiple regression and structural equation modeling (2nd edition), Taylor and Francis, New York, 2015.
[6]	Aiken, L.S. and West, S.G., Multiple regression: Testing and interpreting interactions, Sage, Newbury Park, 1991.
[7]	Gunst, R.F. and Webster, J.T., “Regression analysis and problems of multicollinearity,” Communications in Statistics, 4 (3). 277-292. 1975.
[8]	Vatcheva, K.P., Lee, M., McCormick, J.B., and Rahbar, M.H., “Multicollinearity in regression analysis conducted in epidemiologic studies,” Epidemiology (Sunnyvale, Calif.), 6 (2). 227. 2016.
[9]	Belsley, D.A., Conditioning diagnostics: Collinearity and weak data in regression, John Wiley & Sons, Inc., New York, 1991.
[10]	Belinda, B. and Peat, J., Medical statistics: a guide to SPSS, data analysis, and critical appraisal (2nd edition), Wiley, UK, 2014.
[11]	Knoke, D., Bohrnstedt, W. G. and Mee, A. P., Statistics for social data analysis (4th edition), F.E. Peacock Publisher, Illinois, 2002.