Herawati, Netti and Nisa, Khoirin and Setiawan, Eri and Nusyirwan, Nusyirwan and Tiryono, Tiryono (2018) Regularized Multiple Regression Methods to Deal with Severe Multicollinearity. International Journal of Statistics and Applications, 8 (4). pp. 167-172. ISSN -ISSN: 2168-5193 e-ISSN: 2168-5215

This is the latest version of this item.

[img] Text
10.5923.j.statistics.20180804.02 (1).pdf

Download (305kB)
Official URL: http://www.sapub.org/journal/aimsandscope.aspx?jou...

Abstract

Abstract This study aims to compare the performance of Ordinary Least Square (OLS), Least Absolute Shrinkage and Selection Operator (LASSO), Ridge Regression (RR) and Principal Component Regression (PCR) methods in han-dling severe multicollinearity among explanatory variables in multiple regression analysis using data simulation. In order to select the best method, a Monte Carlo experiment was caried out, it was set that the simulated data contain severe multicollinearity among all explanatory variables (ρ = 0.99) with different sample sizes (n = 25,50,75,100,200) and different levels of explanatory variables (p = 4, 6,8,10,20). The performances of the four methods are compared using Average Mean Square Errors (AMSE) and Akaike Information Criterion (AIC). The result shows that PCR has the lowest AMSE among other methods. It indicates that PCR is the most accurate regression coefficients estimator in each sample size and various levels of explanatory variables studied. PCR also performs as the best estimation model since it gives the lowest AIC values compare to OLS, RR, and LASSO.

Item Type: Article
Subjects: H Social Sciences > HA Statistics
Divisions: Fakultas Matematika dan Ilmu Pengetahuan Alam (FMIPA) > Prodi Matematika
Depositing User: Dr NETTI HERAWATI
Date Deposited: 03 Aug 2018 07:38
Last Modified: 03 Aug 2018 07:38
URI: http://repository.lppm.unila.ac.id/id/eprint/8636

Available Versions of this Item

Actions (login required)

View Item View Item