An Information Criterion for Variable Selection in Support Vector Machines
Gerda Claeskens, Christophe Croux, Johan Van Kerckhoven.
Year: 2008, Volume: 9, Issue: 18, Pages: 541−558
Abstract
Support vector machines for classification have the advantage that the curse of dimensionality is circumvented. It has been shown that a reduction of the dimension of the input space leads to even better results. For this purpose, we propose two information criteria which can be computed directly from the definition of the support vector machine. We assess the predictive performance of the models selected by our new criteria and compare them to existing variable selection techniques in a simulation study. The simulation results show that the new criteria are competitive in terms of generalization error rate while being much easier to compute. We arrive at the same findings for comparison on some real-world benchmark data sets.