Exact Simplification of Support Vector Solutions

Tom Downs, Kevin E. Gates, Annette Masters; 2(Dec):293-297, 2001.


This paper demonstrates that standard algorithms for training support vector machines generally produce solutions with a greater number of support vectors than are strictly necessary. An algorithm is presented that allows unnecessary support vectors to be recognized and eliminated while leaving the solution otherwise unchanged. The algorithm is applied to a variety of benchmark data sets (for both classification and regression) and in most cases the procedure leads to a reduction in the number of support vectors. In some cases the reduction is substantial.

[abs] [pdf] [ps.gz] [ps]