Abstract

Support vector machine (SVM) is a recent method to classify the data. SVM has been proved as a powerful tool for solving classification problem. The problem with complex dataset incurs significant complexity while classifying and its efficiency also cost very much. We propose a reduced set support vector machine based on Eigen structure, to classify dataset having multiple features. In this paper, Eigen vectors use to present the whole data in reduced dimensions. This minimize the task of classification by propose method and cost is reduced while efficiency is improved with the increase complexity of data. The proposed method takes a random chunk of data followed by Eigen structure use to reduce the dimension of the data. So as classification problem solve efficiently. We have compared the proposed method with SVM and RSVM. The result signifies that the proposed method gives better result in comparison to SVM and RSVM.

References

• Cortes. C. ; Vapnik, V. (1995). "Support-Vector Networks. " Machine Learning 20(3) :273. Doi :10. 1007/BF00994018.
• Yuh-aye Lee and Su-Yun Huang, "Reduced Support Vector Machine: A Statistical Theory," IEEE Transaction on Nueral Networks. Vol. 18. No. 1, January 2007.
• V. N. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
• H. Drucker, C. J. C. Burges, L. Kaufman, A. Smola, and V. Vapnik, "Support vector regression machines," in Advances in Nueral Information Processing Systems 9, M. C. Mozer, M. I. Jordan, and T. Petsche, Eds. Cambridge, MA: MIT Press,1997. Pp. 155-161
• O. L. Mangesarian and D. R. Musicant, "Large Scale kernel regression via linear Programming" Data Mining Inst. , Comp. Sci. Dept. , Univ. Wisconsin, Madison, WI, Tech. Rep. 99-02, Aug. 1999[Online]. Available: ftp://ftp. cs. wisc. edu/pub/dmi/tech-reports/99-02. ps.
• D. P. Wiens. Designs for approximately linear regression: Two optimality properties of uniform design. Statist. & probab. Letters, 12: 217-221, 1991
• D. P. Wiens. Minimax Designs for Approximately Linear Regression. J. Statist. Plann, inference, 31:353-371, 1992
• Y. J. Lee and O. L. Mangesarian. SSVM: A Smooth Support Vector Machine. Computational Optimization and Applictions, 20: 5-22, 2001.
• A. Smola and B. Scholkopf. Sparse Greedy Matrix Approximation for Machine Learning. In Proc. 17th international conf. on Machine Learning, Pages 911-918 Morgan Kanfmam, San Fransisco, CA,2000.
• Chistopher J. C. Burges,"A tutorial on Support Vector Machines for Pattern Recognition, " © Kluwer Acadimics Publishers, Boston. Manufactured in the Neitherland. Apeared in: Data Mining and Knowledge Discovery 2, 121-167 1998.
• J. Platt, "Fast training of SVMs using sequential minimal optimization", In B. Sch¨olkopf, C. Burges and A. Smola (ed. ), Advances in Kernel Methods: Support Vector Learning, MIT Press, Cambridge, MA, 1999, 185-208.
• G. Fung and L. Mangasarian, "Proximal support vector machine classifiers", Proceedings of the 7th ACM conference on knowledge discovery and data mining, ACM, 2001, 77-86.