Top > JACIII > Wavelet Lp-Norm Support Vector Regression with Feature Selecti ...

single-jc.php

JACIII Vol.19 No.3 pp. 407-416
doi: 10.20965/jaciii.2015.p0407
(2015)

Paper:

Views over last 60 days: 936

Wavelet Lp-Norm Support Vector Regression with Feature Selection

Ya-Fen Ye*,**, Yuan-Hai Shao*, and Chun-Na Li*

*Zhijiang College, Zhejiang University of Technology
182 Zhijiang Road, Hangzhou 310024, China

**College of Economics, Zhejiang University
Hangzhou 310027, China

Received:
December 30, 2013
Accepted:
February 25, 2015
Published:
May 20, 2015
Creative Commons License
Keywords:
support vector regression, Lp-norm, sparse solution, feature selection, determinants of house price
Abstract
This paper proposes wavelet Lp-norm support vector regression (Lp-WSVR) to solve feature selection and regression problems effectively. Unlike conventional support vector regression (SVR), linear Lp-WSVR ensures that useful features are selected based on theoretical analysis. By using the wavelet kernel,Lp-WSVR approaches any curve in quadratic continuous integral space that leads to improving regression performance. Results of experiments show the superiority of Lp-WSVR in both feature selection and regression performances. Applying Lp-WSVR to Chinese real estate prices shows that the most significant and powerful factor contributing to Chinese housing prices is monetary growth.
Cite this article as:
Y. Ye, Y. Shao, and C. Li, “Wavelet Lp-Norm Support Vector Regression with Feature Selection,” J. Adv. Comput. Intell. Intell. Inform., Vol.19 No.3, pp. 407-416, 2015.
Data files:
References
  1. [1] H. Drucker, C. J. C. Burges, L. Kaufman, A. Smola, and V. Vapnik, “Support Vector Regression Machines,” Bell Labs and Monmouth Universit, 1997.
  2. [2] C. Burges, “A tutorial on support vector machines for pattern recognition,” Data Mining Knowledge Discovery, Vol.2, pp. 121-167, 1998.
  3. [3] B. Schöolkopf and A. Smola, “Learning with kernels,” MIT Press, Cambridge, 2002.
  4. [4] J. Bi and K. P. Bennett, “A geometric approach to support vector regression,” Neurocomputing, Vol.55, No.1-2, pp. 79-108, 2003.
  5. [5] A. Smola and B. Schöolkopf, “A tutorial on support vector regression,” Statistic Computing, Vol.14, No.3, pp. 199-222, 2004.
  6. [6] Jirong Gu, Mingcang Zhu, Liuguangyan Jiang, “Housing price forecasting based on genetic algorithm and support vector machine,” Expert Systems with Applications, Vol.38, No.4, pp. 3383-3386, 2011.
  7. [7] Ahmad Kazem, Ebrahim Sharifi, Farookh Khadeer Hussain, and Morteza Saberi, “Support vector regression with chaos-based firefly algorithm for stock market price forecasting,” Applied Soft Computing, Vol.13, pp. 947-958, 2013.
  8. [8] Zhen-Yu Chen and Zhi-Ping Fan, “Dynamic customer lifetime value prediction using longitudinal data: An improved multiple kernel svr approach,” Expert Systems with Applications, Vol.43, pp. 123-134, 2013.
  9. [9] Li Wang and Ji Zhu, “Financial market forecasting using a two-step kernel learning method for the support vector regression,” Annals of Operations Research, Vol.174, pp. 103-120, 2010.
  10. [10] M. Song, C. Breneman, J. Bi, N. Sukumar, K. Bennett, S. Cramer, and N. Tugcu, “Prediction of protein retention times in anion-exchange chromatography systems using support vector regression,” J. of Chemical Information and Computer Sciences, Vol.42, pp. 1347-1357, 2002.
  11. [11] Ya-Fen Ye, Hui Cao, Lan Bai, Zhen Wang, and Yuan-Hai Shao, “Exploring determinants of inflation in China based on L1-ε- twin support vector regression,” Procedia Computer Science, Vol.17, pp. 514-522, 2013.
  12. [12] X. Peng and D. Xu, “A local information-based feature-selection algorithm for data regression,” Pattern Recognition, Vol.46, pp. 2519-2530, 2013.
  13. [13] Chunhua Zhang, Dewei Li, and Junyan Tan, “The support vector regression with adaptive norms,” Procedia Computer Science, Vol.18, pp. 1730-1736, 2013.
  14. [14] Yingjie Tian, Jun Yu, and Wenjing Chen, “Lp-norm support vector machine with CCCP,” 7th Int. Conf. on Fuzzy Systems and Knowledge Discovery (FSKD), 2010.
  15. [15] Wen Jing Chen and Ying Jie Tian, “Lp-norm proximal support vector machine and its applications,” Procedia Computer Science, Vol.1, pp. 2417-2423, 2012.
  16. [16] Li Zhang, Weida Zhou, and Licheng Jiao, “Wavelet support vector machine,” IEEE Trans. on Systems, Man, and Cybernetics, Vol.34, pp. 34-39, 2004.
  17. [17] Xinghong Shang, Huanyan Qian, “A multiple-kernel wavelet RVM algorithm for fault diagnosis of wireless sensor network,” J. of Information and Computational Science, Vol.3, pp. 711-717, 2012.
  18. [18] Yafen Ye, Yuanhai Shao, Weijie Chen, “Comparing inflation forecasts using an ε-wavelet twin support vector regression,” J. of Information and Computational Science, Vol.10, pp. 2041-2049, 2013.
  19. [19] P. Bradley, O. Mangasarian, and W. Street, “Feature selection via mathematical programming,” INFORMS J. on Computing, Vol.10, No.2, pp. 209-217, doi:10.1287/ijoc.10.2.209, 1998.
  20. [20] J. Y. Tan, Z. Z. Zhang, L. Zhen, C. H. Zhang, and N. Y. Deng, “Adaptive feature selection via a new version of support vector machine,” Neural Computer Application, Vol.23, pp. 937-945, 2013.
  21. [21] Y. H. Shao, C. H. Zhang, Z. M. Yang, L. Jing, N. Y. Deng, “An ε-twin support vector machine for regression,” Neural Computing and Applications, Vol.23, pp.175-185, 2013.
  22. [22] R. L. Eubank, “Nonparametric regression and spline smoothing statistics: textbooks and monographs,” Vol.157, 2nd ed., Marcel Dekker, New York, 1999.
  23. [23] James H. Stock and Mark W. Watson, “Combination forecasts of output growth in a seven-country data set,” J. of Forecasting, Vol.23, pp. 405-430, 2004.
  24. [24] Yu Ren, Cong Xiong, Yufei Yuan, “House price bubbles in China,” China Economic Review, Vol.23, No.4, pp. 786-800, 2013.
  25. [25] Chengsi Zhang, “Money, housing, and inflation in China,” J. of Policy Modeling, Vol.35, No.1, pp. 75-87, 2013.
  26. [26] Haizhen Wen and Allen C. Goodman, “Relationship between urban land price and housing price: Evidence from 21 provincial capitals in China,” Habitat International, Vol.40, pp. 9-17, 2013.
  27. [27] Qiang Li and Satish Chand, “House prices and market fundamentals in urban China,” Habitat International, Vol.40, pp. 148-153, 2013.
  28. [28] R. Adalid and C. Detken, “Liquidity shocks and asset price boom/bust cycles,” ECB working paper No.732, 2007.

Creative Commons License  This article is published under a Creative Commons Attribution-NoDerivatives 4.0 Internationa License.

*This site is desgined based on HTML5 and CSS3 for modern browsers, e.g. Chrome, Firefox, Safari, Edge, Opera.

Last updated on Apr. 19, 2024