Nonlinear feature selection for support vector quantile regression

Neural Netw. 2025 Jan 13:185:107136. doi: 10.1016/j.neunet.2025.107136. Online ahead of print.

Abstract

This paper discusses the nuanced domain of nonlinear feature selection in heterogeneous systems. To address this challenge, we present a sparsity-driven methodology, namely nonlinear feature selection for support vector quantile regression (NFS-SVQR). This method includes a binary-diagonal matrix, featuring 0 and 1 elements, to address the complexities of feature selection within intricate nonlinear systems. Moreover, NFS-SVQR integrates a quantile parameter to effectively address the intrinsic challenges of heterogeneity within nonlinear feature selection processes. Consequently, NFS-SVQR excels not only in precisely identifying representative features but also in comprehensively capturing heterogeneous information within high-dimensional datasets. Through feature selection experiments the enhanced performance of NFS-SVQR in capturing heterogeneous information and selecting representative features is demonstrated.

Keywords: Mixed-integer optimization; Nonlinear feature selection; Sparse learning; Support vector quantile regression.