Modified Mahalanobis-Taguchi System based on proper orthogonal decomposition for high-dimensional-small-sample-size data classification

Mahalanobis-Taguchi System (MTS) is an effective algorithm for dimensionality reduction, feature extraction and classification of data in a multidimensional system. However, when applied to the field of high-dimensional small sample data, MTS has challenges in calculating the Mahalanobis distance due to the singularity of the covariance matrix. To this end, we construct a modified Mahalanobis-Taguchi System (MMTS) by introducing the idea of proper orthogonal decomposition (POD). The constructed MMTS expands the application scope of MTS, taking into account correlations between variables and the influence of dimensionality. It can not only retain most of the original sample information features, but also achieve a substantial reduction in dimensionality, showing excellent classification performance. The results show that, compared with expert classification, individual classifiers such as NB, RF, k-NN, SVM and superimposed classifiers such as Wrapper + RF, MRMR + SVM, Chi-square + BP, SMOTE + Wrapper + RF and SMOTE + MRMR + SVM, MMTS has a better classification performance when extracting orthogonal decomposition vectors with eigenvalues greater than 0.001.