Bankruptcy Prediction Using Genetic Algorithm-Support Vector Machine (GA-SVM) Feature Selection and Stacking
Article Sidebar
Main Article Content
Abstract
Bankruptcy is an impact caused by a company's financial failure. Financial failure in the company must be avoided so as not to cause losses to the company. In the research that was carried out utilizing a data set from the Taiwan Economic Journal as many as 6,819 to be trained using machine learning algorithms using classification techniques. The goal obtained from the research conducted is to obtain a classification technique with the best accuracy results. The method used in this research is preprocessing using the synthetic minority over-sampling technique to handling unbalanced data sets. Then, the results of the balanced data set will be processed using a genetic algorithm-support vector machine feature selection algorithm to reduce the attributes of the data set. Data sets that have experienced reduced attributes will be trained using the stacking method with a single classifier base learner in the form of k-nearest neighbors, naïve bayes, decision trees with classification and regression tree models, gradient boosting decision trees, and light gradient boosting. The meta-learner used in the stacking method is extreme gradient boosting. The results of the accuracy obtained from the research conducted were 99.22%.
Article Details
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
References
D. Liang, C. C. Lu, C. F. Tsai, and G. A. Shih, “Financial ratios and corporate governance indicators in bankruptcy prediction: A comprehensive study,” Eur. J. Oper. Res., vol. 252, no. 2, pp. 561–572, 2016, doi: 10.1016/j.ejor.2016.01.012.
M. A. Muslim, Y. Dasril, H. Javed, W. F. Abror, D. A. A. Pertiwi, and T. Mustaqim, “An Ensemble Stacking Algorithm to Improve Model Accuracy in Bankruptcy Prediction,” J. Data Sci. Intell. Syst., vol. 1, no. 1, 2023.
A. Kadim and N. Sunardi, “Analisis Altman Z-Score Untuk Memprediksi Kebangkrutan Pada Bank Pemerintah (Bumn) Di Indonesia Tahun 2012-2016 Articles Information Abstract Prodi Manajemen Unpam,” Keuang. dan Investasi ), vol. 1, no. 3, pp. 142–156, 2018.
D. West, S. Dellana, and J. Qian, “Neural network ensemble strategies for financial decision applications,” Comput. Oper. Res., vol. 32, no. 10, pp. 2543–2559, 2005, doi: 10.1016/j.cor.2004.03.017.
S. Lee and W. S. Choi, “A multi-industry bankruptcy prediction model using back-propagation neural network and multivariate discriminant analysis,” Expert Syst. Appl., vol. 40, no. 8, pp. 2941–2946, 2013, doi: https://doi.org/10.1016/j.eswa.2012.12.009.
P. Pampouktsi, S. Avdimiotis, M. Maragoudakis, M. Avlonitis, P. Hoogar, and G. Ruhago, “Techniques of Applied Machine Learning Being Utilized for the Purpose of Selecting and Placing Human Resources within the Public Sector,” J. Inf. Syst. Explor., vol. 01, no. 01, pp. 1–16, 2023.
Y. Qu, P. Quan, M. Lei, and Y. Shi, “Review of bankruptcy prediction using machine learning and deep learning techniques,” Procedia Comput. Sci., vol. 162, pp. 895–899, 2019, doi: https://doi.org/10.1016/j.procs.2019.12.065.
E. Chong, C. Han, and F. C. Park, “Deep learning networks for stock market analysis and prediction: Methodology, data representations, and case studies,” Expert Syst. Appl., vol. 83, pp. 187–205, 2017, doi: https://doi.org/10.1016/j.eswa.2017.04.030.
T. Hosaka, “Bankruptcy prediction using imaged financial ratios and convolutional neural networks,” Expert Syst. Appl., vol. 117, pp. 287–299, 2019, doi: https://doi.org/10.1016/j.eswa.2018.09.039.
I. Guyon, J. WESTON, S. Barnhill, and V. Vadnik, “Gene Selection for Cancer Classification using Support Vector Machines,” Mach. Learn., vol. 46, pp. 389–422, 2002.
R. Kohavi and G. H. John, “Wrappers for feature subset selection,” Artif. Intell., vol. 97, no. 1–2, pp. 273–324, 1997.
N. El Aboudi and L. Benhlima, “Review on wrapper feature selection approaches,” in 2016 International Conference on Engineering MIS (ICEMIS), 2016, pp. 1–5. doi: 10.1109/ICEMIS.2016.7745366.
A. R. Safitri and M. A. Muslim, “Improved Accuracy of Naive Bayes Classifier for Determination of Customer Churn Uses SMOTE and Genetic Algorithms,” J. Soft Comput. Explor., vol. 1, no. 1, pp. 70–75, 2020.
W. C. Lin, Y. H. Lu, and C. F. Tsai, “Feature selection in single and ensemble learning-based bankruptcy prediction models,” Expert Syst., vol. 36, no. 1, pp. 1–8, 2019, doi: 10.1111/exsy.12335.
Z. Tao, L. Huiling, W. Wenwen, and Y. Xia, “GA-SVM based feature selection and parameter optimization in hospitalization expense modeling,” Appl. Soft Comput., vol. 75, pp. 323–332, 2019, doi: https://doi.org/10.1016/j.asoc.2018.11.001.
X. Dong, Z. Yu, W. Cao, Y. Shi, and Q. Ma, “A survey on ensemble learning,” Front. Comput. Sci., vol. 14, no. 2, pp. 241–258, 2020, doi: 10.1007/s11704-019-8208-z.
J. Dou et al., “Improved landslide assessment using support vector machine with bagging, boosting, and stacking ensemble machine learning framework in a mountainous watershed, Japan,” Landslides, vol. 17, no. 3, pp. 641–658, 2020, doi: 10.1007/s10346-019-01286-5.
H. H. Patel and P. Prajapati, “Study and Analysis of Decision Tree Based Classification Algorithms,” Int. J. Comput. Sci. Eng., vol. 6, no. 10, pp. 74–78, 2018, doi: 10.26438/ijcse/v6i10.7478.
J. S. Yang, C. Y. Zhao, H. T. Yu, and H. Y. Chen, “Use GBDT to Predict the Stock Market,” Procedia Comput. Sci., vol. 174, no. 2019, pp. 161–171, 2020, doi: 10.1016/j.procs.2020.06.071.
W. Xing and Y. Bei, “Medical Health Big Data Classification Based on KNN Classification Algorithm,” IEEE Access, vol. 8, pp. 28808–28819, 2020, doi: 10.1109/ACCESS.2019.2955754.
G. Ke et al., “LightGBM: A highly efficient gradient boosting decision tree,” Adv. Neural Inf. Process. Syst., no. December, pp. 3147–3155, 2017.
M. A. Muslim and Y. Dasril, “Company bankruptcy prediction framework based on the most influential features using XGBoost and stacking ensemble learning,” Int. J. Electr. Comput. Eng., vol. 11, no. 6, pp. 5549–5557, 2021, doi: 10.11591/ijece.v11i6.pp5549-5557.
M. A. Muslim et al., “New model combination meta-learner to improve accuracy prediction P2P lending with stacking ensemble learning *,” Intell. Syst. with Appl., vol. 18, no. December 2022, p. 200204, 2023, doi: 10.1016/j.iswa.2023.200204.
Y. Zelenkov, E. Fedorova, and D. Chekrizov, “Two-step classification method based on genetic algorithm for bankruptcy forecasting,” Expert Syst. Appl., vol. 88, pp. 393–401, 2017, doi: https://doi.org/10.1016/j.eswa.2017.07.025.
M. J. Kim and D. K. Kang, “Classifiers selection in ensembles using genetic algorithms for bankruptcy prediction,” Expert Syst. Appl., vol. 39, no. 10, pp. 9308–9314, 2012, doi: 10.1016/j.eswa.2012.02.072.