ENSEMBLE CNN WITH ADASYN FOR MULTICLASS CLASSIFICATION ON CABBAGE PESTS
Abstract
Image classification is a complex process influenced by various factors, one of which is the amount of image data. In the context of cabbage pest classification, data often exhibits a significant class imbalance, where certain pests are more prevalent than others. This imbalance can pose challenges during model training and evaluation, potentially leading to biases in favor of the majority pests and reduced accuracy in identifying and classifying the less common ones. This research aims to enhance the classification performance for multiclass data specific to cabbage pests. We propose an ensemble learning approach that combines Convolutional Neural Network (CNN), Support Vector Machine (SVM), and Bagging methods. To address the imbalance issue inherent in cabbage pest data, we employ the Adaptive Synthetic Sampling (ADASYN) resampling technique. The CNN acts as the primary image identifier and classifier for various cabbage pests. Subsequently, the CNN model is integrated into SVM and Bagging models to mitigate the challenges of imbalanced data in pest classification. The research outcomes demonstrate that our ensemble approach, in conjunction with the ADASYN resampling technique, achieves an impressive accuracy rate of 97%, signifying its potential for improved cabbage pest detection and classification.
Downloads
References
E. S. M. Embaby and D. E. S. Lotfy, “Ecological studies on Cabbage pests,” Int. J. Agric. Technol., vol. 11, no. 5, pp. 1145–1160, 2015.
F. M. Abidin, H. Sibyan, and N. Hasanah, “Sistem Pakar Identifikasi Penyakit Sayuran Kubis Menggunakan Metode Foreward Chaining,” J. Eng. Inform., vol. 1, no. 1, pp. 14–21, 2022, doi: 10.56854/jei.v1i1.14.
M. Waleed, A. S. Abdullah, and S. R. Ahmed, “Classification of Vegetative pests for cucumber plants using artificial neural networks,” 2020 3rd Int. Conf. Eng. Technol. its Appl. IICETA 2020, pp. 47–51, 2020, doi: 10.1109/IICETA50496.2020.9318890.
N. W. S. Wardhani, M. Y. Rochayani, A. Iriany, A. D. Sulistyono, and P. Lestantyo, “Cross-validation Metrics for Evaluating Classification Performance on Imbalanced Data,” 2019 Int. Conf. Comput. Control. Informatics its Appl. Emerg. Trends Big Data Artif. Intell. IC3INA 2019, pp. 14–18, 2019, doi: 10.1109/IC3INA48034.2019.8949568.
X. X. Niu and C. Y. Suen, “A novel hybrid CNN-SVM classifier for recognizing handwritten digits,” Pattern Recognit., vol. 45, no. 4, pp. 1318–1325, 2012, doi: 10.1016/j.patcog.2011.09.021.
F. Deng, W. Mao, Z. Zeng, H. Zeng, and B. Wei, “Multiple Diseases and Pests Detection Based on Federated Learning and Improved Faster R-CNN,” IEEE Trans. Instrum. Meas., vol. 71, 2022, doi: 10.1109/TIM.2022.3201937.
B. Jayanthi, T. A. Priyanka, V. B. Shalini, and R. K. Grace, “Pest Detection in Crops Using Deep Neural Networks,” 8th Int. Conf. Adv. Comput. Commun. Syst. ICACCS 2022, pp. 29–32, 2022, doi: 10.1109/ICACCS54159.2022.9785155.
L. Liu, X. Wu, S. Li, Y. Li, S. Tan, and Y. Bai, “Solving the class imbalance problem using ensemble algorithm: application of screening for aortic dissection,” BMC Med. Inform. Decis. Mak., vol. 22, no. 1, pp. 1–16, 2022, doi: 10.1186/s12911-022-01821-w.
J. Brandt and E. Lanzén, “A Comparative Review of SMOTE and ADASYN in Imbalanced Data Classification,” Uppsala Universitet, 2020.
D. Dablain, K. N. Jacobson, C. Bellinger, M. Roberts, and N. V. Chawla, “Understanding CNN Fragility When Learning With Imbalanced Data,” Mach. Learn., no. 0123456789, 2023, doi: 10.1007/s10994-023-06326-9.
H. He, Y. Bai, E. A. Garcia, and S. Li, “ADASYN: Adaptive synthetic sampling approach for imbalanced learning,” Proc. Int. Jt. Conf. Neural Networks, no. 3, pp. 1322–1328, 2008, doi: 10.1109/IJCNN.2008.4633969.
R. Sarki, K. Ahmed, H. Wang, Y. Zhang, J. Ma, and K. Wang, “Image Preprocessing in Classification and Identification of Diabetic Eye Diseases,” Data Sci. Eng., vol. 6, no. 4, pp. 455–471, 2021, doi: 10.1007/s41019-021-00167-z.
N. Dhanachandra, K. Manglem, and Y. J. Chanu, “Image Segmentation Using K-means Clustering Algorithm and Subtractive Clustering Algorithm,” Procedia Comput. Sci., vol. 54, pp. 764–771, 2015, doi: 10.1016/j.procs.2015.06.090.
H. A. H. Al-Najjar et al., “Land cover classification from fused DSM and UAV images using convolutional neural networks,” J. Remote Sens., vol. 11, no. 12, 2019, doi: 10.3390/rs11121461.
A. Maniatopoulos and N. Mitianoudis, “Learnable Leaky ReLU (LeLeLU): An Alternative Accuracy-Optimized Activation Function,” J. Inf., vol. 12, no. 12, 2021, doi: 10.3390/info12120513.
F. N. Iandola, S. Han, M. W. Moskewicz, K. Ashraf, W. J. Dally, and K. Keutzer, “SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size,” in conference paper at ICLR 2017, 2016, pp. 1–13. [Online]. Available: http://arxiv.org/abs/1602.07360
W. Gong et al., “A novel deep learning method for intelligent fault diagnosis of rotating machinery based on improved CNN-SVM and multichannel data fusion,” J. Sensors, vol. 19, no. 7, 2019, doi: 10.3390/s19071693.
D. P. Kingma and J. L. Ba, “Adam: A method for stochastic optimization,” 3rd Int. Conf. Learn. Represent. ICLR 2015 - Conf. Track Proc., pp. 1–15, 2015.
D. Keerthana, V. Venugopal, M. K. Nath, and M. Mishra, “Hybrid convolutional neural networks with SVM classifier for classification of skin cancer,” Biomed. Eng. Adv., vol. 5, no. November 2022, p. 100069, 2023, doi: 10.1016/j.bea.2022.100069.
G. James, D. Witten, T. Hastie, and R. Tibshirani, An introduction to statistical learning (2nd ed.), vol. 102. Springer Text in Statistics, 2021. [Online]. Available: https://www.statlearning.com/
L. Yu and N. Zhou, “Survey of Imbalanced Data Methodologies,” 2021, [Online]. Available: http://arxiv.org/abs/2104.02240
G. Ngo, R. Beard, and R. Chandra, “Evolutionary bagging for ensemble learning,” Neurocomputing, vol. 510, pp. 1–14, 2022, doi: 10.1016/j.neucom.2022.08.055.
J. Nayak, K. Vakula, P. Dinesh, B. Naik, and D. Pelusi, “Intelligent food processing: Journey from artificial neural network to deep learning,” Comput. Sci. Rev., vol. 38, p. 100297, 2020, doi: 10.1016/j.cosrev.2020.100297.
Y. Skaik, “Understanding and using sensitivity, specificity and predictive values,” Indian J. Ophthalmol., vol. 56, no. 4, p. 341, 2008, doi: 10.4103/0301-4738.41424.
Z. Huang, X. Zhu, M. Ding, and X. Zhang, “Medical Image Classification Using a Light-Weighted Hybrid Neural Network Based on PCANet and DenseNet,” IEEE Access, vol. 8, pp. 24697–24712, 2020, doi: 10.1109/ACCESS.2020.2971225.
Copyright (c) 2024 Nabila Ayunda Sovia, Ni Wayan Surya Wardhani
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this Journal agree to the following terms:
- Author retain copyright and grant the journal right of first publication with the work simultaneously licensed under a creative commons attribution license that allow others to share the work within an acknowledgement of the work’s authorship and initial publication of this journal.
- Authors are able to enter into separate, additional contractual arrangement for the non-exclusive distribution of the journal’s published version of the work (e.g. acknowledgement of its initial publication in this journal).
- Authors are permitted and encouraged to post their work online (e.g. in institutional repositories or on their websites) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published works.
1.gif)
