EFFICIENCY AND ACCURACY OF CONVOLUTIONAL AND FOURIER TRANSFORM LAYERS IN NEURAL NETWORKS FOR MEDICAL IMAGE CLASSIFICATION
Abstract
In an era where information flow is moving at a rapid pace, image data processing is becoming increasingly important as technology advances, including in healthcare. Convolutional Neural Network (CNN) has been a common approach in image classification, but the larger the volume of data and the complexity of the task, the more expensive the computational cost of CNN. With the rapid growth in the amount of image data, efficiency in data processing is becoming increasingly important. In this study, the performance of neural network models using the convolution layer and Fourier transform layer in medical image data classification was compared. The results show that models with a Fourier transform layer tend to provide higher accuracy and better Area Under Curve (AUC) compared to models using a convolution layer. In addition, the model with the Fourier transform layer also shows faster execution time per epoch, which indicates efficiency in data processing. However, the convolution layer has an advantage in terms of model size, although it is not significantly different from the Fourier transform layer. In conclusion, the Fourier transform layer has an advantage in the classification of medical image data.
Downloads
References
S. Ati, Nurdien, H. Kistanto, and A. Taufik, Pengantar Konsep Informasi, Data, dan Pengetahuan. Universitas Terbuka, 2014.
J. Stockham, “Hard Copy,” Jul. 2015. doi: 10.14236/ewic/eva2015.25.
R. Ehtisham et al., “Classification of defects in wooden structures using pre-trained models of convolutional neural network,” Case Studies in Construction Materials, vol. 19, Dec. 2023, doi: 10.1016/j.cscm.2023.e02530.
L. Alzubaidi et al., “Review of deep learning: concepts, CNN architectures, challenges, applications, future directions,” J Big Data, vol. 8, no. 1, Dec. 2021, doi: 10.1186/s40537-021-00444-8.
N. Chittora and D. Babel, “A BRIEF STUDY ON FOURIER TRANSFORM AND ITS APPLICATIONS,” International Research Journal of Engineering and Technology, p. 1127, 2008, [Online]. Available: www.irjet.net
K. I. Minami, H. Nakajima, and T. Toyoshima, “Real-time discrimination of ventricular tachyarrhythmia with fourier-transform neural network,” IEEE Trans Biomed Eng, vol. 46, no. 2, pp. 179–185, 1999, doi: 10.1109/10.740880.
J. Lin and Y. Yao, “A Fast Algorithm for Convolutional Neural Networks Using Tile-based Fast Fourier Transforms,” Neural Process Lett, vol. 50, no. 2, pp. 1951–1967, Oct. 2019, doi: 10.1007/s11063-019-09981-z.
N. Vasilache, J. Johnson, M. Mathieu, S. Chintala, S. Piantino, and Y. LeCun, “Fast Convolutional Nets With fbfft: A GPU Performance Evaluation,” Dec. 2014, [Online]. Available: http://arxiv.org/abs/1412.7580
J. Zak, A. Korzynska, A. Pater, and L. Roszkowiak, “Fourier Transform Layer: A proof of work in different training scenarios,” Appl Soft Comput, vol. 145, p. 110607, Sep. 2023, doi: 10.1016/J.ASOC.2023.110607.
K. Fukushima, “Biological Cybernetics Neocognitron: A Self-organizing Neural Network Model for a Mechanism of Pattern Recognition Unaffected by Shift in Position,” 1980.
D. H. Hubel and T. N. Wiesel, “RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE OF MONKEY STRIATE CORTEX,” 1968.
F. Es-Sabery, A. Hair, J. Qadir, B. Sainz-De-Abajo, B. Garcia-Zapirain, and I. Torre-Diez, “Sentence-Level Classification Using Parallel Fuzzy Deep Learning Classifier,” IEEE Access, vol. 9, pp. 17943–17985, 2021, doi: 10.1109/ACCESS.2021.3053917.
R. Yamashita, M. Nishio, R. K. G. Do, and K. Togashi, “Convolutional neural networks: an overview and application in radiology,” Aug. 01, 2018, Springer Verlag. doi: 10.1007/s13244-018-0639-9.
C. Nwankpa, W. Ijomah, A. Gachagan, and S. Marshall, “Activation Functions: Comparison of trends in Practice and Research for Deep Learning,” Nov. 2018, [Online]. Available: http://arxiv.org/abs/1811.03378
V. Nair and G. E. Hinton, “Rectified Linear Units Improve Restricted Boltzmann Machines,” 2010.
Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature, vol. 521, no. 7553, pp. 436–444, May 2015, doi: 10.1038/nature14539.
P. Ramachandran, B. Zoph, and Q. V. Le, “Searching for Activation Functions,” Oct. 2017, [Online]. Available: http://arxiv.org/abs/1710.05941
I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. MIT Press, 2016.
J. W. Cooley and J. W. Tukey, “An Algorithm for the Machine Calculation of Complex Fourier Series,” 1964.
S. L. Brunton and J. N. Kutz, Data-Driven Science and Engineering. Cambridge University Press, 2019. doi: 10.1017/9781108380690.
M. S. Reis, P. M. Saraiva, and B. R. Bakshi, “Denoising and Signal-to-Noise Ratio Enhancement: Wavelet Transform and Fourier Transform,” Comprehensive Chemometrics, vol. 2, pp. 25–55, Jan. 2009, doi: 10.1016/B978-044452701-1.00099-5.
F. A. Spanhol, L. S. Oliveira, C. Petitjean, and L. Heutte, “A Dataset for Breast Cancer Histopathological Image Classification,” IEEE Trans Biomed Eng, vol. 63, no. 7, pp. 1455–1462, Jul. 2016, doi: 10.1109/TBME.2015.2496264.
N. V. Orlov et al., “Automatic classification of lymphoma images with transform-based global features,” IEEE Transactions on Information Technology in Biomedicine, vol. 14, no. 4, pp. 1003–1013, Jul. 2010, doi: 10.1109/TITB.2010.2050695.
M. E. Plissiti, P. Dimitrakopoulos, G. Sfikas, C. Nikou, O. Krikoni, and A. Charchanti, “Sipakmed: A New Dataset for Feature and Image Based Classification of Normal and Pathological Cervical Cells in Pap Smear Images,” in Proceedings - International Conference on Image Processing, ICIP, IEEE Computer Society, Aug. 2018, pp. 3144–3148. doi: 10.1109/ICIP.2018.8451588.
M. Grandini, E. Bagli, and G. Visani, “Metrics for Multi-Class Classification: an Overview,” Aug. 2020, [Online]. Available: http://arxiv.org/abs/2008.05756
A. Tharwat, “Classification assessment methods,” Applied Computing and Informatics, vol. 17, no. 1, pp. 168–192, Jan. 2021, doi: 10.1016/j.aci.2018.08.003.
B. W. Yap and C. H. Sim, “Comparisons of various types of normality tests,” J Stat Comput Simul, vol. 81, no. 12, pp. 2141–2155, Dec. 2011, doi: 10.1080/00949655.2010.520163.
S. F. Sawyer, “Analysis of Variance: The Fundamental Concepts,” Journal of Manual & Manipulative Therapy, vol. 17, no. 2, pp. 27E-38E, Apr. 2009, doi: 10.1179/jmt.2009.17.2.27e.
A. Nanda, Dr. B. B. Mohapatra, A. P. K. Mahapatra, A. P. K. Mahapatra, and A. P. K. Mahapatra, “Multiple comparison test by Tukey’s honestly significant difference (HSD): Do the confident level control type I error,” International Journal of Statistics and Applied Mathematics, vol. 6, no. 1, pp. 59–65, Jan. 2021, doi: 10.22271/maths.2021.v6.i1a.636.
N. Nachar, “The Mann-Whitney U: A Test for Assessing Whether Two Independent Samples Come from the Same Distribution,” 2008.
Copyright (c) 2024 Fauzi Nafi'udin, Hasih Pratiwi, Etik Zukhronah
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this Journal agree to the following terms:
- Author retain copyright and grant the journal right of first publication with the work simultaneously licensed under a creative commons attribution license that allow others to share the work within an acknowledgement of the work’s authorship and initial publication of this journal.
- Authors are able to enter into separate, additional contractual arrangement for the non-exclusive distribution of the journal’s published version of the work (e.g. acknowledgement of its initial publication in this journal).
- Authors are permitted and encouraged to post their work online (e.g. in institutional repositories or on their websites) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published works.
1.gif)
