NATURAL DISASTER REPORT ON SOCIAL MEDIA CLASSIFICATION METHOD BASED ON WORD EMBEDDING AND GRAPH ATTENTION NETWORK
Abstract
Natural disasters frequently occur unexpectedly and seriously threaten human safety and infrastructure. Traditional detection systems rely heavily on IoT sensors and satellite monitoring, which are often costly and less accessible in resource-limited or remote areas. In contrast, social media provides a rich and real-time source of information, as users frequently post eyewitness reports during disaster events. However, automatically classifying these posts into relevant disaster categories remains challenging due to the short and informal nature of the text. The research aims to develop a high-performing classification model for disaster-related tweets using graph-based neural architectures and structured word embedding representations. The method used is a comparative implementation of Graph Convolutional Network (GCN) and Graph Attention Network (GAT) models, with input constructed by concatenating vectors from three word embedding techniques—Word2Vec, FastText, and GloVe—across seven multilingual datasets. The result of this study is that GAT outperformed GCN in all scenarios, with FastText embeddings yielding the highest individual performance. In contrast, combined embeddings sometimes led to performance degradation due to redundancy. The average F1-score for GCN is 0.749, while GAT achieves 0.915. The research conclusions indicate that GAT with word embedding input provides a novel and effective multilingual disaster tweet classification framework, offering valuable insights for future AI-based natural disaster monitoring systems.
Downloads
References
K. Zahra, M. Imran, and F. O. Ostermann, “AUTOMATIC IDENTIFICATION OF EYEWITNESS MESSAGES ON TWITTER DURING DISASTERS,” Inf Process Manag, vol. 57, no. 1, pp. 102–107, 2020, doi: https://doi.org/10.1016/j.ipm.2019.102107
M. R. Faisal, R. A. Nugroho, R. Ramadhani, F. Abadi, R. Herteno, and T. H. Saragih, “NATURAL DISASTER ON TWITTER: ROLE OF FEATURE EXTRACTION METHOD OF WORD2VEC AND LEXICON BASED FOR DETERMINING DIRECT EYEWITNESS,” Trends in Sciences, vol. 18, no. 23, p. 680, 2021, doi: https://doi.org/10.48048/tis.2021.680
I. Budiman, M. R. Faisal, F. Abadi, M. Haekal, and D. T. Nugrahadi, “A COMPARISON OF WORD EMBEDDING-BASED EXTRACTION FEATURE TECHNIQUES AND DEEP LEARNING MODELS OF NATURAL DISASTER MESSAGES CLASSIFICATION,” Journal of Computer Sciences Institute, vol. 27, pp. 145–153, 2023, doi: https://doi.org/10.35784/jcsi.3322
K. Y. Firlia, M. R. Faisal, D. Kartini, R. A. Nugroho, and F. Abadi, “ANALYSIS OF NEW FEATURES ON THE PERFORMANCE OF THE SUPPORT VECTOR MACHINE ALGORITHM IN CLASSIFICATION OF NATURAL DISASTER MESSAGES,” in 2021 4th International Conference of Computer and Informatics Engineering (IC2IE), pp. 317–322, 2021, doi: https://doi.org/10.1109/IC2IE53219.2021.9649107
M. K. Delimayanti, R. Sari, M. Laya, M. R. Faisal, Pahrul, and R. F. Naryanto, “THE EFFECT OF PRE-PROCESSING ON THE CLASSIFICATION OF TWITTER’S FLOOD DISASTER MESSAGES USING SUPPORT VECTOR MACHINE ALGORITHM,” Proceedings of ICAE 2020 - 3rd International Conference on Applied Engineering, no. February 2021, 2020, doi: https://doi.org/10.1109/ICAE50557.2020.9350387
M. R. Faisal, I. Budiman, F. Abadi, D. T. Nugrahadi, M. Haekal, and I. Sutedja, “APPLYING FEATURES BASED ON WORD EMBEDDING TECHNIQUES TO 1D CNN FOR NATURAL DISASTER MESSAGES CLASSIFICATION,” 2022 5th International Conference on Computer and Informatics Engineering, IC2IE 2022, no. December, pp. 192–197, 2022, doi: https://doi.org/10.1109/IC2IE56416.2022.9970188
M. R. Faisal et al., “USING SOCIAL MEDIA DATA TO MONITOR NATURAL DISASTER: A MULTI DIMENSION CONVOLUTIONAL NEURAL NETWORK APPROACH WITH WORD EMBEDDING,” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 6, no. 6, pp. 1037–1046, 2022, doi: https://doi.org/10.29207/resti.v6i6.4525
M. R. Faisal et al., “3D WORD EMBEDDING VECTOR FEATURE EXTRACTION AND HYBRID CNN-LSTM FOR NATURAL DISASTER REPORTS IDENTIFICATION,” TELKOMNIKA (Telecommunication Computing Electronics and Control), vol. 22, no. 5, pp. 1196–1208, 2024, doi: https://doi.org/10.12928/telkomnika.v22i5.26091
H. Ren et al., “GRAPH CONVOLUTIONAL NETWORKS IN LANGUAGE AND VISION: A SURVEY,” Knowl Based Syst, vol. 251, 2022, doi: https://doi.org/10.1016/j.knosys.2022.109250
A. G. Vrahatis, K. Lazaros, and S. Kotsiantis, “GRAPH ATTENTION NETWORKS: A COMPREHENSIVE REVIEW OF METHODS AND APPLICATIONS,” Future Internet, vol. 16, no. 9, 2024, doi: https://doi.org/10.3390/fi16090318
S. A. Zikrina and Fitriyani, “IMPROVING CYBERBULLYING DETECTION WITH GRAPH NEURAL NETWORK APPROACHES,” in ICADEIS 2025 - 2025 International Conference on Advancement in Data Science, E-learning and Information System: Integrating Data Science and Information System, Proceeding, 2025, doi: https://doi.org/10.1109/ICADEIS65852.2025.10933470
K. Zhao, L. Huang, R. Song, Q. Shen, and H. Xu, “A SEQUENTIAL GRAPH NEURAL NETWORK FOR SHORT TEXT CLASSIFICATION,” Algorithms, vol. 14, no. 12, 2021, doi: https://doi.org/10.3390/a14120352
Z. Chen, K. Huang, L. Wu, Z. Zhong, and Z. Jiao, “RELATIONAL GRAPH CONVOLUTIONAL NETWORK FOR TEXT-MINING-BASED ACCIDENT CAUSAL CLASSIFICATION,” Applied Sciences, vol. 12, no. 5, 2022, doi: https://doi.org/10.3390/app12052482
Y. Xi, J. Wang, Y. Tang, S. Qiao, R. Cao, and X. Liu, “RESEARCH ON IDENTIFICATION OF NETWORK PUBLIC OPINION INFORMATION BASED ON GRAPH CONVOLUTIONAL NETWORKS,” in Proceedings - 2020 International Conference on Intelligent Computing and Human-Computer Interaction, ICHCI 2020, pp. 409 – 418, 2020, doi: https://doi.org/10.1109/ICHCI51889.2020.00092
B. Zhang, Q. He, and D. Zhang, “HETEROGENEOUS GRAPH NEURAL NETWORK FOR SHORT TEXT CLASSIFICATION,” Applied Sciences, vol. 12, no. 17, 2022. https://doi.org/10.3390/app12178711
C. P. Chai, “COMPARISON OF TEXT PREPROCESSING METHODS,” Nat Lang Eng, vol. 29, no. 3, pp. 509–553, 2023, doi: https://doi.org/10.1017/S1351324922000213
M. Alirridlo, A. F. Septiyanto, R. Sarno, and D. Sunaryono, “A COMPARATIVE ANALYSIS OF TEXT NORMALIZATION TECHNIQUES FOR ENHANCED SENTIMENT ANALYSIS PERFORMANCE,” in 2024 Beyond Technology Summit on Informatics International Conference (BTS-I2C), pp. 474–479, 2024, doi: https://doi.org/10.1109/BTS-I2C63534.2024.10942038
M. George, “IMPROVING SENTIMENT ANALYSIS OF FINANCIAL NEWS HEADLINES USING HYBRID WORD2VEC-TFIDF FEATURE EXTRACTION TECHNIQUE,” Procedia Comput Sci, vol. 244, pp. 1–8, 2024, doi: https://doi.org/10.1016/j.procs.2024.10.172
G. Lachaud, P. Conde-Cespedes, and M. Trocan, “MATHEMATICAL EXPRESSIVENESS OF GRAPH NEURAL NETWORKS,” Mathematics, vol. 10, no. 24, 2022, doi: https://doi.org/10.3390/math10244770
C. Sun et al., “ATTENTION-BASED GRAPH NEURAL NETWORKS: A SURVEY,” Artif Intell Rev, vol. 56, no. Suppl 2, pp. 2263–2310, 2023, doi: https://doi.org/10.1007/s10462-023-10577-2
S. Wang, H. Lu, A. Khan, F. Hajati, M. Khushi, and S. Uddin, “A MACHINE LEARNING SOFTWARE TOOL FOR MULTICLASS CLASSIFICATION,” Software Impacts, vol. 13, p. 100383, 2022, doi: https://doi.org/10.1016/j.simpa.2022.100383
J.-P. van Zyl and A. P. Engelbrecht, “ANALYSIS OF CLASSIFICATION METRIC BEHAVIOUR UNDER CLASS IMBALANCE,” Egyptian Informatics Journal, vol. 31, p. 100711, 2025. https://doi.org/10.1016/j.eij.2025.100711
M. R. Faisal et al., “LSTM AND BI-LSTM MODELS FOR IDENTIFYING NATURAL DISASTERS REPORTS FROM SOCIAL MEDIA,” Journal of Electronics, Electromedical Engineering, and Medical Informatics, vol. 5, no. 4, 2023, doi: https://doi.org/10.35882/jeeemi.v5i4.319
S. Li, Y. Wang, H. Huang, and Y. Zhou, “STUDY ON THE RUMOR DETECTION OF SOCIAL MEDIA IN DISASTER BASED ON MULTI-FEATURE FUSION METHOD,” Natural Hazards, vol. 120, no. 4, pp. 4011–4030, 2024, doi: https://doi.org/10.1007/s11069-023-06284-4
N. R. Paul and R. C. Balabantaray, “DISASTER RELATED TWEET CLASSIFICATION METHOD BASED ON BERT AND GAT,” International Journal of Information Technology, pp. 1–13, 2025, doi: https://doi.org/10.1007/s41870-024-02389-6
S. M. Jeba, T. T. Aurpa, and M. R. S. Adib, “FROM FACEBOOK POSTS TO NEWS HEADLINES: USING TRANSFORMER MODELS TO PREDICT POST-DISASTER IMPACT ON MASS MEDIA CONTENT,” Soc Netw Anal Min, vol. 14, no. 1, p. 200, 2024, doi: https://doi.org/10.1007/s13278-024-01363-1
F. Vitiugin and H. Purohit, “MuLTILINGUAL SERVICEABILITY MODEL FOR DETECTING AND RANKING HELP REQUESTS ON SOCIAL MEDIA DURING DISASTERS,” in Proceedings of the International AAAI Conference on Web and Social Media, pp. 1571–1584, 2024, doi:https://doi.org/10.1609/icwsm.v18i1.31410
A. Katyshev, A. Anikin, and A. Zubankov, “BIDIRECTIONAL TRANSFORMERS AS A MEANS OF EFFICIENT BUILDING OF KNOWLEDGE BASES: A CASE STUDY WITH XLM-ROBERTA,” in Novel & Intelligent Digital Systems Conferences, pp. 292–297, 2023, doi:https://doi.org/10.1007/978-3-031-44146-2_30
N. Badri, F. Kboubi, and A. H. Chaibi, “COMBINING FASTTEXT AND GLOVE WORD EMBEDDING FOR OFFENSIVE AND HATE SPEECH TEXT DETECTION,” Procedia Comput Sci, vol. 207, pp. 769–778, 2022, doi: https://doi.org/10.1016/j.procs.2022.09.132
Copyright (c) 2026 Mohammad Reza Faisal, Irwan Budiman, Dodon Turianto Nugrahadi, Muhammad Rafi, Mera Kartika Delimayanti, Luu Duc Ngo, Moses Okechukwu Onyesolub
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this Journal agree to the following terms:
- Author retain copyright and grant the journal right of first publication with the work simultaneously licensed under a creative commons attribution license that allow others to share the work within an acknowledgement of the work’s authorship and initial publication of this journal.
- Authors are able to enter into separate, additional contractual arrangement for the non-exclusive distribution of the journal’s published version of the work (e.g. acknowledgement of its initial publication in this journal).
- Authors are permitted and encouraged to post their work online (e.g. in institutional repositories or on their websites) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published works.
1.gif)
