Paper:
Intelligent System Detection of Dead Victims at Natural Disaster Areas Using Deep Learning
Moch. Zen Samsono Hadi , Prima Kristalina , Aries Pratiarso, M. Helmi Fauzan, and Roycardo Nababan
Department of Electrical Engineering, Politeknik Elektronika Negeri Surabaya
Jl. Raya ITS, PENS Campus, Sukolilo, Surabaya, East Java 60111, Indonesia
Corresponding author
Disaster is the occurrence or sequence of occurrences that endangers and disrupts people’s lives and livelihoods due to natural and/or non-natural as well as human elements, including fatalities, property loss, environmental harm, and psychological effects. In addition to concentrating on the victims’ safety and their own safety, the search and rescue (SAR) team plays a significant part in this evacuation operation. Based on these issues, this study examined how to use a drone equipped with electronic equipment to search for victims on the ground to speed up the evacuation process at natural disaster sites, assisting the evacuation process and enhancing the safety of the SAR team. The drone carries a near-infrared camera and GPS. The images captured by the camera provide the parameters for classifying victims using deep learning. The system has been implemented by sampling data from human poses resembling the position of the victims’ bodies from natural disasters. From the experimental results, the system can detect objects with high accuracy, that is, 99% in both static and dynamic conditions. The best model results were obtained at a height of 2 meters with a low error percentage.
- [1] D. R. Hartawan, T. W. Purboyo, and C. Setianingsih, “Disaster Victims Detection System Using Convolutional Neural Network (CNN) Method,” Proc. of the 2019 IEEE Int. Conf. on Industry 4.0, Artificial Intelligence, and Communications Technology (IAICT), pp. 105-111, 2019. https://doi.org/10.1109/ICIAICT.2019.8784782
- [2] H. Sato and Y. Ono, “Disaster Storytelling and Volcanic Eruptions Caused by Debris Avalanches on Mt. Bandai in Aizu and Mt. Unzendake and Mt. Mayuyama in Shimabara,” J. Disaster Res., Vol.16, No.2, pp. 141-145, 2021. https://doi.org/10.20965/jdr.2021.p0141
- [3] A. F. Lee and A. V. Saenz, “An Inclusive Model for the Urban Search and Rescue Teams (USAR),” J. Disaster Res., Vol.17, No.7, pp. 1192-1198, 2022. https://doi.org/10.20965/jdr.2022.p1192
- [4] Centers for Disease Control and Prevention, “Volcanoes,” Natural Disasters and Severe Weather. https://www.cdc.gov/disasters/volcanoes/index.html [Accessed April 5, 2023]
- [5] C. A. Rokhmana and R. Andaru, “Utilizing UAV-based mapping in post disaster volcano eruption,” Proc. of the 2016 6th Int. Annual Engineering Seminar (InAES), pp. 202-205, 2016. https://doi.org/10.1109/INAES.2016.7821934
- [6] E. Hariyono and S. Liliasari, “The Characteristics of Volcanic Eruption in Indonesia,” G. Aiello (Ed.), “Volcanoes – Geological and Geophysical Setting, Theoretical Aspects and Numerical Modeling, Applications to Industry and Their Impact on the Human Health,” pp. 73-92, InTech Open, 2018. https://doi.org/10.5772/intechopen.71449
- [7] A. Kylling, “Ash and ice clouds during the Mt Kelud February 2014 eruption as interpreted from IASI and AVHRR/3 observations,” Atmospheric Measurement Techniques, Vol.9, Issue 5, pp. 2103-2117, 2016. https://doi.org/10.5194/amt-9-2103-2016
- [8] Pusat Vulkanologi dan Mitigasi Bencana Geologi (PVMBG), “Data Dasar Gunungapi Indonesia [Basic Data of Indonesia Volcanoes],” Ministry of Energy and Mineral Resource, Geology Department, 2010.
- [9] J. C. Thouret et al., “Semeru volcano, Indonesia: Measuring hazard, exposure and response of densely populated neighbourhoods facing persistent volcanic threats,” Nat. Hazards, Vol.117, pp. 1405-1453, 2023. https://doi.org/10.1007/s11069-023-05910-5
- [10] A. J. A. Rivera, A. D. C. Villalobos, J. C. N. Monje, J. A. G. Mariñas, and C. M. Oppus, “Post-disaster rescue facility: Human detection and geolocation using aerial drones,” Proc. of the 2016 IEEE Region 10 Conf. (TENCON), pp. 384-386, 2016. https://doi.org/10.1109/TENCON.2016.7848026
- [11] M. Laverdiere, L. Yang, M. Tuttle, and C. Vaughan, “Rapid Structure Detection in Support of Disaster Response: A Case Study of the 2018 Kilauea Volcano Eruption,” IGARSS 2020–2020 IEEE Int. Geoscience and Remote Sensing Symp., pp. 6826-6829, 2020. https://doi.org/10.1109/IGARSS39084.2020.9324160
- [12] M. A. I. Mashuri, M. Z. S. Hadi, R. W. Sudibyo, P. Kristalina, and A. Pratiarso, “Smart Victims Detection in Natural Disaster using Deep Learning,” 2022 Int. Electronics Symp. (IES), pp. 517-521, 2022. https://doi.org/10.1109/IES55876.2022.9888369
- [13] A. F. Aliek, M. Z. S. Hadi, N. R. Mubtadai, and A. Zainudin, “Intelligent System of Natural Disaster Victim Detection using Naïve Bayes Classifier,” 2021 Int. Electronics Symp. (IES), pp. 393-398, 2021. https://doi.org/10.1109/IES53407.2021.9593979
- [14] X. Lv, Y. Liao, and L. Deng, “Natural Disaster Emergency Rescue System Based on the Mobile Phone’s High-Precision Positioning,” 2018 IEEE 3rd Int. Conf. on Image, Vision and Computing (ICIVC), pp. 797-801, 2018. https://doi.org/10.1109/ICIVC.2018.8492850
- [15] A. H. Tantri and N. A. Rakhmawati, “Designing A Natural Disaster Ontology for Indonesia,” 2019 12th Int. Conf. on Information & Communication Technology and System (ICTS), pp. 130-134, 2019. https://doi.org/10.1109/ICTS.2019.8850979
- [16] R. Harakawa, K. Ohtomo, K. Takahashi, Y. Matsuda, and M. Iwahashi, “Hierarchical Clustering of Natural Disaster Images Using Visual Features,” 2021 IEEE 3rd Global Conf. on Life Sciences and Technologies (LifeTech), pp. 120-121, 2021. https://doi.org/10.1109/LifeTech52111.2021.9391792
- [17] L. Liu and X.-K. Sun, “Volcanic Ash Cloud Diffusion From Remote Sensing Image Using LSTM-CA Method,” IEEE Access, Vol.8, pp. 54681-54690, 2020. https://doi.org/10.1109/ACCESS.2020.2981368
- [18] C. A. Rokhmana and R. Andaru, “Utilizing UAV-based mapping in post disaster volcano eruption,” 2016 6th Int. Annual Engineering Seminar (InAES), pp. 202-205, 2016. https://doi.org/10.1109/INAES.2016.7821934
- [19] B. M. Sopha, A. M. S. Asih, D. G. Ilmia, and H. A. Yuniarto, “Knowledge engineering: Exploring evacuation behavior during volcanic disaster,” 2017 IEEE Int. Conf. on Industrial Engineering and Engineering Management (IEEM), pp. 235-239, 2017. https://doi.org/10.1109/IEEM.2017.8289887
- [20] M. Z. S. Hadi, A. A. Dafa, and P. Kristalina, “Detection of Dead Victims at Volcanic Disaster Location based on Drone and LoRa,” 2022 Int. Conf. on Computer Engineering, Network, and Intelligent Multimedia (CENIM), pp. 213-217, 2022. https://doi.org/10.1109/CENIM56801.2022.10037372
- [21] M. Trierscheid, J. Pallenz, D. Paulus, and D. Balthasar, “Hyperspectral Imaging for Victim Detection with Rescue Robot,” Int. Workshop on Safety, Security and Rescue Robotics, 2008. https://doi.org/10.1109/SSRR.2008.4745869
- [22] S. L. Krisna, G. S. R. Chaitanya, A. S. H. Reddy, A. M. Naidu, S. S. Poorna, and K. Anuraj, “Autonomous Human Detection System Mounted on a Drone,” 2019 Int. Conf. on Wireless Communications Signal Processing and Networking (WiSPNET), pp. 335-338, 2019. https://doi.org/10.1109/WiSPNET45539.2019.9032876
- [23] W. Budiharto, A. A. S. Gunawan, J. S. Suroso, A. Chowanda, A. Patrik, and G. Utama, “Fast Object Detection for Quadcopter Drone using Deep Learning,” 2018 3rd Int. Conf. on Computer and Communication Systems, pp. 192-195, 2018. https://doi.org/10.1109/CCOMS.2018.8463284
- [24] M. I. Perdana, A. Risnumawan, and I. A. Sulistijono, “Automatic Aerial Victim Detection on Low-Cost Thermal Camera Using Convolutional Neural Network,” 2020 Int. Symp. on Community-centric Systems (CcS), 2020. https://doi.org/10.1109/CcS49175.2020.9231433
- [25] A. Caruso, S. Chessa, S. Escolar, J. Barba, and J. C. López, “Collection of Data With Drones in Precision Agriculture: Analytical Model and LoRa Case Study,” IEEE Internet of Things J., Vol.8, No.22, pp. 16692-16704, 2021. https://doi.org/10.1109/JIOT.2021.3075561
- [26] R. Tariq, M. Rahim, N. Aslam, N. Bawany, and U. Faseeha, “DronAID: A Smart Human Detection Drone for Rescue,” 2018 15th Int. Conf. on Smart Cities: Improving Quality of Life Using ICT & IoT (HONET-ICT), pp. 33-37, 2018. https://doi.org/10.1109/HONET.2018.8551326
- [27] R. L. Galvez, A. A. Bandala, E. P. Dadios, R. R. P. Vicerra, and J. M. Z. Maningo, “Object Detection Using Convolutional Neural Networks,” Proc. of 2018 IEEE Region 10 Conf. (TENCON 2018), pp. 2023-2027, 2018. https://doi.org/10.1109/TENCON.2018.8650517
- [28] E. Suharto, S. A. P. Widodo, and E. A. Sarwoko, “The use of MobileNet V1 for identifying various types of freshwater fish,” J. of Physics: Conf. Series, Vol.1524, No.1, Article No.012105, 2020. https://dx.doi.org/10.1088/1742-6596/1524/1/012105
- [29] T. Gosh, M. M.-H.-Z. Abedin, S. M. Chowdhury, Z. Tasmin, T. Karim, S. M. S. Reza, S. Saika, and M. A. Yousuf, “Bangla handwritten character recognition using MobileNet V1 architecture,” Bulletin of Electrical Engineering and Informatics, Vol.9, No.6, pp. 2547-2554, 2020. https://doi.org/10.11591/eei.v9i6.2234
- [30] X. Han, X. Zhang, and Y. Liu, “Improving GNSS Navigation and Control with Electronic Compass in Unmanned System,” J. Adv. Comput. Intell. Intell. Inform., Vol.23, No.3, pp. 427-436, 2019. https://doi.org/10.20965/jaciii.2019.p0427
- [31] M. A. Rizzi, M. Z. S. Hadi, and P. Kristalina, “Energy Efficiency with Sleep Schedule for SAR Team Communication,” 2021 Int. Electronics Symp. (IES), pp. 576-581, 2021. https://doi.org/10.1109/IES53407.2021.9594020
This article is published under a Creative Commons Attribution-NoDerivatives 4.0 Internationa License.