Skoči na glavni sadržaj

Izvorni znanstveni članak

https://doi.org/10.24138/jcomss-2023-0129

Accurate and Fast Classification of Natural Disasters using CNN-LSTM and Inference Acceleration

Nathaniel Sze Yang Tan orcid id orcid.org/0009-0006-6033-6456 ; UTAR, Malaysia *
Mau-Luen Tham ; UTAR, Malaysia
Sing Yee Chua orcid id orcid.org/0000-0001-6327-4592 ; UTAR, Malaysia
Ying Loong Lee ; UTAR, Malaysia

* Dopisni autor.


Puni tekst: engleski pdf 1.909 Kb

str. 58-68

preuzimanja: 213

citiraj


Sažetak

Catastrophic occurrences induced by disasters often lead to fatalities, extensive damage, and societal disruptions. In pursuit of realizing disaster-resilient smart cities, video surveillance systems incorporating artificial intelligence (AI) can automatically process and classify the disaster content in real-time. This advancement is fueled by the recent progress in computer vision and AI algorithms, specifically deep learning neural networks, which can be leveraged for disaster categorization tasks. However, minimizing the complexity of AI models while preserving accurate disaster classification remains a formidable challenge. In this paper, we propose a convolutional neural network-long short-term memory (CNN-LSTM) model capable of discerning four types of natural disasters and a non-disaster event. Contrary to prior research that treats input video as a sequence of independent frames, we demonstrate the significance of spatio-temporal characteristics in reaping high prediction accuracy. Furthermore, conventional methods rely on resource-intensive hardware to boost AI model performance, which may not suit real-time monitoring. To facilitate real-time disaster monitoring applications, the trained model is further optimized by utilizing a neural network acceleration platform known as OpenVINO. Our findings reveal that the optimized version of the proposed CNN-LSTM model sustains 100% accuracy while boosting throughput by 25% in terms of frames per second (FPS).

Ključne riječi

CNN-LSTM; Deep learning; disaster classification; inference optimization; OpenVINO

Hrčak ID:

314264

URI

https://hrcak.srce.hr/314264

Datum izdavanja:

30.1.2024.

Posjeta: 744 *