Exploring Vision Transformers and Convolution Neural Networks for the Thermal Image Classification of Volcanic Activity
Journal
APPLIED SCIENCES
ISSN
2076-3417
Date Issued
2025-02-28
DOI
10.3390/app15052604
Abstract
This paper addresses the classification of images depicting the eruptive activity of Mount Etna that were captured by a network of ground-based thermal cameras. This study aimed to evaluate the performance of Vision Transformers (ViTs), such as the Swin Trans- former, compared with Convolutional Neural Networks (CNNs), including AlexNet and ShuffleNet. A dataset of 3000 images, evenly distributed across six classes, was utilized for training and testing. The results indicate that for this specific application, the performance advantage of Vision Transformers over CNNs was marginal, likely due to the nature of the classification task. While the Transformer-based models, like the Swin Transformer, demon- strated a slightly improved accuracy for certain complex classes, the CNN-based models, such as AlexNet and ShuffleNet, exhibited superior computational efficiency, particularly in terms of the classification speed. These findings highlight the suitability of CNNs for real-time volcanic activity monitoring. Additionally, this paper provides a comprehensive review of the various CNN and Vision Transformer architectures, offering insights into their strengths and limitations in the context of volcanic activity classification.
Project(s)
Supported by the Italian Research Center on High Performance Computing Big Data and Quantum Computing (ICSC), a project funded by the European Union—NextGenerationEU—and the National Recovery and Resilience Plan (PNRR)—Mission 4 Component 2 within the activities of Spoke 3 (Astrophysics and Cosmos Observations). Sonia Calvari also acknowledges the financial support of the Project FIRST—ForecastIng eRuptive activity at Stromboli volcano (Delibera n. 144/2020; Scientific Responsibility: S.C.). Vulcani 2019.
