TY - GEN
T1 - Disaster image tagging using generative ai for digital archives
AU - Yasuda, Kotaro
AU - Aritsugi, Masayoshi
AU - Takeuchi, Yukiko
AU - Shibayama, Akihiro
AU - Mendonça, Israel
N1 - Publisher Copyright:
© 2025 Institute of Electrical and Electronics Engineers Inc.. All rights reserved.
PY - 2025/3/13
Y1 - 2025/3/13
N2 - Disaster digital archives play a crucial role in preserving and disseminating data on various natural disasters. To manage these archives effectively, images need to be tagged appropriately and comprehensively, and machine learning is expected to handle this task efficiently. However, existing machine-learning tagging models fail to extract detailed disaster-related information. This study focuses on extracting disaster-specific tags from images using the latest machine-learning techniques. More specifically, we use generative AI to create descriptions of images and extract tags from these descriptions, allowing for more detailed information retrieval compared to traditional tags. By including prior information that the images are disaster-related in the prompts, we aim to achieve more specialized disaster tagging. Qualitative evaluation results suggest that the proposed method extracts more disaster-related tags than existing tagging models, indicating that it provides effective tags for users searching disaster images. This study applies real-world test cases using images from the 2011 Tohoku Earthquake and the 2016 Kumamoto Earthquake.
AB - Disaster digital archives play a crucial role in preserving and disseminating data on various natural disasters. To manage these archives effectively, images need to be tagged appropriately and comprehensively, and machine learning is expected to handle this task efficiently. However, existing machine-learning tagging models fail to extract detailed disaster-related information. This study focuses on extracting disaster-specific tags from images using the latest machine-learning techniques. More specifically, we use generative AI to create descriptions of images and extract tags from these descriptions, allowing for more detailed information retrieval compared to traditional tags. By including prior information that the images are disaster-related in the prompts, we aim to achieve more specialized disaster tagging. Qualitative evaluation results suggest that the proposed method extracts more disaster-related tags than existing tagging models, indicating that it provides effective tags for users searching disaster images. This study applies real-world test cases using images from the 2011 Tohoku Earthquake and the 2016 Kumamoto Earthquake.
KW - Deep learning
KW - Image tagging
KW - digital archives
UR - http://www.scopus.com/inward/record.url?scp=105001136211&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=105001136211&partnerID=8YFLogxK
U2 - 10.1145/3677389.3702516
DO - 10.1145/3677389.3702516
M3 - Conference contribution
AN - SCOPUS:105001136211
T3 - Proceedings of the ACM/IEEE Joint Conference on Digital Libraries
BT - JCDL 2024 - Proceedings of the 24th ACM/IEEE Joint Conference on Digital Libraries
A2 - Wu, Jian
A2 - Hu, Xiao
A2 - Nurmikko-Fuller, Terhi
A2 - Chu, Sam
A2 - Yang, Ruixian
A2 - Downie, J. Stephen
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 24th ACM/IEEE Joint Conference on Digital Libraries, JCDL 2024
Y2 - 16 December 2024 through 20 December 2024
ER -