Disaster image tagging using generative ai for digital archives

Kotaro Yasuda, Masayoshi Aritsugi, Yukiko Takeuchi, Akihiro Shibayama, Israel Mendonça

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Disaster digital archives play a crucial role in preserving and disseminating data on various natural disasters. To manage these archives effectively, images need to be tagged appropriately and comprehensively, and machine learning is expected to handle this task efficiently. However, existing machine-learning tagging models fail to extract detailed disaster-related information. This study focuses on extracting disaster-specific tags from images using the latest machine-learning techniques. More specifically, we use generative AI to create descriptions of images and extract tags from these descriptions, allowing for more detailed information retrieval compared to traditional tags. By including prior information that the images are disaster-related in the prompts, we aim to achieve more specialized disaster tagging. Qualitative evaluation results suggest that the proposed method extracts more disaster-related tags than existing tagging models, indicating that it provides effective tags for users searching disaster images. This study applies real-world test cases using images from the 2011 Tohoku Earthquake and the 2016 Kumamoto Earthquake.

Original languageEnglish
Title of host publicationJCDL 2024 - Proceedings of the 24th ACM/IEEE Joint Conference on Digital Libraries
EditorsJian Wu, Xiao Hu, Terhi Nurmikko-Fuller, Sam Chu, Ruixian Yang, J. Stephen Downie
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798400710933
DOIs
Publication statusPublished - 2025 Mar 13
Event24th ACM/IEEE Joint Conference on Digital Libraries, JCDL 2024 - Hong Kong, Hong Kong
Duration: 2024 Dec 162024 Dec 20

Publication series

NameProceedings of the ACM/IEEE Joint Conference on Digital Libraries
ISSN (Print)1552-5996

Conference

Conference24th ACM/IEEE Joint Conference on Digital Libraries, JCDL 2024
Country/TerritoryHong Kong
CityHong Kong
Period24/12/1624/12/20

Keywords

  • Deep learning
  • Image tagging
  • digital archives

Fingerprint

Dive into the research topics of 'Disaster image tagging using generative ai for digital archives'. Together they form a unique fingerprint.

Cite this