TY - JOUR
T1 - Deep learning increases the availability of organism photographs taken by citizens in citizen science programs
AU - Suzuki-Ohno, Yukari
AU - Westfechtel, Thomas
AU - Yokoyama, Jun
AU - Ohno, Kazunori
AU - Nakashizuka, Tohru
AU - Kawata, Masakado
AU - Okatani, Takayuki
N1 - Funding Information:
We greatly thank many citizens participating in our citizen science program for their help in taking bee photographs. Fujitsu Ltd. provided us Mobile Phone System and Cloud Services. We thank Y. Hatakeyama (Fujitsu Ltd.) for his help in supporting our citizen science program. We also thank Y. Ampo (Hokkaido Environment Foundation), H. Abe (Hokkaido Government), W. Ohnishi (Kanagawa Prefectural Museum of Natural History), U. Jinbo (National Museum of Nature and Science), M. Yamazaki (Sapporo Museum Activities Center), Y. Shiro-saka (Bihoro Museum), S. Kariyama (Kurashiki Museum of Natural History), and K. Nakagawa (Minamisoma City Museum) for their help in supporting our citizen science program. YSO was supported by Grant-in-Aid for JSPS Fellow Grant Number JP16J40194. TN was supported by the Environment Research and Technology Development Fund (S-15 Predicting and Assessing Natural Capital and Ecosystem Services) of the Ministry of the Environment, Japan, and JSPS KAKENHI Grant Number 17H03835. Finally, we thank Kota Yamaguchi and Metira Banluesanoh for their help in trial experiments.
Publisher Copyright:
© 2022, The Author(s).
PY - 2022/12
Y1 - 2022/12
N2 - Citizen science programs using organism photographs have become popular, but there are two problems related to photographs. One problem is the low quality of photographs. It is laborious to identify species in photographs taken outdoors because they are out of focus, partially invisible, or under different lighting conditions. The other is difficulty for non-experts to identify species. Organisms usually have interspecific similarity and intraspecific variation, which hinder species identification by non-experts. Deep learning solves these problems and increases the availability of organism photographs. We trained a deep convolutional neural network, Xception, to identify bee species using various quality of bee photographs that were taken by citizens. These bees belonged to two honey bee species and 10 bumble bee species with interspecific similarity and intraspecific variation. We investigated the accuracy of species identification by biologists and deep learning. The accuracy of species identification by Xception (83.4%) was much higher than that of biologists (53.7%). When we grouped bee photographs by different colors resulting from intraspecific variation in addition to species, the accuracy of species identification by Xception increased to 84.7%. The collaboration with deep learning and experts will increase the reliability of species identification and their use for scientific researches.
AB - Citizen science programs using organism photographs have become popular, but there are two problems related to photographs. One problem is the low quality of photographs. It is laborious to identify species in photographs taken outdoors because they are out of focus, partially invisible, or under different lighting conditions. The other is difficulty for non-experts to identify species. Organisms usually have interspecific similarity and intraspecific variation, which hinder species identification by non-experts. Deep learning solves these problems and increases the availability of organism photographs. We trained a deep convolutional neural network, Xception, to identify bee species using various quality of bee photographs that were taken by citizens. These bees belonged to two honey bee species and 10 bumble bee species with interspecific similarity and intraspecific variation. We investigated the accuracy of species identification by biologists and deep learning. The accuracy of species identification by Xception (83.4%) was much higher than that of biologists (53.7%). When we grouped bee photographs by different colors resulting from intraspecific variation in addition to species, the accuracy of species identification by Xception increased to 84.7%. The collaboration with deep learning and experts will increase the reliability of species identification and their use for scientific researches.
UR - http://www.scopus.com/inward/record.url?scp=85123584019&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85123584019&partnerID=8YFLogxK
U2 - 10.1038/s41598-022-05163-5
DO - 10.1038/s41598-022-05163-5
M3 - Article
C2 - 35075168
AN - SCOPUS:85123584019
SN - 2045-2322
VL - 12
JO - Scientific Reports
JF - Scientific Reports
IS - 1
M1 - 1210
ER -