Detection of fusarium head blight using a YOLOv5s-based method improved by attention mechanism

Lei Shi, Chengkai Yang, Xiaoyun Sun, Jiayue Sun, Ping Dong, Shufeng Xiong, Jian Wang

Abstract


Fusarium head blight (FHB) is one of the most destructive diseases in global wheat production. In order to count the FHB-infected wheat ears under field conditions, this study proposed an algorithm for diseased wheat ear detection based on improved YOLOv5s (Tr-YOLOv5s). The Swin Transformer was used to replace the CSPDarknet backbone network to enhance the extraction of characteristic information of the population wheat ears of FHB in the field background. The convolutional block attention module (CBAM) attention mechanism was added to improve the detection effect of target wheat ears, subsequently improving the overall accuracy of the model. The original loss function complete intersection over union (CIoU) was replaced by Scylla intersection over union (SIoU) loss to accelerate the model convergence and decrease the loss value. The results showed that the mean average precision (mAP) of the Tr-YOLOv5s model reached 90.64%, making a 4.63% improvement compared to the original YOLOv5s model. The improved model could quickly detect and count wheat FHB ear in the field environment, which laid a foundation for the subsequent automatic disease identification and grading of wheat FHB under field conditions.
Keywords: fusarium head blight, YOLOv5s, attention mechanism, Swin Transformer, loss function
DOI: 10.25165/j.ijabe.20241705.8425

Citation: Shi L, Yang C H, Sun X Y, Sun J Y, Dong P, Xiong S F, et al. Detection of fusarium head blight using a YOLOv5s-based method improved by attention mechanism. Int J Agric & Biol Eng, 2024; 17(5): 247-254.

Keywords


fusarium head blight, YOLOv5s, attention mechanism, Swin Transformer, loss function

Full Text:

PDF

References


Han J C, Zhang Z, Cao J, Luo Y C, Zhang L L, Li Z Y, Zhang J. Prediction of winter wheat yield based on multi-source data and machine learning in China. Remote Sensing, 2020; 12（2）: 236.

Huang J, Chen J H, Zhang F M, Hu Z H. Spatial-temporal changes in risk of climate related yield reduction of winter wheat during 1973-2014 in Anhui province, southeast China. Theoretical and Applied Climatology, 2022; 148（1-2）: 49–63.

Zhao S Q, Gu J B, Zhao Y Y, Hassan M, Li Y N, Ding W M. A method for estimating spikelet number per panicle: Integrating image analysis and a 5-point calibration model. Scientific Reports, 2015; 5: 16241.

Chaudhary A, Thakur R, Kolhe S, Kamal R. A particle swarm optimization based ensemble for vegetable crop disease recognition. Computers and Electronics in Agriculture, 2020; 178: 105747.

Abdu A M, Mokji M M, Sheikh U U. Automatic vegetable disease identification approach using individual lesion features. Computers and Electronics in Agriculture, 2020; 176: 105660.

Suganya Devi K, Srinivasan P, Bandhopadhyay S. H2K - A robust and optimum approach for detection and classification of groundnut leaf diseases. Computers and Electronics in Agriculture, 2020; 178: 105749.

Rahman C R, Arko P S, Ali M E, Khan M A I, Apon S H, Nowrin F, et al. Identification and recognition of rice diseases and pests using convolutional neural networks. Biosystems Engineering, 2020; 194: 112–120.

Li C L, Li H Y, Gao G S, Liu Z F, Liu P C. An accelerating convolutional neural networks via a 2D entropy based-adaptive filter search method for image recognition. Applied Soft Computing, 2023; 142: 110326.

Zhao Z Q, Zheng P, Xu S T, Wu X D. Object detection with deep learning: A review. IEEE Transactions on Neural Networks and Learning Systems, 2019; 30（11）: 3212–3232.

Redmon J, Divvala S, Girshick R, Farhadi A. You Only Look Once: Unified, real-time object detection. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition （CVPR）, Las Vegas: IEEE, 2016; pp.779–788. doi: 10.1109/CVPR.2016.91.

Agarwal M, Gupta S K, Biswas K K. Development of efficient CNN model for tomato crop disease identification. Sustainable Computing: Informatics & Systems, 2020; 28: 100407.

Fang T, Chen P, Zhang J, Wang B. Crop leaf disease grade identification based on an improved convolutional neural network. Journal of Electronic Imaging, 2020; 29（1）: 013004.

Qi J T, Liu X N, Liu K, Xu F R, Guo H, Tian X L, et al. An improved YOLOv5 model based on visual attention mechanism: Application to recognition of tomato virus disease. Computers and Electronics in Agriculture, 2022; 194: 106780.

Zhang D Y, Luo H S, Wang D Y, Zhou X G, Li W F, Gu C Y, et al. Assessment of the levels of damage caused by fusarium head blight in wheat using an improved YOLOv5 method. Computers and Electronics in Agriculture, 198: 107086.

Wang C-Y, Liao H-Y M, Wu Y-H, Chen P-Y, Hsieh J-W, Yeh I-H. CSPNet: A new backbone that can enhance learning capability of CNN. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops （CVPRW）, Seattle: IEEE, 2020; pp.1571–1580. doi: 10.1109/CVPRW50498.2020.00203.

Zheng Z H, Wang P, Liu W, Li J Z, Ye R G, Ren D W. Distance-IoU loss: Faster and better learning for bounding box regression. In: Proceedings of the AAAI Conference on Artificial Intelligence, 2020; 34（7）: 12993–13000.

Du S J, Zhang B F, Zhang P. Scale-sensitive IOU loss: An improved regression loss function in remote sensing object detection. IEEE Access, 2021; 9: 141258–141272.

Woo S, Park J, Lee J Y, Kweon I S. CBAM: Convolutional Block Attention Module. In: Proceedings of the European Conference on Computer Vision （ECCV）, 2018; pp.3–19. doi: 10.1007/978-3-030-01234-2_1.

Wu D H, Lv, S C, Jiang M, Song H B. Using channel pruning-based YOLO v4 deep learning algorithm for the real-time and accurate detection of apple flowers in natural environments. Computers and Electronics in Agriculture, 2020; 178: 105742.

Ren S, He K M, Girshick R, Sun J. Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017; 39（6）: 1137–1149.

Xiao D Q, Feng J Z, Lin T Y, Pang C H, Ye Y W. Classification and recognition scheme for vegetable pests based on the BOF-SVM model. Int J Agric & Biol Eng, 2018; 11（3）: 190–196.

Wang L A, Zhou X D, Zhu X K, Dong Z D, Guo W S. Estimation of biomass in wheat using random forest regression algorithm and remote sensing data. The Crop Journal, 2016; 4（3）: 212–219.

Sampathkumar S, Rajeswari R. An automated crop and plant disease identification scheme using cognitive fuzzy C-means algorithm. IETE Journal of Research, 2022; 68（5）: 3786–3797.

Bao W X, Zhao J, Hu G S, Zhang D Y, Huang L S, Liang D. Identification of wheat leaf diseases and their severity based on elliptical-maximum margin criterion metric learning. Sustainable Computing: Informatics & Systems, 2021; 30: 100526.

Basavaiah J, Anthony A A. Tomato leaf disease classification using multiple feature extraction techniques. Wireless Personal Communications, 2020; 115（1）: 633–651.

Chew R, Rineer J, Beach R, O’Neil M, Ujeneza N, Lapidus D, et al. Deep neural networks and transfer learning for food crop identification in UAV images. Drones, 2020; 4（1）: 7.

Zhang F, Chen Z J, Ali S, Yang N, Fu S L, Zhang Y K. Multi-class detection of cherry tomatoes using improved YOLOv4-Tiny. Int J Agric & Biol Eng, 2023; 16（2）: 225–231.

Tripathi S P, Yadav R K, Rai H. Chapter 9 - Weednet: A deep neural net for weed identification. In: Deep Learning for Sustainable Agriculture, Academic Press, 2022; pp.223–236. doi: 10.1016/B978-0-323-85214-2.00010-0.

Wang Z, Guo J X, Zhang S W. Lightweight convolution neural network based on multi-scale parallel fusion for weed identification. International Journal of Pattern Recognition and Artificial Intelligence, 2022; 36（7）: 2250028.

Tian J Y, Zhang Y, Wang Y L, Wang C, Zhang S Y, Ren T H. A method of corn disease identification based on convolutional neural network. In: 2019 12th International Symposium on Computational Intelligence and Design （ISCID）, Hangzhou: IEEE, 2019; pp.245–248. doi: 10.1109/ISCID.2019.00063.

Wu Y H. Identification of maize leaf diseases based on convolutional neural network. Journal of Physics: Conference Series, 2021; 1748（3）: 032004.

Cheng X, Zhang Y H, Chen Y Q, Wu Y Z, Yue Y. Pest identification via deep residual learning in complex background. Computers and Electronics in Agriculture, 2017; 141: 351–356.

Wang D W, Deng L M, Ni J G, Gao J Y, Zhu H F, Han Z Z. Recognition pest by image-based transfer learning. Journal of the Science of Food and Agriculture, 2019; 99（10）: 4524–4531.

Liu B, Ding Z F, Tian L L, He D J, Li S Q, Wang H Y. Grape leaf disease identification using improved deep convolutional neural networks. Frontiers in Plant Science, 2020; 11: 1082.

Chen J D, Zhang D F, Zeb A, Nanehkaran Y A. Identification of rice plant diseases using lightweight attention networks. Expert Systems with Applications, 2021; 169: 114514.

Marszalek M, Körner Ms, Schmidhalter U. Prediction of multi-year winter wheat yields at the field level with satellite and climatological data. Computers and Electronics in Agriculture, 2022; 194: 106777.

Ma J C, Li Y X, Du K M, Zheng F X, Zhang L X, Gong Z H, et al. Segmenting ears of winter wheat at flowering stage using digital images and deep learning. Computers and Electronics in Agriculture, 2020; 168: 105159.

Madec S, Jin X L, Lu H, De Solan B, Liu S Y, Duyme F, et al. Ear density estimation from high resolution RGB imagery using deep learning technique. Agricultural and Forest Meteorology, 2019; 264: 225–234.

Ma J C, Li Y X, Liu H J, Wu Y F, Zhang L X. Towards improved accuracy of UAV based wheat ears counting: A transfer learning method of the ground-based fully convolutional network. Expert Systems With Applications, 2022; 191: 116226.

Wang Y D, Qin Y X, Cui J L. Occlusion robust wheat ear counting algorithm based on deep learning. Frontiers in Plant Science, 2021; 12: 645899.

Yang B H, Gao Z W, Gao Y, Zhu Y. Rapid detection and counting of wheat ears in the field using yolov4 with attention module. Agronomy, 2021; 11（6）: 1202.




Copyright (c) 2024 International Journal of Agricultural and Biological Engineering

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

2023-2026 Copyright IJABE Editing and Publishing Office