Recognition of grape leaf diseases using MobileNetV3 and deep transfer learning

Xiang Yin, Wenhua Li, Zhen Li, Lili Yi

Abstract


Timely diagnosis and accurate identification of grape leaf diseases are decisive for controlling the spread of disease and ensuring the healthy development of the grape industry. The objective of this research was to propose a simple and efficient approach to improve grape leaf disease identification accuracy with limited computing resources and scale of training image dataset based on deep transfer learning and an improved MobileNetV3 model (GLD-DTL). A pre-training model was obtained by training MobileNetV3 using the ImageNet dataset to extract common features of the grape leaves. And the last convolution layer of the pre-training model was modified by adding a batch normalization function. A dropout layer followed by a fully connected layer was used to improve the generalization ability of the pre-training model and realize a weight matrix to quantify the scores of six diseases, according to which the Softmax method was added as the top layer of the modified networks to give probability distribution of six diseases. Finally, the grape leaf diseases dataset, which was constructed by processing the image with data augmentation and image annotation technologies, was input into the modified networks to retrain the networks to obtain the grape leaf diseases recognition (GLDR) model. Results showed that the proposed GLD-DTL approach had better performance than some recent approaches. The identification accuracy was as high as 99.84% while the model size was as small as 30 MB.
Keywords: grape leaf diseases, real-time recognition, deep transfer learning, MobileNetV3
DOI: 10.25165/j.ijabe.20221503.7062

Citation: Yin X, Li W H, Li Z, Yi L L. Recognition of grape leaf diseases using MobileNetV3 and deep transfer learning. Int J Agric & Biol Eng, 2022; 15(3): 184–194.

Keywords


grape leaf diseases, real-time recognition, deep transfer learning, MobileNetV3

Full Text:

PDF

References


Ji M M, Zhang L, Wu Q F. Automatic grape leaf diseases identification via United Model based on multiple convolutional neural networks. Information Processing in Agriculture, 2020; 7(3): 418–426.

Zhang S, Wu X, You Z, Zhang L. Leaf image based cucumber disease recognition using sparse representation classification. Computers and Electronics in Agriculture, 2017; 134: 135–141.

Zhang C L, Zhang S W, Yang J C, Shi Y C, Chen J. Apple leaf disease identification using genetic algorithm and correlation based feature selection method. Int J Agric & Biol Eng, 2017; 10(2): 74–83.

Ramcharan A, Baranowski K, McCloskey P, Ahmed B, Legg J, Hughes D P. Deep learning for image-based Cassava disease detection. Frontiers in Plant Science, 2017; 8: 1852. doi: 10.3389/fpls.2017.01852.

Lu Y, Yi S, Zeng N, Liu Y, Zhang Y. Identification of rice diseases using deep convolutional neural networks. Neurocomputing, 2017; 267(6): 378–384.

Bailey T L. MD-SVM: A novel SVM-based algorithm for the motif discovery of transcription factor binding sites. Bioinformatics, 2019; 28(1): 56–62.

Deng X L, Li Z, Hong T S. Citrus disease recognition based on weighted scalable vocabulary tree. Precision agriculture, 2014; 15(3): 321–330.

Kussul N, Lavreniuk M, Skakun S, Shelestov A. Deep learning classification of land cover and crop types using remote sensing data. IEEE Geoscience and Remote Sensing Letters, 2017; 14(5): 778–782.

Arulkumaran K, Deisenroth M P, Brundage M, Bharath A A. A brief survey of deep reinforcement learning. IEEE Signal Processing Magazine, 2017; 34(6): 26–38.

McCool C, Perez T, Upcroft B. Mixtures of lightweight deep convolutional neural networks: Applied to agricultural robotics. IEEE Robotics and Automation Letters, 2017; 2(3): 1344–1351.

Dechant C, Wiesner–Hanks T, Chen S, Stewart E L, Yosinski J, Gore M A, et al. Automated identification of northern leaf blight-infected maize plants from field imagery using deep learning. Phytopathology, 2017; 6(107): 1426–1432.

Mohammed B, Kamel B, Abdelouahab M. Deep learning for tomato diseases: Classification and symptoms visualization. Applied Artificial Intelligence, 2017; 31(4): 299–315.

Nachmani E, Marciano E, Lugosch L, Warren J G, David B. Deep learning methods for improved decoding of linear codes. IEEE Journal of Selected Topics in Signal Processing, 2018; 12(1): 119–131.

Saleem M, Potgieter J, Arif K M. Plant disease detection and classification by deep learning. Plants, 2019; 8(11): 468–510.

Geetharamani G, Arun P J. Identification of plant leaf diseases using a nine-layer deep convolutional neural network. Computers & Electrical Engineering, 2019; 76: 323–338.

Pan S J, Yang Q. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 2010; 22(10): 1345–1359.

Abbas A, Abdelsamea M M, Gaber M. 4S-DT: Self supervised super sample decomposition for transfer learning with application to COVID-19 detection. IEEE Transactions on Neural Networks and Learning Systems, 2021; 32(7): 2798–2808.

Liu Y, Jing L, Jian Y, Ng M K. Learning transferred weights from Co-occurrence data for heterogeneous transfer learning. IEEE Transactions on Neural Networks and Learning Systems, 2016; 27(11): 2187–2200.

Zhuang F, Qi Z, Duan K, Xi B D, Zhu Y C, Zhu H S, et al. A comprehensive survey on transfer learning. Proceedings of the IEEE, 2020; 109(1): 43–76.

Coulibaly S, Kamsu F B, Kamissoko D, Traore D. Deep neural networks with transfer learning in millet crop images. Computers in industry, 2019; 108(2019): 115–120.

Long M S, Ouyang C J, Liu H, Fu Q. Image recognition of Camellia oleifera diseases based on convolutional neural network and transfer learning. Transactions of the CSAE, 2018; 34(18): 194–201. (in Chinese)

Arnal B. Impact of dataset size and variety on the effectiveness of deep learning and transfer learning for plant disease classification. Computers and Electronics in Agriculture, 2018; 153: 46–53.

Lumini A, Nanni L. Deep learning and transfer learning features for plankton classification. Ecological Informatics, 2019; 51: 33–43.

Chen J, Chen J, Zhang D, Sun Y, Nanehkaran Y. Using deep transfer learning for image-based plant disease identification. Computers and Electronics in Agriculture, 2020; 173: 105393. doi: 10.1016/ j.compag.2020.105393.

Zhu R, Li S, Wang P, Xu M L, Yu S. Energy-efficient deep reinforced traffic grooming in elastic optical networks for cloud-fog computing. IEEE Internet of Things Journal, 2021; 8(15): 12410–12421.

Lin F, Chen J, Ding G, Jiao Y, Sun J C, Wang H C. Spectrum prediction based on GAN and deep transfer learning: A cross-band data augmentation framework. China Communications, 2021; 8(1): 18–32.

Abidin A Z, Deng B, Dsouza A M, Nagarajan M B, Coan P, Wismülleret A. Deep transfer learning for characterizing chondrocyte patterns in phase contrast X-Ray computed tomography images of the human patellar cartilage. Computers in Biology and Medicine, 2018; 95: 24–33.

Zhang X, Wang Z, Liu D, Lin Q, Ling Q. Deep adversarial data augmentation for extremely low data regimes. IEEE Transactions on Circuits and Systems for Video Technology, 2020; 3(1): 15–28.

Frid-Adar M, Diamant I, Klang E, Amitai M, Goldberger J, Greenspan J. GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification. Neurocomputing, 2018; 321(10): 321–331.

Rangarajan A K, Purushothaman R, Ramesh A. Tomato crop disease classification using pre-trained deep learning algorithm. Procedia Computer Science, 2018; 133: 1040–1047.

Chen Z, Le Z, Cao Z, Jing J. Distilling the knowledge from handcrafted features for human activity recognition. IEEE Transactions on Industrial Informatics, 2018; 14(10): 4334–4342.

Liang Z, Tao M, Wang L, Su J, Yang X. Automatic modulation recognition based on adaptive attention mechanism and ResNeXt WSL model. IEEE Communications Letters, 2021; 25(9): 2953–2957.

Hui J, Du M, Ye X, Qin Q, Sui J. Effective building extraction from high-resolution remote sensing images with multitask driven deep neural network. IEEE Geoscience and Remote Sensing Letters, 2019; 16(5): 786–790.




Copyright (c) 2022 International Journal of Agricultural and Biological Engineering

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

2023-2026 Copyright IJABE Editing and Publishing Office