Adaptive spraying decision system for plant protection unmanned aerial vehicle based on reinforcement learning

Ziyuan Hao, Xinze Li, Chao Meng, Wei Yang, Minzan Li

Abstract


To solve the problem of lacking scientific guidance in aerial pesticide application, this study introduced an adaptive spraying decision system (ASDS) for the unmanned aerial vehicle (UAV) spraying to guide the operators of plant protection UAVs to set reasonable spraying parameters under complicated environment. The minimum applied volume rate, proper spraying velocity, spraying height, and initial droplet size were recommended by the ASDS. The key factor of the decision system is the decision model of reinforcement learning based on the actor-critic neural network. In specific, the field experimental data were used to train the critic and actor networks, which made the model adaptive to optimize the output of spraying parameters. Compared with the conventional spraying parameters, the spraying parameters recommended by the ASDS had a positive impact on wheat parcels. The decision results of the ASDS showed that the spraying volume rate was lower in the blocks with a small leaf area index. In addition, the spraying volume rate for the whole parcel was reduced by 14%. After UAV spraying, the uniformity of the droplet deposition in the ASDS parcel was better than that in the conventional parcel. Moreover, the penetrability of the droplets and the control efficacy for the brown wheat mite Petrobia latens (Muller) were similar in the two parcels. The ASDS can recommend the optimal spraying parameters to minimize pesticide application.
Keywords: unmanned aerial vehicle, spraying parameters, decision, reinforcement learning, droplet deposition
DOI: 10.25165/j.ijabe.20221504.6929

Citation: Hao Z Y, Li X Z, Meng C, Yang W, Li M Z. Adaptive spraying decision system for plant protection unmanned aerial vehicle based on reinforcement learning. Int J Agric & Biol Eng, 2022; 15(4): 16–26.

Keywords


unmanned aerial vehicle, spraying parameters, decision, reinforcement learning, droplet deposition

Full Text:

PDF

References


Hong S W, Zhao L, Zhu H. CFD simulation of pesticide spray from air-assisted sprayers in an apple orchard: Tree deposition and off-target losses. Atmospheric Environment, 2018; 175: 109–119.

Su X J, Wang Y L, Wei J, Huang C C, Liu A Y, Li S, et al. Pesticide deposition percentage and control effect of nine kinds of crop protection machineries against wheat aphid. Acta Agriculturae Boreali-Occidentalis Sinica, 2018; 27(1): 149–154. (in Chinese)

Li Y N, Wang H D, Qu H R, Cao H Z, Tong B X, Cui S L, Han Y R, Ma W Q. Establishment and assessment of management systems for wheat and maize with high yield and nitrogen use efficiency based on GIS at the village level. Chinese Journal of Eco-Agriculture, 2019; 27(7): 1124–1133. (in Chinese)

Zhang X Q, Song X P, Liang Y J, Qin Z Q, Wu J M. Effects of spray parameters of drone on the droplet deposition in sugarcane canopy. Sugar Tech, 2020; 22(2): 583–588.

Wang C L, Song J L, He X K, Wang Z C, Wang S L, Meng Y H. Effect of flight parameters on distribution characteristics of pesticide spraying droplets deposition of plant-protection unmanned aerial vehicle. Transactions of the CSAE, 2017; 33(23): 109–116. (in Chinese)

Qin W C, Qiu B J, Xue X Y, Chen C, Xu Z F, Zhou Q Q. Droplet deposition and control effect of insecticides sprayed with an unmanned aerial vehicle against plant hoppers. Crop Protection, 2016; 85: 79–88.

Chen S D, Lan Y B, Zhou Z Y, Fan O Y, Wang G B, Huang X Y, et al. Effect of droplet size parameters on droplet deposition and drift of aerial spraying by using plant protection UAV. Journal of Agronomy, 2020; 10: 195. doi: 10.3390/agronomy10020195.

Wang G B, Lan Y B, Qi H X, Chen P C, Hewitt A, Han Y X. Field evaluation of an unmanned aerial vehicle (UAV) sprayer: effect of spray volume on deposition and the control of pests and disease in wheat. Pest Management Science, 2019; 75(6): 1546–1555.

Xue X Y, Tu K, Qin W C, Lan Y B, Zhang H H. Drift and deposition of ultra-low altitude and low volume application in paddy field. Int J Agric & Biol Eng, 2014; 7(4): 23–28.

Kharim M N A, Wayayok A, Shariff A R M, Abdullah A F, Husin E M. Droplet deposition density of organic liquid fertilizer at low altitude UAV aerial spraying in rice cultivation. Computers and Electronics in Agriculture, 2019; 167: 105045. doi: 10.1016/j.compag.2019.105045.

Gil E, Campos J, Ortega P, Llop J, Gras A, Armengol E, et al. DOSAVIA: Tool to calculate the optimal volume rate and pesticide amount in vineyard spray applications based on a modified leaf wall area method. Computers and Electronics in Agriculture, 2019; 160: 117–130.

Tackenberg M, Volkmar C, Dammer K H. Sensor-based variable-rate fungicide application in winter wheat. Pest Management Science, 2016; 72(10): 1888–1896.

Lee R, Uyl R D, Runhaar H. Assessment of policy instruments for pesticide use reduction in Europe; Learning from a systematic literature review. Crop Protection, 2019; 126: 104929. doi: 10.1016/j.cropro.2019.104929.

Chen Y M, Lin F G, Zhao Y, Huang T T, Ding L, Mei A Z, et al. Prevalence reasons and monitoring countermeasures of scab in eastern wheat area of Jiangsu Province. Plant Diseases and Pests, 2016; 7(2): 1–6.

Dong Y Y, Zhao C J, Yang G J, Chen L P, Wang J H, Feng H K. Integrating a very fast simulated annealing optimization algorithm for crop leaf area index variational assimilation. Mathematical & Computer Modelling, 2013; 58(3-4): 877–885.

Bu F, Wang X. A smart agriculture IoT system based on deep reinforcement learning. Future Generation Computer Systems, 2019; 99: 500–507.

An H, Xian B. Attitude reinforcement learning control of an unmanned helicopter with verification. Control Theory & Applications, 2019; 36(4): 516–524. (in Chinese)

Tottman D R, Broad H. The decimal code for the growth stages of cereals, with illustrations. Annals of Applied Biology, 1987; 93(2): 441–454.

Emilia H, Arnoldus W P V. Spray drift review: The extent to which a formulation can contribute to spray drift reduction. Crop Protection, 2013; 44: 75–83.

Tang Y, Hou C J, Luo S M, Lin J T, Yang Z, Huang W F. Effects of operation height and tree shape on droplet deposition in citrus trees using an unmanned aerial vehicle. Computers and Electronics in Agriculture, 2018; 148: 1–7.

Chen W Q. Integrated management of diseases and insect pests on wheat. Plant Protection, 2013; 39(5): 16–24. (in Chinese)

Xiao Q, Li Y P, Li M, Qu T Y, Li D Y, Li X Y. Application of XAIRCRAFT P20 plant protection UAV to the control of Sclerochloa dura (L.) Beauv. in a wheat field. Barleyand Cereal Sciences, 2019; 36(3): 39–40, 51. (in Chinese)

Ma L, Wang X Z, Wang S P, Liu S T. Evaluation of the control efficiency of lime sulfur to red-spider and main diseases on wheat. Agrochemicals, 2016; 55(6): 450–453. (in Chinese)

Franz E, Bouse L F, Carlton J B, Kirk I W, Latheef M A. Aerial spray deposit relations with plant canopy and weather parameters. Transactions of the ASAE, 1998; 41(4): 959–966.

Maciel C F S, Teixeira M M, Fernandes H C, Zolnier S, Cecon P R. Droplet spectrum at different vapour pressure deficits. Revista Ciencia Agronomica, 2016; 47(1): 41–46.

Faiçal B S, Freitas H, Gomes P H, Mano L Y, Pessin G, Carvalho A, et al. An adaptive approach for UAV-based pesticide spraying in dynamic environments. Computers and Electronics in Agriculture, 2017; 138:

–223.

Chen Y Q, Yang W, Li M Z, Sun H. Measurement system of winter wheat LAI based on Android mobile platform. Transactions of the CSAM, 2017; 48(S1): 123–128. (in Chinese)

Zhang P, Deng L, Lyu Q, He S L, Yi S L, Liu Y D, Yu Y X, Pan H Y. Effects of citrus tree-shape and spraying height of small unmanned aerial vehicle on droplet distribution. Int J Agric & Biol Eng, 2016; 9(4): 45–52.

Furness G O, Magarey P A, Miller P M, Drew H J. Fruit tree and vine sprayer calibration based on canopy size and length of row: unit canopy row method. Crop Protection, 1998; 17(8): 639–644.

Gil E, Escolà A. Design of a decision support method to determine volume rate for vineyard spraying. Applied Engineering in Agriculture, 2009; 25(2): 145–151.

Jensen P K, Olesen M H. Spray mass balance in pesticide application: a review. Crop Protection, 2014; 61(2): 23–31.

Planas S, Camp F, Solanelles F, Sanz R, Rosell-Polo J R. Advances in pesticide dose adjustment in tree crops. In: 9th European Conference on Precision Agriculture, Lleida, Spain, 2013; pp.533–539.

Grondman I, Busoniu L, Lopes G A D, Babuska R. A survey of actor-critic reinforcement learning: Standard and natural policy gradients. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 2012; 42(6): 1291–1307.

Song R, Lewis F, Wei Q, Zhang H G, Jiang Z P, Levine D. Multiple actor-critic structures for continuous-time optimal control using input-output data. IEEE Transactions on Neural Networks and Learning Systems, 2015; 26(4): 851–865.

Fan Q Y, Yang G H. Adaptive actor-critic design-based integral sliding-mode control for partially unknown nonlinear systems with input disturbances. IEEE Transactions on Neural Networks and Learning Systems, 2016; 27(1): 165–177.

Zhang S Q, Zhao S S. Effects of returning whole corn stalk into soil on the soil moisture and manure and winter wheat growth. Journal of Hebei Agricultural Sciences, 2001; 5(2): 50–55. (in Chinese)

Song L, Li F M, Fan X W, Xiong Y C, Wang W Q, Wu X B, Turner N C. Soil water availability and plant competition affect the yield of spring wheat. European Journal of Agronomy, 2009; 31(1): 51–60.

Ibrahim M, Yamin M, Sarwar G, Anayat A, Habib F, Ullah S, et al. Tillage and farm manure affect root growth and nutrient uptake of wheat and rice under semi-arid conditions. Applied Geochemistry, 2011; 26: S194–S197.

Chen S D, Lan Y B, Zhou Z Y, Liao J, Zhu Q Y. Effects of spraying parameters of small plant protection UAV on droplets deposition distribution in citrus canopy. Journal of South China Agricultural University, 2017; 38(5): 97–102. (in Chinese)

Ru Y, Jin L, Zhou H P, Jia Z C. Performance experiment of rotary hydraulic atomizing nozzle for aerial spraying application. Transactions of the CSAE, 2014; 30(3): 50–55. (in Chinese)




Copyright (c) 2022 International Journal of Agricultural and Biological Engineering

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

2023-2026 Copyright IJABE Editing and Publishing Office