Estimation of asparagus stem height and diameter in complex environments by integrating improved YOLOv5 with point cloud

Authors

  • Weiwei Hong 1. Faculty of Mechanical Engineering, Zhejiang Sci-Tech University, Hangzhou 310018, China 2. Special Equipment Institute, Hangzhou Vocational&Technical College, Hangzhou 310018, China
  • Zenghong Ma 1. Faculty of Mechanical Engineering, Zhejiang Sci-Tech University, Hangzhou 310018, China 3. Zhejiang Province Key Laboratory of Transplanting Equipment and Technology, Hangzhou 310018, China 4. Key Laboratory of Agricultural Equipment for Hilly and Mountainous Areas in Southeastern China (Co-construction by Ministry and Province), Ministry of Agriculture and Rural Affairs, Hangzhou 310018, China
  • Bingliang Ye 1. Faculty of Mechanical Engineering, Zhejiang Sci-Tech University, Hangzhou 310018, China 3. Zhejiang Province Key Laboratory of Transplanting Equipment and Technology, Hangzhou 310018, China 4. Key Laboratory of Agricultural Equipment for Hilly and Mountainous Areas in Southeastern China (Co-construction by Ministry and Province), Ministry of Agriculture and Rural Affairs, Hangzhou 310018, China
  • Gaohong Yu 1. Faculty of Mechanical Engineering, Zhejiang Sci-Tech University, Hangzhou 310018, China 3. Zhejiang Province Key Laboratory of Transplanting Equipment and Technology, Hangzhou 310018, China 4. Key Laboratory of Agricultural Equipment for Hilly and Mountainous Areas in Southeastern China (Co-construction by Ministry and Province), Ministry of Agriculture and Rural Affairs, Hangzhou 310018, China
  • Tao Tang 1. Faculty of Mechanical Engineering, Zhejiang Sci-Tech University, Hangzhou 310018, China
  • Mingfeng Zheng 1. Faculty of Mechanical Engineering, Zhejiang Sci-Tech University, Hangzhou 310018, China 2. Special Equipment Institute, Hangzhou Vocational&Technical College, Hangzhou 310018, China

DOI:

https://doi.org/10.25165/ijabe.v18i5.9262

Keywords:

asparagus, height, diameter, improved YOLOv5, point cloud

Abstract

Identifying the maturity of asparagus is a crucial step for machine-assisted harvesting of asparagus in complex environments. This study proposes an innovative method to evaluate the height and diameter of asparagus stems, combining an enhanced YOLOv5 detection algorithm with point cloud data. In this method, first, the YOLOv5 model was improved, enabling efficient recognition and detection of asparagus in complex environments. Subsequently, a RealSense L515 radar camera was deployed to capture both the original RGB images and the point cloud information. The improved YOLOv5 algorithm was then employed to detect asparagus instances within the RGB images, with the pixel positions of the detection frames mapped onto the point cloud dataset to extract comprehensive 3D point cloud details of the asparagus. Finally, noise was reduced through statistical filtering and Euclidean clustering, and asparagus height was determined using the oriented bounding box methodology. Slices, each with a thickness of 10 mm, were extracted at designated measurement points, and the asparagus diameter was calculated by assessing the disparity between the maximum and minimum coordinates perpendicular to the growth direction of the asparagus. Experimental results showed that the mean average precision, precision, and recall of the improved YOLOv5 model increased by 4.85%, 5.09%, and 3.4%, reaching 98.21%, 97.11%, and 95.33%, respectively, which are higher than those of the YOLOv5 prototype network. Therefore, the proposed method could effectively detect asparagus. The algorithm exhibited a mean absolute error of 1.08 cm, a mean absolute percentage error of 4.06%, and a root mean square error of 1.60 cm in its estimation of asparagus height. For asparagus diameter estimation, the algorithm achieved a mean absolute error of 0.86 mm, a mean absolute percentage error of 7.98%, and a root mean square error of 1.23 mm. These results confirm that the proposed method can estimate the height and diameter of asparagus stems accurately, thereby providing invaluable technical support for machine harvesting of asparagus. Keywords: asparagus, height, diameter, improved YOLOv5, point cloud DOI: 10.25165/j.ijabe.20251805.9262 Citation: Hong W W, Ma Z H, Ye B L, Yu G H, Tang T, Zheng M F. Estimation of asparagus stem height and diameter in complex environments by integrating improved YOLOv5 with point cloud. Int J Agric & Biol Eng, 2025; 18(5): 268–277.

References

Lu B. Development status and trend of asparagus industry in China. Shanghai Vegetables, 2018; 4: 3, 4, 12. （in Chinese） doi: 10.3969/j.issn.1002-1469.2018.04.002.

Peng L L, Yu Y F, Zhou K H. Analysis of the industrial layout optimization of asparagus in China. Chinese Journal of Agricultural Resources and Regional Planning, 2015; 36（1）: 123–127. （in Chinese）

Li D, Lin Z. Study on international trade and industrial competitiveness of asparagus in China since 2000. Chinese Agricultural Science Bulletin, 2022; 38（26）: 158–164. （in Chinese）

Li D, Lin Z, Li L. Analysis of global asparagus production situation in recent fifty years. Hunan Agricultural Sciences, 2019; 9: 96–99.

He C X. Development status and prospect of asparagus industry in China. Vegatables, 2022; 5: 33–39. （in Chinese）

Gao F F, Fang W T, Sun X M, Wu Z C, Zhao G N, Li G, et al. A novel apple fruit detection and counting methodology based on deep learning and trunk tracking in modern orchard. Computers and Electronics in Agriculture, 2022; 197: 107000.

Kotaro I, Taichiro Y, Masayuki I, Yoshiko K. Estimating tree height and diameter at breast height （DBH） from digital surface models and orthophotos obtained with an unmanned aerial system for a Japanese Cypress （Chamaecyparis obtusa） forest. Remote Sensing, 2018; 10（2）: 13.

Swayze N C, Tinkham W T, Vogeler J C, Hudak A T. Influence of flight parameters on UAS-based monitoring of tree height, diameter, and density. Remote Sensing of Environment, 2021; 263: 112540.

Wu Z C, Li G, Yang R Z, Fu L S, Li R, Wang S J. Coefficient of restitution of kiwifruit without external interference. Journal of Food Engineering, 2022; 327: 111060.

Zhang C, Serra S, Quiros-Vargas J, Musacchi W, Sankaran S. Non-invasive sensing techniques to phenotype multiple apple tree architectures. Information Processing in Agriculture, 2023; 10（1）: 136–147.

Sakai H, Shiigi T, Kondo N, Ogawa Y, Taguchi N. Accurate position detecting during asparagus spear harvesting using a laser sensor. Engineering in Agriculture, 2013; 6（3）: 105–110.

Leu A, Razavi M, Langstadtler L, Ristic-Durrant D, Raffel H, Schenck C, et al. Robotic green asparagus selective harvesting. IEEE/ASME Transactions on Mechatronics, 2017; 22（6）: 2401–2410.

Clary C D, Ball T, Ward E, Fuchs S, Durfey J E, Cavalieri R P, et al. Performance and economic analysis of a selective asparagus harvester. Applied Engineering in Agriculture, 2007; 23（5）: 571–577.

Peebles M, Lim S H, Duke M, McGuinness B. Investigation of optimal network architecture for asparagus spear detection in robotic harvesting. IFAC-PapersOnLine, 2019; 52（30）: 283–287.

Peebles M, Shen H L, Duke M, Chi K A. Overview of sensor technologies used for 3d localization of asparagus spears for robotic harvesting. Applied Mechanics and Materials, 2018; 884: 77–85.

Peebles M, Shen H L, Streeter L, Duke M, Chi K A. Ground plane segmentation of time-of-flight images for asparagus harvesting. In: 2018 International Conference on Image and Vision Computing New Zealand （IVCNZ）, Auckland, New Zealand: IEEE, 2018; pp.1–6.

Kennedy G, Ila V, Mahony R. A Perception pipeline for robotic harvesting of green asparagus. IFAC-PapersOnLine, 2019; 52（30）: 288–293.

Liu X P, Wang D N, Li Y N, Guan X Q, Qin C J. Detection of green asparagus using Improved Mask R-CNN for automatic harvesting. Sensors, 2022; 22（23）: 9270.

Hong W W, Ma Z H, Ye B L, Yu G H, Tang T, Zheng M F. Detection of green asparagus in complex environments based on the improved YOLOv5 algorithm. Sensors, 2023; 23（3）: 1562.

Qian Y, Xu Q J, Yang Y Y, Lu H, Li H, Feng X B, et al. Classification of rice seed variety using point cloud data combined with deep learning. Int J Agric & Biol Eng, 2021; 14（5）: 206–212.

Kang H W, Chen C. Fruit detection, segmentation and 3D visualisation of environments in apple orchards. Computers and Electronics in Agriculture, 2020; 171: 105302.

Ji J T, Han Z H, Zhao K X, Li Q W, Du S C. Detection of the farmland plow areas using RGB-D images with an improved YOLOv5 model. Int J Agric & Biol Eng, 2024; 17（4）: 156–165.

Hua C J, Zou X T, Jiang Y, Yu J F, Chen Y. RGB-D visual saliency detection of stacked fruits under poor lighting. Int J Agric & Biol Eng, 2025; 18（1）: 230–237.

Wang Z, Wang Q Y, Lou M Z, Wu F, Zhu Y N, Hu D, et al. Geometric based apple suction strategy for robotic packaging. Int J Agric & Biol Eng, 2024; 17（3）: 12–20.

Hu H M, Kaizu Y, Zhang H D, Xu Y W, Imou K, Li M, et al. Recognition and localization of strawberries from 3D binocular cameras for a strawberry picking robot using coupled YOLO/Mask R-CNN. Int J Agric & Biol Eng, 2022; 15（6）: 175–179.

Wang J P, Xu L, Mei S, Hu H R, Zhou J L, Chen Q. Fast and accurate detection of kiwifruits in the natural environment using improved YOLOv4. Int J Agric & Biol Eng, 2024; 17（5）: 222–230.

Sun X M, Fang W T, Gao C Q, Fu L S, Majeed Y Q, Liu X J, et al. Remote estimation of grafted apple tree trunk diameter in modern orchard with RGB and point cloud based on SOLOv2. Computers and Electronics in Agriculture, 2022; 199: 107209.

Qiu R C, Miao Y L, Ji Y H, Zhang M, Li H, Liu G. Method for measurement of maize stem diameters based on RGB-D camera. Transactions of the Chinese Society for Agricultural Machinery, 2017; 33（s1）: 211–219. （in Chinese）

Yang S, Gao W L, Mi J Q, Wu M L, Wang M J, Deng L H. Method for measurement of vegetable seedlings height based on RGB-D camera. Transactions of the Chinese Society for Agricultural Machinery, 2019; 50（S1）: 128–135. （in Chinese）

McGlade J, Wallace L, Hally B, White A, Reinke K, Jones S. An early exploration of the use of the Microsoft Azure Kinect for estimation of urban tree Diameter at Breast Height. Remote Sensing Letters, 2020; 11（11）: 963–972.

Montoya O, Icasio-Hernández O, Salas J. TreeTool : A tool for detecting trees and estimating their DBH using forest point clouds. SoftwareX, 2021; 16: 100889. doi: 10.1016/j.softx.2021.100889.

Pires R d P, Olofsson K, Persson H J, Lindberg E, Holmgren J. Individual tree detection and estimation of stem attributes with mobile laser scanning along boreal forest roads. ISPRS J. Photogramm. Remote Sensing, 2022; 187: 211–224.

Li Y T, He L Y, Jia J M, Lv J, Chen J N, Qiao X, et al. In-field tea shoot detection and 3D localization using an RGB-D camera. Computers and Electronics in Agriculture, 2021; 185: 106149.

Bochkovskiy A, Wang C-Y, Liao H Y M. YOLOv4: Optimal speed and accuracy of object detection. arXiv: 2004.10934, 2020; In press. doi: 10.48550/arXiv.2004.10934.

Redmon J, Divvala S, Girshick R, Farhadi A. You only look once: Unified, real-time object detection. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition （CVPR）, Las Vegas, NV, USA: IEEE, 2016; pp.779–788.

Redmon J, Farhadi A. YOLO9000: Better, Faster, Stronger. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition （CVPR）, Honolulu, HI, USA: IEEE, 2017; pp.6517–6525.

Redmon J, Farhadi A. YOLOv3: An Incremental Improvement. arXiv: 1804.02767, 2018; In press. doi: arxiv-1804.02767.

Chen J R, Kao S H, He H, Zhuo W P, Wen S, Lee C H, et al. Run, don’t walk: Chasing higher FLOPS for faster neural networks. In: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition （CVPR）, Vancouver, BC, Canada: IEEE. 2023; pp.12021–12031.

Dai X Y, Chen Y P, Xiao B, Chen D D, Liu M C, Yuan L, et al. Dynamic head: Unifying object detection heads with attentions. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition （CVPR）, Nashville, TN, USA: IEEE, 2021; pp.7369–7378.

Tong Z J, Chen Y H, Xu Z W, Yu R. Wise-IoU: Bounding box regression loss with dynamic focusing mechanism. arXiv: 2301.10051, 2023; In press. doi: 10.48550/arXiv.2301.10051.

Downloads

Published

2025-10-27

How to Cite

Hong, W., Ma, Z., Ye, B., Yu, G., Tang, T., & Zheng, M. (2025). Estimation of asparagus stem height and diameter in complex environments by integrating improved YOLOv5 with point cloud. International Journal of Agricultural and Biological Engineering, 18(5), 268–277. https://doi.org/10.25165/ijabe.v18i5.9262

Issue

Vol. 18 No. 5 (2025): IJABE

Section

Information Technology, Sensors and Control Systems

License

IJABE is an international peer reviewed open access journal, adopting Creative Commons Copyright Notices as follows.


Authors who publish with this journal agree to the following terms:


  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.

  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.

  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).