Laser-range-finder-based target detection for human-robot collaboration in hilly orchards
DOI:
https://doi.org/10.25165/ijabe.v18i2.8346Keywords:
human-robot collaboration, following robot, human torso recognition, LiDAR, support vector data descriptorsAbstract
Human-robot collaboration is a promising means to promote orchard intelligence and reduce the over-reliance on manual work for complex agronomic practices such as fruit tree pruning, flower and fruit thinning, and harvesting. Accurate target detection and recognition of robots on humans are the basis and prerequisite for subsequent autonomous human-robot collaboration. In this study, detection and recognition of following robots for human torso were carried out in a standardized hilly orchard. A LiDAR-based human torso detection method was proposed based on the actual orchard environment. Breakpoint detection was used to cluster and segment the point clouds, and the segmentation thresholds were determined based on experimental results. The geometric attributes of the human torso were trained in the classification detection model, resulting in the extraction of six geometric attributes of the human torso. The classification model was then trained with various combinations to obtain the optimal feature combination [girth-depth-average curvature (G-D-k)] for human torso recognition in an orchard environment. Practical experiments were carried out to validate the feasibility and accuracy of the G-D-k feature combination. The experimental results demonstrate that the G-D-k feature combination can accurately recognize human bodies in orchards. The LiDAR-based detection method can achieve relatively accurate human detection and recognition in complex orchard environments, providing a reference for target detection in human-robot collaboration in orchards. Key words: human-robot collaboration; following robot; human torso recognition; LiDAR; support vector data descriptors DOI: 10.25165/j.ijabe.20251802.8346 Citation: Bao X L, Ma X J, Niu Y X, Yin Q L, Chen H, Wu Q. Laser-range-finder-based target detection for human-robot collaboration in hilly orchards. Int J Agric & Biol Eng, 2025; 18(2): 231–238.References
Yuan B, Chen C. Evolution of a development model for fruit industry against background of rising labor cost: Intensive or extensive adjustment? Sustainability, 2019; 11(14): 3864.
Mao W J, Liu H, Hao W, Yang F Z, Lin Z J. Development of a combined orchard harvesting robot navigation system. Remote Sensing, 2022; 14(3): 675.
Silwal A, Davidson J R, Karkee M, Mo C, Zhang Q, Lewis K. Design, integration, and field evaluation of a robotic apple harvester. Journal of Field Robotics, 2017; 34(6): 1140–1159.
Verbiest R, Ruysen K, Vanwalleghem T, Demeester E, Kellens K. Automation and robotics in the cultivation of pome fruit: Where do we stand today? Journal of Field Robotics, 2021; 38(4): 513–531. doi: 10.1002/rob.22000.
Tang Y C, Chen M Y, Wang CL, Luo, L F, Li J H, Lian G P, et al. Recognition and localization methods for vision-based fruit picking robots: A review. Frontiers in Plant Science, 2020; 11: 510.
Ding H, Yang X, Zheng N, Li M, Lai Y, Wu H. Tri-Co Robot: A Chinese robotic research initiative for enhanced robot interaction capabilities. National Science Review, 2018; 5(6): 799–801.
Wang G, Li W L, Jiang C, Zhu D H, Xie H, Liu X J. Simultaneous calibration of multicoordinates for a dual-robot system by solving the AXB=YCZ problem. IEEE Transactions on Robotics, 2021; 37(4): 1172–1185.
Lai Y N, Ye X, Ding H. Research progress of major research plan on Tri-Co robots. Journal of Mechanical Engineering, 2021; 57(23): 1–11, 20. (in Chinese)
Hirose N, Tajima R, Sukigara K. Personal robot assisting transportation to support active human life—Human-following method based on model predictive control for adjacency without collision. In: 2015 IEEE International Conference on Mechatronics (ICM), Nagoya: IEEE, 2015; pp.76–81. doi: 10.1109/ICMECH.2015.7083951.
Gupta M, Kumar S, Behera L, Subramanian V. A novel vision-based tracking algorithm for a human-following mobile robot. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2016; 47(7): 1415–1427.
Alves R, Linhares B, Souza J. Autonomous shopping cart: A new concept of service robot for assisting customers. In: 2018 Latin American Robotic Symposium, 2018 Brazilian Symposium on Robotic (SBR) and 2018 Workshop on Robotics in Education (WRE), João Pessoa: IEEE, 2018; pp.451–456. doi: 10.1109/LARS/SBR/WRE.2018.00086.
Su H, Zhang Y S, Li J S, Hu J. The shopping assistant robot design based on ROS and deep learning. In: 2016 2nd International Conference on Cloud Computing and Internet of Things. Dalian: IEEE, 2016; pp.173–176. doi: 10.1109/CCIOT.2016.7868328.
Gross H, Meyer S, Scheidig A, Eisenbach M, Mueller S, Trinh T, et al. Mobile robot companion for walking training of stroke patients in clinical post-stroke rehabilitation. In: 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore: IEEE, 2017; pp.1028–1035. doi: 10.1109/ICRA.2017.7989124.
Xiao H Z, Li Z J, Yang C G, Yuan W, Wang L Y. RGB-D sensor-based visual target detection and tracking for an intelligent wheelchair robot in indoors environments. International Journal of Control, Automation and Systems, 2015; 13: 521–529.
Sales J, Martí J, Marín R, Cervera E J, Sanz P. CompaRob: The shopping cart assistance robot. International Journal of Distributed Sensor Networks, 2016; 12(2): 4781280.
Guerrero-Higueras Á, Álvarez-Aparicio C, Calvo Olivera M, Rodríguez-Lera F, Fernández-Llamas C, Rico F, et al. Tracking people in a mobile robot from 2d lidar scans using full convolutional neural networks for security in cluttered environments. Frontiers in Neurorobotics, 2019; 12: 85.
Feng T, Yu Y, Wu L, Bai Y R, Xiao Z, Lu Z. A human-tracking robot using ultra wideband technology. IEEE Access, 2018; 6: 42541–42550.
Masuzawa H, Miura J, Oishi S. Development of a mobile robot for harvest support in greenhouse horticulture—Person following and mapping. In: 2017 IEEE/SICE International Symposium on System Integration. Taipei: IEEE, 2017; pp.541–546. doi: 10.1109/SII.2017.8279277.
Yorozu A, Ishigami G, Takahashi M. Human-following control in furrow for agricultural support robot. In: Intelligent Autonomous Systems 16: Proceedings of the 16th International Conference IAS-16, Cham: Springer, 2022; pp.155–164. doi: 10.1007/978-3-030-95892-3_12.
Polvara R, Del Duchetto F, Neumann G, Hanheide M. Navigate-and-seek: A robotics framework for people localization in agricultural environments. IEEE Robotics and Automation Letters, 2021; 6(4): 6577–6584.
Mao W J, Liu H, Wang X L, Yang F Z, Liu Z J, Wang Z Y. Design and experiment of dual navigation mode orchard transport robot. Transactions of the CSAM, 2022; 53(3): 27–39, 49. (in Chinese)
Taipalus T, Ahtiainen J. Human detection and tracking with knee-high mobile 2D LIDAR. In: 2011 IEEE International Conference on Robotics and Biomimetics, Karon Beach: IEEE, 2011; pp.1672–1677. doi: 10.1109/ROBIO.2011.6181529.
Chung W, Kim H, Yoo Y, Moon C, Park J. The detection and following of human legs through inductive approaches for a mobile robot with a single laser range finder. IEEE Transactions on Industrial Electronics, 2012; 59(8): 3156–3166.
Cha D, Chung W. Human-leg detection in 3D feature space for a person-following mobile robot using 2D LiDARs. International Journal of Precision Engineering and Manufacturing, 2020; 21: 1299–1307.
Zainudin Z, Kodagoda S, Dissanayake G. Torso detection and tracking using a 2d laser range finder. In: Proceedings of the 2010 Australasian Conference on Robotics and Automation, ACRA 2010, 2010. Available: https://opus.lib.uts.edu.au/bitstream/10453/16405/1/2010000410.pdf. Accessed on [2022-12-07].
Jung E, Lee J, Yi B, Park J, Yuta S, Noh S. Development of a laser-range-finder-based human tracking and control algorithm for a marathoner service robot. IEEE/ASME Transactions on Mechatronics, 2013; 19(6): 1963–1976.
Kim J, Jeong H, Lee D. Single 2D lidar based follow-me of mobile robot on hilly terrains. Journal of Mechanical Science and Technology, 2020; 34: 3845–3854.
Zheng Y J, Chen B T, Lyu H D, Kang F, Jiang S J. Research progress of orchard plant protection mechanization technology and equipment in China. Transactions of the CSAE, 2020; 36(20): 110–124. (in Chinese)
Hayat F, Li J, Iqbal S, Peng Y, Hong L M, Balal R, et al. A mini review of citrus rootstocks and their role in high-density orchards. Plants, 2022; 11(21): 2876.
Downloads
Published
How to Cite
Issue
Section
License
IJABE is an international peer reviewed open access journal, adopting Creative Commons Copyright Notices as follows.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
