Simulation software and virtual environments for acceleration of agricultural robotics: Features highlights and performance comparison

Redmond Ramin Shamshiri, Ibrahim A. Hameed, Lenka Pitonakova, Cornelia Weltzien, Siva K. Balasundram, Ian J. Yule, Tony E. Grift, Girish Chowdhary

Abstract


Research efforts for development of agricultural robots that can effectively perform tedious field tasks have grown significantly in the past decade. Agricultural robots are complex systems that require interdisciplinary collaborations between different research groups for effective task delivery in unstructured crops and plants environments. With the exception of milking robots, the extensive research works that have been carried out in the past two decades for adaptation of robotics in agriculture have not yielded a commercial product to date. To accelerate this pace, simulation approach and evaluation methods in virtual environments can provide an affordable and reliable framework for experimenting with different sensing and acting mechanisms in order to verify the performance functionality of the robot in dynamic scenarios. This paper reviews several professional simulators and custom-built virtual environments that have been used for agricultural robotic applications. The key features and performance efficiency of three selected simulators were also compared. A simulation case study was demonstrated to highlight some of the powerful functionalities of the Virtual Robot Experimentation Platform. Details of the objects and scenes were presented as the proof-of-concept for using a completely simulated robotic platform and sensing systems in a virtual citrus orchard. It was shown that the simulated workspace can provide a configurable and modular prototype robotic system that is capable of adapting to several field conditions and tasks through easy testing and debugging of control algorithms with zero damage risk to the real robot and to the actual equipment. This review suggests that an open-source software platform for agricultural robotics will significantly accelerate effective collaborations between different research groups for sharing existing workspaces, algorithms, and reusing the materials.
Keywords: agricultural robotics, precision agriculture, virtual orchards, digital agriculture, simulation software, multi-robots
DOI: 10.25165/j.ijabe.20181104.4032

Citation: Shamshiri R R, Hameed I A, Pitonakova L, Weltzien C, Balasundram S K, Yule I J, et al. Simulation software and virtual environments for acceleration of agricultural robotics: Features highlights and performance comparison. Int J Agric & Biol Eng, 2018; 11(4): 15–31.

Keywords


agricultural robotics, precision agriculture, virtual orchards, digital agriculture, simulation software, multi-robots

Full Text:

PDF

References


Shamshiri R R, Hameed I A, Karkee M, Weltzien C. Robotic harvesting of fruiting vegetables: A simulation approach in V-REP, ROS and MATLAB. Proceedings in Automation in Agriculture-Securing Food Supplies for Future Generations, 2018, InTech.

Quigley M, Conley K, Gerkey B, Faust J, Foote T, Leibs J, et al. ROS: an open-source Robot Operating System. In ICRA workshop on open source software, 2009; 3(2): 5.

Michel O. Cyberbotics Ltd. WebotsTM: professional mobile robot simulation. Int. J. Adv. Robot. Syst., 2004; 1(1): 5.

Koenig N P, Howard A. Design and use paradigms for Gazebo, an open-source multi-robot simulator. IROS, 2004; 4: 2149–2154.

Montemerlo M, Roy N, Thrun S. Perspectives on standardization in mobile robot programming: The Carnegie Mellon navigation (CARMEN) toolkit. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003), 2003; 3: 2436–2441.

Nesnas I A D, Wright A, Bajracharya M, Simmons R, Estlin T. CLARAty and challenges of developing interoperable robotic software. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003), 2003; 3: 2428–2435.

Pivtoraiko M, Nesnas I A, Nayar H D. A reusable software framework for rover motion control. International Symposium on Artificial Intelligence, Robotics and Automation in Space, Los Angeles, CA, 2008.

Cepeda J S, Chaimowicz L, Soto R. Exploring Microsoft Robotics Studio as a mechanism for service-oriented robotics. Robotics Symposium and Intelligent Robotic Meeting (LARS), Latin American, 2010; pp.7–12.

Makarenko A, Brooks A, Kaupp T. Orca: Components for robotics. International Conference on Intelligent Robots and Systems (IROS), 2006; pp.163–168.

Bruyninckx H. Open robot control software: the OROCOS project. Proceedings of IEEE International Conference on Robotics and Automation. (2001 ICRA), 2001; 3: 2523–2528.

Gerkey B P, Vaughan R T, Stoy K, Howard A, Sukhatme G S, Mataric M J. Most valuable player: A robot device server for distributed control. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, 2001; 3: 1226–1231.

Kuhnert K D. Software architecture of the autonomous mobile outdoor robot AMOR. IEEE International Conference on Intelligent Vehicles Symposium, 2008; pp.889–894.

Beck A B, Andersen N A, Andersen J C, Ravn O. MobotWare–A Plug-in Based Framework for Mobile Robots. IFAC Proc. 2010; 43(16): 127–132.

Jensen K, Larsen M, Nielsen S H, Larsen L B, Olsen K S, Jørgensen R N. Towards an open software platform for field robots in precision agriculture. Robotics, 2014; 3(2): 207–234.

Nebot P, Torres-Sospedra J, Martínez R J. A new HLA-based distributed control architecture for agricultural teams of robots in hybrid applications with real and simulated devices or environments. Sensors, 2011; 11(4): 4385–4400.

García-Pérez L, García-Alegre M C, Ribeiro A, Guinea D. An agent of behaviour architecture for unmanned control of a farming vehicle. Comput. Electron. Agric., 2008; 60(1): 39–48.

Blackmore S, Fountas S, Have H. Proposed system architecture to enable behavioral control of an autonomous tractor. Proceedings of the Conference on Automation Technology for Off-Road Equipment, 2002; p. 13.

Fountas S, Blackmore B. S, Vougioukas S, Tang L, Sørensen C G, Jørgensen R. Decomposition of agricultural tasks into robotic behaviours. Agric. Eng. Int. CIGR J., 2007.

Halavatyi A A, Nazarov P V, Medves S, Van Troys M, Ampe C, Yatskou M, et al. An integrative simulation model linking major biochemical reactions of actin-polymerization to structural properties of actin filaments. Biophys. Chem., 2009; 140(1–3): 24–34.

Mikhalevich S, Krinitsyn N, Manenti F, Kurochkin V, Baydali S. Developing of KUKA youBot software for education process. Chem. Eng. Trans., 2017; 57: 1573–1578.

Lemaignan S, Echeverria G, Karg M, Mainprice J, Kirsch A, Alami R, Human-robot interaction in the MORSE simulator. in Proceedings of the Seventh Annual ACM/IEEE International Conference on Human-Robot Interaction, 2012; pp.181–182.

Diankov R, Kuffner J. OpenRAVE: A planning architecture for autonomous robotics. Robot. Institute, Carnegie Mellon University Pittsburgh, PA, Tech. Rep. C., 2008; 79p.

Kanehiro F, Hirukawa H, Kajita S. OpenHRP: Open architecture humanoid robotics platform. Int. J. Rob. Res., 2004; 23(2): 155–165.

Rohmer E, Singh S P N, Freese M. V-REP: A versatile and scalable robot simulation framework. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2013; pp.1321–1326.

Carlo Pinciroli, Vito Trianni, Rehan O’Grady, Giovanni Pini, Arne Brutschy, Manuele Brambilla, Nithin Mathews, Eliseo Ferrante, Gianni Di Caro, Frederick Ducatelle, Mauro Birattari, Luca Maria Gambardella, Marco Dorigo. ARGoS: a Modular, Parallel, Multi-Engine Simulator for Multi-Robot Systems. Swarm Intelligence, 2012; 6(4): 271-295.

Bouchier P. Embedded ROS [ROS Topics]. IEEE Robot. Autom. Mag., 2013; 20(2): 17–19.

Barth R, Baur J, Buschmann T, Edan Y, Hellström T, Nguyen T, et al. Using ROS for agricultural robotics-design considerations and experiences. Proceedings of the Second International Conference on Robotics and Associated High-Technologies and Equipment for Agriculture and Forestry, 2014; pp.509–518.

Ackerman E. Latest version of gazebo simulator makes it easier than ever to not build a robot. IEEE Spectrum, 2016. https://spectrum.ieee.org/automaton/robotics/robotics-software/latest-version-of-gazebo-simulator

Grimstad L, From P J. Thorvald II - a Modular and Re-configurable Agricultural Robot. IFAC-PapersOnLine, 2017; 50(1): 4588–4593.

Biber P, Weiss U, Dorna M, Albert A. Navigation system of the autonomous agricultural robot Bonirob. in Workshop on Agricultural Robotics: Enabling Safe, Efficient, and Affordable Robots for Food Production (Collocated with IROS 2012), Vilamoura, Portugal, 2012.

Sharifi M, Young M S, Chen X, Clucas D, Pretty C. Mechatronic design and development of a non-holonomic omnidirectional mobile robot for automation of primary production. Cogent Eng., 2016; 3(1): 1250431.

Nguyen T T, Kayacan E, De Baedemaeker J, Saeys W. Task and motion planning for apple harvesting robot. IFAC Proc., 2013; 46(18): 247–252.

Habibie N, Nugraha A M, Anshori A Z, Ma’sum M A, Jatmiko W. Fruit mapping mobile robot on simulated agricultural area in Gazebo simulator using simultaneous localization and mapping (SLAM). International Symposium on Micro-NanoMechatronics and Human Science (MHS), 2017; pp.1–7.

Mehta S S, Burks T F. Vision-based control of robotic manipulator for citrus harvesting. Comput. Electron. Agric., 2014; 102: 146–158.

Shamshiri R, Wan Ismail W I. Nonlinear tracking control of a two link oil palm harvesting manipulator. Int J Agric & Biol Eng, 2012; 5(2): 9–19.

Han S, Burks T F. 3D reconstruction of a citrus canopy. 2009 Reno, Nevada, June 21- 24, 2009.

Whitbrook A. Programming Mobile Robots with Aria and Player: A Guide to C++ Object-oriented Control. Springer Science & Business Media, 2009.

Longo D, Muscato G. Design and Simulation of Two Robotic Systems for Automatic Artichoke Harvesting. Robotics, 2013; 2(4): 217–230.

Pitonakova, Lenka, Manuel Giuliani, Anthony Pipe, and Alan Winfield. 2018. “Feature and Performance Comparison of the V-REP, Gazebo and ARGoS Robot Simulators.” pp. 357–68 in Annual Conference Towards Autonomous Robotic Systems. Springer.

Shamshiri R, Ishak W, Ismail W. Design and Simulation of Control Systems for a Field Survey Mobile Robot Platform. Res. J. Appl. Sci. Eng. Technol., 2013; 6(13): 2307–2315.

Wang H, Zou X, Liu C, Lu J, Liu T. Study on behavior simulation for picking manipulator in virtual environment based on binocular stereo vision. 7th International Conference on System Simulation and Scientific Computing (ICSC 2008), 2008; pp.27–31.

Shamshiri R, Panchapakesan R, Ruslan R, Savary S K J U, Jadhav U. Autonomous Robotic Vehicle Design for ASABE Robotics Competition 2010, Team GATORS, University of Florida, 2009.




Copyright (c) 2018 International Journal of Agricultural and Biological Engineering



2023-2026 Copyright IJABE Editing and Publishing Office